1
GriPhyN – Towards Petascale Virtual Data Grids Paul Avery, University of Florida Ian Foster, University of Chicago NSF Grant ITR-0086044 www.griphyn.org Research Objectives Provide tools to manage, discover, & apply peta-scale data and software resources Enable Grids to be used by scientists as simply as personal workstations Approach A uniform virtual data model (VDL) to express datasets and workflow. Advanced planners, executors, monitors, predictors, and fault recovery to make the Grid “like a workstation” Intensive Experiment/CS collaboration Partnership with iVDGL and PPDG to deploy international Grid: www.ivdgl.org/grid2003 Broader Impact Unified language to express data transformation benefits all sciences Lowered barrier to computation; increased collaboration and communication Benefits to education – enhance discovery and learning of scientific processes Participants Argonne, Boston U, Brookhaven, Caltech, Fermilab, Hampton, Johns Hopkins, Harvard, Salish Kootenai, Texas A&M, UC Berkeley, UC San Diego, U Chicago, U Florida, USC/ISI, U Texas, U Wisconsin Significant Results Virtual Data Language, Virtual Data Toolkit (VDT) VDT tools applied by multiple sciences (ATLAS, CMS, LIGO, SDSS, Bioinformatics, others ) Collaboration with other NSF & DOE supported projects to build international Grid Grid2003 Outreach impact: Virtual data for QuarkNet, Summer Grid Workshop 2004-05 Intensive student involvement – 25 graduate, 2 undergraduate; 4 CS PhDs as of 07/2005 discovery Science R eview Production M anager R esearcher discovery sharing U sers V irtual D ata com position planning Planning Execution V irtualD ata Toolkit C him era virtualdata system Pegasus planner DAGm an G lobus Toolkit Condor G anglia, etc. M onitoring and Prediction Production A nalysis param s exec. data discovery Science R eview Production M anager R esearcher discovery sharing U sers V irtual D ata O pen S cience G rid, TeraG rid com position Planning Execution V irtualD ata Toolkit VDS virtualdata system Pegasus planner DAGm an G lobus Toolkit Condor G anglia, etc. M onitoring and Prediction Production A nalysis param s exec. data Production A nalysis param s exec. data

Research Objectives

  • Upload
    zelia

  • View
    19

  • Download
    0

Embed Size (px)

DESCRIPTION

GriPhyN – Towards Petascale Virtual Data Grids Paul Avery, University of Florida Ian Foster, University of Chicago NSF Grant ITR-0086044 www.griphyn.org. Research Objectives Provide tools to manage, discover, & apply peta-scale data and software resources - PowerPoint PPT Presentation

Citation preview

Page 1: Research Objectives

GriPhyN – Towards Petascale Virtual Data GridsPaul Avery, University of Florida Ian Foster, University of ChicagoNSF Grant ITR-0086044 www.griphyn.org

Research Objectives Provide tools to manage, discover, & apply peta-scale

data and software resources Enable Grids to be used by scientists as simply as

personal workstationsApproach A uniform virtual data model (VDL) to express

datasets and workflow. Advanced planners, executors, monitors, predictors, and fault recovery to make the Grid “like a workstation”

Intensive Experiment/CS collaboration Partnership with iVDGL and PPDG to deploy

international Grid: www.ivdgl.org/grid2003

Broader Impact Unified language to express data

transformation benefits all sciences Lowered barrier to computation; increased

collaboration and communication Benefits to education – enhance discovery and

learning of scientific processes

Participants Argonne, Boston U, Brookhaven, Caltech, Fermilab,

Hampton, Johns Hopkins, Harvard, Salish Kootenai, Texas A&M, UC Berkeley, UC San Diego,U Chicago, U Florida, USC/ISI, U Texas, U Wisconsin

Significant Results Virtual Data Language, Virtual Data Toolkit (VDT) VDT tools applied by multiple sciences (ATLAS, CMS, LIGO, SDSS,

Bioinformatics, others ) Collaboration with other NSF & DOE supported projects to build

international Grid Grid2003 Outreach impact: Virtual data for QuarkNet,

Summer Grid Workshop 2004-05 Intensive student involvement – 25 graduate, 2 undergraduate; 4 CS

PhDs as of 07/2005

discovery

ScienceReview

ProductionManager

Researcherdiscovery

sharing

Users

VirtualData

composition

planning

Planning

Execution

Virtual DataToolkit

Chimera virtual data

system

Pegasus planner

DAGman

Globus ToolkitCondor

Ganglia, etc.

Monitoring and Prediction

Production Analysisparams

exec.

data

discovery

ScienceReview

ProductionManager

Researcherdiscovery

sharing

Users

VirtualData

Open Science Grid,TeraGrid

composition

Planning

Execution

Virtual DataToolkit

VDSvirtual data

system

Pegasus planner

DAGman

Globus ToolkitCondor

Ganglia, etc.

Monitoring and Prediction

Production Analysisparams

exec.

data

Production Analysisparams

exec.

data