2. McKean CEO & Editorial Director InfoWorld Media Group
Kevin 3. 4.
Gold Sponsors 5. 6. Foster Professor, Computer Science
University of Chicago Assoc. Director, Mathematics & Computer
Science Division Argonne National Laboratory Ian 7. The Grid inYour
Future 8. Three Questions
- Where is it today, and where is it going?
9. The Grid Is
- A collaboration & resource sharing infrastructure for
scientific applications
- A distributed service integration and management
technology
- A disruptive technology that enables a virtualized,
collaborative, distributed world
- An open source technology & community
10. Grid Past, Present, Future
-
- Origins and broad adoption in eScience, fueled by open source
Globus Toolkit
-
- Rapidly growing commercial adoption
-
- Open Grid Services Architecture (OGSA)
-
- Key enabler of new applications & industries based on
resource virtualization and distributed service integration
11. Why You Should Care
- 1) Grids address pain points now, e.g.
-
- Cost of provisioning for peak demand
-
- Data federation and integration
- 2) Grids are a disruptive technology
-
- Usher in (or solve problems of) a virtualized, collaborative,
distributed world
-
- Potentially significant competitive advantages
- 3) An open Grid is to your advantage
-
- Insist that your suppliers embrace OGSA, refuse proprietary
solutions!
12. Overview
- The power grid analogy & its limitations
- Grid past: From eScience to eBusiness
- Grid future: virtualization & ubiquitization
13. The Power Grid Time Quality, economies of scale 14. By
Analogy, A Computing Grid
- Decouple production and consumption
-
- Achieve economies of scale
-
- Enhance consumer flexibility
15. Not Exactly a New Idea
- The time-sharing computer system can unite a group of
investigators . one can conceive of such a facility as an
intellectual public utility.
-
- ~ Fernando Corbato and Robert Fano, 1966
- We will perhaps see the spread of computer utilities, which,
like present electric and telephone utilities, will service
individual homes and offices across the country.
16. But, Things are Different Now
- Networks are far faster (and cheaper)
-
- Faster than computer backplanes
- Computing is very different than pre-Net
-
- Our computers have already disintegrated
-
- E-commerce increases size of demand peaks
-
- Entirely new applications & social structures
- Weve learned a few things about software
17. But Wait A Minute Computing isnt Really Like
Electricity!
- I import electricity but must export data
- Computing is not interchangeable but highly heterogeneous
-
- Computers, data, sensors, services,
- Ok, so the story is more complicated
- But more significantly, the sum can be greater than the
parts
-
- Real opportunity: Construct new capabilities dynamically from
distributed services
-
- Virtualization & distributed service mgmt
18. Virtualization & Distributed Service Management Less
capable, integrated Less connected User service locus Larger, more
integrated More connected Dynamically provisionedDevice Continuum
Resource & service aggregation Delivery of virtualized services
with QoS guarantees Dynamic, secure service discovery &
composition Distributed service management 19. The Fundamental
Questions
- Can I build effective virtualized services?
- Can I achieve QoS across services?
- Can I achieve economies of scale?
- Can I identify applications that yield real competitive
advantage?
20. Overview
- The power grid analogy & its limitations
- Grid past: From eScience to eBusiness
- Grid future: virtualization & ubiquitization
21. Origins: Revolution in Science
-
- Theorize &/or experiment, alone or in small teams; publish
paper
-
- Construct and mine large databases ofobservational or
simulation data
-
- Develop simulations & analyses
-
- Access specialized devices remotely
-
- Exchange information withindistributed multidisciplinary
teams
22. Science Grids Tier0/1 facility Tier2 facility 10 Gbps link
2.5 Gbps link 622 Mbps link Other link Tier3 facility Cambridge
Newcastle Edinburgh Oxford Glasgow Manchester Cardiff Soton London
Belfast DL RAL Hinxton 23. 24. NSF TeraGrid
- NCSA, SDSC, Argonne, Caltech
-
- Accessible to thousands of scientists working on advanced
research
25. Data Grids for Physics
- Enable international community of 1000s to access & analyze
petabytes of data
- Harness computing & storage worldwide
- Virtual data concepts: manage programs,data, workflow
- Distributed systemmanagement
26. NEESgrid Earthquake Engineering Collaboratory U.Nevada Reno
www.neesgrid.org 27. NASA: Aviation Safety
- Reverse Thrust performance
Crew Capabilities - accuracy - perception - stamina - re-action
times - SOPs Engine Models Airframe Models Wing Models Landing Gear
Models Stabilizer Models Human Models 28. Access Grid
Collaboration
- Enable collaborative work at dozens of sites worldwide,with
strong sense of shared presence
- Combination of commodity audio/video tech + Grid technologies
for security, discovery, etc.
- 150+ sites worldwide,number rising rapidly
Ambient mic (tabletop) Presenter mic Presenter camera Audience
camera 29. The Need for New Technology
- Resource sharing & coordinated problem solving in dynamic,
multi-institutional virtual organizations
30. The Grid/eScience World: Status
- Dozens of major Grid projects in scientific & technical
computing/research & education
-
- Deployment, application, technology
-
- www.mcs.anl.gov/~foster/grid-projects
- Globus Toolkit broadly adopted as de facto standard for major
protocols & services
- Global Grid Forum a significant force for community building
and standardization
-
- GGF8: Tokyo, March 2003, 850 people
-
- www.gridforum.org; 200+ organizations; Boeing, Merck, Ford,
J&J, IBM, Platform,
31. Revolution in Business
-
- Central data processing facility
-
- Enterprise computing is highly distributed, heterogeneous,
inter-enterprise (B2B)
-
- Business processes increasinglycomputing- & data-rich
-
- Outsourcing becomes feasible =>service providers of various
sorts
32. The New Enterprise Computing Environment 33.
eScience/eBusiness Vision
- Link dynamically acquired resources
-
- From collaborators, customers, eUtilities, (members of evolving
virtual organization)
- Into a virtual computing system
-
- Dynamic, multi-faceted system spanning institutions and
industries
-
- Configured to meet instantaneous needs, for:
- Multi-faceted QoS for demanding workloads
-
- Security, performance, reliability,
34. Overview
- The power grid analogy & its limitations
- Grid past: From eScience to eBusiness
- Grid future: virtualization & ubiquitization
35. Grids and Open Standards Increased functionality,
standardization Time Custom solutions App-specific Services Open
Grid Services Arch GGF: OGSI, (+ OASIS, W3C) Multiple
implementations, including Globus Toolkit Web services Globus
Toolkit Defacto standards GGF: GridFTP, GSI X.509, LDAP, FTP, 36.
Open Grid Services Architecture
- Service-oriented architecture
-
- Key to virtualization, discovery, composition, local-remote
transparency
- Leverage industry standards
- Distributed service management
-
- A component model for Web services
- A framework for the definition of composable, interoperable
services
The Physiology of the Grid: An Open Grid Services Architecture
for Distributed Systems Integration, Foster, Kesselman, Nick,
Tuecke, 2002 37. Transient Service Instances
- Web services address discovery & invocation ofpersistent
services
-
- Interface to persistent state of entire enterprise
- In Grids, must also supporttransient service instances ,
created/destroyed dynamically
-
- Interfaces to the states of distributed activities
-
- E.g. workflow, video conf., dist. data analysis
- Significant implications for how services are managed, named,
discovered, and used
-
- In fact, much of Grid is concerned with the management of
service instances
38. OGSA Structure
- A standard substrate: the Grid service
-
- Standard interfaces and behaviors that address key distributed
system issues
-
- A refactoring and extension of the Globus Toolkit protocol
suite
- supports standard service specifications
-
- Resource management, databases, workflow, security,
diagnostics, etc., etc.
-
- Target of current & planned GGF efforts
- and arbitrary application-specific services based on these
& other definitions
39. Open Grid Services Infrastructure Implementation Hosting
environment/runtime (C, J2EE, .NET, ) Data access
Service data element Other standard interfaces: factory,
notification, collections Service data element Service data element
GridService (required)
Client Grid Service Handle Grid Service Reference handle
resolution 40. Open Grid Services Infrastructure GWD-R
(draft-ggf-ogsi- gridservice-23)Editors: Open Grid Services
Infrastructure (OGSI)S. Tuecke, ANL http://www.ggf.org/ogsi-wgK.
Czajkowski, USC/ISI I. Foster, ANL J. Frey, IBM S. Graham, IBM C.
Kesselman, USC/ISI D. Snelling, Fujitsu Labs P. Vanderbilt, NASA
February 17, 2003 Open Grid Services Infrastructure (OGSI) 41. The
OGSA Platform OGSI GWD-R (draft-ggf-ogsa-platform-3) Editors: Open
Grid Services Architecture Platform I. Foster, Argonne &
U.Chicago http://www.ggf.org/ogsa-wgD. Gannon, Indiana U. Transport
Protocol Hosting Environment Hosting Environment Host. Env.&
Protocol Bindings OGSA Platform services: registry, authorization,
monitoring, data access, etc., etc.More specialized&
domain-specific services Models for resources & other entities
Other models Environment- specific profiles Domain- specific
profiles OGSA Platform 42. OGSA: Next Steps
-
- Open Grid Services Infrastructure is complete
-
- Security, data access, Java binding, common resource models,
etc., etc., in the pipeline
- Implementations and compliant products
-
- Here: OGSA-based Globus Toolkit v3,
-
- Announced: IBM, Avaki, Platform, Sun, NEC, HP, Oracle, UD,
Entropia, Insors, ,
- Rich set of service defns & implementations
43. Globus Toolkit v3 (GT3)
- Implement core OGSI interfaces
- Support primary GT2 interfaces
-
- High degree of backward compatibility
- Multiple platforms & hosting environments
-
- J2EE, Java, C, .NET, Python
-
- SLA negotiation (GRAM-2), registry, replica location, community
authorization, data,
- Growing external contributions & adoption
44. Globus Toolkit History NASA initiates Information Power Grid
Globus Project wins Global Information Infrastructure Award MPICH-G
released The Grid: Blueprint for a New Computing
Infrastructurepublished GT 1.0.0 Released Early Application
Successes Reported GT 1.1.1 Released GT 1.1.2 Released GT 1.1.3
Released NSF & European Commission Initiate Many New Grid
Projects GT 1.1.4 and MPICH-G2 Released Anatomy of the Grid Paper
Released First EuroGlobus Conference Held in Lecce Significant
Commercial Interest in Grids NSF GRIDS Center Initiated GT 2.0 beta
Released Physiology of the Grid Paper Released GT 2.0 Released GT
2.2 Released Only Globus.Org; not downloads from: NMI UK eScience
EU DataGrid IBM Platform etc. DARPA, NSF begin funding Grid work
45. Overview
- The power grid analogy & its limitations
- Grid past: From eScience to eBusiness
- Grid future: virtualization & ubiquitization
46. Virtualization & Ubiquitization 47. Converging on
Standards-Based Grids Complexity of Workload
DepartmentEnterpriseCollaborationInternet OGSA-based Grids
Industrial Grid Deployments Scientific Grid Deployments 48. What I
Expect from OGSA
- True open source/industry partnership
-
- Globus Toolkit 3.0 provides common Grid middleware
framework
-
- Industry adds value in services & platforms
- New applications (and industries?)
-
- Grid middleware will create virtual services, servers, and
storage from pools of services, servers, clients & storage
dispersed throughout the Internet
-
- Grid computing utilities will emerge and become like power
utilities
49. Platform Symphony Servers: Execution Application Services:
Distribution Applications: Delivery 50. Platform Symphony Servers:
Execution Application Services: Distribution Applications: Delivery
Application Virtualization
- Automatically connect applications to services
51. Platform Symphony Servers: Execution Application Services:
Distribution Applications: Delivery Application Virtualization
- Automatically connect applications to services
Infrastructure Virtualization
52. A Cross-Institutional GridNY Financial Institution Insurance
Group UK Financial Institution NYFinancial Institution Capital
Markets Group 53. Overview
- The power grid analogy & its limitations
- Grid past: From eScience to eBusiness
- Grid future: virtualization & ubiquitization
54. Recap: The Grid Is
- A collaboration & resource sharing infrastructure for
scientific applications
- A distributed service integration and management
technology
- A disruptive technology that enables a virtualized,
collaborative, distributed world
- An open source technology & community
55. Grid Past, Present, Future
-
- Origins and broad adoption in eScience, fueled by open source
Globus Toolkit
-
- Rapidly growing commercial adoption
-
- Open Grid Services Architecture (OGSA)
-
- Key enabler of new applications & industries based on
resource virtualization and distributed service integration
56. Why You Should Care
- 1) Grids address pain points now, e.g.
-
- Cost of provisioning for peak demand
-
- Data federation and integration
- 2) Grids are a disruptive technology
-
- Usher in (or solve problems of) a virtualized, collaborative,
distributed world
-
- Potentially significant competitive advantages
- 3) An open Grid is to your advantage
-
- Insist that your suppliers embrace OGSA, refuse proprietary
solutions!
57. Summary
- Grids : Enabling resource sharing & coordinated problem
solving in dynamic, multi-institutional virtual organizations
- Major relevance not to eScience but also eBusiness, as an
enabler ofcomputing on demand ,eUtilities ,B2B communities ,
- Open Grid Services Architecturedefines standards for
distributed system integration
- Globus Toolkitas open source, open architecture solution to key
Grid problems
58. For More Information
59. 60. 61.