Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner SURA...

Resources for Getting Started:

The Culinary Art of Grids

Mary Fran Yafchak, Mary Trauner

SURA Cyberinfrastructure Workshop:

Grid Application Planning & ImplementationDecember 8, 2005

The Grid Technology CookbookA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Outline• Why a cookbook on grids• Why a cookbook model works• Experiences, lessons learned• Overview of the cookbook• The writing team and sponsors• Timetable, next steps• Resources to get you started• How you (!) can join in

Confessions of a Grid MasterA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Why a cookbook on grids

•Using grids still requires understanding•We want to see more use of grids•Grid standards are still in infancy•Books exist but are often too general or very complex, sometimes expensive•We feel a lighter, friendlier, maintainable resource is needed•We want to collaborate across grid projects

Great Grids Made SimpleA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Why a cookbook model works

•Other cookbooks have been highly

successful•The flexibility of the resource provides for

delivery of more timely material•The layout and outline smooth under-

standing of scattered and diverse material•The approach promotes development for the

community, by the community

The Grid ConnoisseurA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Experiences, lessons learned•Development, revision - cycle & method•Two editors work best

•Recruitment and nurturing•Site work•First edits

•Quality control is key•One year revision cycle, “recovery” period•Funding for revisions is important

Humble Grid PieA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Cookbook Overview

The Grid Lover’s CompanionA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Who is the audience

• Beginners:•Users/researchers•Higher level administrators•Those just curious

• Programmers• New developers or Integrators• All of the above

The Joy of GridsA guide to building and using grid

resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

• Acknowledgements• Preface

•Why this guide•Intended readers•How to use

• Introduction•What is a grid•Heterogeneous versus homogenous grids•Research grids versus enterprise grids•Instruments, resources and services on a grid•How grids work•Security factors on a grid

Betty Crocker’s Guide to GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• What Grids Can Do for You

•Payoffs and tradeoffs

•Trends in computational and networked services

•The future of grids

• Case Studies

•Overview of 3-6 grid technologies with

discussion of applications using them

Five Star Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Technology for Grids•An overview of grid fabric

•Computing services

•Data services

• Instrumentation (and other unique services)

•Networks, switches, and interconnects for grids

•Grid domains (single and multiple)

•Middleware & service directories

•Authentication and authorization

•Account management and reporting

•Popular grid building projects/software/tool kits

The Culinary Art of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Standards & Emerging Technologies

•Standards initiatives

•Web services

•Portals

•Schedulers and metaschedulers

•Certificate and registry services

•Grid in a box?

•Enhanced resources: visualization engines,

specialized instruments, collaboratories

Calculated Cooking with GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Programming concepts and challenges

•Access to and scheduling of resources

•Security and security integration with existing

authn/z structures

•Job submission, management, and monitoring

•Data access, movement, and storage

•Workflow processing

•Network communication

•Usage/programming examples

The Grid GourmetA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Building your own grid

•Designing your grid

•Grid system administrator, manpower

requirements

•Software repositories, distribution services

• Installation and configuration, deployment

•Management and monitoring

•Security notes (certificates, firewall issues,

patching, etc.)

Grids Throughout the WorldA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Example grid: installation procedure(s)

•Simple basic grid example, and/or

•Grid specific material

• Example grid: usage example(s)

•For simple example grid, &/or

•For specific grid solution

The Science of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Practical Tips, FAQ, other

•How long does it take to build a grid?

•Grids and AFS

•Grids across multiple OS platforms (aka. Image

consistency)

•War stories

•more

Foolproof Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

• Glossary (or links to glossaries)• Appendices

•Related links•Resources•Organizations•Grid solutions and research projects•Grid software distributions•National and regional facilities•Alliances and application communities

•Grid bulletin boards and mailing lists•Benchmarks and performance•Bibliography

The Best of Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curious

ProgrammersNew developers or IntegratorsAll of the above

The Writing TeamAmy Apon

University of ArkansasVictor Bolet

Georgia State UniversityNeil Bright

Georgia Institute of TechnologyVikram Gazula

University of KentuckyJames Patton Jones

JRAC, Inc.Harmut Kaiser

Louisiana State University and CCTScott Koranda

Univa CorporationRavi Madduri

Argonne National LaboratoryWarren Matthews

Georgia Institute of TechnologyJohn McGee

Renaissance Computing InstituteShawn McKee

University of MichiganRob Quick

Indiana UniversityLavanya Ramakrishnan

Renaissance Computing InstituteJohn-Paul Robinson

University of Alabama at BirminghamJorge Rodriguez

University of Florida and OSGJudith Utley

Old Dominion UniversityArt Vandenberg

Georgia State UniversityBarry Wilkinson

University of North Carolina at Chapel HillMatthew Wolf

Georgia Institute of TechnologyKatie Yurkewicz

Fermilab and OSG

Adventures in Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Timetable, next steps

•Outline Development, Vetting September-October

•Assemble Writing Teams October-December

•Develop Web Structure November-December

•Writing Process Underway November-March

•Material Edited and Entered December-April

•Review of First Draft May

•Edits to First Draft Entered Early June

•Review of Final Draft Late June

•Release of Version 1 July 2006

The South Beach of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Resources to get started (just a few!)

•Grid Café - http://gridcafe.web.cern.ch/gridcafe/

•The Grid: Defining the Future of the Net - Gentzsch, in

International Lab Mate, Feb 05, http://www.internationallabmate.com/

•NMI Case Study Series - http://www1.sura.org/3000/NMI-Testbed.html#NMI

•GT4 Documentation - Quick Start Guide -http://www.globus.org/toolkit/docs/4.0/admin/docbook/quickstart.html

•IBM Redbooks: Grid Computing with the IBM Grid Toolbox - http://www.redbooks.ibm.com/abstracts/sg246332.html?Open

If you have pointers to share, please send to: mary.trauner@bellsouth.net, maryfran@sura.org

The Grid Builder’s ApprenticeA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

How you (!) can join in

•Check out the outline

http://www.hpc.gatech.edu/gtcb/outline

•Pick a section, send us a brief abstract

•Volunteer to be a reviewer

•Contact us

Mary Trauner

marytrauner@bellsouth.net

Mary Fran Yafchak

maryfran@sura.org

Zen and the Art of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices