Outline

Grid Computing, B. Wilkinson, 2004 outline.1

Grid Computing

Fall 2004Tuesday/Thursday 2:00 pm - 3:15 pm

Instructors

Dr. Barry WilkinsonWestern Carolina University

andDr. Clayton Ferner

University of North Carolina at Wilmington


Outline


Grid Computing

• Using usually geographically distributed and interconnected computers together for high performance computing and/or for resource sharing.

Notice “usually”, “and/or” - many definitions of grid computing and applications.


The interconnection - now “usually” made through the Internet to multiple administrative domains.

Resource sharing - can involve a geographically distributed team (virtual organization) and resources in addition to computers (software, experimental equipment etc.)


“The grid virtualizes heterogeneous geographically disperse resources”

From "Introduction to Grid Computing with Globus," IBM Redbooks


Course creditThis course can be taken by students at any university connected to the NCREN for credit at their institution.

Listed as an undergraduate course but could be taken for graduate credit with my approval (and your institution).

Graduate students can expect more demanding work.


Class schedule

Each university has its own class schedule.

Classes will start on August 26th, 2004 (WCU's start date).

Last class presentation will be on Thursday December 2nd, 2004.

No class on Thursday October 14th, 2004 (WCU Fall break).

It will be necessary for students at sites with breaks that do not coincide with WCU's breaks to watch recordings of classes later.

Final exams will be scheduled according to the local schedule.


Prerequisites

• Preferably programming skills in Java on a Linux system.

• Some later work may also involve C/C++ programming.


Topics

• Introduction to grid computing• Web services• Grid services• Security, Public Key Infrastructure • Open Grid Services Architecture (OGSA)• Globus 3.2• Condor-G• MPI and grid enabled MPI• UNC-W GUI and grid computing applications


Assignments and Grading• 6 “simple” pre-written programming

assignments (tasks)– web services– grid services– Globus job– Condor job– MPI-G2 job– Using UNC-W GUI

• Additional programming assignment/project

• Class tests (2)• Final test• Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder.

45%

15%

25%15%


“Simple” Prewritten Programming Assignments

• Detailed instructions provided on achieving a task (creating a web service, grid service, etc.,)

• Simply follow instructions.• At end, asked to extend the work - e.g. add

functionality to a service.

These assignments require specific distributed computing software available either locally, or through remote access to WCU.


Weeks 1 - 3 (tentative)Grid computing Virtual organizations, computational grid

projects, grid computing networks, TeraGrid, grid projects in the US and around the world, grid challenges

Internet Technologies IP addresses, HTTP, URL, HTTP, XML, Telnet,

FTP, SSL Web Services I. Service-Oriented Architecture (SOA), service

registry, XML documents, XML schema, namespaces, SOAP, XML/SOAP examples, Axis

Web Services II. WSDL, portType, message definition, WSDL

to/from code Assignment 1 "Simple" Web service Java programming

assignment. Tomcat environment, axis, JWS facility


Weeks 3 - 4 (tentative)

Grid Service Concepts, differences to Web services, stateful/stateless/transient/non-transient, Open Grid Services Architecture (OGSA), OGSI, grid service factory, Web Services Resource Framework (WSRF)

Assignment 2 "Simple" grid service Java programming assignment. Globus 3.2 environment.Tools: ant


Weeks 4 - 6 (tentative)Security Secure connection, authorization

requirements, symmetric and asymmetric (public/private) key cryptography, non-repudiation, digital signatures, certificates, certificate authorities, X509 certificate

Globus: Part 1 Basic structure (version 3.2), grid service

container, service browser, Globus Resource Allocation Manager (GRAM), job submission with managed-job-globusrun, Grid Security Infrastructure (GSI), Globus certificates, simpleCA, proxies, creating a proxy

Globus: Part II Resource management, Master Managed Job Factory Service (MMJFS), more on managed-job-globusrun. Resource Specification Language (RSL and RSL-2), syntax and examples in RSL and RSl-2

Assignment 3 Submitting a Job to the Grid, GT3 mangaged-job-globusrun, job specified in RSL-2 (XML file)



Globus: Part III Information Directory Services, LDAP,

resource discovery

Schedulers and Condor, submit description file, resource brokers DAGMan, Checkpointing, ClassAd, Condor-

G, other systems

Assignment 4 Submitting a Condor-G Job


Weeks 7 - 8 (tentative)High performance Grand challenge problems, parallel computing (HPF) computing, potential speed-up, types of

parallel computers, shared memory multiprocessors, programming, message-passing multicomputers

Parallel Programming Techniques suitable for a Grid, embarrassingly parallel computations, Monte Carlo, parameter studies, sample "big" problems, gravitational N-body problem

Cluster Computing Basic message passing techniques, History, Beowulf clusters, system software, programming models (MPMD, SPMD), synchronous message passing, asynchronous message passing, message tags, collective routines



MPI Process creation, communicators, unsafe

message passing, point-to-point message-passing, blocking, non-blocking, communication modes, collective communication, running an MPI program on a cluster

Grid-enabled MPI MPI-G2 internals, mpirun command, RSL script

Assignment 5 Running a simple MPI-G2 program


Weeks 10 to 15

Grid portals

UNC-W GUI, Assignment 6

UNC-W applications Scientific, business

Guest Speaker


Instructor details

Barry Wilkinson

Department of Mathematics and Computer ScienceWestern Carolina University

Home page: http://www.cs.wcu.edu/~abwEmail: [email protected]

Tele: (828) 227 3944

Office Hours

Tuesday/Thursday 11:00 am - 12:00 pm, 3:30 pm - 5:00 pm


Course Home Page

http://www.cs.wcu.edu/~abw/CS493F04

for announcements, slides, assignments, reading materials, tests dates, etc.

Visit regularly.






Course Text

• There is no assigned course textbook

• Materials and links are provided on the home page.


Class Expectations

• Understand Queen’s English (the language of instruction). Verbal skills not necessary.

• Print out slides before class, read them, and annotate them during class.

• Read key papers and other materials provided.• Ask questions during class and participate in class

discussion.


Acknowledgements

This course is a team effort of:

Mountain Area Grid Innovation Collaborative

(MAGIC)Faculty: Barry Wilkinson, Mark Holliday, David Luginbuhl

Students (Wizards): Sam Daoud, Jeffrey House, Chris Johnson

http://www.cs.wcu.edu/~abw/MAGIC

and:

University of North Carolina at Wilmington



Acknowledgements

Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grant 0410667and byUniversity of North Carolina, Office of the President.

MAGIC gratefully acknowledges their support.

Documents

Outline