1PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Grid Developments, the Oxford e-Science Centre and ITSS
Paul JeffreysDirector OUCS
Director Oxford e-Science Centre
http://e-science.ox.ac.uk/
2PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Talk Outline
⢠Summary of developments over last yearâ (Re-)Introduction to e-Science and the Gridâ SR2000 e-Science allocationâ OeSC
⢠Funds⢠Achievements⢠Team and Management⢠Access Grid
â Race through Oxford projectsâ SR2002 âe-Scienceâ priorities
⢠What does it mean for IT SS and OU?â What will be needed?
3PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Whatâs in a name?!
⢠âOxford e-Science Centreâ vs âOxford Regional Grid Centreâ⢠However:
â IBM Press Release quote (Aug. 2001): ⢠âThe driving force behind the evolutionary Grid Project is the
global scientific communityââ e-Science funding!
⢠But in Oxford, much more than e-Scienceâ âŚand clear change of emphasis in SR2002
4PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
e-Science
⢠John Taylor, Director General of the Research Councils, OST
â âe-Science means science increasingly done through distributed global collaborations enabled by the Internet, using very large data collections, terascale computing resources and high performance visualisationâ
â "e-Science will change the dynamic of the way science is undertaken"
5PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
What is the Grid?
⢠âThe Grid is a software infrastructure that enables flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions and resources.â [The Grid, eds. Foster & Kesselman]
⢠âThe Grid is an emergent infrastructure capable of delivering dependable, pervasive and uniform access to a set of globally distributed, dynamic and heterogeneous resources. It brings challenges of scalability, interoperability, fault tolerance, resource management and security.â [UK e-Science Director]
6PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Digital Mammography
⢠Example to fire the imagination (Brady et al.)!â 1.5 million screenings, 20% films lost, 80% false positive rateâ 40% increase; radiographer rather than radiologistâ -> need to develop standardised mammograms in federated
databaseâ Enables âfindonelikeitâ with clinical historyâ Principle generic
7PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
SR2000 e-Science
⢠http://www.research-councils.ac.uk/escience/â âResearch Councils invest ÂŁ98M for e-Scienceâ
⢠http://www.dti.gov.uk/ost/link/news/issue10_3.htm ForesightLINK, Issue No 10 Summer 2001â âThe new ÂŁ80m LINK programme for e-Science Grid
Technologies will spearhead the UK contribution to developing the next generation internet, supporting scientific research and e-business development in partnership with UK firmsâ
âIf UK industry wants a place in the world of business [Grid] applications, it has to get involved now - at the academic research stageâ
8PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
ÂŁ80m Collaborative projects
E-ScienceSteering
Committee
DG Research Councils
Director Directorâs
Management RoleDirectorâs
Awareness and Co-ordination Role
Generic Challenges EPSRC (ÂŁ15m), DTI (ÂŁ15m)
Industrial Collaboration (ÂŁ40m)
Academic Application SupportProgramme
Research Councils (ÂŁ74m), DTI (ÂŁ5m)
PPARC (ÂŁ26m) BBSRC (ÂŁ8m) MRC (ÂŁ8m) NERC (ÂŁ7m) ESRC (ÂŁ3m) EPSRC (ÂŁ17m) CLRC (ÂŁ5m)
Grid TAG
SR2000 e-Science Allocation
9PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Indicative Core Funding Breakdown
1. Grid Centres ÂŁ7.0M + ÂŁ11.5M + ÂŁ11.0M2. Grid Middleware ÂŁ2.5M ÂŁ2.5M + ÂŁ2.5M3. Grid IRC Projects ÂŁ3.0M ÂŁ1.0M + ÂŁ4.0M4. Grid Support ÂŁ2.0M5. International ÂŁ1.0M6. GNT ÂŁ1.5M ÂŁ1.5M ÂŁ1.5M7. Demonstrators ÂŁ0.5M8. Pilots ÂŁ1.0M ÂŁ8.0M
______ ______ ______ ÂŁ15M + ÂŁ20M + ÂŁ27M
OST DTI Industry
10PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
UK Grid Network
Cambridge
Newcastle
Edinburgh
Oxford
Glasgow
Manchester
Cardiff
Soton
London
Belfast
DL
RAL Hinxton
ÂŁ470k to âpass goâÂŁ1M pot â matched by industry
Oxford University Investment:-Associate Directors (RDF ÂŁ85k), plus 3 posts phased (RDF ÂŁ218k), plus some subsidised effort
Oxford has receivedÂŁ8M and rising!
11PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
OeSC âObjectivesâ
⢠Establish Oxford as regional centre on national Gridâ Thereby establish Grid connections for our researchersâ Make our resources available on the Grid (part of the deal!)â Aim .. to become âCentre of Excellenceâ -- NB SR2002
⢠Support groups throughout University undertaking national and international e-Science projects (and other Grid activities), collaborate with Oxford Brookes, and link with companiesâ Provide physical infrastructureâ Provide support infrastructure:- registration, certificate
authorisation, training, documentation, security, servicesâ Share development, coordinate and optimise across projectsâ Disseminate
⢠Commission âintranet Gridââ Share resources across university
12PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Status of Oxford e-Science Centre
⢠Formally launched 17 August â Associate Directors: David Gavaghan, Mike Giles, Mark Sansom, Jim
Daviesâ Web site ⌠http://e-science.ox.ac.ukâ Administrative Centre and Point-of-Contact (OUCS)
[email protected]â Strong connections with Business Liaison Unit (from the outset)â Connections established with OII and SBSâ Technical Development:
⢠Access Grid installed in ComLab - and shortly in hospital-area⢠âGate-keeperâ in OUCS running GLOBUS⢠8 cpu Linux cluster running Condor scheduling
â Management Structure establishedâ Building close relationship with RAL (A34 Corridor)â OUCS team built within Research Technologies Section, in Information
and Support Groupâ Oxford University is online!
13PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
OeSC Management
⢠Substantial/important activity; needs appropriate structureâ Management Board
⢠Overall âresponsibilityâ for delivery and operation of functional e-Science Centre, resources invested, accountability, outside relations and integration, and overseeing all e-Science and Grid activities in OU
â Technical/Development Board⢠High level management of e-Science/Grid activities,
internal resources invested on OeSC, coordination â Technical Committee
⢠Detailed internal technical management and organisationâ User Committee
⢠Forum for Users working on e-Science and Grid projects, and for dissemination across the University
14PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Access Gridâ˘Collection of resources that support formal and informal group-to-group interaction across the gridâ˘Supports large-scale distributed meetings and collaborative work sessions
15PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Ambient mic(tabletop)
Presentermic
Presentercamera
Audience camera
Access Grid Technology
⢠Access Grid Collaboration â Enable collaborative work at
dozens of sites worldwide, with strong sense of shared presence
â Combination of commodity audio/video tech + Grid technologies for security, discovery, etc.
â 40+ sites worldwide, number rising rapidly
â Clear area of interest to OIIâ Second installation (Churchill?)
http://www.accessgrid.org
16PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Oxford Grid Project Overview
⢠Projects under different headingsâ Research Council Related
⢠EPSRC⢠DataGrid⢠Other RC and IRC
â OeSC Industrial⢠Company has to commit itself to Grid⢠Purpose is to âeffect the connectionâ and to disseminate
⢠Much more information availableâŚ!
17PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
EPSRC e-Science Projects⢠EPSRC
â Grid Enabled Optimisation and Design Search for Engineering⢠Aim to develop a new way of optimising engineering design
through the use of a grid enabled design search service, and focusing on CFD
â Mike Gilesâ The RealityGrid â a tool for investigating condensed matter and
materials⢠Aim to use Grid technology to closely couple high
performance computing and visualisation (steering) to create an environment for modelling to be compared and to integrate with experimental data
â Adrian Suttonâ Distributed Aircraft Maintenance
⢠Aim to build a generic grid testbed for distributed diagnostics of aircraft engines on a global scale
â Lionel Tarassenko
18PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
DataGrid Projects
⢠Two projects each involving the use of computer science to underpin the implementation of Grid applications software â Grid security
- develop provably correct security protocols to ensure secrecy, integrity and authenticity
- Collaborators: OUCL (Gavin Lowe, Bill Roscoe, David Gavaghan), RAL, EU DataGrid Security Coordination group
â Data Management â with functionality checked⢠develop a distributed handling and job-submission system
for very large datasets arising in experimental particle physics and use software engineering techniques to ensure that the implementation has the correct functionality
â Collaborators: OUCL (Andrew Martin, Jim Davies, David Gavaghan, Todd Huffman, Ian McArthur), RAL, EU DataGrid WP 2
19PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Other R.C. Projects(1)
⢠PPARCâ GridPP: National Centre and 4 regional Centres
â Todd Huffman, Ian McArthur, Tony Weidberg and many others
⢠EPSRC-MRC Interdisciplinary Research Consortiumâ âFrom Medical Signals and Images to Clinical Informationââ Joint EPSRC/MRC IRC in Medical Imaging and Signalsâ Awarded ÂŁ500K to develop and maintain the necessary Grid
infrastructure to support e-Science activities between the IRC consortium and the associated Regional e-Science Centres
â Mike Brady, Lionel Tarassenko, Alison Noble, Steve Smith
⢠BBSRC1. A Grid Database for Biomolecular Simulations (ÂŁ700k + 10%)â Simulations, creating a federated database, with data mining
â Mark Sansom, Paul Jeffreys2. Molecular Consortium; Structural Biology
â David Stuart (WTCHG) representing Oxford Component
20PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Other R.C. Projects(2)
⢠MRCâ Project looking at very large clinical trials of cancer utilising
genomic information; marrying genetic informations and clinical trial data
â Prof David Kerr (Clinical Pharmacology and Therapeutics)
⢠Reached the final stage of the MRC call
⢠NERCâ Closely related to âClimatePredictionâ project discussed below
⢠Wellcomeâ Working to establish Wellcome Grid Centre!
⢠âŚalso other projects underway with e-Science component
21PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
OeSC Industrial ProjectsâŚ
⢠Collaborative Visualisation and Computational Steering⢠Project Leader: Ken Brodlie (Computer Science, Leeds
University) ⢠Industrial Partners: NAG, Streamline Computing⢠Successful bid to Open Call
â A key generic enabling technology for Grid computing is
collaborative and remote visualisation and computational steering
â This project will address this in the context of steady and unsteady three-dimensional data arising from CFD calculations at Oxford and Imperial College, and the heart-modelling project described above
â The results will also be relevant to any scientific computations on an underlying computational mesh, using finite volume or finite element
22PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
âŚOeSC Industrial Projects âŚ
⢠Videoworks ⢠Project Leader: David Shotton, Zoology Department⢠Industrial Partners: IBM, Informix, Virage⢠Funded -> £327k
â Aim to create a unified suite of generic and scalable video e-services specifically for the handling and analysing scientific digital video data files located in distributed file stores over high bandwidth academic Grid networks, with a particular emphasis on the usefulness of these video e-services for biomedical research
23PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
⌠OeSC Industrial ProjectsâŚ
⢠Remote use of scientific Instrumentation⢠Project Leader: David Cockayne (Materials)⢠Industrial Partner: JEOL⢠Submitted and awaiting response! (£250k)
â Micro-analytical instrumentation, such as transmission electron microscopes, electron probes and surface analysis equipment is becoming increasingly expensive, increasingly sophisticated
â Consolidation of infrastructure seems both inevitable and desirable
â Many instruments can now be operated (at least in part) remotely
â Purpose is to develop a capability for satisfying this need in electron optical instrumentation, and to put in place a demonstration national grid of access to sophisticated electron optical equipment
24PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
⌠OeSC Industrial Projects âŚ
⢠Climate Prediction⢠Project Leaders: Myles Allen, Dave Stainforth (Atmospheric
Physics)⢠Industrial Partners: IBM, RSL, up to 2 million PC owners
world-wide⢠Submitted last week £320k
â Recent studies have shown that atmosphere-ocean general circulation models (AOGCMs) are capable of simulating some large-scale features of present-day climate and recent climate change with remarkable accuracy
â Aim is to develop techniques that will allow the use of up to 2 million home and business PCs to provide the first fully probabilistic 50-year forecast of human induced climate change
â New challenge of collecting (relatively) large data samples
25PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
âŚOeSC Industrial Projects
⢠eDiamond (Digital Mammography)⢠Will be submitted to DTI as âspecialâ on Friday⢠Mike Brady, David Gavaghan, Paul Jeffreys⢠Expect to be ÂŁ3M, but only need modest amount from OeSC
⢠Heterogeneous Workload Management and Grid Integration⢠IBM researcher on secondment to Oxford⢠Basically receive money for two staff!⢠Submit to DTI on Friday
â End to end response time monitoring and differentiated service applications running within Virtual Organisation
â Applied to e-Diamond
26PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
OeSC Projects under developmentâŚ
⢠Computational Drug Discovery⢠Project Leader: Graham Richards, Mark Sansom⢠Industrial Partners: Inhibox, Wellcome Trust?
â Following screensaver project, more computationally demanding calculations on binding of small molecules to proteins using the Grid
⢠Whole-heart Modelling⢠Project Leader: Denis Noble, David Gavaghan⢠Industrial Partners: The Wellcome Trust, possibly others
â Biological function arises from a complex interplay between processes at all levels of organisation -> comprehensive biological simulation of the whole-heart to be undertaken in a grid environment
27PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
âŚOeSC Projects Under Development
⢠Fully Accessible Video for e-Learning⢠Oxford/Cambridge (Stuart Lee)⢠£412k⢠âTest waterââŚ
â An e-Learning project to develop the use of high quality video-based resources for teaching, enabling random access to video data files while operating at streaming speeds
â Enables accurate access to precise points within datasources (eg down to sentences)
⢠Library Services⢠Matthew Dovey, David Price
â Looking for overlapping areas of interest, eg access to heterogeneous databases, methods for locating protocol gateways and information services, and distributed library architectures
28PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Is the Grid Niche or Mainstream?
⢠âA major development in 2001 has been the endorsement of the concept of the Grid by Microsoft, Sun and IBMâ (SR2002 bid)
⢠Irving Wladawsky-Berger (Lead for IBM Corporate on Grid)â âGrid computing is a set of research management services that sit
on top of the OS to link different systems togetherââ âWe will work with the Globus community to build this layer of
software to help share resourcesââ âAll of our systems will be enabled to work with the grid,
and all of our middleware will integrate with the softwareâ
⢠Dave Turek (IBMâs Vice President of LINUX)â âIBM's Global Services division plans to build $4 billion worth of
such [Grid] "computer farms" around the globeâ
⢠NeSC opened by Gordon Brown⢠Tony Blairâs talk âŚ
29PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Blairâs speech on British Science
http://politics.guardian.co.uk/speeches/story/0,11126,721029,00.html
⢠âThe emerging field of e-science should transform this kind of work. It's significant that the UK is the first country to develop a national e-science grid, which intends to make access to computing power, scientific data repositories and experimental facilities as easy as the web makes access to information. One of the pilot e-science projects is to develop a digital mammographic archive, together with an intelligent medical decision support system for breast cancer diagnosis and treatment. An individual hospital will not have supercomputing facilties, but through the grid it could buy the time it needs. So the surgeon in the operating room will be able to pull up a high-resolution mammogram to identify exactly where the tumour can be found. â
30PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
SR2002(1)
⢠SR2002 â distinct change of emphasis1. e-Learning
⢠Virtual Laboratories, AccessGrid and other Grid-enabled technologies
2. e-Government⢠Many of the heterogeneous data collections of Government
Departments should be federated using Grid middleware 3. Medical and Healthcare Informatics
⢠Grid middleware to maintains privacy and trust; need to strengthen links with NHS activities
4. e-Environment⢠Grid infrastructure needs to be applied to a wide variety of
environmental problems ranging from monitoring endangered species or traffic flows to flood warning systems or pollution monitoring
31PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
SR2002(2)
5. e-Businessâ By the end of the SR2002 period, robust, industrial-strength
Gridmiddleware will be available -> âVirtual Organisationsâ -> multi-company business opportunities
6. International e-Science collaborationâ e-Science âŚs UK programme fits well into the EUâs
European Research Area initiative7. Military applications of Grid technologies
â Joint programme should be established with the MOD 8. Security
â Vital area of concern for the Grid and requires a focused sub-programme of R&D looking at the needs of the different application areas
32PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
SR2002 OST resources
SR2000 Programme SR2002
15.0 Core 20.0
(20.0) (DTI) (25.0)
8.0 BBSRC 15.0
5.0 CLRC 9.3
17.0 EPSRC 19.5
3.0 ESRC 8.5
8.0 MRC 10.0
7.0 NERC 10.0
26.0 PPARC 45.0
89.0 Total 137.3
33PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
SR2002 conclusions
⢠More money requested for e-Science than in SR2000â Up to now Oxford University received > ÂŁ8M and growing
⢠Activity is now mainstreamâ We are building a special relationship with IBM
⢠Different emphases from SR2000â Clearly advantage to Oxfordâ Healthcare prominent!
⢠We need to be preparing for SR2002â OeSC â building projects in the key areas and competing!â Preparing to bid against the RC funds
34PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Implications for ITSS
⢠Role of Computing Services and IT Support in Infrastructureâ Generally understood that the Grid will form part of the basic IT
infrastructure of the modern University⢠Meeting May 1, NeSC â e-Science Developers/Computing
Servicesâ âGoal is to have the advantages of the infrastructure, but not
visible to userâ
⢠Oxford uniquely placed â and leading⢠Computing Services becoming more important as move from
Level 1 Grid (basic Grid functionality for one-off tests) to Level 2 Grid (persistent, robust, 24X7)
⢠Majority of e-Science money in Oxford invested in applications
â How do we support the researchers, who generally are not Grid experts?
35PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
What will it mean for IT SS (1) ?
⢠Our IT usersâ âI need a digital certificate to access my collaboratorsâ computing
resourcesâ⢠Authentication by University of Oxford
â âI need authorisation to use the database and Beowulf cluster at..â⢠Authorisation through their collaboration, but coordinated and
facilitated hereâ âI need to be able to use my digital certification to launch jobs into the
âAstroGridâ⢠Means variety of things:
â Knowing how to send secure requests with digital certificatesâ How to launch jobs (different schedulers)
⢠Substantial help from OeSC will be availableâ âI need to advertise the resources here in Oxford to my collaboration
(or I need to find out what resources are available)â⢠Need to be able to advertise/interrogate MDS GIIS/GIS services
36PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
What will it mean for IT SS (2) ?
⢠Collaborators from outside Oxford wishing to use facilities owned by our usersâ âA collaborator based at ⌠needs to access the OU
SuperComputer and databaseâ⢠Your user will need a âGrid Clientâ or gatekeeper (could be
central one or one set up locally)â This will need to receive his/her collaboratorâs digital certificate
⢠He/she will need to be authorised to use the facilities⢠You will need to take care of firewall and other security
issuesâ âMy collaborator has launched a job which requires facilities at
Oxford, but it is running slowly/does not workâ⢠At least will need to know how to route questions!
37PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Likely questions from IT SS (1)⢠"How much am I going to need to know?â
â Not need to know intricacies of the Grid (unless wish to!)â Basic understanding will probably be necessaryâ Some exciting opportunities!
⢠"Where can I get help?ââ OeSC point of information: [email protected]
⢠Routed through RT to expert⢠All learning together to some extent!⢠Applications will build up considerable expertise which must be
able to draw upon⢠âHow much of an additional workload is the introduction of the Grid is
likely to impose upon me?ââ Hard to be sureâ At the moment â specifically related to scientific applications, but could
be much broaderâ How would you answer the question if asked about WWW?â Certainly true that expertise being built up across most Universitiesâ Perhaps will mean closer association with application teams
38PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Likely questions from IT SS (2)
⢠âShould I be responsible for supporting usersâ collaborators?ââ Ideally it should all balance out!â I suspect for some time it will operate through well defined
mini-Grids (eg the Dame Grid)â The project itself will offer support
⢠âHow can I be kept informed and/or contribute?ââ email [email protected]â Training will be made availableâ Partnership needed
39PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Summary
⢠e-Science and the Grid are now mainstreamâ Will have profound effect on the University
⢠Oxford has extremely exciting Grid projects⢠OeSC is one of the main centres within a world leading
national Grid installation⢠Opportunity for OU to really lead the way in terms of creating
a persistent, robust IT infrastructureâ Must be done in partnership
⢠Collaboration between IT SS, OeSC, OUCS and application researchers will be needed
40PWJ/ ITSSG Conference
June 2002
Oxford Universitye-Science Centre
Conclusions
⢠SR2000 investment in e-Science has been successful⢠OeSC is well advanced, managerially and technically⢠Oxford has been very successful in bidding against RC
funds⢠The Industrial Projects are well developed and we will
be one of the first Centres to allocate our funds!⢠Over the last year, the Grid has become mainstream⢠Definite change of emphasis in SR2002 e-Science bid⢠Oxford should be preparing now..⢠There will be profound implications for the University
and for IT SS!