Upload
cleta
View
49
Download
0
Tags:
Embed Size (px)
DESCRIPTION
EU FP6 Project. GRID enabled remote instrumentation and sensors with distributed control. Francesco Lelli Istituto Nazionale di Fisica Nucleare – Laboratori di Legnaro Legnaro (PD), Italy. The Grid Technologies to extend the limit of a single computer (center). Storage Element. Computing - PowerPoint PPT Presentation
Citation preview
GRID enabled remote instrumentation and sensors with distributed control
Francesco LelliIstituto Nazionale di Fisica Nucleare – Laboratori di Legnaro
Legnaro (PD), Italy
EU FP6 Project
F. Lelli, Cairo 09 09 2007 2www.gridcc.org (EU FP6 Contract 511382)
The Grid Technologies to extend the limit of a single computer (center)
Grid Technologies
Grid Technologies
User Interface
Grid Gateway
ComputingComputingElementElement
StorageStorageElementElement
ComputingComputingElementElement
ComputingComputingElementElement
F. Lelli, Cairo 09 09 2007 3www.gridcc.org (EU FP6 Contract 511382)
Extending the Grid Concepts
Grid Technologies
Grid TechnologiesSatellite views
to monitor the volcano
Control and Monitor RoomTo model calculations
and disaster predictions
Terrestrial probes to monitorThe volcano activities
Grid Gateway
F. Lelli, Cairo 09 09 2007 4www.gridcc.org (EU FP6 Contract 511382)
GridCC
Instruments Grid Computational Grid
GridCC
+
Data for Model Calculations
Predictions
F. Lelli, Cairo 09 09 2007 5www.gridcc.org (EU FP6 Contract 511382)
The GRIDCC project: Goals & Objectives
1. The GRIDCC - Grid Enabled Remote Instrumentation with Distributed Control and Computation – project has the main aim to bring Instruments to the GRID
2. It is a 3-years EU FP6 project started in September 2004
3. Web site: www.gridcc.org
4. More in particular the project goals are:1. Definition of a “Instrument Element” allowing a standard remote
access to any type of instrumentation
2. Tight integration between instrument grid and classical computational grid
3. Human interaction with Grids via Virtual Control Room (collaborative environment)
4. Enactment of complex workflows
F. Lelli, Cairo 09 09 2007 6www.gridcc.org (EU FP6 Contract 511382)
The GRIDCC partners
Participant name Country
Istituto Nazionale di Fisica Nucleare Italy
Institute Of Accelerating Systems and Applications Greece
Brunel University UK
Consorzio Interuniversitario per Telecomunicazioni Italy
Sincrotrone Trieste S.C.P.A Italy
IBM (Haifa Research Lab) Israel
Imperial College of Science, Technology & Medicine UK
Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche
Italy
Universita degli Studi di Udine Italy
Greek Research and Technology Network S.A. Greece
F. Lelli, Cairo 09 09 2007 7www.gridcc.org (EU FP6 Contract 511382)
GridCC: The Basic Idea
StorageElementsStorage
Elements
ComputingElement
ComputingElement
InstrumentElement
ComputingElement
StorageElement
InstrumentElement
InstrumentElement
Existing Grid Infrastructures
Virtual Control
Room
Virtual Control
Room
ExecutionService
F. Lelli, Cairo 09 09 2007 8www.gridcc.org (EU FP6 Contract 511382)
GRIDCC Architecture
Web ServiceInterface
Execution
Service
WfMS
WMS
AS
Instrument elements
(IE)StorageElement
(SE)
Instrument elements
(IE)StorageElement
(SE)
Instrument Element
(IE)StorageElement
(SE)
Compute element
(CE)
Compute element
(CE)
Computing Element
(CE)
StorageElement
(SE)
StorageElement
(SE)
StorageElement
(SE)
Information System(BDII)
Virtual Control
Room
WMS Work Management System
WfMS Work Flow Mng System
AS Agreement ServiceBroker
gLite GRID
GRIDCC
F. Lelli, Cairo 09 09 2007 9www.gridcc.org (EU FP6 Contract 511382)
GridCC PermanentTest Bed
VOMSVOMS
AS, KrbServerAS, KrbServer
VCR, SE, IE, BDIIVCR, SE, IE, BDII
IE, CE/CREAM,SE, LFC IE, CE/CREAM,SE, LFC
WMProxyWMProxy
WfMS WfMS
VCR, IE VCR, IE
F. Lelli, Cairo 09 09 2007 10www.gridcc.org (EU FP6 Contract 511382)
GRIDCC main target areas(Large-scale) scientific
experimentsHigh energy particle physics
(Radio-) Telescopes
Remote process control Accelerator control (Tele-) Biomedicine
Robotics Automotive
Electronic microscopes
Widely Sparse Instrumentation Power Grids
Monitoring of the territory Monitoring of the seaGeo-hazard prediction
Distributed laboratories Transportation monitoring
Sensor network
GRIDCCMiddleware
F. Lelli, Cairo 09 09 2007 11www.gridcc.org (EU FP6 Contract 511382)
GRIDCC pilot applications
Power Grid
Power Grid
High Energy Physics
CMS
High Energy Physics
CMS
Particle Accelerator
Particle Accelerator
Device Farm
Device Farm
Geohazard MonitoringGeohazard Monitoring
MeteorologyMeteorology
F. Lelli, Cairo 09 09 2007 12www.gridcc.org (EU FP6 Contract 511382)
Instrument Element Requirements
Web Services
Instrument Element
Any Protocol or physical connection
Sensor Network
Instrument
Instrument
GridGrid
ComputingComputing ElementElement
StorageStorage ElementElement
ComputingComputing ElementElement InstrumentInstrument
ElementElement
W
EF
A
B
C
D
1: Provide a uniform access to the physical devices
2: Allow a standard grid access to the instruments
3: Allow the cooperation between different instruments that belong to different VOs
F. Lelli, Cairo 09 09 2007 13www.gridcc.org (EU FP6 Contract 511382)
A new 4 channels element to fit the requirements: The Instrument Element (IE)
Inst
rum
enta
tion
Con
torl
GR
ID A
cces
s
Instruments Access
Data/Info Pubblishing
InstrumentElement
Web
Ser
vice
SR
M/G
RID
FT
P
Custom (JMS, ..... )
Custom
I’m here
Discovery
QoSAdvance Reservation
F. Lelli, Cairo 09 09 2007 14www.gridcc.org (EU FP6 Contract 511382)
VIG
S
IMSProxy
ControlManager
DataCollector
Real Instruments
Data Flow
Control Flow
State FlowError FlowMonitor Flow
The term Instrument Element describes a set of services that provide the needed interface and implementation that enables the remote control and monitoring of physical instruments.
InputManager
EventProcessor
FSMEngine
ResourceProxy
Control Manager
IMSInstrument Element Architecture
ResourceService
IMS
ProblemSolver
InstrumentManager
Instrument Element
Data Publisher
Acc
ess
Con
trol
Man
ager
SRM/SEGridFTP
SE
IMS
Instrument Protocols
F. Lelli, Cairo 09 09 2007 15www.gridcc.org (EU FP6 Contract 511382)
Virtual Control Room (VCR)
The VCR is a web portalBased on the Gridsphere framework(portlet technology) and providing• general cooperative tools
• event tools• resource tools• communicatin tools
• chat• video conf
• application specific tools• instrument control• log book• log reports• data monitor
F. Lelli, Cairo 09 09 2007 16www.gridcc.org (EU FP6 Contract 511382)
VCR examples
F. Lelli, Cairo 09 09 2007 17www.gridcc.org (EU FP6 Contract 511382)
GRIDCC at Work
F. Lelli, Cairo 09 09 2007 18www.gridcc.org (EU FP6 Contract 511382)
Pilot applications: CMS - I The GridCC middleware has been deployed to control the run of the CMS
(Compact Muon Solenoid), one of the four high energy experiments in LHC (Large Hadron Collider) at CERN laboratory.
CMS Magnet Test and Cosmic Challenge (MTCC) I and II, a milestone in the CMS construction, positively carried out.
Top IE
CSCIE
TrackerIE
HCALIE
DAQIE
RPC IE
TriggerIE
DTIE
ECAL IE
DAQIM
FB RB FF
xdaq
xdaqxdaq
DAQRS
DAQIMS
UserInterface
CMS Control Structure
CMS Detector
F. Lelli, Cairo 09 09 2007 19www.gridcc.org (EU FP6 Contract 511382)
CMS MTCC phase I and phase II carried out in 2006
Scale MTCC versus CMSFEDs: 20 out of 600 3%EVB RUs: 6 out of 600 1%Filter Farm: 14 out of 2000 0.3%Trigger rate: 100 Hz out of 100 kHz 0.1%Event size: 200 kB out of 1 MB 20%IEs 15 out of 150 10 %
Scale MTCC versus CMSFEDs: 20 out of 600 3%EVB RUs: 6 out of 600 1%Filter Farm: 14 out of 2000 0.3%Trigger rate: 100 Hz out of 100 kHz 0.1%Event size: 200 kB out of 1 MB 20%IEs 15 out of 150 10 %
F. Lelli, Cairo 09 09 2007 20www.gridcc.org (EU FP6 Contract 511382)
Top IM
VCR
ServicesServicesServices
PSAChf d’Or
EVBChf d’Or
TrackingChf d’Or
StorageIM
SlwCtrlIM
EVB Sub- System Storage
Sub- System
PSA Sub-System Tracking Sub-System
SlowCtrl Sub- System
Maestro
Web Services
Main Data Flow(Narval Systems)
Resource ServiceLog CollectorError Collector…..
AncillaryIM
Ancillary Sub- System
Na
rval
Sys
tem
s
IM = Function Manager
F. Lelli, Cairo 09 09 2007 21www.gridcc.org (EU FP6 Contract 511382)
Pilot applications: Power grid
Instrument Manager
Instrument Element
...
Virtual Control Room
Virtual Control Room
Gas
Solar Panel
Power Grid V.O.
GRIDCC deployed to monitor:• A 50kW generator• A 1 kw Photo-Voltaic array
F. Lelli, Cairo 09 09 2007 22www.gridcc.org (EU FP6 Contract 511382)
Pilot applications: Remote Operation of an Accelerator
Elettra Synchrotron
F. Lelli, Cairo 09 09 2007 23www.gridcc.org (EU FP6 Contract 511382)
GRIDCC: other applications Meteorology (Ensemble Limited Area Forecasting)
Weather forecasting system to detect hazardous weather
Device Farm for the Support of Cooperative Distributed Measurements in Telecommunications and Networking Laboratories The Device Farm consists of a pool of Measurement
Instruments for Telecommunication Experiments
Geo-hazards: Remote Operation of Geophysical Monitoring Network The monitoring net will be characterized by different levels of
activity: stand-by, pre-alert, alert, plus a control modality An event worth to be monitored is for example the evolution
of a “landslip”
F. Lelli, Cairo 09 09 2007 24www.gridcc.org (EU FP6 Contract 511382)
Instrument Element: Scalable on embedded systems
FPGAPPC405
Xilink Virtex IV
Custom Board
Cus
tom
Ele
ctro
nics
1 Gbps Ethernet
Web
Ser
vice
Grid
CC
IM
Java
VM
Linu
x
USER INTERFACE
Custom Logic
Montavista www.montavista.com
JamVM http://jamvm.sourceforge.net
Standalone Axis
IEInstrument Manager
F. Lelli, Cairo 09 09 2007 25www.gridcc.org (EU FP6 Contract 511382)
IE technologies Web Service compliant (WS-I)
Tomcat + Axis (and Java) and Axis standalone are the main technologies of the IE
All the services are deployed on a single or multiple instances of Tomcat, according to the needs of the application
Message oriented middleware (Pub/Sub) is based on the Java Messaging System (JMS). The following implementations are used in the project
Sun Narada Brokering RMM - JMS (GridCC IBM)
MySQL and Oracle are used as Data Base for the RS
SRM interface version 2.2 used
F. Lelli, Cairo 09 09 2007 26www.gridcc.org (EU FP6 Contract 511382)
Conclusions I
The GRIDCC technology (based on web services) is used to have an homogenous backbone to control and monitor geographically widely distributed instrumentation.
Data taken from the instrumentation can be directly seen by the european computational and storage GRID
CMS experiment is using for its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes
AGaTA experiment is building its data taken GRIDCC based run control system. The final configuration is target to control O(1000) nodes
F. Lelli, Cairo 09 09 2007 27www.gridcc.org (EU FP6 Contract 511382)
Conclusions II
GRIDCC is ending this year having reached all the mail milestones foreseen and having, in particular, a production environment (CMS) daily running and serving hundreds of physicists in commanding and controlling either their sub detectors or the full experiment.
GRIDCC team is now keen to look for new exploitations of their outcomes in different contexts adding, possibly, new developments and customization of the middleware according to the new needs.
The control and monitor of pan European projects like EMSO and KM3NET appears to be very attractive in this sense, as it could be implemented like a new e-infrastructure across Europe dedicated to the remote control of big scientific apparatus. Moreover the online data integration with the computational and storage GRID provides to fill a gap in the existing computational grid and at the same time give a strong added value to the proposal of this new e-infrastructure.
F. Lelli, Cairo 09 09 2007 28www.gridcc.org (EU FP6 Contract 511382)
Grid TechnologiesGrid Technologies
Lambda Lambda NetworkNetwork
Web 2.0 Web 2.0 ToolsTools
Pervasive Pervasive ComputingComputing
Conclusions IIIhttp://sadgw.lnl.infn.it:2002/MapsMonitor
F. Lelli, Cairo 09 09 2007 29www.gridcc.org (EU FP6 Contract 511382)
Querring Client
Querring Client
Discovery Instruments (I) The discovery of the instruments or of the IEs is an issue
when the number of elements is high We can have two cases:
Quasi static cases The number of IEs are well defined and the single IE is quite complex with
a good hardware support In this case a register based discovery mechanism can be used. GRIDCC tesbed is using the LCG BDII (Berkely Database Information
Index ) based on LDAP The information collected in the BDII follow a GLUE schema and can be
used for match making querries
IE
IE
IE
BDIILocal BDII
Querring Client
F. Lelli, Cairo 09 09 2007 30www.gridcc.org (EU FP6 Contract 511382)
Discovering Instruments (II)
Dynamic cases The number of IEs can change very quickly, they are very simple devices,
often with poor hardware support The discovery is just use to know which are the online IEs A new approach has been developed based on Peer to Peer (P2P)
protocols See the demo
IE
IE
IEIE
M1
M2
Querring Client
Querring Client
Querring Client
F. Lelli, Cairo 09 09 2007 31www.gridcc.org (EU FP6 Contract 511382)
Question?
Thx for your time!The GRIDCC Project. Grid enabled Remote Instrumentation with Distribute Control and Computation. Official Webpage of FP6 European funded project. Video On-Line Demo. A sample video that shows the GRIDCC service orchestration.
Live Demo. A Peer to Peer Approach for the Geo-Location of a Grid of Instruments
GridCC in GRIDToday. Gaetano Maron and Francesco Lelli presented the GRIDCC project in one of the leading online journals.
GridCC in Wikipedia
Instrument Element Facade Online documentation for Instrument Elements developers.
More: