1
User view Ganga classes and functions can be used interactively at a Python prompt, can be referenced in scripts, or can be used indirectly via a Graphical User Interface (GUI). The GUI consists of a main panel, which displays job information, and three dockable windows - windows that can be hidden, integrated in the main panel, or floated separately. The dockable windows provide for job building, for execution of arbitrary Ganga/Python commands, and for the logging of system messages. Scope Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It is being developed to meet the needs of the ATLAS and LHCb experiments for a Grid user interface, but offers possibilities for extension and customisation that make it interesting for a wide range of user communities. ATLAS and LHCb will investigate various aspects of particle production and decay in high-energy proton-proton interactions at the Large Hadron Collider (LHC), due to start operation at the European Laboratory for Particle Physics (CERN), Geneva, towards the end of 2007. Both experiments will require processing of data volumes of the order of petabytes per year, and will rely on computing resources distributed across multiple locations. The experiments’ data-processing applications, from event modelling to physics analysis, are based on the Gaudi/Athena C++ framework. Ganga (Gaudi/Athena and Grid Alliance), deals with configuring these applications, allows simple switching between testing on a local batch system and large-scale processing on the Grid, and helps keep track of results. Other projects using Ganga In addition to its use in ATLAS and LHCb, Ganga is finding application in a growing number of other projects, both as a standalone tool and as submission engine and monitoring system for the DIANE job- distribution framework. The Ganga user groups include: other high-energy physics experiments: Compass, Harp teams developing detector simulations: Garfield, Geant4 biomedical projects: med-austron, projects researching Avian flue projects involving image processing: Cambridge Ontology, Xmipp chemistry project: WIEN2k telecomunications industry: International Telecommunication Union (ITU) HEP Computing Uniform User Interface Worldwide Resources Ganga an Optimiser and Front-End for Grid Job Submission Job representation A job in Ganga is constructed from a set of building blocks. All jobs must specify the software to be run (application) and the processing system (backend) to be used. Many jobs will specify an input dataset to be read and/or an output dataset to be produced. Optionally, a job may also define functions (splitters and mergers) for dividing a job into subjobs that can be processed in parallel, and for combining the resultant outputs. Ganga provides a framework for handling different types of application, backend, dataset, splitter and merger, implemented as plug-in classes. Each of these has its own schema, which places in evidence the configurable properties. Job details Logical Folders Job Monitoring Log window Job builder Scriptor Ganga tutorials for ATLAS and LHCb have been held at locations including Bologna, Cambridge, CERN, Edinburgh, Lyon, Milan, Mumbai and Munich, and online guides to getting started with Ganga are also available. Tutorials and guides have been key factors in stimulating Ganga take-up, with more than 500 Ganga users recorded. Job statistics from Ganga Use of the Grid to search for drugs against avian flu was widely reported. About one eighth of the Grid jobs were submitted using Ganga/DIANE 5 May 2006 Regression tests for Geant4 major releases require a few years of CPU, concentrated in a short time. These tests are run on the Grid using Ganga/DIANE. The ITU Regional Radio Conference, held in Geneva in May-June 2006, required real-time optimisation of evolving plans for sharing frequencies between 120 countries. The aim was to maximise the number of satisfied requests, and minimise interference. Ganga/DIANE was used to run the optimisation jobs on the Grid. Cambridge Ontology is developing solutions for image retrieval based on image content. Plug-in classes specialised for the required image- processing tasks have been implemented, and are used with Ganga to submit jobs to the Grid. Enabling Grids for E-sciencE F.Brochu 1 , U.Egede 2 , J.Elmsheuser 3 , B.Gaidioz 4 , K.Harrison 1 , H.C.Lee 5 , D.Liko 4 , A.Maier 4 , J.T.Moscicki 4 , A.Muraru 4 , V.Romanovsky 6 ,A.Soroko 7 , C.L.Tan 8 1 University of Cambridge, 2 Imperial College London, 3 Ludwig-Maximilians-Universität München, 4 CERN, 5 ASGC Taipei, 6 IHEP Protvino, 7 University of Oxford, 8 University of Birmingham EGEE-II INFSO-RI-031688 http://cern.ch/ganga Ganga User statistics

HEP Computing Uniform User Interface Worldwide Resourceslhcb-doc.web.cern.ch/lhcb-doc/presentations...and Munich, and online guides to getting started with Ganga are also available

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: HEP Computing Uniform User Interface Worldwide Resourceslhcb-doc.web.cern.ch/lhcb-doc/presentations...and Munich, and online guides to getting started with Ganga are also available

User viewGanga classes and functions can be used interactively at a Pythonprompt, can be referenced in scripts, or can be used indirectly via aGraphical User Interface (GUI). The GUI consists of a main panel, whichdisplays job information, and three dockable windows - windows that canbe hidden, integrated in the main panel, or floated separately. Thedockable windows provide for job building, for execution of arbitraryGanga/Python commands, and for the logging of system messages.

ScopeGanga is an easy-to-use frontend for job definition and management, implemented in Python.It is being developed to meet the needs of the ATLAS and LHCb experiments for a Grid userinterface, but offers possibilities for extension and customisation that make it interesting for awide range of user communities. ATLAS and LHCb will investigate various aspects of particleproduction and decay in high-energy proton-proton interactions at the Large Hadron Collider(LHC), due to start operation at the European Laboratory for Particle Physics (CERN), Geneva,towards the end of 2007. Both experiments will require processing of data volumes of the orderof petabytes per year, and will rely on computing resources distributed across multiplelocations. The experiments’ data-processing applications, from event modelling to physicsanalysis, are based on the Gaudi/Athena C++ framework. Ganga (Gaudi/Athena and GridAlliance), deals with configuring these applications, allows simple switching between testingon a local batch system and large-scale processing on the Grid, and helps keep track ofresults.

Other projects using GangaIn addition to its use in ATLAS and LHCb,Ganga is finding application in a growingnumber of other projects, both as astandalone tool and as submission engineand monitoring system for the DIANE job-distribution framework. The Ganga usergroups include:• other high-energy physics experiments:Compass, Harp• teams developing detector simulations:Garfield, Geant4• biomedical projects: med-austron,projects researching Avian flue• projects involving image processing:Cambridge Ontology, Xmipp• chemistry project: WIEN2k• telecomunications industry: InternationalTelecommunication Union (ITU)

HEP Computing Uniform User Interface Worldwide Resources

Gangaan Optimiser and Front-End for Grid Job Submission

Job representationA job in Ganga is constructed from a set of building blocks. All jobsmust specify the software to be run (application) and the processingsystem (backend) to be used. Many jobs will specify an input dataset tobe read and/or an output dataset to be produced. Optionally, a job mayalso define functions (splitters and mergers) for dividing a job intosubjobs that can be processed in parallel, and for combining theresultant outputs. Ganga provides a framework for handling differenttypes of application, backend, dataset, splitter and merger, implementedas plug-in classes. Each of these has its own schema, which places inevidence the configurable properties.

Job details

LogicalFolders

Job Monitoring

Log window

Job builder

Scriptor

Ganga tutorials for ATLAS and LHCb have been held at locationsincluding Bologna, Cambridge, CERN, Edinburgh, Lyon, Milan, Mumbaiand Munich, and online guides to getting started with Ganga are alsoavailable. Tutorials and guides have been key factors in stimulatingGanga take-up, with more than 500 Ganga users recorded.

Job statistics from Ganga

Use of the Grid to search for drugs against avian fluwas widely reported. About one eighth of the Gridjobs were submitted using Ganga/DIANE

5 May 2006

Regression tests forGeant4 major releasesrequire a few years ofCPU, concentrated in ashort time. These testsare run on the Gridusing Ganga/DIANE.

The ITU Regional Radio Conference, held in Genevain May-June 2006, required real-time optimisation ofevolving plans for sharing frequencies between 120countries. The aim was to maximise the number ofsatisfied requests, and minimise interference.Ganga/DIANE was used to run the optimisation jobson the Grid.

Cambridge Ontologyis developingsolutions for imageretrieval based onimage content.Plug-in classes specialised for the required image-processing tasks have been implemented, and areused with Ganga to submit jobs to the Grid.

Enabling Grids for E-sciencEF.Brochu1, U.Egede2, J.Elmsheuser3, B.Gaidioz4, K.Harrison1, H.C.Lee5, D.Liko4, A.Maier4, J.T.Moscicki4, A.Muraru4,V.Romanovsky6,A.Soroko7, C.L.Tan8

1University of Cambridge, 2Imperial College London, 3Ludwig-Maximilians-Universität München,4CERN, 5ASGC Taipei, 6IHEP Protvino, 7University of Oxford, 8University of Birmingham

EGEE-II INFSO-RI-031688 http://cern.ch/ganga

Ganga Userstatistics