Mobile Analyzer

A Distributed Computing Platform

Juho Karppinen <Juho.Karppinen@hut.fi>

Helsinki Institute of Physics Technology Program

May 23th, 2002

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (1)

Overview

• Distributed computing platform

• Designed for need of high energy physics

• Can be used to analyze vast amounts of data stored in a distributed fashion

• Agent based concept

• Implemented using Java

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (2)

Basic idea

• User provides java code and description of needed data

• Data is found automatically using intelligence implemented to LDAP directories

• Agents (analysis code) are sent where the data is and executed

• Only status messages and results are sent back

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (3)

Architecture

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (4)

Network

LDAP

Server 2

Server 3

Client

public void processEvent (Event e){ if( e.getColumn( RMC ))…}

Data ranges to process:10..100, 500..1600

Proxy

Server 1

Client computergives access point

User supplied dataThe code to run and a

description of required data

Resource information serverRuns “yellow pages” for needed resources

Proxy server(s)Autonomous job dispatching,result saving and status monitoring

Analysis serversComputers which have data and computing power for users

Technology overview

• Uses Grid Security Infrastructure for security and authentication

• Agents uses Java Analysis Studio –interface with some modifications

• Supports JAS compatible data sources and custom ones, like Objectivity

• Uses own XML-based agent platform for communication

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (5)

Benefits

• Supports truly heterogeneous hardwareenvironments (Solaris, Linux, Windows, ...)

• Uses existing Java Analysis Studio and GSI -interfaces

• Reduced workload for the user as the data location does not need to be known

• Not only restricted to physics analysis. Agents gives lots of possibilities, ex real-time graphical cluster status monitoring.

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (6)

Current status

• Support for off-line execution of jobs

• Can access private networks or clusters through proxy server

• Integration with CMSIM through GridPortal, allows automated verification of results right after simulations are finished

• Command line utilities

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (7)

Conclusion

• Mobile Analyzer has lots of potential in future. Be aware!

• More informationDemonstration during breaks

or

http://wikihip.cern.ch/twiki/bin/view/Globus/MobileAnalyzer/

Mobile Analyzer - A Distributed Computing Platform, May 23th, 2002, (9)