Work Package 5Data Acquisition and High Level Triggering System

Jean-Christophe Garnier

3/08/2010

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

French engineer in computer sciences and mathematics Joined ACEOLE the 1st October 2008

Incomplete scientific background MadWifi open-source device driver Embedded systems, robots and mobile robots Virtual reality (graphics and physics engine) Geographic Information System Training module for proprietary framework in industrial

process control

Introduction

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Training Technical Training

Force10 Operating System Certification (Force10) Secure Coding in Python (CERN) Computer Architecture and Performance Tuning (CERN/Intel) Multi-processing development with GPUs (Speed-Up

Workshop) CUDA, OpenCL

Complementary Training Radiological Protection (CERN) German Course from nothing to B1 (outside) Presentation course - How to make a poster (CERN) Leaders in Science, Learning from Experience (CERN)

Confidence building on 2 days

Secondment Force10 Networks, to be done

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0Introduction – Training – Technical – Dissemination - Impact

Event-Builder

Storage

Event-Filter

Dataflow Simulator

Induction project

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

A way to exercise the complete system Before the LHC start-up Currently used to replay

physics run and tune the Event-Filter

Learn a lot about the entire LHCb DAQ

Upgrade project, implementing an hardware version Driving 10 Gigabit Ethernet

interface Opportunity to supervise

interns Privileged link with my

highschool

Dataflow simulator for full system test

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Communication Oral presentation in LHCb

software weeks Oral presentation in

Computing in High Energy Physics Conference (CHEP09)

Poster in Real Time Conference (RT2009)

Posters in Topical Workshop on Electronic for Particle Physics (2009 and soon 2010)

3 (+1) papers in conference proceedings and 1 peer-reviewed paper in the Transactions for Nuclear Sciences (TNS)

Dataflow simulator for full system test

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0Introduction – Training – Technical – Dissemination - Impact

Event-Builder

Storage

Event-Filter

File system for

physics data

Takeover, improvements and completion

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Takeover from Sai Suman Cherukuwada project, from the Marie Curie contract MITELCO

Reliable way to write physics data required Performance should be scalable as

requirements might change Don’t lose any data, robust against hard

and soft failuresHigh-performance data reading

To reprocess physics data in the computing farm

Solution User space file system

Handle anything, not only physics data Active-Passives, failover, failback Implemented now on a 10 GbE network

File System for Physics Data

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Data writing in production First requirement: 70 MB/s, currently

400 MB/sData reading research project still in

progress Proof of concept at 400 MB/s

maximum

Communication Poster in Real Time Conference

(RT2010) 1 paper in the proceedings and 1

paper submitted in TNS

File System for Physics Data

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0Introduction – Training – Technical – Dissemination - Impact

Event-Builder

Storage

Event-Filter

R&D on Event-Builder

From scratch

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

10 GbE is already well-known, as the upgrade of the Gigabit Ethernet standard, Challenger is InfiniBand

InfiniBand pros: High bandwidth / low-

latency Interesting features :

RDMA InfiniBand cons:

No standard programming interface

“Designed” for distributed system, different from a computing farm

Results will be presented with a poster at CHEP2010

R&D on Event-Builder

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Lab designer and instructor for CERN Summer Students - 2009 and 2010

Lab co-designer and co-instructor in the International School of Trigger and Data Acquisition (ISOTDAQ), in 2010 in Ankara, and 2011 in Rome.

Presentation of CERN at UniversitySupervision of interns and summer students 2009 and

2010Guide in the LHCb ExperimentAuthor and peer-reviewer in the Transactions on

Nuclear SciencesChairperson of the 1st ACEOLE 6 month meetingCo-author on a few other papers

About the general system or about systems involving my software

Dissemination

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

My impact Important projects for the experiment

2 for operations 1 R&D And a lot of interventions

Secondary project about LHCb survey reused in ISOLDE

Feedback to Chelsio on their device drivers when investigating 10 GbE performance

Impact on intern carriers, introducing to CERN, giving them project opportunities

After ~ 2 years Much more lines in my CV Good visibility in the experiment, with piquet

tasks, DAQ sub-system expertise and system administration

Intern supervision possible right after graduation

Impact

Introduction – Training – Technical – Dissemination - Impact

WP

1W

P2

WP

3W

P4

WP

5

CO

OR

DIN

ATO

RW

OR

K P

AC

KA

GE

LD

RR

ES

EA

RC

HER

AC

EO

LE M

ID T

ER

M R

EV

IEW

CER

N 3

RD

AU

GU

ST 2

01

0

Questions?