LHCb resources updates for 2012-

2015

Marco CattaneoCERN – LHCb

On behalf of the LHCb Computing Group

2

Changes since 2012 request

m New reconstructed data format:o Previously, RAW and SDST saved on separate files

P Both have to be staged, synchronously, when restrippingP Very demanding on tape systems, since in general on

different tapesP Does not allow to achieve maximum throughput

o Now write FULL.DST, containing RAW+SDSTP Effectively an extra copy of RAW

m Data taking changeso Extension of pp run by 2 monthso LHCb operation at higher instantaneous luminosity

P 4x1032 cm-2s-1 (3.7 in 2011)o Higher HLT output rate

P (2011: 3kHz, 2012 forecast: 4.5kHz, 2012 actual: 5kHz)o Participation in pA (heavy ion) run in early 2013

3

Effect of changes on resources

m RAW data: 1.7 PB, o 43% increase with respect to previous estimates (1.2

PB).m Reconstructed data:

o 3.1 PB, 120 % increase with respect the previous estimate (1.4 PB).

m Derived datasets (DST, MDST for physics analysis)o 43% increase

m Heavy Ion RAW data: 100 TB.

m Higher CPU peak power for reprocessingo Originally foreseen after data-taking, now in parallel

to be ready for Winter 2013 conferencesP Clashes with prompt processing (data quality, fast

analyses)P Cannot use resources of HLT farm

4

Mitigation to fit into 2012 pledges

m CPU:o Reduce prompt processing to 50% of new data

P Only at CERN, 20% sub-contracted to Tier2so Reprocessing extended by two months

P Only at Tier1s, 20% sub-contracted to Tier2sP Only 60% of 2012 data available for Winter 2013

conferencesm Tape:

o Removed NOW all output of 2012 prompt reconstructionP Needed for restripping

d No new analyses until reprocessing completedo Reduce all archives (data preservation) to one copy

m Disk:o Aggressive reduction of 2012 prompt DST/MDST

copiesP In parallel with appearance of reprocessed data

o New distribution policy taking into account unused pledgeP In practice, replicas of reprocessed data will go only to

CERN, RAL, CNAF, GRIDKA

5

Storage: forecast for March 2013

m Disk OK but big imbalance between sites (next slide)

m Serious shortfall in tape, no solution yeto Already cleaned up all 2012 prompt SDST to fit in

existing tapeo No room at Tier1s for second copy of new RAW, and for

ONLY copy of FULL.DST

6

Resources imbalancem Evolution of disk pledges at Tier1s

m Changes balance of resources among siteso Preferentially clean old data from sites below shareo Available space used as weight for placing replicas of

new datam E.g. 2012+2011 reprocessed data distribution will

be:

m Consequence: analysis of 2011 and 2012 reprocessed data will not use all Tier1s according to their CPU share

7

2013-2014

m Activities during 2013-2014o Several restrippings, ~every 6 months

P ~ neutral in disk usage since older strippings get replaced

P moderate increase in tape (archive copy)o Full reprocessing of 2011-2012 data, during 2014

P Ultimate reprocessing of this datasetP Duration stretched to fit within existing CPU resourcesP ~neutral on tape (FULL.DST replaces previous version)

o Continuing MonteCarlo production at constant rateP Higher rate than previous estimates to match increased

real data sampled But no increase in Tier2 CPU request, use HLT farm instead

P Linear increase in disk and tape

8

2013-2014 requests (LHCb-PUB-2012-014)

m N.B. 2012 column is what is needed to complete processing of 2012 data, after all possible mitigations

9

Resources after LS1

m Date of startup for physics, and number of physics days in 2015

P LHCb nominal luminosity reached rather quickly (lumi levelling). Assume:d One month data-taking in 2014, at 2012 HLT data rate

(Insignificant impact on resources, included in previous tables)d 5*106 seconds in 2015, at nominal data rates (see below)

m Changes in data-taking rate (not precisely predictable yet)

P Average multiplicity of pp collisionsd Higher than at 8 TeV

P Effect of pileup on RAW sized If 25ns bunch spacing, lower multiple interaction rate but greater

spillover from out of time eventsP Operating luminosity at LHCb IP

d Considering 50% higher than in 2012, may lead to higher HLT rateP HLT bandwidth allocation to different physics channels

d To be studied during LS1, may lead to significant changes in ratem Assume all above lead to doubling of data rate (MB/s)

from HLTP Currently limited by DAQ to 700 MB/sP Doubles also all derived (reconstruction, stripping) data

formatsP CPU time scaled with data volume

10

First estimate of resources in 2015(LHCb-PUB-2012-015)