Muon Operations Summary

Muon Operations Summary

Outline• Summary from Operations Session

– Shutdown Activities– CSC, MDT, RPC, TGC– MDT EE Side C

• Readiness for 2012– First Running– Data taking– Plans

• Manpower• Shift Organization

A. Polini(on behalf of the Muon Group)

CSC

TGCMDT

RPC

Many thanks to all who provided material and information

CSC Operation

New ROD firmware V08-00-00● Removal of status words● Time window● Two-sample readout● ROD register checks

Fixed broken fiber couplerChannel status

Michael Schernau0 Slide 1

CSC

Removal of status wordsOld release V070603

} expected data volume

} expected data volume

37% busy at 75kHz

New Release V080000 ~5% busy at 75kHz Removed status words

for error-free events No impact on physics

or debugging

03/19/12 Slide 2

CSC

Two sample readoutNew option to read only2 instead of 4 samplesReduces clusters from~10 words to ~6 wordsData volume reduction

} expected data volume 3.6 kB--> 2.0 kB 5.7 kB--> 3.5 kBReduces busy 4% --> 1.5% 8% --> 3.2%

03/19/12 Slide 3

CSC

Four- and two-sample readoutFour sample readout Resolution 90 microns 80% unspoiled hits Timing-independent

amplitudes

2011 Z --> mu mu data Two sample readout Resolution 98 microns 83% unspoiled hits

- Due to slightly smalleramplitudes

No more time info

03/19/12 Slide 4

CSC

Smaller readout time windowCurrent time window is ~140 ns wideOptional new time window of 75 ns width Reduces hits from previous and next bunch crossing Reduces hits from early beam halo Expected benefit: 30% reduction in data volume Requires the installation of fiber extensions to

equalize timing The window can be moved in 25 ns time intervals

- If not properly aligned, efficiency losses for early orlate hits can occurrInitial tests show that the execution time increases

busy by 0.5 % which would reduce the gain fromdata volume

03/19/12 Slide 5

CSC

Deadtime versus L1 rate after busyATLAS-wide test, but no occupancy in other detectorsSimulate L=7e33, two-samples, 75ns time window

03/19/12 Slide 6

CSC

ROD register monitoringInternal registers of the ROD are read● During configuration

● Before start of run● At end of run

Checked against expected valuesErrors are sent to MRS and log filesTransfers took too long● Commands were serviced every 0.5 seconds

●14 commands took 7 secondsOne register had a link-lock related flag set● This flag is always set and is now ignored

03/19/12 Slide 7

CSC

Fixed broken fiber couplerConsistent link lossduring HI runUnlocked fiber producesrandom dataHigh occupancy in sectorA05 layer 1 and 2Fixed by replacing thefiber connector of thecontrol fiber at the patchpanel

03/19/12 Slide 8

CSC

Detector statusUnchanged from lastyear3 layers without HV32 groups of 12 channelswith bit errors96.4% OK

03/19/12 Slide 9SideASideC

CSC

SummaryRemoval of status words

37% 5%, no impact on physicsTwo sample readout 5% ~3%, resolution worse by 8 microns, loss of

timing informationEven almost empty events give ~1% busy at 75kHz 2-4% busy will be unavoidable

Busy decreases when L decreases during run96.4% of all channels are OKReady for 2012 data taking

03/19/12 Slide 10

CSC

MDT Pit ActivitiesBing Li

Univ. of Science & Tech. of ChinaInstitute of Physics, Academia Sinica

On Behalf of MDT Group

Muon Week MeetingMarch 19th, 2012

MDT

MDT Installation and Maintenance• EE chamber installation, services and commissioning

Installation by CERN team; Chamber survey and Alignment service Gas Services

Cable Services, HV/LV and readout mapping Commissioning

• Gas Maintenance Zeolith gas filter replacement (Joerg + MPI Technicians) Gas leak test and measurement (Joerg)• EO Gas Leak Repair (Anatoli + UM + USTC personals)

• MDT Chamber Maintenance Repair damaged chambers during shutdown activities;

Replacing front-end electronics to fix issues on readout; Resolving B-field, temperature and voltage sensor problems;

• Power Suppliers (George, Stephanie …, detail see Preema Talk)2

MDT

EE Chamber Installation,Services and Commissioning

3

MDT

Manpower for Services

=> InstallationCERN team, Giancarlo Spigo etc.

=> GasJoerg Dubbert, Jianbei Liu

=> Cable Service installation at pitClaudio Ferretti, Zhen Yan, Anatoli Kozhin, Lulu Liu, Bing Li,

Tiesheng Dai=> Alignment

Christoph Amelung, Laurel Coffey, Benjamin Wiener,Andrei Dushkin, Jim Bensinger, Kevan Hashemi and

Survey team from CERN=> Technicians

Dmitri Kharchenko, Konstantin Levterov, Nikolay Kusnetso

4

MDT

Manpower for Commissioning

=> Detector Operation and Commissioning from P1 ControlRoom

Jacob Groth-Jensen, Silvia Franchino, Rosemarie Aben,Alan W Wilson, Yusheng Wu, Laura La Rotonda, Lulu Liu, Zhen YanTiesheng Dai, Georgios Iakovidis, Konstantinos Ntekas, Konstantinos

Karakostas, Stefanos Leontsinis=> Supports

ELMB and MROD: Robert Hart, Henk Boterenbrood, GerjanBobbinkLV/HV/DCS Control: Stephanie Zimmermann, Georgios Iakovidis,

Konstantinos Ntekas, Konstantinos Karakostas, Stefanos LeontsinisTDAQ: Enrico Pasqualucci, Preema Rennee Pais

GNAM: Gaudio GabriellaGNAMON: Philipp Fleischmann

Others: Devin Harpe (MDT Config. DB), Hugh Skottowe5

MDT

Few unexpected issues for EE Installation at Beginning- C07 alignment bar too long

- EEL mounted in moving rack wrongly, ML1 was facing out instead ofML2, resolved

- EELC11 could not installed since crane was blocked by endcap toriodmagnet, resolved

First Installed EEchamber: EEL1C09on Jan. 6th, 2012

6

MDT

Commissioning Goals• Functional alignment system and consistent results with survey, and

adjust chamber to final position (Christoph)• No gas leak (Joerg and Jianbei)

• CANBUS and DCS functional• Front-end electronics hold LV and make sure JTAG initialization works.• Continues monitor B-field, Temperature and Voltage Sensors to ensure

reasonable readout• Chamber hold HV 3080V with low dark current

• Right mapping for LV, HV and readout• No unexpected noise

• No unexpected dead tube/channel• Reasonable ADC (peaked around 100ns) and flat TDC distributions)

Noise rate of alltube/channel, allbelow 5KHz atthreshold of -50mV

8

Noise rate of all tube/channel, all below 5KHz at threshold of -50mV

MDT

Alignment• Route and Connect Alignment cables

• Survey sector• Readout alignment sensor data followed by analysis• Adjust chamber(s) if necessary (typically by few cm)

• Readout alignment to verify• After fixing issues on 3 alignment sensors, all of them

works now;• Need to cut access platforms for EES to link different EE

sectors since they block optical path where most of themalready done;• Still need to install optical sensors for sector C05 and

replacing cable during next technical stop .

9

MDT

EE alignment system works, still working on analysis to get a full picture ofEE alignment, details see Wed. Christoph talk on Endcap Muon Alignment.

Just show one example:Adjusted EEL-C Position

10

MDT

EE Gas Services• Put gas connector on gas pipe and install extension pipe if

necessary before EE chamber/sector installation;• Check chamber pressure and depressurize it after

installation;• Wait till final chamber adjustment done;

• Connect to gas system• Check the gas leak (~1 day)

• Gas flush at 2 bar for about 1 day• Pressurize to 3 bar

No major leak, all of them less than few mbar (limited bymeasurement precision), except of EES1C08 ML2

~20mbar per day11

MDT

EE Cable Service Sequence• Install HV splitter boxes for EEL chambers

• Install and connect the safety grounding cables from chamberto general copper grounding line

• Route DCS cables to EE chambers and connect tocorresponding MDT-DCS box (MDM)

• Route LV and HV cables to EE chambers and connect tocorresponding CSM and chamber multilayer

• Install and route readout fibers from fanout box to EEchambers and connect to corresponding CSM and fiber fanout

channel, where the fiber fanout box on sector 9 need to beinstalled

Turn on both ELMB and CSM LV to check DCS fully functionaland no problem in JTAG initialzation

13

MDT

B-field Sensor Measurements

B-field : 0.5 to 1.5GTemperature:

around 21.5~23 ℃

All fine

14

MDT

Chamber Temperature Measurements

Example: EES1C06All 8 temperaturesensors have goodmeasurements.

Similar for otherchambers, all works

15

MDT

Front-end Electronics T & V Sensors

Example: EEL1C09All V measurementsas expected, and alltemperature value

are reasonable

All chambers are OK

16

MDT

LV and HV MappingLV Mapping:

Turn on sector by sector following the cable service ensure rightLV mapping both in LV cable connection and DCS control

HV Mapping with 2 steps:1) Measure HV line by line (i.e., ML by ML) with 30V at chamber end

to ensure right HV connection;2) Collect data by turning on only 1 ML and check ADC distributions

which ensure right mapping in DAQ and monitor

Charge Distribution: Charge Distribution:Cosmic Hits on ML2 No Cosmic Hits on ML1

(HV only on ML2)

17

MDT

Fixed EE Hardware ProblemsEven though EE chambers have been fully tested,

See Lulu’s talk https://indico.cern.ch/conferenceDisplay.py?confId=162647still one has to:

• Replace C09 fiber fanout due to one bad TTCchannel;

• Replace one broken fiber from fiber fanout box toMDT chamber

• Replace CSM card for EES2C12 (twice) and EES1C10• Replace mezz card 4 for EES2C12 to fix unexpecteddead tubes due to loose connector

• Disconnect EES1C10 ML2-2-22 from HV20

MDT

EEL A03 Installation and ServiceOnly giving half day for service works

• EEL A03 installation done around noon of Feb. 21,2012;

• A03 survey and alignment services done afternoon• Obtain initial alignment results early evening

• Gas services finished at night• Cable services finished at night

• DCS, JTAG and readout fully functional at same day• Final alignment, gas and HV were fullycommissioned on Feb. 22 before 14:00

We did it 21

MDT

Check All Install EE side A fibersGOL TTC GOL TTC

EEL1A01 -25.01 -24.85 EEL2A09 -25.38 -24.74

EEL2A01 -25.09 -24.89 EES1A10 -25.38 -24.89

EES1A02 -25.34 -25.38 EES2A10 -25.69 -24.85

EES2A02 -25.64 -24.97 EES1A12 -25.25 -25.01

EEL1A03 -27.5 -24.93 EES1A12 -25.51 -25.42

EEL2A03 -25.46 -24.89 EES1A14 -26.02 -24.97

EEL1A07 -25.51 -25.09 EES2A14 -25.69 -25.21

EEL2A07 -25.74 -25.05 EEL1A15 -25.6 -24.85

EES1A08 -25.51 -24.93 EEL2A15 -25.33 -24.78

EES2A08 -25.55 -25.05 EES1A16 -25.55 -24.38

EEL1A09 -25.64 -24.66 EES2A16 -25.38 -24.35

All fine22

MDT

MDT Maintenance•~30 problems were investigated from gas leak, HV trip to various sensor

issues;• Fixed 2 gas leaks;• Fixed 3 HV trips;• Replace 1 ELMB;• Replace 5 CSMs;

• Replaced ~10 mezzanine cards;• Replaced 1 B-field sensor;

• Two broken mezzanine cables (someone stepped on them!), one fixedand one still need to be done properly;

• Touch/push/reconnect mezzanine cables.

1. Most mother boards are EU-MB-04-21-xxxx except two cases with EU-MB-04-20-xxxx2. At least 4 cases, mezzanine card got JTAG problem where downstream mezzanine

will be killed if troubled mezzanine is included.27

MDT

Conclusion

• EE chambers of full side C and A03 were installed andcommissioned in short period;

• New installed EE chambers are gas tight, low noise, fullyfunctional and integrated into Muon/ATLAS TDAQ, all B-fieldand Temperature sensors work well;

• A major effort is done to fix EO gas leak;• MDT maintenance are performed and many problems are

fixed.

28

MDTMDT

A. Polini 32Muon Week March 2012

MDT

• EE integration• DCS/TDAQ• Services Gas• Manpower


MDT


MDT

A. Polini 35

Summary (MDT Operations)

• New EE chambers included in DCS, TDAQ configurations

• Many DCS updates completed during shutdown

• TDAQ migration to v-04-00-01 went smoothly, only a few minor issues to be fixed with MDT DAQ

• Manpower for DCS and TDAQ (on-call experts) is sufficient for now, but replacements may be needed by the end of the year - training is needed for new people

Muon Week March 2012

MDT

TGC

TGC

TGC

TGC

TGC

TGC

TGC

RPC

RPC

A. Polini, S. Zimmermann 45Muon Week Nov. 2011

RPC

RPC

RPC

RPC

RPC

RPC

RPC

RPC

RPC

A. Polini 54

Muon Class 1 and 2 Tasks

Muon Week March 2012

Class 1 Control Room Muon ShiftsFollowing Steering and IB discussions in November:• max 3 people per institute doing at 12 shifts in 3 months• we got ~ 110 names from ~ 50 institutes• Some groups (in particular those who didn’t have a chance of shifts in 2010 could

book a week in advance)

2012 Status:• Few hours after opening the booking all shifts filled• Several groups had no chance to get shifts• No easy solution available

– Indeed not enough class 1 shifts available within Muons– ATLAS is always missing Shift Leaders, Run Control, SLIMOS, Trigger etc.

Future options:• Reduce the institution quota• Adjust the institute shift quota/credits according to the size of the participating group

One idea I personally liked from yesterday’s IB:• Shadow shifts (with partial OTP credit) especially targeted to get young people

involved in detector operations

Class 2 shifts (Muon Experts)

Status:• Situation of experts partially static (few more experts in MDT

community)• OTP class 2 shifts reduced w.r.t. 2011• MDT/CSC/TGC moved to primary, secondary on call shifts

where secondary on calls are credited 50% of the tasks

Future:Long term situation uncertain. Several expert on call tasks are (still) covered by very few (2-4) individuals all year round, which might not work after 2012

Operations: LHC Schedule

Day LHC Tentative Planning:

1 injection & closed orbit

3 : ramp & squeeze probe

5 : injection of nominal bunch at ref orbit (flat).

7 start collimation setup at 450 GeV.

8 aperture at 450 GeV.

12 : setup first collisions

14 ramp & squeeze with nominal bunch.

16 : start collimation setup at 4 TeV

20 : multi-bunch injection

23 first stable beams 3x3.

Operations: Readiness

• TDAQ and DCS infrastructure– Udate and consolidations during the shutdown– Effort in consolidation of Stopless Recovery/

Partition restart, improved DQ, Automatic Actions• Running:

– Occasional hiccups but already getting more stable– Muons took already useful data (Alignment Cosmic

Run, Beam splashes• First stable collision expected on Easter

Conclusions• New EE Side C installed and well integrated in the Muon MDT

system)

• All subdetectors put a huge effort during the shutdown for detector and infrastructure consolidation

• All Muon System are showing both in combined and standalone running a good level of stability and readiness w.r.t. data taking

• The RPC Gas inlets are still a long standing problem which might impact on the trigger performance. Most of this effect can be recovered in short term. Detailed intervention plan for the April technical stop is under preparation while a major effort to put in safe conditions the gas system during the next long shutdown is under study.

• Manpower: Missing experts and loss of expertise is likely still under control for 2012 but might becoming a real issue for the future


Many thanks Stephanie for all work, dedication and guidance !!!Good luck as New Atlas Run Coordinator

Documents

Muon Operations Summary