RPC Detector ReviewHardware Status and New Technical Procedures

CMS RPC EQUIPMENT Detector and Service EQUIPMNET Known Problems Procedures

DETECTOR AND SERVICE EQUIPMENTBARRELENDCAPTRIGGERSPAREUXCSpareUSCSpareUXCUSCSpareUXCUSCTriggerEndcapBarrel EQUIPMENT ALREADY UPLOADED in EMDb EQUIPMENT TO BE UPLOADED in EMDb till end of June 2010

KNOWN PROBLEMSChambers in SGSlow ControlMasked RollsThreshold ControlTPH SensorsPROBLEMS by TYPEPROBLEMS by SEVERITY1) Problems for long shutdown/CMS opening2) Problems for NEXT UXC ACCESS3) Reappearing Problems

Technical ProceduresHow to deal with a new equipment problems? How to create a work package when access is announced?How to replace equipment in UXC?How to replace equipment in USC?

How to deal with an equipment problemOperation ManagerP5 SHIFTERRPC Equipment ManagerHARDWAREEXPERTelogSavannahSavannahAutomatic mailAutomatic mailSavannah

ACCESSCMS RC&TC, GLIMOS SLIMOS, RFM, CSLSubdetector RFM (Operation Managers)WPEMDB System ExpertsEMDB ManagerRPTechnical shifterBUFFER ZONEEMDB EQUIPMENTUXCAnnounceAccessRP SweepAccess OpenAuthorizeRequest/ModifyRequest/ModifyOpen/CloseOpen/CloseControlGive Access/KeyChange Data (Full System Rights)Supervise (Full Rights)OperationalSpareOperationalDefectiveCheck EquipmentRepairStill DefectiveTestedWasteBrokenTake after RP checkUse WP name to check in equipment

Work Package List

Work Packages by system

BARREL HV INTERVENTIONS

Barrel HV System: Summary by Components II Trimester

Barrel HV System Status II trimesterBroken Y in Distributor Boxes: 6/480; ~ 1.2% (0.6%*)Broken long black cables (USC UXC): 11 (7*)Spare black cables used 17/480; ~ 3.5% (2.7%*)473** RPC in DG mode 473/480; ~ 98.54% (98.75%*)5 RPC in SG mode 10/1020; ~ 1% (1%*)1 RPC totally dead 1/480; ~ 0.21% (0.21%*)N.B. * => Barrel HV system status for I trimester 2010** => 1 RPC OFF due to LV problem (next slide)

Barrel Low Voltage/Slow Control Status II Trimester1 RPC LV OFF 479/480 ~ 0.21% (0%*)18 RPC I2C lines (in 17 chambers) not working in the Barrel 18/800 ~ 2.25% (2.13%*)Redundant DT lines working for 8/18 ~ 44% (9/17~53%*)10/800 I2C lines in the Barrel not controlled at all ~ 1.25% (8/800 ~ 1%*) Vth or Vmon values not settable on chip basis in 4 cases in the Barrel (no change*)

Barrel Threshold Control History

RE+2/2, 3/11- Tripping: Problem localized in HV distributor so fixed it by using the spare channel. (On April08)RE-1/3/31, 32- Spikes: Problem localized in RE-1/3/31 (TOP) so disconnect this gap and run rest of three gaps. (On April08)RE-1/3/05, 06-Tripping: Localized ~ at PP so fixed it by changing the tripolar connector in UXC. (Reported on April10)RE-3/2, 3/26-Tripping - Fixed by changing connector in UXC at PP. (On April 28)RE-1/3/35, 36-Tripping Actually problem was in RE-1/2/01,02 because channels were swapped. Put back the channels at original position. Problem do not reproduce. (On April 28 RE+1/2/21, 22- Tripping During TA31052010 switch on back this channel so it start working without any intervention and it is working up to now.(Reported on May06)RE-2/2,3/11-Tripping- During TA31052010 swapped the channel with RE-2/2,3/12 both are working without any problem. (Reported on June 02).

During last 3 months total 7 (6 trpping+1spikes) HV problems were reported Saleh Muhammad NCP IslamabadEndcap HV Interventions and Status

Endcap LV Interventions and Status RE+2/2, 3/31- Tripped (LV FEB) Fixed the problem by changing the problematic module with good spare one. (On March 11).

RE-3/2, 3/25 Tripped (LV FEB) Localized the problem in the module channels. Fixed the problem by changing the module also by repairing the connector which break during changing the module . (Reported on May19)

LV modules serial no.47 which was replaced form P5 test it in bld.904 testing setup. The board did not give the problem again so put it back into system at P5 on May31.

On 1st of April the X2S32 rack (YE-1 far side, X2 level) all electronics become off due to rising the temperature of MAO at 29C and LV boards at 40C. This happen due to power failure of the turbine. But after 4 hours power came back and just switching on the MAO and boards everything start working.

Saleh Muhammad NCP Islamabad

Endcap Summary (RPC TCM) Saleh Muhammad NCP Islamabad

Systems HVLV Slow controlGas RPC TCM New pending Problem Spare cables in useDB spare ch. in use Single gap RPCsFull RPC outNew pending problemFull RPCs outTH setting ProblempendingT and RH sensor problem pending Known big leaks channelsApril26, 201030118101702May 03, 201001117101702May 10, 201010117101702May 17, 201010117101702May 23,201010117111702June 02,201000117101702June 07, 201000117101702June 14, 201000117101702

Trigger USC electronicsCAEN VME controller failed in one Trigger Crate on night 18/19 April 2010. Replaced by a spare on 19 April. It was checked that only mezzanine board with optics was damaged (most probably optical transmitter).

At the moment no other problems - 100% of the system functional!!!Karol Bukowski, CERN, UW

Trigger Link System ~10 March: one Half Box tripped during normal operation (not during power on), first we have replaced the LV module, but it did not helped, so then we have replaced all boards from that Half Box (CB, 2x MLB,4x SLB), and this helped. Test showed that:CB Actel damaged, the CB itself is OK,GOLs on both MLB damaged,SLBs are OK,RB+1 far (24 April 2010) - problems with the CCU ring:FEC mezzanine was not well attached to the CCU board.When it was corrected CCU errors appeared again. So the FEC mezzanine was swapped with other one. After that both FECs were working correctly. Possible reason: FEC and the ribbon fiber connectors not compatible???RB+2_near (31 May 2010) - the CCU errors become very frequent, ~every second (before that ring had a few CCU errors per day), The ring B for that tower was disconnected, after that no CCU errors.CCU errors appear only on one-two rings, with low rate. In most of the cases are recovered by the reset_fec automatically executed by the online software. The system is working stable - 100% of the system functionalKarol Bukowski, CERN, UW

Trigger Firmware22 April - CB firmware updated - problem with the LB firmware loading from FLASH correctedKarol Bukowski, CERN, UW 14 June2010

Trigger Online Software StatusThe Trigger Supervisor control over the full system (Link System, Trigger System, RBC/TTU) is working fine.Latest improvements:Monitoring panels in TS (the data from the XDAQs to the TS are send with use of the flash lists)Panel in the TS LBox Worker:Disabling the LBox XDAQs from the TS controlLoading the LB firmwarePresenting the LBox XDAQs statusPanel in the TS Cell:disabling the TC XDAQs from the TS controlPresenting the TC XDAQs statusAlarms in the HOTSOPTGUI for disabling the Sorter Crate inputs (in case of the Trigger Crate malfunction)To do next:Better management of the configuration data (different local config keys for different parts of the system),FEB configuration from the DBStoring monitoring data in the condition databaseKarol Bukowski, CERN, UW

Ian Crotty 14 June 2010

RPC Cooling

Two main changes have occurred this yearRegulation Valve change on the Endcap cooling circuitWeek 17 2010

The changes of set Point and regulation Parameters sinceWeek 20 2010

Continuing ConcernsLow contingencyTemps still high in EndcapsTemp gradients along Z in RE

Ian Crotty 14 June 2010

RB Temperature Log since April 2010

Ian Crotty 14 June 2010

RE Temperature Log since April 2010

Ian Crotty 14 June 2010

Endcap Circuit Set-point Changed to 16.5C

Ian Crotty 14 June 2010

X2 Power Cut & New Set-point Change

Ian Crotty 14 June 2010

RPC Temperature Distributions +Z-ZRB020.33C19.90C19.79C20.25C20.25C18.67C19.41C20.83C21.33C20.32C21.92C0.5C0.8C0.6C0.7C0.8C0.75CGains since April 2010

Gas StatusNew gas leak in WP2_S05_RB2 notified to CERN gas group. W0 readout board replaced (middle of March). No effect on RPC operationWarning due to purifiers fixed.New Flow cell threshold settings for warnings and alarms uploaded into DB. This did not solve the sporadic warnings due to spikes on cells readout. For this is needed a new approach in the warning treatment to be implemented into RPC-DCS. Discussion on this is ongoing with G.Polese. L. Benussi

Gas Flow cell Reading fluctuationsL. Benussi

ConclusionsPartitions that cannot be threshold controlled are increasing in time, leading to the dilemma noise vs. masking!Apart from that Detector Performance is stable!For better Detector performance threshold refinement is required => DB is highly needed!Temperatures in Endcap still higher than 20C, but decreasing after the change of coolant set-point. Signals of after pulsing raised again the question of individual chamber HV working point definition.Still lot of effort to be put in order to update all the instructions!