W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 1 The CMS Regional Calorimeter Trigger Electronics Integration W. H

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 1

The CMS Regional Calorimeter The CMS Regional Calorimeter Trigger Electronics IntegrationTrigger Electronics IntegrationThe CMS Regional Calorimeter The CMS Regional Calorimeter Trigger Electronics IntegrationTrigger Electronics Integration

W. H. Smith, S. Dasu, R. Fobes, T. Gorski, M. Grothe,M. Jaworski, P. Klabbers, J. Lackey, G. Ott, P. Robl

Physics Department, University of Wisconsin,Madison, WI, USA

IEEE 2006

November 1, 2006

The pdf file of this talk is available at:

http://www.hep.wisc.edu/wsmith/cms/doc06/wsmith_IEEE2006.pdf

See also the CMS Level 1 Trigger Home page at

http://cmsdoc.cern.ch/ftp/afscms/TRIDAS/html/level1.html


CMS in 2007CMS in 2007CMS in 2007CMS in 2007

MUON BARREL

CALORIMETERS

PixelsSilicon Microstrips210 m2 of silicon sensors9.6M channels2007: no pixels(installed during 1st shutdown)

ECAL76k scintillating PbWO4 crystals2007: no endcap ECAL (installed during 1st shutdown)

Cathode Strip Chambers (CSC)Resistive Plate Chambers (RPC)

Drift Tube Chambers (DT)

Resistive Plate Chambers (RPC)

Superconducting Coil, 4 Tesla

IRON YOKE

TRACKER

MUONENDCAPS

HCALPlastic scintillator/brasssandwich

2007:RPC || < 1.6 instead of 2.1 & 4th endcap layer missing

Level-1 Trigger Output• 2007: 50 kHz

(instead of 100)


CMS July 2006CMS July 2006CMS July 2006CMS July 2006


CMS Trigger & DAQCMS Trigger & DAQCMS Trigger & DAQCMS Trigger & DAQ

Overall Trigger & DAQ Architecture: 2 Levels:

Level-1 Trigger:

Interaction rate: 1 GHz

Bunch Crossing rate: 40 MHz

Level 1 Output: 100 kHz (50 initial)

Output to Storage: 100 Hz

Average Event Size: 1 MB

Data production 1 TB/day

thistalk


Calorimeter Trig.OverviewCalorimeter Trig.Overview(located in underground counting room)(located in underground counting room)

Calorimeter Trig.OverviewCalorimeter Trig.Overview(located in underground counting room)(located in underground counting room)

CalorimeterElectronics

Interface

RegionalCalorimeter

Trigger

ReceiverElectron Isolation

Jet/Summary

Global Cal. TriggerSorting, ET

Miss, ET

GlobalTriggerProcessor

Muon Global TriggerIso Mu MinIon Tag

Lumi-nosity Info.

4K 1.2 Gbaud serial links w/2 x (8 bits E/H/FCAL Energy+ fine grain structure bit) + 5 bits error detection codeper 25 ns crossing

US CMS HCAL:BU/FNAL/Maryland/Princeton

US CMS ECAL:Lisbon/Palaiseau

US CMS:Wisconsin

UK CMS: Imperial/Bristol

CMS:Vienna

72 x60 H/ECALTowers (.087x.087 for <2.2 & .174-.195, >2.2)HF: 2x(12 x 12 )

Copper 80 MHz Parallel4 Highest ET:Isolated & non-isol. e/Central, forward, jets,Ex, Ey from each crate

MinIon & QuietTags for each 4 x 4 region


CMS Calorimeter GeometryCMS Calorimeter GeometryCMS Calorimeter GeometryCMS Calorimeter Geometry

EB, EE, HB, HE map to 18 RCT crates

Provide e/ and jet, ET triggers


Trigger MappingTrigger MappingTrigger MappingTrigger Mapping


Calorimeter Trig. AlgorithmsCalorimeter Trig. AlgorithmsCalorimeter Trig. AlgorithmsCalorimeter Trig. Algorithms

Electron (Hit Tower + Max)• 2-tower ET + Hit tower H/E• Hit tower 2x5-crystal strips >90% ET in 5x5 (Fine Grain)

Isolated Electron (3x3 Tower)• Quiet neighbors: all towerspass Fine Grain & H/E

• One group of 5 EM ET < Thr.

Jet or ET

• 12x12 trig. tower ET sliding in 4x4 steps w/central 4x4 ET > others

: isolated narrow energy deposits• Energy spread outside veto pattern sets veto

• Jet if all 9 4x4 region vetoes off


160 MHz point to point backplane, differential ECL with 0.4 Tbit/sec dataflow• Physics object selection: Isolated & Non-Isolated Electron, Tau & Jet Triggers• 18* Clock&Control, 126* Electron ID, 18* Jet/Summary Cards

• Operate at 4X LHC crossing frequency: 160 MHz • Use 5 Custom Gate-Array 160 MHz GaAs Vitesse Digital ASICs

• Phase, Adder, Boundary Scan, Electron Isolation, Sort

Regional Calorimeter Trigger CrateRegional Calorimeter Trigger CrateRegional Calorimeter Trigger CrateRegional Calorimeter Trigger Crate

Data from Calorimeter Trigger Primitive Generators on Cu links at 1.2 Gbaud to 18 Crates:

•Into 126Into 126* * rear Receiver Cardsrear Receiver Cards

*Spares not included

2 Std.VMESlots

48V DC Power

CustomPoint-to-pointDataflow on

AMP StriplineHD Conn.

VME

Designed by J. Lackey

18 X


Regional Cal. Trigger Cards IRegional Cal. Trigger Cards IRegional Cal. Trigger Cards IRegional Cal. Trigger Cards I

Provides 160 MHz and 120 MHz clocks, reset, LHC orbit signal to entire RCT crate

Signals generated on board or received from Master Clock Crate fed by CMS Trigger Timing and Control (TTC) System

Fans out signals and adjusts phase to all boards

Clock and Reset timing set with delay adjust

delay adjust

Receives 8x8 E/HCAL towers on 1.2 GB Cu Links (Vitesse 7216-1) on RMC’s

Phase ASIC: Deskew,Mux at 160MHz & provides Test Vectors for Memory Lookup TablesMemory LUT at 160 MHzAdder ASIC: 8 inputs at 160 MHz in 25 ns.

BSCAN ASIC: Synchronizes shared data & Diff. Output at 160 MHz to backplane

Reg. Sum ET’s, MIP, sent to Jet/Sum. Card

50 Tower ET’s & vetos sent to Electron ID Card

Master Clock Crate Input

Receiver(126* - 7 per crate)

Clock & Control

(18* - one per crate)

Receiver Mezzanine

Card (RMC)

Data Sharing on cables for

e/ algo

AdderASICs

*spares not included


Regional Cal. Trigger Cards IIRegional Cal. Trigger Cards IIRegional Cal. Trigger Cards IIRegional Cal. Trigger Cards II

Processes a 4x8 tower region at 160 MHzUses Sort (disabled) ASIC for backplane receive & the EISO ASIC fully implements e/ algos

LUT for ET conversion

Highest ET iso and non-iso e/ per 4x4 region sent to JSC for sorting and top 4 of each type forwarded to Global Calorimeter Trigger7 cards send candidates over backplane to Jet Summary card

•14 Isolated e/•14 Non-Iso e/

ElectronIdentification

Card (126* - 7 per crate)

Jet SummaryCard

(18* - 7 per crate)

Output to Global Calorimeter

Trigger

SortASICs

Forward Calorimeter

Input

Electron/photon/muon•Sort ASICs receive data on BP & find top iso. & non-iso.)•14 Quiet Bits by threshold on JS•14 MinIon bits from RC

•Forward Calorimeter (HF) functionality•RMC on board & LUTs for HF ET’s

•Region energies•HF and 4x4 tower sums (regions) to GCT for jets, , & calculation of global quantities total & missing ET

*spares not included

EISOASICs

one per 4x4 region}


8 Compact Receiver

MezzanineCards for

each Receiver

Card accept 4 x 20 m 1.2-Gbaud

copper pairs transmitting 2 cal. tower energies w/error detection

every 25 ns with low cost & power.

Uses Vitesse Link Chips (7216-01).

Custom Serial Link Test Card to check links

Used for integration with ECAL/HCAL,

Mezzanine Card Testing,

RC/JSC link validation

Bit Error Rate < 10-15

RCT 4 Gbaud CopperRCT 4 Gbaud CopperLink Cards & Serial Test CardLink Cards & Serial Test Card

RCT 4 Gbaud CopperRCT 4 Gbaud CopperLink Cards & Serial Test CardLink Cards & Serial Test Card


Test Card: Jet Capture CardTest Card: Jet Capture CardTest Card: Jet Capture CardTest Card: Jet Capture Card

FPGAs

Translators

DelaysCCCSignals In

SignalsOut

JSC Inputs

Receives all the data from one RCT crate:14 Reg. Sums, 8 HF ET’s, 8 e/, and and bits on 6 SCSI type cables

• Located in spare VME slot of RCT crate• Clocks, Reset, and Orbit from Clock and Control Card on low-skew cable (Kerpen MegaLine® 8)• Triggers out on programmable thresholds• Different data capture modes• Used in final validation of RCT crates• Used in integration tests with HCAL and ECAL Trigger Primitive Generators• Trigger Output to be used in Magnet Test and Cosmic Challenge Phase II for an HCAL Trigger


RCT Board ProductionRCT Board ProductionRCT Board ProductionRCT Board ProductionFull production available:

• Standard RCT Boards

• Backplanes and Crates - 28 (BP) & 26 (crates)

• Clock and Control Cards - 25

• Receiver Mezzanine Cards - 1420

• Receiver Cards - 158

• Electron Identification Cards - 154

• Jet Summary Cards - 25

• Test Cards

• Serial Test Cards - 20

• Jet Capture Cards - 10

In production• Master Clock Crate and Cards

• Clock Input Card in Revision B

• Cards for Clock Fanout in Design• Clock Fanout Card Midlevel

• Clock Fanout Card to Crates

Courtesy of Jeff Miller, University of Wisconsin, Madison


Operate fully functional trigger electronics•Use in tests & preparation activities

Tests in Electronics Integration Center• Labs & row of racks for all electronicssubsystems

• Integration row of racks identical tounderground counting room (USC55)

• Test interfaces & integration as much as possible before move to USC55

Magnet Test & Cosmic Challenge(MTCC) in Surface Hall (SX5)•Simultaneous activities withtesting 4T solenoid operation.

• Test multiple triggercomponents with multipledetector components

• Verify trigger functions &interfaces w/detectors onsurface

UndergroundCounting Room

Trigger Integration ActivitiesTrigger Integration Activitiesat CERN nowat CERN now

Trigger Integration ActivitiesTrigger Integration Activitiesat CERN nowat CERN now

USC55

ExperimentalHall

ShieldingWall (7 m)

TriggerTunnels


CMS Electronics Integration CenterCMS Electronics Integration Centerat CERNat CERN

CMS Electronics Integration CenterCMS Electronics Integration Centerat CERNat CERN

Large scale integration tests in central racks using common clocking involving trigger primitives, regional & global processing:

CMS Trigger Timing and Control System (TTC) used for common clock

HCAL

ECAL RCT Global Calo. Trigger

Global Trigger Trigger Timing and Control

DTTF

CSCTF

Global Muon Trig.


ECAL TCC

SLB:Link Boards

HCAL HTR

ECAL & HCAL Input to RCTECAL & HCAL Input to RCTIntegration TestsIntegration Tests

ECAL & HCAL Input to RCTECAL & HCAL Input to RCTIntegration TestsIntegration Tests

Both HCAL HTR (HCAL Trigger and Readout) and ECAL TCC (Trigger Concentrator Card) use a Serial Link Board (SLB) with the V2716-1 on it

• Configurable mezzanine card• Two Altera Cyclone FPGAs synchronize data

for V2716 and calculate Hamming Code

• Common Clocking w/CMS TTC system• Separate adjustment ensures data in time

between subsystems

HTR - HCAL• Receives data from Front-End on fiber• Up to 19 SLBs send Tower Energies• Used JCC

• RC created 4x4 Tower sums• Verified value and alignment• 19 HCAL-HTR cables used - all in sync

TCC - ECAL• Up to nine SLBs send Tower Energies• Front-end data received on Fiber

• Valid link established • 9 ECAL- TCC cables sent in sync to RCT

Tests run for > 10 hours error free


HCAL to RCT for Magnet Test &HCAL to RCT for Magnet Test &Cosmic Challenge (MTCC)Cosmic Challenge (MTCC)

HCAL to RCT for Magnet Test &HCAL to RCT for Magnet Test &Cosmic Challenge (MTCC)Cosmic Challenge (MTCC)

RCT inputRCT input

RCT outputRCT output

Muon system, ECAL, HCAL, & tracker: understand magnetic field & perform a “slice test” of CMS DAQ• Two Phases: Summer (I) & Fall (II) - ongoing now - 2006

Use RCT to create a trigger using HCAL MIP bits• MIP bit uses upper and lower thresholds • Installed one full RCT crate and support• Receive 56 HCAL links to all inputs (448 towers)

• Split cabling to create separate paths • HCAL top to HCAL inputs• HCAL bottom to ECAL inputs

• Send trigger out with JCC to Global Trigger System• OR of towers in each half using HCAL MIP bit

HCAL to RCTHCAL to RCT


Results from MTCCResults from MTCCResults from MTCCResults from MTCC

From Running today (Nov. 1):

Drift Tube Trigger vs. Calorimeter Trigger timein 25 ns bunch crossings (coincidence = 0 bx)


Commissioning Underground at CMSCommissioning Underground at CMSCommissioning Underground at CMSCommissioning Underground at CMS

Rack Infrastructure Installed in Underground Control Room (USC55)

• 10 racks worth of crates, fans, custom rack monitoring, power & associated cabling.

• Card installation and integration starts in November

• Large scale - 1026 links being installed/checked

Power & Temp.

Fans & Readout

Rack Monitor Card and power chassis


ConclusionsConclusionsConclusionsConclusionsFull production of CMS Regional Calorimeter Trigger boards

• Main RCT board production finished

• Test Boards STC and JCC produced to validate input and output and help with integration tests

• Master Clock Crate and cards in production

Integration in full swing• Integration performed with HCAL HTR and ECAL TCC in Electronics

Integration Facility

• Alignment verified

• Common clocking used

• Long term stability checked

• RCT is part of CMS Magnet Test and Cosmic Challenge Phase II

• Running Now

• RCT Installation during November

• Integration tests to continue underground

• Integration Facility to remain as testing, debugging, and storage area

Documents

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 1 The CMS Regional Calorimeter Trigger Electronics Integration W. H