JCOP Workshop, June 5th 2002, H.J.Burckhart 1

ATLASDCS

ATLAS DCSATLAS DCS

Scope & ContextScope & ContextArchitectureArchitectureConnection to DAQConnection to DAQFrontFront--End: ELMBEnd: ELMBFull Vertical SliceFull Vertical SliceFuture work and JCOPFuture work and JCOP

JCOP Workshop, June 5th 2002, H.J.Burckhart 2

ATLASDCS

Scope of DCSScope of DCS

IncludedIncludedSupervision and operation of all subdetector hardwareSupervision of common experimental infrastructureConnection to the CERN infrastructure servicesInteraction with the LHC accelerator

ExcludedExcludedGlobal safety (subdetectors have internal interlocks)Any contact with physics data (“events”)

data quality monitoring data flow control

JCOP Workshop, June 5th 2002, H.J.Burckhart 3

ATLASDCS Organization of ATLAS DCSOrganization of ATLAS DCS

ATLAS Detector

Inner Detector

Pixel

Disks Cylinders

Si Strips

EC Barrel ECTRT LAr

EMCHCBarrel EC FW

TileCal

Barrel Ext Barrel

Muons CommonInfrastructure

Gas Detector

EC Barrel EC

HT Laser Cs S. CSC MDT RPCTGC

Frontend boardsCoolingPower SuppliesTemp.

Rad Env.CoolingLV & HV

MixingPurifiying

CoolingHV & LVGas CtrlGas dist.Temp

Power SuppliesCryoPurityTemp.Position, Strain

Gas sysTempMagnetic fieldAlignmentLV & HV

RacksCratesCoolingEnv.

DAQ CERN LHC

Op .Param

Bckgnd Luminosity BeamDump

InjectionInhibit

Information SystemMessage Report SystemRun Ctrl, DB

AcessCtrl

Electr.Distrib.

CoolingVentilation

SafetyCryo CtrlRoom

External Systems

Detector

Magnet

BT SolenoidET

JCOP Workshop, June 5th 2002, H.J.Burckhart 4

ATLASDCS

DCS ArchitectureDCS ArchitectureSC

X1

USA

15Front-End System

Back-End System

Local Area Network

Partition 3Supervisory

only Partition m

UX

15

Partition 2

Common Infrastructure

Local Control Stations (LCS)

Partition 1

Expert Workstations

ServerOperation

Subdetector 1 Subdetector 2a Subdetector n

DetectorSub-system

SensorsActuators

Fieldbus 200m≈

ELMBElectronicRack

ELMBELMB

ELMB

Rack PC

Power Supply

CoolingInterlock

Box

Test

Rack PC

ELMB

Alarms

CFS

HVBarrel

JCOP Workshop, June 5th 2002, H.J.Burckhart 5

ATLASDCS

DCS StructureDCS Structure

BackBack--End (2 layers)End (2 layers)Supervisory Controls (Control Room)Subsystem Controls (Local Control Station LCS)

FrontFront--EndEndCommercial equipment (e.g. HV, LV, VME, PLC)Subdetector specific systems (e.g. alignment) with standard interfaces like CANbus, OPC, VME General purpose Embedded Local Monitor Board ELMB

JCOP Workshop, June 5th 2002, H.J.Burckhart 6

ATLASDCS

Relation DCS <==> DAQRelation DCS <==> DAQ

Operational independence from DAQOperational independence from DAQSeparate data paths for DAQ and DCSSeparate data paths for DAQ and DCSConnection DCS <==> DAC via dedicated Connection DCS <==> DAC via dedicated interface DCSinterface DCS--DAQDAQ--Connection DDC:Connection DDC:

bi-directional ‘data’ (volatile, information) exchange‘messages’ (occurrences, state changes) DCS => DAQcommands with feedback DAQ => DCS

Via the DAQ Online Software Components DCS Via the DAQ Online Software Components DCS gains access to the ATLAS SW environmentgains access to the ATLAS SW environment

configuration data baseconditions data base

JCOP Workshop, June 5th 2002, H.J.Burckhart 7

ATLASDCS

Operation of ATLASOperation of ATLAS

During DAQ runDuring DAQ runby TDAQ run control

Outside DAQ runOutside DAQ runcentrally by shift operator from DCS consolelocally by equipment expert from LCS

Booking scheme for subBooking scheme for sub--systems to switch systems to switch between these 3 modes of operationbetween these 3 modes of operation

JCOP Workshop, June 5th 2002, H.J.Burckhart 8

ATLASDCS

Functions of FrontFunctions of Front--EndEnd

SCADACAN

SPII/O function

eg. ADC DAC digital I/O JTAG I2C

eg. multiplexers sensor current R-network

Signal adaptation

Signals andSensors

eg. Voltage Current Temperature Pressure B-Field

EquipmentHardwareInterlocks

≤ 30 m

≤ 500 m

≤ 2 m ?

u-Processoreg. CAN protocol CAN open I/O processing

overall1.cdr

JCOP Workshop, June 5th 2002, H.J.Burckhart 9

ATLASDCS

Reasons for ELMBReasons for ELMB

Experience from LEP: flexible I/O system Experience from LEP: flexible I/O system neededneededHomogenous solution for all of ATLAS Homogenous solution for all of ATLAS (LHC experiments?)(LHC experiments?)

save development effortease integrationreduce maintenance effort

No commercial solution exists for usage in No commercial solution exists for usage in caverncavern

radiation tolerancemagnetic field

CostCost (very large number of channels)

JCOP Workshop, June 5th 2002, H.J.Burckhart 10

ATLASDCS

Features of ELMBFeatures of ELMB

Flexible I/O functions Flexible I/O functions multiplexed ADC, 16 bit, 64 channels with signal adaptation8 input, 8 output and 8 definable I/O ports SPI buslow power consumption, opto-isolatedadd-ons: DAC, 12 bit, 16-64 channels; interlock facility

Radiation Radiation toleranttolerant for usage in cavern outside of for usage in cavern outside of the calorimeterthe calorimeter

0.5 Gy and 3*1010 neutrons per year

Operation in field of 1.5 TeslaOperation in field of 1.5 TeslaRemote diagnostics, loading of SW, SEE Remote diagnostics, loading of SW, SEE detection and recoverydetection and recoveryLow cost (order of 100$ US)Low cost (order of 100$ US)

JCOP Workshop, June 5th 2002, H.J.Burckhart 11

ATLASDCS

ELMB (digital side)ELMB (digital side)

50mm

67 mm

JCOP Workshop, June 5th 2002, H.J.Burckhart 12

ATLASDCS

ELMB Motherboard ELMB Motherboard (connector side)(connector side)

JCOP Workshop, June 5th 2002, H.J.Burckhart 13

ATLASDCS

ELMB on MotherboardELMB on Motherboard

AdaptersELMB

JCOP Workshop, June 5th 2002, H.J.Burckhart 14

ATLASDCS

Signal AdaptersSignal Adapters

Further adapters:• resistive sensor 2-wire • differential attenuator• single-ended attenuator• active adapters (Vref available)• special purpose

4-wire PT100 adapter :

JCOP Workshop, June 5th 2002, H.J.Burckhart 15

ATLASDCS

Resolution and stability of Resolution and stability of ELMBELMB

ELMB 25 mV (Testbox)

21.117

21.118

21.119

21.120

0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000

Time (s)

AD

C re

adin

gs (m

V)

1 V1uV

JCOP Workshop, June 5th 2002, H.J.Burckhart 16

ATLASDCS

Radiation Tolerance (TID)Radiation Tolerance (TID)

JCOP Workshop, June 5th 2002, H.J.Burckhart 17

ATLASDCS

Status ELMBStatus ELMB

300 pieces produced (in collab. CERN 300 pieces produced (in collab. CERN electronics pool), in use by subdetectorselectronics pool), in use by subdetectorsRadiation qualification doneRadiation qualification doneNew revision finishedNew revision finished

new processor of same familysimplify softwarereduce costincrease radiation tolerance

LongLong--term test onterm test on--going with radiation at going with radiation at CERN TCC2 with automatic SEE recoveryCERN TCC2 with automatic SEE recoveryProduce 500 pieces by October 2002Produce 500 pieces by October 2002Mass production in 2003 Mass production in 2003

JCOP Workshop, June 5th 2002, H.J.Burckhart 18

ATLASDCS

DCS ArchitectureDCS ArchitectureSC

X1

USA

15Front-End System

Back-End System

Local Area Network

Partition 3Supervisory

only Partition m

UX

15

Partition 2

Common Infrastructure

Local Control Stations (LCS)

Partition 1

Expert Workstations

ServerOperation

Subdetector 1 Subdetector 2a Subdetector n

DetectorSub-system

SensorsActuators

Fieldbus 200m≈

ELMBElectronicRack

ELMBELMB

ELMB

Rack PC

Power Supply

CoolingInterlock

Box

Test

Rack PC

ELMB

Alarms

CFS

HVBarrel

JCOP Workshop, June 5th 2002, H.J.Burckhart 19

ATLASDCS

Full Vertical Slice Full Vertical Slice

JCOP Workshop, June 5th 2002, H.J.Burckhart 20

ATLASDCS

CAN Message TimingCAN Message Timing• 16 x 8 = 128 digital input lines (Sync + Async), 16 x 2 x 8 = 256 digital output lines (Async)• Input and output lines interconnected• 16 x 64 = 1024 Analogue channels (Sync)

t

SYN

C_1

ELM

B_3

0

ELM

B_3

1

ELM

B_3

F

δ

ELM

B_3

0_0

ELM

B_3

1_0

δδ

ELM

B_3

F_0

SYN

C_2

ELM

B_3

0

SYNC Interval

...

...

ELM

B_3

0_1

ELM

B_3

1_1

δ...

∆

Digital Signals(Higher Priority)

Analogue Channels(Lower Priority)

ELM

B_3

F_1

ELM

B_3

F_63

Bus Cycle

...

JCOP Workshop, June 5th 2002, H.J.Burckhart 21

ATLASDCS

ReadRead--out Performanceout Performance

Sync Interval vs νadc for 16 ELMBs @ 125 kbit/sec

0

5

10

15

20

25

30

35

40

0 5 10 15 20 25 30 35

νadc (Hz)

SYN

C In

terv

al (s

)

SYNC IntervalBus Period

Time diff Bus Period - SYNC Interval (s)

JCOP Workshop, June 5th 2002, H.J.Burckhart 22

ATLASDCS

ResultsResults

Realistic CAN branch successfully operated Realistic CAN branch successfully operated 200m long (powering, data transmission)16 ELMB: 1024 analogue and 384 digital channelsIn worst case load situation: 4 sec read-out time

ExperienceExperienceCAN network operationCAN card limitingPVSS archiving (!)Load distribution in readout chain

ELMB to send data on change Conversion to physical units

JCOP Workshop, June 5th 2002, H.J.Burckhart 23

ATLASDCS

Work in progressWork in progress

Port OPC to new CAN cardPort OPC to new CAN cardAttribute functions to elements in readAttribute functions to elements in read--out chainout chainSeveral CAN buses per PCSeveral CAN buses per PCAutomation of CAN network managementAutomation of CAN network managementLong term operation in radiation with SEE Long term operation in radiation with SEE recoveryrecoveryIntegration of ELMB SCADA SW into JCOP Integration of ELMB SCADA SW into JCOP FrameworkFramework

JCOP Workshop, June 5th 2002, H.J.Burckhart 24

ATLASDCS

Future WorkFuture Work

FrontFront--EndEndDefinition of final CAN topologyELMB production and calibrationEnhancement of ELMB functionality

BackBack--EndEndHierarchical organization of subdetectorsInterplay with DAQ (e.g. partitioning, calibration)Connection DCS <==> Detector Safety System (DSS)

Optimization of work load distribution over Optimization of work load distribution over the whole readthe whole read--out chainout chainUsage of JCOP Framework toolsUsage of JCOP Framework tools

JCOP Workshop, June 5th 2002, H.J.Burckhart 25

ATLASDCS

Request to JCOPRequest to JCOP

Continue PVSS supportContinue PVSS supportGeneral user supportCoordinate enhancement request to ETMProvide LHC experiment specific features within the Framework

Develop FrameworkDevelop FrameworkTools for handling a big number of channels in PVSS

configurationoperation (e.g. alarming, masking)

Tools for data handlingaccess to historical dataexport data to conditions DBinterface to configuration DB

User training

JCOP Workshop, June 5th 2002, H.J.Burckhart 26

ATLASDCS

Request to JCOP (cont.)Request to JCOP (cont.)

Connection of FrontConnection of Front--End equipmentEnd equipmentHTLTVMEPLC

Data Interchange ProtocolData Interchange ProtocolProvide toolApplication for exchange of data with LHC acceleratorApplication for interaction with CERN services

Develop DSSDevelop DSS