Status of the TPS Control System

EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011

Status of the TPS Control System

Kuo-Tung Hsu

On-behalf of the TPS Control Team

NSRRC, Hsinchu, Taiwan

June 13, 2011

2EPICS 2011 Spring Meeting, Hsinchu, June 13-17, 2011

Strategic for TPS Control System Development TPS control system frameworks => EPICS toolkit.

Most successful and largest collaboration for control system project

Development strategic for new EPICS site like TPS projectWork first, then pursue work wellLearning by doingLearn from EPICS community

Focus on hardware and software of data source layer at this moment.Standardization and minimized requires resources

Middle layer and presentation layer will be focus in next step.

Co-operative development to integrated EPICS and non-EPICS systemSome subsystems controls have their special requirements and preferencesIt need time to clarify between EPIC (poem, computer form factor, …) and

EPICS (Experimental Physics and Industrial Control System) for a new comer!

Goal: Meet system integration and commissioning and machine fine tune schedule in 2013~2014 and requirements for future development.


A Chivalrous Sword-ManJia Dao (779-843 A.D.)Spend 10-year sharpening my sword,The frost-bright blade has never tested.Let me show it to you todayHave you anything unjust to say?

劍客賈島 (779-843 A.D.)

十年磨一劍，霜刃未曾試。今日把示君，誰有不平事？

Essay by Peter Norvig: Teach Yourself Programming in Ten Years

After the sword (skill) is sharpen -Hope we can contribute something to the EPICS community in future!

Our Aspiration


Phase I: Minimized type of EPICS IOCMinimized type of platform, OS and software versionsEPICS IOC Nodes

cPCI IOCs ~ 70 nodesCorrector PS control IOCs ~ 120 nodesBPM IOCs ~ 72 nodesSpecial IOCs ~ 30 nodes

Servers ~ 20 nodesControl console ~ 10 nodesBasic software for system integration, commissioning and operationBasic software development management…

Phase II :Complex and sophisticated applicationsEPICS extension…

2010 2011 2012 2013 2014 2015

Phase I Phase II

Machine Commissioning and Tuning

TPS Control System Development Phase


Consolesand

Servers

Standard cPCI EPICS IOCs- Intel CPU/Linux (fully preemptive kernel )- High volume I/O- High speed serial connection (GbE, … etc.)

Miscellaneous EPICS IOCs- Pentium/XScale/ARM/PPC Linux- Soft real-time system- RS-232/422/485 Devices- CCD camera server- PLC (safety type system)- Bunch-by-bunch feedback system interface- Special applications

cPCI EPICS IOCs

File and Name Server,Gateway, Archivers, Beam Physics Server (Modeling System), Display Ma

nagers, Database Server,Alarm Server, AP Server, Boot Serve

r, Monitoring Services,Storage Server … etc.

EPICSIOC

(Input Output

Controller) Signal

Conditioning

Miscellaneous EPICS IOCs

Safety Type System

Intranet

Beamline Network,Network Attached

EPICS Devices(e.g. EPICS Oscillosc

ope,… etc.)

PLC-IOCControl Ethernet

PrivateEthernet

Field Devices(Power Supply, Motion Controller,

LXI Instruments, …etc.)

Timing

EPICS/OPI

PC/Linux

Router

Control System Infrastructure

http://www.clker.com/clipart-3608.html


D-TacqIntel IOP + ADC

TEWS cPCI IP carrierADLINK 128 Bits DI/DI

ADLINK cPCI CPU board

CompactPCI IOC (Linux)

BI, BO, AI, AO, Timing, Network attached devices

I-Tech BPM IOC(Intel CPU, Linux)

MRF cPCI Event System Modules

D-TacqCustom Designed

Corrector Power Supply Controller IOC(~ 20 bit DAC)

D-Tacq 18 bits DAC

Power SuppliesEthernet/LXI devices

Dimtel Bunch-by-BunchFeedback and Diagnostic

IOC

Middle Layer IOC(JavaIOC ?)

Applicaion Specific

SoftIOC

Special IOC

YEC PLC IOC

Hytec 18/20/24 bitsDAC/ADC IP Modules

Oscilloscopes

MOXA Serial Server MODBUS/TCP Devices

ADLINK cPCI Crate

64 Nodes of cPCI Platforms in Test

EPICS IOC Hardware Building Blocks


Control System Computer Room to CIAs

Control and Timing fiber network

Control fiber network

To TLS Control System Computer Room

Intra-CIA fiber link

CIA #24 to Control System Computer Room and all CIAs

Control, Timing and Intra-CIA Fiber Network


CIA Switch 24 setsPulse magnet PS x 1 set

TPS Control SystemComputer Room

CIA24Network Rack

TPS Control Network Infrastructure –Baseline Design

(ready in late 2012)

~ 32 SFP+ 10 GbEdual speed ports

E3143 (TLS Control System Computer Room)

M230 (Laboratory)

10 Gigabit Fiber Links

1 Gigabit Fiber Link

NSRRCIntranet

Ethernet Switch Ethernet Switch

Ethernet Switch

Ethernet Switch

Ethernet Switch

Ethernet SwitchEthernet Switch

Ethernet Switch

Edge Switch24 GbE + 4 SFP + 2 SFP+

NTP server

Ethernet Switch

NSRRC Intranet


cPCI modules- CPU modules- 6 U cPCI EVG/EVR- 32/64/96 channel 16 bits AI 32/64 channel 24 bits AI (transient signal capture capability)- 32 channel, 18 bits AO- 128 bit DI, 128 bit DO- EVG, EVR in 6U cPCI form factor- IP carrier and IP modules 16 channel/24 bits ADC 16/8 channel 18/20 bits DAC- In house design modules

FiledbusEthernet (> 95%) Raw ASCII/LXI/VXI-11 /Modbus-TCP, ….RS-232/422-485 devices Serial device server => Ethernet… etc.

Ethernet and LXI compliant devicesPower supplyDiagnosticsElectronics instrumentsEnvironment monitoring (temperature, vibration,

pressure, …)Motion control Ethernet based motion controllerFast waveform capture

Oscilloscope and soft-IOCCamera

GigE VisionInterlock

PLC embedded EPICS IOCEthernet/LXIMiscellaneous Interface… etc.

EPICS Controls Hardware Standard


cPCI-EVRTG-300(e-Gun Trigger)

Fan-Out Concentrator

Universal I/O TTL Interlock Input ModuleUniversal I/O TTL Input UNIV-TTLIN Universal I/O TTL Output UNIV-TTLUniversal I/O TTL Output Module w/ Delay TuningUniversal I/O NIM Output UNIV-NIMUniversal I/O LVPECL Output ModuleUniversal I/O LVPECL Output Module with Delay Tuning Universal I/O HFBR-1414 Output UNIV-HFBR-1414 Universal I/O HFBR-1528 Output UNIV-HFBR-1528In-house made fanout Fanout module

cPCI-EVG-300

cPCI-EVR-300

GUN-RC-203/300

Fibre+Transceiver

Ru87

Timing System Hardware


Storage ring dipole power supply, booster dipole power supply and quadrupole power supplies were awarded to the IE Power.

Control interface is similar as CLS.

Booster dipole power supply and quadrupole power supply will build in waveform generator and/or external reference input (cPCI EPICS IOC + IP Carrier Module + Hytec 18/20 bits DAC IP module).

Storage ring quadrupole 、 sextupole power supplies and transport line dipole 、quadrupoles power supply were contracted to Chroma ATE Inc. All power supply equip with Ethernet/LXI interface with NSRRC specify control functionality.

Power Supply Control Interface


Interlock PLC IOC

EPICS IOCADLINK cPCI CPU

ADLINK 128 Bits DI/DO

TEWSTCP201

IP Carrier

Hytec IP ADC24 bits, 16 channels

IP-ADC-8417

EVR (CPCI6U-EVR-300)

Trigger Fanout

Trigger

Ramp Trigger

TPS Control Network

Hytec IP DAC18 bits, 16 channels

IP-DAC-8415

BR frev clock3 Hz

Power supplies trigger

EPICS IOCACQ164CPCI

24 bits ADC, 32 ch, GbE

SextupoleSD, SF PS

Ethernet Switch

Ethernet Interface:On/Off controlStatus readbackInterlock reset

Two Options: Analogue Reference Input (Waveform) or Embedded Waveform Generator

Booster Dipole, QF, Q1, Q2, QM PS (IE Power Inc.)

Booster Main Power Supply Control Interface


TPS Control network

CellPower Supply

Control cPCI IOC

Ethernet Switch

Quad (10), Sextupole (7)(Chroma ATE Inc.)

x 24

EPICS Access(10 Hz rate)

Orbit Feedback Setting(10 kHz rate)

CPU Module

±10 Amp Power Supplies (ITRI)

EVR (cPCI-EVR-300)

Corrector Power Supply

Controller(CPSC)

SR Slow Correctors 168 (H) +168 (V)SR Fast Correctors 96 (H) + 96 (V)

Skew Quadrupole 96BR Correctors 60 (H) + 36 (V)

EPICS IOC20 bits DAC24 bits ADC

(D-Tacq)

CLK/Trigger

Dipole PS(IE Power)

x 1

Power Supply Control in one Cell


+Slow Setting

Buffer

External Clock Input

DO (LEMO connector, for timing measurement), Trigger out, Package received

Write Registers8 bit DO

Setting Buffers

GigabitEtherne

t

Slow Trigger(on demand, may not necessary)

Heartbeat Register

Rx

FastSetting Ports (GbE, UDP/IP),Through Port

Heartbeat Register

AURORA

8 Ch, 20 bit DAC

Single Board Computer(Linux, EPICS IOC) Status Registers

8 bit DI

24 ch, 16 bit ADC

8 ch, 24 bit ADC(10 kHz Sampling)

Slow Access(~ 10 Hz)

Control and Status Registers

Ethernet Interface(Hardware UDP Stack)

96 pinDIN61412

Connectors x 2

+/- 15 V+ 5 V

4 ways,8 ch adder

~8 x 64 k x 32 bitWaveform Memory

Sequencer10 kHz clock

Waveform MemoryFree running

Or Pre/Post Trigger10 Hz rate data

Trigger (3 Hz) Precise digital temperature sensors

Individual Channel Enable/Disable?

Control and Status RegistersSlow Access (~ 10 Hz)

RxTx

FastSetting Port,

Through Port

(AURORA)

TxSFP Port

Up to 10 kHz (Fast Setting Clock)10 kHz Clock Generator

10 kHz rate waveform

Data AcquisitionTrigger input

Corrector Power Supply Controller (CPSC)SR corrector PS (fast + slow), skew quad, BR correctors


Orbit Feedback Environment within for one Cell

To Cell N-1Group 14*Magnet output

repeater

Add XBPM in IOFB or local feedback are feasible.

To Cell N+1

I-Tech SolutionGroup 8*Magnet output

CPSC for Skew quad4 (or more)

Cell’s Edge Switch

CPSC for slow horizontal corrector

7 CPSC for slow

vertical corrector7

BPM Grouping Links(2.5~3.125 Gb/s)

AURORA

AURORA

CPSC for fast horizontal and vertical corrector

4 + 4

TPS Control Network

Fast Setting GbE link


Storage ringFront-end

Beamline and Experimental StationHardwired handshake

Cell N+1 Vacuum SyustemcRIO PAC

Beamline N-1 front-endcRIO PAC

1. Vacuum and front-end: Vacuum gauge reading IP current Valves information Various status (pressure 、 temp 、 flow rate 、… )2. Limited setting functionality

CIA #N-1EPICS IOC

EPICSCA gateway

Ethernet

Accelerator Control System and Vacuum and Front-end PAC System

MachineProtection

System

Cell N Vacuum SystemcRIO PACCell N-1 Vacuum SystemcRIO PAC

Beamline N-1 Control System and Experimental Station

Front-end Status Fanout

EPICS CAChannel

MODBUS/TCP

Accelerator Control System

Vacuum & FrontendControl System

Beamline & End-Station


TPS Phase I ID Plans (10 IDs)

IU22 3 M x 3IU22 (1+1) x 2EPU48 (1+1) x 1(U50, EPU48 ?) x 1


TPS Control Ethernet

PowerSupplies

128 Bits DI/DIcPCI CPU boardCompactPCI

Insertion Devices IOC

(Linux,EPICS)

200 update/sec

IP DAC16 channels, 18 bits

IP ADC16 channels, 24 bits

Motor Drivers(Stepper (IU22) or Servo (EPU)

Encoders(SSI,

Incremental)

LimitSwitches

TemperatureRTD/TC

VacuumIon-Pump,BA Gauge

Global compensationUDP/IP (~ 200 update/sec)

Local compensation

EPICS OPI

Beamline monochromator synchronization link ?

Beamline control system

Wiring Adapters

MOXA RS-232/422/485 Serial Device Servers

RS-232/485 Based Devices Galil DM-404x Motion Controller

Ethernet Switch

EPICSGateway

ICPDAS RTD/TC(POE)

Interlock Logic

Insertion Devices Control Environment


Motion Controller

EPICS IOC

Status update every 5 msec

EPICS CA access ~ 10 Hz rate

LocalCompensationPower Supplies

Setting update every 5 msec

Gap/Phase information broadcas

t every 5 msec

Clients(Global orbit/tune/coupling

correction,, …)

Fast SettingReal-time Ethernet(up to 10 kHz rate)

Soft real-time applications are supported (~ 5 msec)

StreamDevice

Quadrupole control ~ 10 update/sec(via standard EPICS channel)

Correctors & skew quads

ID Global Compensation Solution


EPICS IOCADLINK cPCI CPU

TEWS TCP201 IP Carrier

EPICS Ethernet(3 Hz rate)


IP-ADC-8417

Trigger3 Hz @ TZERO

Storage Ring DCCT

EVR (cPCI-EVR-300)

10 kHz sampled data averaged into 3 Hz rateLifetime calculation updated in 3 Hz rate

ITau

I x TauAccumulated I x Tau

Transfer efficiency form booster synchrotron to storage ring

HeartbeatDetector

ToMachine

ProtectionSystem

Beam Trip Detector

Orbit Interlock Threshold

Lock-in Amplifier


IP-ADC-8417

2 A, 5 kHzTone Loop

ThresholdRelay

Stop Injection Trigger:

Current achieve target valueDCCT failedEPICS IOC failed

BPM VLANSUM signals from

several BPM @ 10 Hz rate

For Beam Current Safety Check

2 A

Excitation OFFNPCT Power Loss

DCCT OK

DCCT Failed

TPS Storage Ring DCCT IOC


Turnkey systems compliant with EPICS included:Linac (EPICS ready)RF transmitter

… etc.

Turnkey EPICS devices included:BPM electronics, feedback processor, oscilloscope, …

Measures to minimize amount of workload for integration supports and maintenance

Standard components should be chosen to get consistency of hardware

EPICS development environment and documentation on the TPS application development process

Turnkey System Interface


TPS Control Network

Lianc Timing and IOC(Timing, LTB PS, LTB Diagnostics, Oscilloscopes, GigE Vision

Camera,… etc.)

EPICSOPI

TPS Control Environment

Modulator #1

Linac ControlEthernet Switch

Modulator #3Gun

LocalController

(PLC, ..etc.)

LocalControlPanel

Power Supply

RFVacuumInterlock

…etc.

LocalController

(PLC, ..etc.)

LocalControlPanel

LocalController

(PLC, ..etc.)

LocalControlPanel

LocalController

(PLC, ..etc.)

LocalControlPanel

Linac RF, Diagnostic, …etc

LocalController

(PLC, ..etc.)

Timing Network

Event ReceiverEVR

CPCI-EVR-300,cPCI-EVRTG-300

cPCI CPU board

+

+

Linac Timing IOC (Linux)

cPCI IOC

Trig SignalGun grid pulser, Klystron Current/ Voltage, RF, Faraday Cup, Current Transfor

mer, … etc.

RI’s EPICSSoft-IOC

Gun Trigger

Optical Fiber

+

LTB Devices

RI’s Linac – EPICS Enable


Vacuum system and Beamline Front-end (responsive by Vacuum Group) Connect to cRIO based PAC System via MODBUS/TCP links

DiagnosticsBPM electronics: Embedded EPICSImage: GigE Vision cameraMiscellaneous controls: Motor, BI, BO, AI, AO, counter

RF (responsible by RF group)=> Transmitter, LLRF, Cryogenic ElectronicsEPICS CA interface

Machine protection=> Dedicated PLC system with fast link PLC Embeded EPICS IOC

Safety system (responsible by Radiation Safety Group)Ethernet to control system.

Others Subsystem Interface


Feedback system interface Orbit control – embedded with power supply controlBunch-by-bunch feedbackTune feedbackFiling pattern feedback

Environment monitoring: Vibration, Temperature, …Raw TCPLXIMODBUS/TCP

Post-mortem supportsMany devices support this functionalityTrigger by event system

…

Others Subsystem Interface – cont.


NPCTIOC(Beam current,Beam lifetime,…)

FillingPatternIOC(Bunch current,Bunch lifetime,…)

Timing Master IOCEVG

LinacEVR

Gun Timing,Linac Timing,

Timing DiagnosticInjection Control

IOC

CA accessCA access

Injection and ExtractionTiming IOC

EVR

Booster Main PSTiming IOC

EVR

GunEVR

UplinkEVR

Timing Fanout

Two injection control options: Matlab scripts running on control console (3 Hz injection rate tested)

EPICS record processing (in consider)

Injection Control


Control system framework: EPICS toolkitDevelopment focus on V3V4 and extension are in study

High level physics framework (responsible by Beam Dynamic Group) :Matlab/Accelerator Toolkit/Matlab Middle Layer

Applications interface and Operation related applications:DefineImplementation

Many items are still in studyRDBE-logArchiver and retrieverDocumentation… etc.

Software Infrastructure


Basic EPICS environment Subsystem control

Device supports and device driversUser interface (control and status monitoring)Cold start, warm up, shutdown, operation checkSave and restore

Subsystem application programsGun processing

Power supply performance checkBPM system diagnosticEPICS IOCs house keepingNetwork monitoring… etc.

High level applicationsBeam diagnostic related ….

Special operation applicationsEPICS IOC housekeepingNetwork trafficMagnet degaussingSybsystem warm-up, processingSave/restoreLattice management

Save, restore, …LTB, BTS, Booster Synchrotron, Storage Ring, …etc.

Booster synchrotron: ramping waveform managementInjection control

Bucket addressingInjectionTop-up injectionFilling pattern control and feedback

Multi-bunchSingle bunchMultiple single bunch (Isolated bunch)Exotic filling pattern - Camshaft mode, Repeat Camshaft mode, ….

Etc.Special operation applications – cont.

Timing controlPulse magnets current waveform monitoringAlarm checkingArchiver and browserMachine status web pageSafety system statusBeamline related applications

Feed-forward table managementOrbit feedback supportsMachine status web page

….

Commissioning and Operation Related Applications Check List (2012-2014)

Intensity monitorStorage ring DCCT

Current and lifetime stream dataBooster synchrotron DCCT

Current waveformLTB/BTS FCT

Stream dataInjection efficiency

Filling pattern monitorStorage ring

Bunch current (or charge)Bunch purity monitor for isolated bunch

Booster synchrotronBunch current

BPM relatedConfiguration toolsLTB/BTS single pass BPMBooster BPM display

Ramping orbitStorage ring BPM (A, B, C, D, X, Y, Q, SUM, I, Q)

First tune dataTurn-by-turn10 kHz steam data10 Hz stream dataOrbit (in waveform – array format)Spectrum for turn-by-turn dataSpectrum for 10 kHz dataSpectrum for 10 Hz data

Bunch-by-bunch dataBunch phase oscillation dataBunch oscillation data

TuneBooster ramping tuneStorage ring tune

….Real-time beam loss monitor Screen monitor

Actuator controlImage acquisitionImage analysis

Synchrotron radiation monitorBooster synchrotron

Optical controlTiming controlImage acquisitionImage analysis

Storage ringOptics controlImage acquisitionImage analysis

Bunch-by-bunch dataBunch phase oscillation dataBunch oscillation data

Waveform data….….….

Plan based on priority and delivery schedule


TPS Synoptic Page

TPS LTB GUI

E-Gun Trigger ModuleTiming Master Prototype

Test Screen Monitor

Single PS GUI

Developed Simple Applications


TPS Timing Modules Configuration PageProfile Analysis

TPS Timing Summary Control Page

Single Pass BPM

Kicker Pulser Control

FCT Waveform

Developed Simple Applications – cont.


To enable early testing of applications through the control system, a virtual accelerator has been implemented to give simulation of the accelerators though the intended EPICS PV interface. Prototype was set up by the help from DLS. Current version is on AT/MML environment.

TPS Storage Ring

(Lattice provided by BD Group)

Virtual TPS Storage Ring (EPICS)

Virtual Accelerator EPICS IOC


Major procurements are in proceed. Plans for installation. Learn how to deal with EPICS system development and management. Infrastructure of the software system. TODO list for the software components. Familiar with subsystem for applications development. Explore EPICS new developments:

For middle layer applicationsFor API interface and another applications

Solutions for archiver and retriever, RDB, E-Log, … etc. Plan a realistic schedule and set priority.

Current Efforts


Implementation of the TPS control system is under way.

Standard hardware are specified.

Standardization of software components and tools are the current focus.

High level applications and EPICS extensions will be the next focus issues.

Reinforce collaboration with EPICS community. Help from the EPICS community are essential!

Summary



Announcement

1. Name list for Taipei visit is posted on the bulletin board. Please check its correctness! If you name is missing, please contact information desk.

2. NSRRC offer to buy insurance for your stay in Taiwan this week. If you are still interest and not provide your information, please contact information desk.

3. The 3rd floor meeting room is available for your lunch also.

4. Tour of TPS Linac and TLS – please gather on the front gate of this building at 13:00.

Documents

Status of the TPS Control System