PALM-3000
ATST/BBSO Visit
Stephen GuiwitsP3K System Hardware
126 Cahill
February 11, 2010
PALM-3000Agenda
• High level overview of the P3K Electronics
• P3K System Hardware– RTC Electronics– Interfaces and Layout
• Xinetics GenIII Communications– High Speed
– Low Speed
• Xinetics GenIII Drivers– Stability
– Features
PALM-3000Overview
PALM-3000RTC Electronics
• Cluster of 10 PC’s in the computer room
• Real-time calculations performed on 16 Nvidia GPU’s
• PC 0 provides the servo control, central scheduling, and control of the cluster
• PC 1 – PC 8 provides GPU calculations
• PC 9 is dedicated to telemetry recording
• Cluster communication provided by the high speed Quadrics switch
• QsNet II (16 way solution)
• 1064 Mbytes/s
• 900 MB/S Sustainable
4
PALM-3000
5
RTC Electronics
• RAID System– NexSAN Technologies– Configured for throughput optimization
• RAID 0• Two partitions
– High Speed data
– All other data
• Optical Splitter provides duplicates frames to all 8 PC’s
• All PC’s running Red Hat Enterprise Linux 5– Kickstart set up for automated, repeatable installations – Custom RPMS built and tested specifically for P3K
PALM-3000
6
RTC Electronics
PC 0 – 9
RAID System
KVM Switch
Quadrics High Speed Switch
16 Port Gigabit Ethernet Switch
Optical Splitter
PALM-3000Electronics Interfaces and Layout
Wavefront Processor(computer room)
DM Racks(Cass cage pos. 2 & 3)
Controller Racks(Cass cage pos. 4 & 5)
User Workstation(Data Room)
FiberSplitter
AO Bench
Ethernet
Pvt net
PALM-3000
8
Xinetics GenIII Communications
• P3K Requires high speed communication and low speed communication with the Xinetics GenIII Drivers
• Low Speed (serial interface) to configure and monitor driver states
• High Speed (SOR-422U) for DM control
PALM-3000High Speed Communications
PALM-3000
10
High Speed Communications
Transmit End• Curtiss Wright FibreXtreme SL240 PCIe 2.5 Gb/s Data Link Card
– Up to 247 MB/s per channel sustained data rate per channel
– Low overhead ANSI/VITA 17.1-2003 Serial FPDP Protocol• Based on Fiber Channel. Uses similar ordered sets
– Low latency (about 1us)
– 4 independent channels
PALM-3000High Speed Communications
Receive End• Curtiss Wright FibreXtreme SL240 CMC 2.5 Gb/s Data Link Card
– IEEE P1386 Common Mezzanine Card form factor (same as PMC)
– 32-bit parallel FPDP data bus @ 62.5 MHz
•Custom Carrier Board–6U VME form factor. FPGA based.
–Four SOR-422U parallel output ports for connection to Xinetics Drivers.
–P1 port for connection to LODM and TTM amplifiers.
PALM-3000Low Speed Communications
• Serial Communication @ 115200 Baud
• Communicate with each driver through a terminal server – Terminal server has 16 RJ 45 ethernet ports
– Each driver has a 9 pin DE 9 connector
– 9 pin – RJ 45 adapter required
• Drivers have a Primary/Secondary configuration– Specially developed by Xinetics for P3K
12
PALM-3000Xinetics GenIII Drivers
• Software– Written for the low speed serial interface
– Communicates via serial terminal server• PC ethernet terminal server RJ-45 9 pin driver
• Certain commands are required for each driver while others are only required by the Primary driver
– Commands tested for all 8 drivers• Power up
• Power down
• Put driver in proper mode (Normal or Test)
• Clear faults on the drive (Xinetics feature)
• Mute the drivers
• Drive actuator values
• Drive bias value
• Read back voltage table (needs adjusting)
• Read status table
PALM-3000Xinetics GenIII Drivers
• Stability– Idle issues. Random driver will fault when powered
on and not used– Work well after running
• Had multiple runs over a 48+ hour period
– Thousands of commands sent to date
• Features– Daisy Chain
• Developed for P3K by Xinetics
– Undocumented software API– API bugs must be worked around (trial and error)
14
PALM-3000Questions, Comments, Suggestions