MONSOON Software Design & Status

1

MONSOON Software MONSOON Software Design & StatusDesign & Status

……

2

ContentsContentsReview of Software System ArchitectureReview of Software System Architecture

Interfaces and LibrariesInterfaces and Libraries

PAN Process Architecture and StatusPAN Process Architecture and Status

Documentation and Testing StatusDocumentation and Testing Status

Schedule and ResourcesSchedule and Resources

To-Do list for MONSOONTo-Do list for MONSOON

To-Do list for NEWFIRMTo-Do list for NEWFIRM

3

Review of Software System ArchitectureReview of Software System Architecture

4

MONSOON Pixel ServerMONSOON Pixel Server

LINUX PCPCI FIBER CARD

Ethernet Link100Mb/s

1Gb/s Fiber(50Mpixel/s)




SYNC


SYNC


N NODES

SUPERVISORY NODELINUX PC


CCDor

FPA

10Mb/sEthernet

10Mb/sEthernet

10Mb/sEthernet

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

SYNC SYNCN NODES

SUPERVISORY NODELINUX PC

CCDor

FPA

10Mb/sEthernet

10Mb/sEthernet

10Mb/sEthernet

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

PIXEL ACQUISITION NODE 1

DETECTOR HEADELECTRONICSNODE 1

SYNC SYNCN NODES

SUPERVISOR NODELINUX PC

CCDor

FPA

10Mb/sEthernet

10Mb/sEthernet

10Mb/sEthernet

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

CCDor

FPA

PIXEL ACQUISITION NODE 2 PIXEL ACQUISITION NODE 3



MSL (MONSOON Supervisory Level

5

MONSOON Level 0 ContextMONSOON Level 0 ContextMonsoon System Context Diagram

Science Client System

Local DHSInterface

Fits Imageon Disk

Local DHSInterface

ICD 4.0 GPX Interface

ICD 4.1 MONSOON Restrictions (TBD)

(Level 0)

3.0DHE

System

ICD 5.0 PPX Interface

ICD 6.0 Generic DHE

ICD 6.1 MONSOON DHE

1.0Supervisor

Layer

MONSOON GPX(Pixel Server)

Local StatusInterface

Df1.5Status DataConn ection

(Instrument Control System)(Observation Control System)

Client System(Engineering Lab Console)

Df1.2Response Strin g

Con nection

Df1.3Asynchronou s

Status Con nection

(Engineering Lab Console)

2.0PAN

System

Df1.4Pixel Data

Stream

TBD

Df1.1Co mman d Str ing

Conn ection

Df1.4Pixel Data

Stream

External Entity or Process

Interface Definition Label

1.0InternalProcessDf 1.1

Data Flow Label

Data Flow 2.1MONSOON

ExternalProcess

6

Three Layer System ArchitectureThree Layer System Architecture

1.1. MONSOON MONSOON SupervisorSupervisor (MSL) Layer. (MSL) Layer.

2.2. Pixel Acquisition Node (PAN) Layer.Pixel Acquisition Node (PAN) Layer.

3.3. Detector Head Electronics (DHE) Layer.Detector Head Electronics (DHE) Layer.

7

Three Layer System ArchitectureThree Layer System Architecture (cont)(cont)

1.1. MONSOON Supervisor Layer. (MSL).MONSOON Supervisor Layer. (MSL).– A command/control Layer, (no pixel data).A command/control Layer, (no pixel data).– Provides GPX interface to clients.Provides GPX interface to clients.– Provide single point contact to system. Provide single point contact to system. – Provides client access security.Provides client access security.– Provides multiple client connections.Provides multiple client connections.– Provides error monitoring & recovery.Provides error monitoring & recovery.– Handles Command/response to/from multiple PANs.Handles Command/response to/from multiple PANs.– May run remotely or on a PAN.May run remotely or on a PAN.

8

Three Layer System Architecture Three Layer System Architecture (cont)(cont)

2.2. Pixel Acquisition Node (PAN) Layer.Pixel Acquisition Node (PAN) Layer.– No knowledge of other PAN-DHE pairs.No knowledge of other PAN-DHE pairs.– Provides PPX interface to MSL or users.Provides PPX interface to MSL or users.– Provides run-time configuration of PAN/DHE.Provides run-time configuration of PAN/DHE.

– Provides first level data archiving.Provides first level data archiving.– Provides multiple image processing ‘modes’.Provides multiple image processing ‘modes’.

» Fowler Sampling, coadds, MSR techniques, OT imaging.Fowler Sampling, coadds, MSR techniques, OT imaging.

– Provides parameter verification/control/help.Provides parameter verification/control/help.– Deals with IR/OUV/etc. differences.Deals with IR/OUV/etc. differences.

9


2.2. Pixel Acquisition Node (PAN) Layer Pixel Acquisition Node (PAN) Layer (cont).(cont).

– Handles single exposure sequencing. Handles single exposure sequencing. – Handles raw data pre-processing. Handles raw data pre-processing.

– Provides interface to DHE hardware.Provides interface to DHE hardware.

– Provides DHE sequencer configuration/download.Provides DHE sequencer configuration/download.

– Provides PAN error monitoring/reporting/recovery.Provides PAN error monitoring/reporting/recovery.

– Provides support for ‘speed ROI’.Provides support for ‘speed ROI’.

– Provides support for ‘compression ROI’s’.Provides support for ‘compression ROI’s’.

10


3.3. Detector Head Electronics (DHE) Layer.Detector Head Electronics (DHE) Layer.– Handles array hardware control.Handles array hardware control.

» Voltage levels, sequencing, monitoring.Voltage levels, sequencing, monitoring.

– Handles integration timing.Handles integration timing.

– Handles detector readout sequencing.Handles detector readout sequencing.

– Handles digital averaging.Handles digital averaging.

– Handles shutter control.Handles shutter control.

– Can handle array temperature control.Can handle array temperature control.

– Board Self Identification and Version tracking.Board Self Identification and Version tracking.

11

Interfaces and LibrariesInterfaces and Libraries

12

Interface DefinitionsInterface Definitions Client System to Generic Pixel Server.Client System to Generic Pixel Server.

ICD 4.0 Generic Pixel Server - Communications, Command/Response ICD 4.0 Generic Pixel Server - Communications, Command/Response and Data Stream Interface Description. and Data Stream Interface Description. (GPX)(GPX)..

MONSOON Restrictions on Science Client Access.MONSOON Restrictions on Science Client Access.ICD 4.1 MONSOON Command and Parameter Restriction Lists.ICD 4.1 MONSOON Command and Parameter Restriction Lists.Developed in conjunction with Science Team.Developed in conjunction with Science Team.

Supervisor Layer to Pixel Acquisition Node.Supervisor Layer to Pixel Acquisition Node.ICD 5.0 Generic Pixel Acquisition Node – Communications, Command ICD 5.0 Generic Pixel Acquisition Node – Communications, Command

& Response Description. & Response Description. (PPX).(PPX).

PAN to Generic DHE PAN to Generic DHE (Detector Controller)(Detector Controller)..ICD 6.0 Generic Detector Head Electronics - Command and Data ICD 6.0 Generic Detector Head Electronics - Command and Data

Stream Interface Description. Stream Interface Description. (A Command Interface).(A Command Interface).

MONSOON PAN to MONSOON DHE.MONSOON PAN to MONSOON DHE.NICD 6.1 MONSOON Detector Head Electronics - Command and Data NICD 6.1 MONSOON Detector Head Electronics - Command and Data

Stream Interface Description. Stream Interface Description. (Hardware/Software Interface Details).(Hardware/Software Interface Details).

Published interface

13

Interfaces and Software LayeringInterfaces and Software LayeringScience or Engineering Clients

SDSU-IIDetector

Head Electronics

MONSOONDetector

Head Electronics

Simulated MONSOONDetector

Head Electronics

OTHERDetector

Head Electronics

Supervisor Layer Software

Pixel Acquisition Node Software

ICD 6.1 MONSOON DHE Interface & Design

ICD 6.2 SDSU-IIDHE Interface & Design

ICD 6.99 Other DHEInterface & Design

OTHER DHE Interface Software

SDSU-II DHE Interface Software

MONSOON DHEInterface Software

OTHER FiberDrivers

SDSU-II FiberDrivers

Systran FiberDrivers

Systran Fiber Hdwr SDSU-II Fiber Hdwr OTHER Fiber Hdwr

ICD 6.0 Generic Detector Head ElectronicsCommand and Data Stream Interface Description

Communications to Simulator

ICD 4.0 Generic Pixel Server - Communications, Command/Response and Data Stream Interface Description

ICD 5.0 PAN Pixel Node - Communications, Command/Response & Data Stream Interface Description

ICD 7.0 MONSOON Backplane

ICD 6.1 MONSOON DHE Interface & Design

14

Monsoon Layers and ICD'sMonsoon Layers and ICD'sMONSOON GPX Image Acquisition system

ICD and Software Layer relationship

Monsoon Supervisory Layer (ICD 4.0 GPX)

Systran SL240 Hardware

Monsoon PAN Interface Layer (ICD 5.0 PPX)

Monsoon DHE(Detector Head Electronics)

Pixel Acquisition Node

Monsoon DHE Utility Library (libDheUtil) (ICD 6.0 Generic DHE)

Monsoon DHE Hardware Library (libmonsoon) (ICD 6.1 MONSOON DHE)

Monsoon Com Utility Library (libComUtil) (Com Util Library API)

Monsoon Com Hardware Library (libsystran) (Com Hdw Library API)

Systran SL240 Drivers (libfxslapi) (FXSL Library API)

Pixel Acquisition Node

GeneralStatus

Not started

In Testing

Complete (in use)

Complete (in use)

Complete (in use)

Complete (in use)

Complete (in use)

COTS (Complete)

COTS Hardware

NOAO/CTIO Hdw

NEWFIRMStatus

Not Needed

In Testing

Complete (in use)

Complete (in use)

Complete (in use)

Complete (in use)

Complete (in use)

COTS (Complete)

COTS Hardware

NOAO/CTIO Hdw

15

General Functionality LibrariesGeneral Functionality LibrariesAll complete and either in test or in use nowAll complete and either in test or in use now libcmdCfgUtil- libcmdCfgUtil- runtime configuration to specific detector.runtime configuration to specific detector.

libcliUtil- libcliUtil- command line interface; parse, search & help.command line interface; parse, search & help.

libqueUtil - libqueUtil - queue functions; new, add, remove, full, empty.queue functions; new, add, remove, full, empty.

libsemUtil -libsemUtil - semaphore functions; new, init, give, take, release… semaphore functions; new, init, give, take, release…

libshmUtil - libshmUtil - shared memory functions; attach, detach…shared memory functions; attach, detach…

libsockUtil -libsockUtil - socket functions; new, listen, accept, read, write… socket functions; new, listen, accept, read, write…

libmiscUtil - libmiscUtil - a set of routines used by many pan processes.a set of routines used by many pan processes.

16

Generic Interface LibrariesGeneric Interface Libraries

Complete and in use now Complete and in use now (no changes needed for NEWFIRM)(no changes needed for NEWFIRM)

LibppxUtilLibppxUtil - - the PAN pixel server interface routines the PAN pixel server interface routines

(ICD 5.0)(ICD 5.0)

LibdheUtil LibdheUtil - - generic DHE interface routines generic DHE interface routines

(ICD 6.0)(ICD 6.0)

libcomUtil - libcomUtil - generic communications link routinesgeneric communications link routines

libpanUtil - libpanUtil - shared memory setup & init used by PAN processesshared memory setup & init used by PAN processes

17

Hardware Specific LibrariesHardware Specific LibrariesComplete and in use now Complete and in use now (no changes needed for NEWFIRM)(no changes needed for NEWFIRM) libsystran.libsystran.

– Implements the SL240 specific interface to the com link Implements the SL240 specific interface to the com link

libmonsoon.libmonsoon.– Implements the MONSOON DHE access routines Implements the MONSOON DHE access routines

(ICD 6.1)(ICD 6.1)

18

Focal Plane Specific LibrariesFocal Plane Specific Libraries libdetCmnds.libdetCmnds.

– Implements routines unique to a detector/instrument.Implements routines unique to a detector/instrument.

– Implements OUV, IR, Guider, etc. differences.Implements OUV, IR, Guider, etc. differences.

– Integration Time Calculations, ROI checking & setup, Integration Time Calculations, ROI checking & setup,

– Unique Array Initialization & Setup requirements. Unique Array Initialization & Setup requirements.

– OTI details, charge/image shift commands, etc.OTI details, charge/image shift commands, etc.

– User Function name to ‘C’ function translation provided.User Function name to ‘C’ function translation provided.» Same structure as runtime command configuration.Same structure as runtime command configuration.

» Translation compiled into library.Translation compiled into library.

– Shared Library loaded at run time.Shared Library loaded at run time.» One Library for each unique detector/instrument combination.One Library for each unique detector/instrument combination.

» Library loaded from detector/instrument directory. Library loaded from detector/instrument directory.

19

Focal Plane Specific Library Focal Plane Specific Library STATUSSTATUS

libdetCmnds. libdetCmnds. – libgeneric - version complete and in test.libgeneric - version complete and in test.

– libaladdin_III - version complete and in use.libaladdin_III - version complete and in use.

– liborion_II - version complete and ready for test.liborion_II - version complete and ready for test.

– liborion_II_2x2 - version needed for NEWFIRM in work.liborion_II_2x2 - version needed for NEWFIRM in work.» No changes over ORION_II version foreseen at this timeNo changes over ORION_II version foreseen at this time

– libota - version in design phase.libota - version in design phase.

– libccd - version for single CCD testing similar to genericlibccd - version for single CCD testing similar to generic

20

PAN Process ArchitecturePAN Process Architectureand Statusand Status

21

PAN Layered Process ArchitecturePAN Layered Process Architecture

Shared Memory Interface

panSaverpanProcAlgpanCapture

libfxslapi - Systran Sl240 Driver

libcomutil - generic communications link routines

libmonsoon - Monsoon DHE hardware interface ICD6.1

Socket interface and CLI to command processorHigh level DHE control

Pan Process Startup and shutdownProcess control for Pan processes

Error checking and recovery

PanDaemon

libsystran - systran versions of communications link interface

Well defined API's

fSaver(FITS Writer)

libdheutil - Generic DHE Interface ICD 6.0

Command or Semaphore accessData or data dddress flow pathShared memory access

PANprocess

libppx - Generic Pan Interface ICD 5.0

extTrgger

22

Pan Process StatusPan Process Status panDaemon panDaemon

– ICD 5.0 - “ppx interface” complete and tested.ICD 5.0 - “ppx interface” complete and tested.

– ICD 6.0 - “generic” DHE interface - complete and tested.ICD 6.0 - “generic” DHE interface - complete and tested.

– ICD 6.1 - MONSOON DHE interface - complete and tested.ICD 6.1 - MONSOON DHE interface - complete and tested.

– DHE/PAN Attribute access routines complete and in test.DHE/PAN Attribute access routines complete and in test.» All currently used routines are tested.All currently used routines are tested.

» Additional routines may need testing/modification.Additional routines may need testing/modification.

» Attribute array code complete and in test.Attribute array code complete and in test.

– panDaemon interface to panCapture tested in dheHdwDbg.panDaemon interface to panCapture tested in dheHdwDbg.

– Pan process startup routines still in coding.Pan process startup routines still in coding.

23

Pan Process Status Pan Process Status (cont)(cont)

panCapture panCapture – Data capture interfaceData capture interface

» ICD 6.0 - “generic” DHE interface - complete and tested.ICD 6.0 - “generic” DHE interface - complete and tested.

» ICD 6.1 - MONSOON DHE interface - complete and tested.ICD 6.1 - MONSOON DHE interface - complete and tested.

– DHE/PAN Attribute access routines complete.DHE/PAN Attribute access routines complete.

– panCapture interface to buffer queues written and in test.panCapture interface to buffer queues written and in test.

– panCapture data capture routines tested in dheHdwDbg.panCapture data capture routines tested in dheHdwDbg.

– panCapture automated process startup still in coding.panCapture automated process startup still in coding.

24


panProcAlgpanProcAlg– Data processing interfaceData processing interface

» ICD 6.0 - “generic” DHE interface - complete and tested.ICD 6.0 - “generic” DHE interface - complete and tested.

» ICD 6.1 - MONSOON DHE interface - complete and tested.ICD 6.1 - MONSOON DHE interface - complete and tested.

– DHE/PAN Attribute access routines complete.DHE/PAN Attribute access routines complete.

– panProcAlg interface to buffer queues written and in test.panProcAlg interface to buffer queues written and in test.

– panProcAlg data processing routine tested in dheHdwDbg.panProcAlg data processing routine tested in dheHdwDbg.

– panProcAlg automated process startup still in coding.panProcAlg automated process startup still in coding.

25


panSaverpanSaver– DHE/PAN Attribute access routines complete.DHE/PAN Attribute access routines complete.

– panSaver interface to buffer queues written and in test.panSaver interface to buffer queues written and in test.

– panSaver image save routine tested in dheHdwDbg.panSaver image save routine tested in dheHdwDbg.

– panSaver automated process startup still in coding.panSaver automated process startup still in coding.

– panSaver Header info creation not yet coded.panSaver Header info creation not yet coded.

– Final image publication scheme to NEWFIRM DHS not Final image publication scheme to NEWFIRM DHS not finalized.finalized.

26

Software Documentation StatusSoftware Documentation Status System Architecture document in work.System Architecture document in work. Software ICD’s (4.0, 5.0, 6.0, 6.1) Published.Software ICD’s (4.0, 5.0, 6.0, 6.1) Published.

– Some modification/rewrite needed to match actual interface.Some modification/rewrite needed to match actual interface. Library API Published.Library API Published.

– Maintained with Source code - Some modification/rewrite Maintained with Source code - Some modification/rewrite will be needed to match recent changeswill be needed to match recent changes

Process description documentation begun.Process description documentation begun.– Using source code Documentation system for processes.Using source code Documentation system for processes.

– Manually produced text used to detail process interactions.Manually produced text used to detail process interactions.

– Queues and Semaphores described in added text.Queues and Semaphores described in added text.

27

Test & Verification StatusTest & Verification Status General function libraries complete and tested.General function libraries complete and tested.

– in individual test program and in panDaemon. in individual test program and in panDaemon.

Generic interface libraries complete and tested.Generic interface libraries complete and tested.– in individual test program and in panDaemon. in individual test program and in panDaemon.

– Many also tested in dheHdwDbg.Many also tested in dheHdwDbg.

Hardware specific librariesHardware specific libraries– Currently libraries are being used in dheHdwDbg.Currently libraries are being used in dheHdwDbg.

» ALADDIN_III library tested with dheHdwDbg on actual arrayALADDIN_III library tested with dheHdwDbg on actual array

» Generic/CCD library tested with panDaemon.Generic/CCD library tested with panDaemon.

» ORION_II library tested with panDaemon.ORION_II library tested with panDaemon.

» ORION_II_2x2 library in coding.ORION_II_2x2 library in coding.

28

Test & Verification Status Test & Verification Status (cont)(cont) In PAN process system.In PAN process system.

– All Processes verified against functional description.All Processes verified against functional description.

– All processes are compiled and in test.All processes are compiled and in test.

– Processes being tested against GEMINI DEWAR.Processes being tested against GEMINI DEWAR.

– Automated Process startup still in coding.Automated Process startup still in coding.

29

Schedule & ResourcesSchedule & Resources Libraries tested & running in dheHdwDbgLibraries tested & running in dheHdwDbg (May `03)(May `03)

– Generic Interface Libraries Generic Interface Libraries (DONE)(DONE)– General Utility Libraries General Utility Libraries (DONE)(DONE)– Hardware Specific Libraries Hardware Specific Libraries

» libsystran, libmonsoon libsystran, libmonsoon

(DONE)(DONE)

– Detector Specific LibrariesDetector Specific Libraries» generic, ALADDIN_III - generic, ALADDIN_III - (DONE)(DONE)» ORION_II - ready for testingORION_II - ready for testing» ORION_II_2x2 - in coding (same as ORION_II)ORION_II_2x2 - in coding (same as ORION_II)

PAN Interface & processes running DHEPAN Interface & processes running DHE (Sept `03)(Sept `03)

– PPX interface LibraryPPX interface Library (DONE) (DONE)

30

Schedule & Resources Schedule & Resources (cont)(cont) TCL/TK Engineering Client TCL/TK Engineering Client (Sept. ‘03)(Sept. ‘03)

– First functionality First functionality (DONE)(DONE)– Scripts, auto-configuration, auto GUI setup, etc in workScripts, auto-configuration, auto GUI setup, etc in work

Everything Needed for NEWFIRMEverything Needed for NEWFIRM (Nov `03)(Nov `03)

– libORION_II - ready for test libORION_II - ready for test (Completion Jan 03)(Completion Jan 03)– libORION_II_2x2 - in coding libORION_II_2x2 - in coding (Completion Jan 03)(Completion Jan 03)– Configuration files Configuration files

» ORION_II_2x2.arr ORION_II_2x2.arr (DONE)(DONE)» ORION_II_2x2.cfg - constructed with hardwareORION_II_2x2.cfg - constructed with hardware in workin work» ORION_II_2x2.ucd - sequencer code file - ORION_II_2x2.ucd - sequencer code file - in workin work

Multi-Pan system development starting Multi-Pan system development starting (Apr ‘04)(Apr ‘04)

31

To-Do List for MONSOONTo-Do List for MONSOON Still to be done for General MONSOONStill to be done for General MONSOON

– Pan process coordination testingPan process coordination testing (3 MW)(3 MW)

– Automated startup routines/scriptsAutomated startup routines/scripts (2 MW)(2 MW)

– ROI’s, single-Array readout, added Error Handling, added Simulation ROI’s, single-Array readout, added Error Handling, added Simulation capabilities, runtime process control (restart, reset, new algorithm capabilities, runtime process control (restart, reset, new algorithm load), etc.load), etc. (?? MW)(?? MW)

– Handling for CCD detector details.Handling for CCD detector details. (?? MW)(?? MW)

– Complete Engineering Client functionalityComplete Engineering Client functionality (4 MW)(4 MW)

32

To-Do list for NEWFIRMTo-Do list for NEWFIRM Still to be done for NEWFIRM Still to be done for NEWFIRM (assuming a single PAN-DHE pair)(assuming a single PAN-DHE pair)

– Detector specific library testingDetector specific library testing (2 MW)(2 MW)– Detector specific library testing w/arraysDetector specific library testing w/arrays (1 MW)(1 MW)– Configuration files testing -Configuration files testing -

» ORION_II_2x2.arr ORION_II_2x2.arr (DONE)(DONE)» ORION_II_2x2.cfg - constructed with hardwareORION_II_2x2.cfg - constructed with hardware (0.5 MW)(0.5 MW)» ORION_II_2x2.ucd - sequencer code file - ORION_II_2x2.ucd - sequencer code file - (2 MW)(2 MW)

– Setup & Observing MODE files - Creation and TestingSetup & Observing MODE files - Creation and Testing» To be done by NEWFIRM scientists and engineers.To be done by NEWFIRM scientists and engineers.» Some recoding may be neededSome recoding may be needed (2 MW)(2 MW)

– Integration and testing with NEWFIRM ClientIntegration and testing with NEWFIRM Client (2 MW)(2 MW)– DHS interface routinesDHS interface routines (4 MW)(4 MW)

Documents

MONSOON Software Design & Status