Upload
juliana-crawford
View
215
Download
0
Embed Size (px)
Citation preview
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
ALMA OperationsALMA Operations
interaction with and support to the usersinteraction with and support to the users
Paola Andreani
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Meaning of ALMA Operations and the Joint ALMA
Observatory
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Science OperationsScience OperationsAstronomerAstronomer’’ssperspectiveperspective
Principles:
Non-experts should be able to use ALMA
Dynamic scheduler to match observing conditions
Reliable and consistent calibration
Data public in timely fashion
User Committee, Garching April 30 2010User Committee, Garching April 30 2010 Paola Andreani
OperationSupport
Facility (OSF)
ALMA Operations Sites in Chile
60 MB/s(peak)
6 MB/s(average)
Antenna Operations Site (AOS)
Santiago Central Office (SCO)
array scheduling + operationsquick-look, maintenance and repair
issues of callsPRC processSB checkspipeline data reductionquality assessmentPopulation of the archive
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
High-level concepts forHigh-level concepts forScience OperationsScience Operations
• Observations only in service observing mode with flexible (dynamic) scheduling.
• Observations 24h/day interrupted by maintenance periods.• All observations executed in the form of scheduling blocks (SBs).• Default output: reliable images, calibrated according to the
calibration plan.• The Joint ALMA Observatory (JAO) is responsible for the data
product quality.• All science and calibration raw data are captured and archived.
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Science Deliverables:• uv-plane astronomical source and calibration data.• Processed images, with supporting information on the data
processing and quality assurance.• Off-line data reduction software, including user support for
installation and basic usage.• Software tools for proposal and observation preparation,
including user documentation.• ALMA users manual.
User support:• Web pages• Phase I and phase II support• Helpdesk• f2f support• Data delivery• Archive
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
*Tokyo*Garching
*Cvlle
*Santiago*ALMA site
ALMA Science Operations sitesOSF, Santiago and the ARCs
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Joint ALMA Observatory (JAO)
• ALMA is operated by the JAO.• The ALMA Regional Centres (ARCs) form an integral part of
JAO operations.
ALMA Director
Department ofScience Operations
Department ofTechnical Services
Department ofAdministration
ARCs(NA, EU, EA)
SafetyExecutives
(NA, EU, EA)HR EPO
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
ALMA Operations: Three ALMA Regional Centres - ARCs
Joint ALMA Observatory
NA ARCEU ARC (ESO)
EA ARC
NAOJ
“Satellite” EU ARCs
NAASC
ARCs provide user interface, archive,software toolsdata delivery
Astronomers on duty
Enhanced User Services
Enhanced services are needed to provide advanced user support, algorithm development, student programs, EPO, grants
DSO provides:• Array operations• Scheduling of projects• Execution of observations• Data quality assurance and trend analysis• Calibration plan maintenance• Delivery of data to the archives• Archive operations• Pipeline operations
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ARCs and their relation to the JAOThe ARCs and their relation to the JAO
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Work flow of ALMA Operations
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Archive User Interface (User Portal will be based on this)
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
ALMA User PortalHelpdesk
Proj.TrackrArchiveUser Preferences
John HibbardNRAO, 520 Edgemont RdCharlotesville VA [email protected], [email protected], [email protected] Executive: NAmPreferred ARC: NAm…
Proposals
User Portal provides access to all on-line end-user ALMA applications. Some applications available only after authentication
ALMA User PortalLogin
Username:
Password:
Helpdesk
Proj.TrackrArchiveProposals
User Portal
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Observers’ affiliation identified on observing proposal
• P.I. (name, info)• Co-I 1• Co-I 2• Co-I 3• Co-I 4
…
NAEU EA ChileNon-ALMA
member
X X X X X
X X X X X
X X X X X
X X X X X
…
(Default associations filled in from users User Profile preferences)
Affiliation
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Observers’ affiliation identified in User Portal profile
• Eligible Affiliations• Preferred ARC for
support
NAEU EA ChileNon-ALMA member
XX X
X X X X X(checkbox; i.e. multiple selections allowed)
(radio button; i.e. only single selection allowed)
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
the ALMA software shall offer an easy to useinterface to any user and should not assumedetailed knowledge of millimetre astronomyand of the ALMA hardware
The ALMA observing tool
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Getting ALMA time
Joint ALMA Observatory issues calls for proposals
• Register on the ALMA web page• Prepare a proposal with the ALMA Observing Tool• user can contact their ARC node for assistance
European ARC provides documentation
ALMA Observatory (with ARCs help) coordinates refereeing process Program Review Committee ranks proposals
Executives approval
Phase I
MAKE A PROPOSAL!
Scientific case Instrument setup: frequency rms
S/N source extension
spatial resolution
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ALMA Observing toolThe ALMA Observing tool
• Split Observing Programs in two parts:• a Phase I Observing Proposal
– emphasis on the scientific justification of the proposed observations.
• a Phase II Observing Program– submitted only if observing time has been granted.
• Set of Scheduling Blocks (SBs)– required to drive observing with ALMA.– the SB contains a full description of how the science target and the
calibration targets are to be observed
• sets of SBs can be combined with a description for the post processing of the data, ultimately resulting in an image.
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Getting ALMA time
Phase I: Proposals are submitted using ALMA Observing Tool
Phase II: Successful PIs submit observing programme using the Observing Tool
Preparation of the scheduling blocks
European ARC helps with observation planning and validates observing schedule
Phase II
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ALMA observing tool
More details in Liz’s presentation
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
ALMA helpdesk (kayako, being evaluated for ALMA)
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
JAO ARCs
PS Phase 1
Project
PRC
PS Phase 2
Technicalfeasibility
Scheduling
JAO MediumTerm Queue
LongTerm Queue
Archive
ALMA DATA FLOW
Blocks
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Getting ALMA dataGetting ALMA data Queue based dynamic scheduling
Programs are composed of 30-60 min scheduling blocks
Raw data pass through multi-tiered quality assurance
Combination of on-site duty astronomer, ARC staff, and automated checks
Data proceeds to pipeline and archiving
Data available from ARC (ESO) within ~2 weeks (TBD, quicker if internet available)
Pipeline products (images and calibrated u-v data), raw data, off-line data processing software made available to Pis
Expert hands-on data reduction help from ARC nodes staff provided on request, helpdesk also available at ESO
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Main ALMAArchive
ALMARegional CenterNorth America
ALMARegional Center
Europe
ALMARegional Center
Japan/Asia
ALMAScienceArchive
ALMAFrontendArchive
Archive nodes at the OSF, SCO and the ARCs
•ARC archive nodes delivered, commissioned and activated as soon as possible after SCO archive.
•During science operations ARC nodes are synchronized with the central archive through internet (small data sets) or via physical media. OSF connected to SCO via high-bandwidth. It MUST be always
possible to operate ALMA even if the internet link does not work
The ALMA archives andThe ALMA archives anddata distributiondata distribution
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Data reductionData reduction
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Data Available for download
• Available data:– Raw UV visibilities– Calibration & flagging tables– Casapy reduction scripts– Imaging products (calibrated cubes & reference
images)
– Source visibilities with calibration & flagging applied
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Offline Data Processing
• Download CASA & CASA documentation/guides/use cases– Interface: JAO & ARC webs– Actors: JAO & ARCs, assembling & posting material
• Attend CASA tutorial
– Interface & Actors: ARCs, including nodes• Ask questions
– Interface: UP:helpdesk– Actor: ARCs
• Visit ARC or ARC node for face-to-face support– Interface & Actors: ARCs, including nodes
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
suite of C++ application libraries packaged through a Python scripting interfaceextensively tested
C.A.S.A.: Common Astronomy Software Applications Primary goals: supporting the data post-processingneeds of the next generation of radio astronomicaltelescopes such as ALMA and EVLA projects
The ALMA offline reduction package (CASA)
See Dirk’s presentationSee Dirk’s presentation
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Simulating the dataSimulating the data
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
In one command, CASA generates o uv data (with thermal noise if desired)o a dirty and cleaned image.o a diagnostic window including• your input• the simulated image
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
In one command, CASA generates o uv data (with thermal noise if desired)o a dirty and cleaned image.o a diagnostic window including• your input• the simulated image• the difference• uv coverage• and dirty beam or PSF
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ALMA Regional CentresThe ALMA Regional Centres
The European ARC
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The European ARC
ARC DepartmentARC Department
Data ManagementOperations DivisionData ManagementOperations Division
Director of OperationsDirector of Operations
Ondrejov(CZ)Ondrejov(CZ)
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ALMA Regional CentresThe ALMA Regional Centres
The European ARC network
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
: express interest
: ARC nodes
The European ARC network
Paola Andreani European Southern Observatory
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The European ARC• Core functions
– Scientific support:Proposal & observation
preparationuser support– Archive Operations:host a copy, data delivery– Astronomer on duty at OSF– Science community activity– User support:User support:f2f helpf2f help
• Non-core functionsData reduction– Advanced pipeline– Extended archive support– Support for special projects– Science community activity:
training, schools, workshops
ESO: ARC DepartmentESO: ARC Department
ARC nodesARC nodes
ESO ARC + nodesESO ARC + nodes
ARC nodesARC nodes
ALMA simulators
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The role of the central node (@ ESO)
• Support the European users from proposal preparations to data delivery through the helpdesk
• Validation of the Scheduling Blocks• Help in the technical assessment of the proposals• Provide help to the proposal handling team• Host and maintain a complete mirror of the ALMA
archive• Provide duties at the OSF during observations• Manage the ARC nodes
41
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ESO ARC staff
ARC Astronomers:Scientific user support
(proposal, SB, OSF duties, technical assessment,
proposal handling)Help in managing the nodes
ARC Astronomers:Scientific user support
(proposal, SB, OSF duties, technical assessment,
proposal handling)Help in managing the nodes
ARC scientistsHelpdesk, SW testing and
implementation, SW feedback, archive queries
ARC scientistsHelpdesk, SW testing and
implementation, SW feedback, archive queries
Archive operations (system
administration, data delivery,
database)
Archive operations (system
administration, data delivery,
database)
7 astronomer
s
7 astronomer
s 5 scientists 5 scientists
5 contracto
rs
5 contracto
rs
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The role of the ARC nodes
• Provide one to one user support (proposal, SBs preparation, data reduction, archive research)
• Participate in the helpdesk• New software and techniques• Advanced data reduction• Scientific community development • Public relations and outreach
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
The ARC nodes: staff• Bonn-Bochum-Cologne, Germany (F. Bertoldi)• Current staff: Bonn: 2 staff astronomers (part-time 25-50%), 1 postdoc, IT support; Cologne: 4 staff
astronomers (part time 5-10%); Bochum: 3 staff astronomers (part time 30%) + 2 COFUND Fellows
• Bologna, Italy, (J. Brand)• Current staff: 5 staff astronomers (part-time), 3 postdocs, 1 technician, IT support, 1 staff position
advertised + 1 COFUND Fellow
• Onsala, Denmark, Sweden, Finland (J. Conway)• Current staff: 1 staff astronomers (at 30%), 1 astronomer + 1 SW engineer, maybe 1 more position
• IRAM, Grenoble, France, Spain, Germany (F. Gueth)• Current staff: 5 IRAM staff share the task ALMA/PdB support (10-50 %) 1 postdoc, + 3 SW engineer + 1
COFUND Fellows
• Leiden, The Netherlands, (M. Hogerheijde)• Current staff: 2 staff astronomers (part-time) + 2 postdocs, + 1 COFUND Fellow
• Manchester, United Kingdom (T. Muxlow)• Current staff: 4 staff astronomers (10-50%), 1 staff 100%, + 1 COFUND Fellow
• Ondřejov, Czech Republic (M. Karlický)• Current staff: 4 staff astronomers (10-50%), 1 SW engineer, IT support, 2 postdoc
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
List of expertise areas inthe EU ARC nodes
• High-frequency observing NL• Wide-field and high-dynamic-range imaging - UK/NL/IRAM (IRAM: short-spacings too)
• Mosaicing - I• Infrastructure for advanced data analysis tools – DE/NL/Nordic (Collaboration between the
Netherlands and Nordic Countries exists; ASTRONET funded ARTIST collaboration between Germany and Netherlands)
• Data handling/GRID-technology- I• Molecular spectroscopy, catalogues, models, NL/DE/CZ• Coordinating surveys/key-projects- I/UK• Polarimetry – DE/IRAM/I/UK• Astrometry – Nordic/DE/UK• Multi-frequency synthesis - Nordic/UK• Array combination imaging- UK (combining ACA and 12m array)• Robust self-calibration methods - Nordic/UK• Atmospheric phase calibration and use of the WVR data – IRAM/Nordic/UK• ALMA imaging simulations – IRAM/UK
• Interoperability and data publication UK• Solar physics CZ
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
User support and helpdesk
ARC nodes: f2f support,
helpdesk, SW feedback,
community activity
ARC nodes: f2f support,
helpdesk, SW feedback,
community activity
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Current TimelineCurrent Timeline• Start of CSV (Commissioning and Science Verification): End 2009 (3
antennas at the AOS)
• ESDP (Early Science Decision Point): Nov 2010 (call for proposals)– Mirror Archives in place– ALMA User Portal activated– ALMA Helpdesk activated
• Deadline for proposals (Early 2011)– PRC review procedure initiated
• Deadline for PRC final ranking (Mid 2011)– Preparation of SBs
• Start Early Science: Autumn 2011– Take and deliver data
• Inauguration: September 2012– More than 50 fully equipped antennas
• Baseline ALMA Construction Complete 2013
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Early Science Operations
• Start Science Operations before the ALMA construction finishes
• Minimum requirements for Early Science• Goals for Early Science• Early Science Operations
– One year scheduling period– Time shared with commissioning. At least 33% of available
time will be used for observations
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Minimum requirements for Early Science Operations
– 16 antennas with at least 3 receiver bands– Single field interferometry– Baselines out to 250m– Correlator modes (~20): a mixture of pseudo-continuum
(Time Division Mode) and spectral line (Frequency Division Mode) correlator configurations.
– Single dish mapping (zero baseline observations) of extended objects in continuum and spectral line mode
– Calibration better or comparable with existing mm-arrays
User Committee, Garching April 30 2010User Committee, Garching April 30 2010
Goals for Early Science
• In addition to the above minimum requirements:• Frequency bands: 3, 6, 7 and 9 on all antennas and 4 and 8 on as
many as possible• Array configurations: additional spacings out to a maximum baseline
of 1 km• Observing modes: interferometric pointed mosaics• Polarization: linear and circular polarization observations of compact
sources• Single dish: extended sources mappable in either continuum or
spectral lines, including On-The-Fly (continuous scanning)• Calibration: to a level better than already achieved on established
mm arrays
• In addition to the above minimum requirements:• Frequency bands: 3, 6, 7 and 9 on all antennas and 4 and 8 on as
many as possible• Array configurations: additional spacings out to a maximum baseline
of 1 km• Observing modes: interferometric pointed mosaics• Polarization: linear and circular polarization observations of compact
sources• Single dish: extended sources mappable in either continuum or
spectral lines, including On-The-Fly (continuous scanning)• Calibration: to a level better than already achieved on established
mm arrays
The first Call for Proposals will detail exactly what willbe available for Early Science. The first Call for Proposals will detail exactly what willbe available for Early Science.