Embed Size (px)
Citation preview
The Global PoolThe Global Pool
The Global PoolThe Global Pool
AstroWise Workshop20-11-2006
AstroWise Workshop20-11-2006
list of active and potential calibratorslist of active and potential calibratorslist of active and potential calibratorslist of active and potential calibrators
The Global PoolThe Global PoolThe Global PoolThe Global Pool
• Why– Calibration refinement
• What– Astrometric calibration– Photometric calibration
• How– DB storage– Global processing
• Why– Calibration refinement
• What– Astrometric calibration– Photometric calibration
• How– DB storage– Global processing
Why a global poolWhy a global poolWhy a global poolWhy a global pool
• Higher precision– Astrometric reference frame
• Large errors on dense catalogs• Small errors on sparse catalogs
– Photometric calibration grid
• New calibrators– Increase density of astrometric grid– Build secondary photometric standards
• Higher precision– Astrometric reference frame
• Large errors on dense catalogs• Small errors on sparse catalogs
– Photometric calibration grid
• New calibrators– Increase density of astrometric grid– Build secondary photometric standards
What is the global poolWhat is the global poolWhat is the global poolWhat is the global pool
• Data store of (potential) calibrators• Source Pool
– Ever growing– Source extractions
• Positions• Fluxes
• Catalog– Predefined slice from the Source Pool
• Calibrators– Catalog with calibration status sources
• Data store of (potential) calibrators• Source Pool
– Ever growing– Source extractions
• Positions• Fluxes
• Catalog– Predefined slice from the Source Pool
• Calibrators– Catalog with calibration status sources
Actions on global poolActions on global poolActions on global poolActions on global pool
• Use– Astrom – input reference catalog– Photom – input standard star catalog
• Add– SAssociate single chip/global catalogs
• Validate– Check reliability of information
• Modify– Derive new values
• Use– Astrom – input reference catalog– Photom – input standard star catalog
• Add– SAssociate single chip/global catalogs
• Validate– Check reliability of information
• Modify– Derive new values
How to build the global poolHow to build the global poolHow to build the global poolHow to build the global pool
• Filled with known calibrators– USNO, GSC, Hipparcos, ... (weights)– Landolt, SDSS, etc.
• Adding potential candidates– Selections from the standard pipeline processing– One or more characteristics
• Position measurements• Flux measurements
• Evaluating candidates• Deriving new calibrators
• Filled with known calibrators– USNO, GSC, Hipparcos, ... (weights)– Landolt, SDSS, etc.
• Adding potential candidates– Selections from the standard pipeline processing– One or more characteristics
• Position measurements• Flux measurements
• Evaluating candidates• Deriving new calibrators
Filling the global pool (1)Filling the global pool (1)Filling the global pool (1)Filling the global pool (1)
• At calibration pipeline processing– Astrometric pipeline
• Calibration source extractions• Overlap source extractions• Other high SNR extractions (stellar objects)
– Multiple extraction of same source• Re-run of pipeline• Reobservation of sky area• Associations of ‘same’ source (association lists)
• At calibration pipeline processing– Astrometric pipeline
• Calibration source extractions• Overlap source extractions• Other high SNR extractions (stellar objects)
– Multiple extraction of same source• Re-run of pipeline• Reobservation of sky area• Associations of ‘same’ source (association lists)
Filling the global pool (2)Filling the global pool (2)Filling the global pool (2)Filling the global pool (2)
PipelinePipelineAssociateAssociate
calibratorcalibrator extractionextraction
PipelinePipelineAssociateAssociate
extractionextraction extractionextraction
Pool SourcePool Source IngestIngestAssociateAssociate
calibratorcalibrator candidatecandidatePhysical sourcePhysical sourcePhysical sourcePhysical source
Filling the global pool (3)Filling the global pool (3)Filling the global pool (3)Filling the global pool (3)IdentityIdentity unique id per physical sourceunique id per physical sourceOriginOrigin external, measured, derivedexternal, measured, derivedPositionPosition measured or derived positionsmeasured or derived positionsPositional errorPositional errorSignalSignal signal/flux/magnitudesignal/flux/magnitudeSignal errorSignal errorAstrom weightAstrom weight 0 … 10 … 1Photom weightPhotom weight 0 … 10 … 1QualityQuality unknown, calibratedunknown, calibratedVersionVersion 1 … N1 … NVariableVariable y/ny/nProper motionProper motion y/ny/nStatusStatus unknown, validated, calibratorunknown, validated, calibratorFlagsFlags TBDTBDObsdateObsdateChipidChipidfiltidfiltid
Filling the global pool (4)Filling the global pool (4)Filling the global pool (4)Filling the global pool (4)
• Calibrator– Reference calibrator
• Original calibration data• Multiple source extractions
– New calibrator• Derived calibration data• Multiple source extractions
• Potential calibrator– No calibration data– Multiple source extractions
• Calibrator– Reference calibrator
• Original calibration data• Multiple source extractions
– New calibrator• Derived calibration data• Multiple source extractions
• Potential calibrator– No calibration data– Multiple source extractions
Deriving calibrators (1)Deriving calibrators (1)Deriving calibrators (1)Deriving calibrators (1)
• Evaluate a given source (verify())– Determine candidate status
• Stable (proper motion, variable, ...)• High SNR information• Enough measurements
• Promote/demote to/from calibrator– Model description of instrument– Large time interval processing
• Evaluate a given source (verify())– Determine candidate status
• Stable (proper motion, variable, ...)• High SNR information• Enough measurements
• Promote/demote to/from calibrator– Model description of instrument– Large time interval processing
Deriving calibrators (2)Deriving calibrators (2)Deriving calibrators (2)Deriving calibrators (2)
• Model description Astrometric– Optical path modelling– Independent parametrization from standard
pipeline processing– History on extracted source information– Association information– Multiple pointings– Multiple filters
• Model description Astrometric– Optical path modelling– Independent parametrization from standard
pipeline processing– History on extracted source information– Association information– Multiple pointings– Multiple filters
Deriving calibrators (3)Deriving calibrators (3)Deriving calibrators (3)Deriving calibrators (3)
• Create new entry in Source Pool– New derived information– Status: calibator– Quality: calibrated– Weight: 0 … 1 (errors)
• Demote older calibrator entry– Last = best?– History of calibration
• Create new entry in Source Pool– New derived information– Status: calibator– Quality: calibrated– Weight: 0 … 1 (errors)
• Demote older calibrator entry– Last = best?– History of calibration
Deriving calibrators (4)Deriving calibrators (4)Deriving calibrators (4)Deriving calibrators (4)Id:1 seqnr:1 Status:calibrator Obsdate: 20030405Id:1 seqnr:1 Status:calibrator Obsdate: 20030405Id:1 seqnr:2 Status:unknown Obsdate: 20051201Id:1 seqnr:2 Status:unknown Obsdate: 20051201Id:1 seqnr:3 Status unknown Obsdate: 20051204Id:1 seqnr:3 Status unknown Obsdate: 20051204Id:1 seqnr:4 Status:unknown Obsdate: 20060101Id:1 seqnr:4 Status:unknown Obsdate: 20060101Id:1 seqnr:5 Status unknown Obsdate: 20060523Id:1 seqnr:5 Status unknown Obsdate: 20060523Id:1 seqnr:6 Status:calibrator Obsdate: 20060723Id:1 seqnr:6 Status:calibrator Obsdate: 20060723Id:1 seqnr:7 Status: unknown Obsdate: 20061010Id:1 seqnr:7 Status: unknown Obsdate: 20061010Id:1 seqnr:8 Status: unknown Obsdate: 20061011Id:1 seqnr:8 Status: unknown Obsdate: 20061011Id:2 seqnr:1 Status:calibrator Obsdate: 20030405Id:2 seqnr:1 Status:calibrator Obsdate: 20030405Id:2 seqnr:2 Status:unknown Obsdate: 20040909Id:2 seqnr:2 Status:unknown Obsdate: 20040909Id:2 seqnr:3 Status unknown Obsdate: 20041001Id:2 seqnr:3 Status unknown Obsdate: 20041001Id:2 seqnr:4 Status:unknown Obsdate: 20041230Id:2 seqnr:4 Status:unknown Obsdate: 20041230Id:2 seqnr:5 Status unknown Obsdate: 20050305Id:2 seqnr:5 Status unknown Obsdate: 20050305Id:2 seqnr:6 Status:unknown Obsdate: 20050809Id:2 seqnr:6 Status:unknown Obsdate: 20050809Id:2 seqnr:7 Status: calibrator Obsdate: 20060723Id:2 seqnr:7 Status: calibrator Obsdate: 20060723Id:2 seqnr:8 Status: unknown Obsdate: 20061120Id:2 seqnr:8 Status: unknown Obsdate: 20061120Id:3 seqnr:1 Status: unknown Obsdate: 20060402Id:3 seqnr:1 Status: unknown Obsdate: 20060402Id:3 seqnr:2 Status: unknown Obsdate: 20060505Id:3 seqnr:2 Status: unknown Obsdate: 20060505Id:3 seqnr:3 Status: calibrator Obsdate: 20060723Id:3 seqnr:3 Status: calibrator Obsdate: 20060723
Calibration consquencesCalibration consquencesCalibration consquencesCalibration consquences
• Every N months a new calibrator set– Regenerate all calibrated data– Regenerate all extractions that added to the
Source Pool• Iterative process
• Calibration refinement throughout observing
• Every N months a new calibrator set– Regenerate all calibrated data– Regenerate all extractions that added to the
Source Pool• Iterative process
• Calibration refinement throughout observing
Global PoolGlobal PoolGlobal PoolGlobal Pool
Virtual sky of calibratorsVirtual sky of calibratorsVirtual sky of calibratorsVirtual sky of calibrators
