Upload
gage-foley
View
24
Download
0
Embed Size (px)
DESCRIPTION
Ocean Data View - Available Data Collections and Data Model. Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research. Available Datasets. Many important oceanographic and other geo-referenced datasets are available for download as ready-to-use ODV collections…. - PowerPoint PPT Presentation
Citation preview
Reiner SchlitzerReiner Schlitzer
Alfred Wegener Institute for Polar and Marine ResearchAlfred Wegener Institute for Polar and Marine Research
Ocean Data View -Ocean Data View -Available Data Collections Available Data Collections and Data Modeland Data Model
Available DatasetsAvailable Datasets
Many important oceanographic and other geo-Many important oceanographic and other geo-referenced datasets are available for download as referenced datasets are available for download as ready-to-use ODV collections…ready-to-use ODV collections…
See: http://odv.awi-bremerhaven.de/data.htmlfor complete list of datasets.
Oceanography – Historical DataOceanography – Historical Data
Reid & MantylaReid & Mantyla
South Atlantic Ventilation Experiment (SAVE)South Atlantic Ventilation Experiment (SAVE)
Oceanography - CarbonOceanography - Carbon
Oceanography - WOCEOceanography - WOCE
Other – River DischargeOther – River Discharge
Vorosmarty, Fekete,Vorosmarty, Fekete,and Tucker (1018 stations)and Tucker (1018 stations)
Station SelectionStation Selection
Build large dataBuild large datacollectionscollections Apply selection criteriaApply selection criteria
Analyze stationAnalyze stationsubsetsubset
Station…Station…
Point in space and time, where some Point in space and time, where some measurements have been made.measurements have been made.
ODV Data ConceptODV Data Concept
ODVODV Station MetadataStation Metadata
MeaningMeaning Generic LabelGeneric Label TypeType
Cruise label Cruise string (20 char. max)
Station label Station string (20 char. max)
Station type Type string (1 char.)
Date of observation or deployment mon/day/yr string (mm/dd/yyyy)
Time of observation or deployment hh:mm string (hh:mm)
Decimal longitude of station [degrees east] Longitude [degrees_east] float
Decimal latitude of station [degrees north] Latitude [degrees_north] float
Bottom depth at station, or instrument depth
Bot. Depth [m] float
CruiseCruise Station Station Type Type mon/day/yrmon/day/yr hh:mm hh:mm A05_29HE06_1A05_29HE06_1 3232 BB 7/28/19927/28/1992 20:2320:23
Longitude [degrees_east]Longitude [degrees_east] Latitude [degrees_north]Latitude [degrees_north] Bot. Depth [m]Bot. Depth [m]326.665326.665 24.50224.502 61916191
ODVODV Station DataStation Data
Data for up to 50 variables at up to 20,000 Data for up to 50 variables at up to 20,000 observed depths or times.observed depths or times.
Profile Example:Profile Example:
ODVODV Station DataStation Data
Time Series Example:Time Series Example:
ODV Generic Spreadsheet FormatODV Generic Spreadsheet FormatCategoryCategory SpecificationSpecification
General ASCII coding
File extension .txt
Comment lines Start with // as first two characters (comment lines are added to the collection .info file during import). Comment lines may appear anywhere in the file.
Columns Station header information (metadata) and data values for up to 50 variables are stored in separate columns. Header and data columns can be in arbitrary order. All non-comment lines in the file must have the same number of columns.
Column separation character TAB or ;
Header Line
(first non-comment line; must be present)
1.Contains column labels.
2.The following metadata header labels must be used exactly as given below: Cruise, Station, Type, mon/day/yr, hh:mm, Longitude [degrees_east] , Latitude [degrees_north], Bot. Depth [m].
3.Labels for data variables can be up to 60 characters long and should include unit specifications enclosed in brackets [ ].
4.Each column for a data variable can have an optional quality-flag column immediately following the variable to which it belongs. The label of a quality-flag column must be either QF or QF:* where * can be an arbitrary character sequence.
ODV Generic Spreadsheet FormatODV Generic Spreadsheet Format
Data Lines
(2nd … last non-comment line)
1.Each line contains metadata and data for one sample. All samples of a given station must be in consecutive order but need not be sorted. An ODV Spreadsheet file can store the data of many stations from many cruises.
2.Cruise and station labels are limited to a maximum of 20 characters. The use of numbers for the station label will enable enhanced internal sorting and selection functionality and is recommended.
3.Station Type is a single character string. You should use B for stations with less than about 250 samples (e.g., bottle data) and C for stations with more than about 250 samples (e.g., CTD, XBT, etc.). Specifying * for Type lets ODV make the choice.
4.If Bot. Depth is not available, use “0” (zero) in this field.
5.The station header information must be present on the first line of each station. On the remaining lines of a given station you may repeat the station header information, or you may leave the header columns empty to reduce file size.
Quality flag columns 1.If data quality information is available for a given variable, this information is stored in the column immediately following to the right of the variable to which it belongs.
2.Quality flags are single digit integers: 0=good, 1=unknown, 4=questionable, 8=bad.
Missing data value Blank field or –1.e10.
ODV Collection FormatODV Collection Format
• optimized for variable length profiles/sequences (original optimized for variable length profiles/sequences (original data or data products)data or data products)
• binary format providing dense storage and fast data binary format providing dense storage and fast data accessaccess
• support for data quality flagssupport for data quality flags
• expandableexpandable
• platform-independentplatform-independent
• can be used for many different data typescan be used for many different data types
ODV Collection FilesODV Collection Files
Extension Format Comment
Basic filesBasic files Must be present. Must be present.
<col>.var ASCII Defines collection variables, stores collection name and number of stations. On Windows this file type is automatically associated with the ODV executable, e.g. double-clicking on the .var file starts ODV and opens the respective collection.
<col>.hob binary Stores the station meta-data (name, position, date, etc.).
<col>.dob binary Stores the actual station data and quality flags.
Info FileInfo File OptionalOptional
<col>.info ASCII Description of the collection (in freeform text format). ODV automatically creates an .info file containing information on dimensions and variables, when opening a netCDF file.
Auxiliary FilesAuxiliary Files If not present, ODV automatically creates these files.If not present, ODV automatically creates these files.
<col>.inv ASCII Collection inventory listing by cruises.
<col>.cid binary Cruise ID numbers
<col>.log ASCII Collection log file. Keeps records of data changes.
<col>.idv ASCII Lists IDs of key variables used as input for derived variables (depth, temperature, oxygen, etc.)
<col>.cfl ASCII Contains names of most recently used configuration file and output directory.
<any>.cfg binary Configuration files storing layout, value ranges, derived and iso-surface variable selections, and many other settings. The name of the collection that owns a configuration is recorded inside the cfg file. Certain restrictions apply, if a different collection uses the cfg file.
<any>.sec ASCII Stores section outlines and characteristics.
•World Ocean Database (US NODC)World Ocean Database (US NODC)
•WOCE (all data types, various netCDF and WOCE (all data types, various netCDF and spreadsheet formats)spreadsheet formats)
•Medatlas profile and time series formatsMedatlas profile and time series formats
•ARGO profile and trajectory formatsARGO profile and trajectory formats
•SD2 formatSD2 format
•Various spreadsheet formatsVarious spreadsheet formats
Supported Import FormatsSupported Import Formats
Example: World Ocean Database FormatExample: World Ocean Database Format
B4133478575489905141591985 1 122110452-3480452-41232280 411410120101301019010191B4133478575489905141591985 1 122110452-3480452-41232280 4114101201013010190101911 5156712751811774473000013440630314330929172201321044060002291107291110329977021 51567127518117744730000134406303143309291722013210440600022911072911103299770200612601100004421860005533588000332545003328150022013004421826005533588000332546006126011000044218600055335880003325450033281500220130044218260055335880003325460033281900220260044218220055335910003325390033282100220390044218040055335900003300332819002202600442182200553359100033253900332821002203900442180400553359000033254200332821002206600442172400553358200033254600332823002209800442160300553357302542003328210022066004421724005533582000332546003328230022098004421603005533573000332532003328200033013000442154200553356600033252700332820003301960044215100055003325320033282000330130004421542005533566000332527003328200033019600442151000553356300033252800332818003302620044214800055335580003325280033281800330328004421333563000332528003328180033026200442148000553355800033252800332818003303280044213960055335430003325160033281600330393004421344005533534000332517003328160033052909600553354300033251600332816003303930044213440055335340003325170033281600330529003329790055334790003324850033280900330660003326460055334440003325520033280800330033297900553347900033248500332809003306600033264600553344400033255200332808003307790033254500553343200033256300332807004401016003323550055334240003325520033280477900332545005533432000332563003328070044010160033235500553342400033255200332804004401252003322920055334330003324940033280000440149700332278005533450000332436000044012520033229200553343300033249400332800004401497003322780055334500003324360033279800440182200332308005533468000332454003328010044019800033231200553347600033332798004401822003323080055334680003324540033280100440198000332312005533476000332467003328020044023960033233600553349000033253600332806004402540003323150055334824670033280200440239600332336005533490000332536003328060044025400033231500553348800033256600332801004403099003322570055334880003325450033280900440337400332214008000332566003328010044030990033225700553348800033254500332809004403374003322140055334840003325340033280900440364800332137005533474000332507003328060044039600022553348400033253400332809004403648003321370055334740003325070033280600440396000222560055334710003324900033280400440419800222290055334700003325560033281000440445625600553347100033249000332804004404198002222900553347000033255600332810004404456002222000553346800033251200332806004404715002222000--- 002222000553346800033251200332806004404715002222000--- B4138078526776745107211985 1 13321527754835833785-1110167100 01811 4166B23914113B4138078526776745107211985 1 13321527754835833785-1110167100 01811 4166B2391411330172144401027229110729977020061264126115111103141101173301912163321522303301722301721444010272291107299770200612641261151111031411011733019121633215223033017221319115508525700123311000013331100002103303000021722015002202206800227441100030213191155085257001233110000133311000021033030000217220150022022068002274411000302284426810002307704282000001911550888020012331100001333110000210330100002171102002844268100023077042820000019115508880200123311000013331100002103301000021711020022022068002273313333022844268100023077042820000018115508576700123311000013331100220220680022733133330228442681000230770428200000181155085767001233110000133311000021022050002202206800227331167302284426810002307704282000001811550857560012331100210220500022022068002273311673022844268100023077042820000018115508575600123311