20
Reiner Schlitzer Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Alfred Wegener Institute for Polar and Marine Research Ocean Data View - Ocean Data View - Available Data Collections Available Data Collections and Data Model and Data Model

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Embed Size (px)

DESCRIPTION

Ocean Data View - Available Data Collections and Data Model. Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research. Available Datasets. Many important oceanographic and other geo-referenced datasets are available for download as ready-to-use ODV collections…. - PowerPoint PPT Presentation

Citation preview

Page 1: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Reiner SchlitzerReiner Schlitzer

Alfred Wegener Institute for Polar and Marine ResearchAlfred Wegener Institute for Polar and Marine Research

Ocean Data View -Ocean Data View -Available Data Collections Available Data Collections and Data Modeland Data Model

Page 2: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Available DatasetsAvailable Datasets

Many important oceanographic and other geo-Many important oceanographic and other geo-referenced datasets are available for download as referenced datasets are available for download as ready-to-use ODV collections…ready-to-use ODV collections…

See: http://odv.awi-bremerhaven.de/data.htmlfor complete list of datasets.

Page 3: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Oceanography – Historical DataOceanography – Historical Data

Reid & MantylaReid & Mantyla

South Atlantic Ventilation Experiment (SAVE)South Atlantic Ventilation Experiment (SAVE)

Page 4: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Oceanography - CarbonOceanography - Carbon

Page 5: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Oceanography - WOCEOceanography - WOCE

Page 6: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research
Page 7: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Other – River DischargeOther – River Discharge

Vorosmarty, Fekete,Vorosmarty, Fekete,and Tucker (1018 stations)and Tucker (1018 stations)

Page 8: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Station SelectionStation Selection

Build large dataBuild large datacollectionscollections Apply selection criteriaApply selection criteria

Analyze stationAnalyze stationsubsetsubset

Page 9: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Station…Station…

Point in space and time, where some Point in space and time, where some measurements have been made.measurements have been made.

ODV Data ConceptODV Data Concept

Page 10: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODVODV Station MetadataStation Metadata

MeaningMeaning Generic LabelGeneric Label TypeType

Cruise label Cruise string (20 char. max)

Station label Station string (20 char. max)

Station type Type string (1 char.)

Date of observation or deployment mon/day/yr string (mm/dd/yyyy)

Time of observation or deployment hh:mm string (hh:mm)

Decimal longitude of station [degrees east] Longitude [degrees_east] float

Decimal latitude of station [degrees north] Latitude [degrees_north] float

Bottom depth at station, or instrument depth

Bot. Depth [m] float

CruiseCruise Station Station Type Type mon/day/yrmon/day/yr hh:mm hh:mm A05_29HE06_1A05_29HE06_1 3232 BB 7/28/19927/28/1992 20:2320:23

Longitude [degrees_east]Longitude [degrees_east] Latitude [degrees_north]Latitude [degrees_north] Bot. Depth [m]Bot. Depth [m]326.665326.665 24.50224.502 61916191

Page 11: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODVODV Station DataStation Data

Data for up to 50 variables at up to 20,000 Data for up to 50 variables at up to 20,000 observed depths or times.observed depths or times.

Profile Example:Profile Example:

Page 12: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODVODV Station DataStation Data

Time Series Example:Time Series Example:

Page 13: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODV Generic Spreadsheet FormatODV Generic Spreadsheet FormatCategoryCategory SpecificationSpecification

General ASCII coding

File extension .txt

Comment lines Start with // as first two characters (comment lines are added to the collection .info file during import). Comment lines may appear anywhere in the file.

Columns Station header information (metadata) and data values for up to 50 variables are stored in separate columns. Header and data columns can be in arbitrary order. All non-comment lines in the file must have the same number of columns.

Column separation character TAB or ;

Header Line

(first non-comment line; must be present)

1.Contains column labels.

2.The following metadata header labels must be used exactly as given below: Cruise, Station, Type, mon/day/yr, hh:mm, Longitude [degrees_east] , Latitude [degrees_north], Bot. Depth [m].

3.Labels for data variables can be up to 60 characters long and should include unit specifications enclosed in brackets [ ].

4.Each column for a data variable can have an optional quality-flag column immediately following the variable to which it belongs. The label of a quality-flag column must be either QF or QF:* where * can be an arbitrary character sequence.

Page 14: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODV Generic Spreadsheet FormatODV Generic Spreadsheet Format

Data Lines

(2nd … last non-comment line)

1.Each line contains metadata and data for one sample. All samples of a given station must be in consecutive order but need not be sorted. An ODV Spreadsheet file can store the data of many stations from many cruises.

2.Cruise and station labels are limited to a maximum of 20 characters. The use of numbers for the station label will enable enhanced internal sorting and selection functionality and is recommended.

3.Station Type is a single character string. You should use B for stations with less than about 250 samples (e.g., bottle data) and C for stations with more than about 250 samples (e.g., CTD, XBT, etc.). Specifying * for Type lets ODV make the choice.

4.If Bot. Depth is not available, use “0” (zero) in this field.

5.The station header information must be present on the first line of each station. On the remaining lines of a given station you may repeat the station header information, or you may leave the header columns empty to reduce file size.

Quality flag columns 1.If data quality information is available for a given variable, this information is stored in the column immediately following to the right of the variable to which it belongs.

2.Quality flags are single digit integers: 0=good, 1=unknown, 4=questionable, 8=bad.

Missing data value Blank field or –1.e10.

Page 15: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research
Page 16: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research
Page 17: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODV Collection FormatODV Collection Format

• optimized for variable length profiles/sequences (original optimized for variable length profiles/sequences (original data or data products)data or data products)

• binary format providing dense storage and fast data binary format providing dense storage and fast data accessaccess

• support for data quality flagssupport for data quality flags

• expandableexpandable

• platform-independentplatform-independent

• can be used for many different data typescan be used for many different data types

Page 18: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

ODV Collection FilesODV Collection Files

Extension Format Comment

Basic filesBasic files Must be present. Must be present.

<col>.var ASCII Defines collection variables, stores collection name and number of stations. On Windows this file type is automatically associated with the ODV executable, e.g. double-clicking on the .var file starts ODV and opens the respective collection.

<col>.hob binary Stores the station meta-data (name, position, date, etc.).

<col>.dob binary Stores the actual station data and quality flags.

Info FileInfo File OptionalOptional

<col>.info ASCII Description of the collection (in freeform text format). ODV automatically creates an .info file containing information on dimensions and variables, when opening a netCDF file.

Auxiliary FilesAuxiliary Files If not present, ODV automatically creates these files.If not present, ODV automatically creates these files.

<col>.inv ASCII Collection inventory listing by cruises.

<col>.cid binary Cruise ID numbers

<col>.log ASCII Collection log file. Keeps records of data changes.

<col>.idv ASCII Lists IDs of key variables used as input for derived variables (depth, temperature, oxygen, etc.)

<col>.cfl ASCII Contains names of most recently used configuration file and output directory.

<any>.cfg binary Configuration files storing layout, value ranges, derived and iso-surface variable selections, and many other settings. The name of the collection that owns a configuration is recorded inside the cfg file. Certain restrictions apply, if a different collection uses the cfg file.

<any>.sec ASCII Stores section outlines and characteristics.

Page 19: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

•World Ocean Database (US NODC)World Ocean Database (US NODC)

•WOCE (all data types, various netCDF and WOCE (all data types, various netCDF and spreadsheet formats)spreadsheet formats)

•Medatlas profile and time series formatsMedatlas profile and time series formats

•ARGO profile and trajectory formatsARGO profile and trajectory formats

•SD2 formatSD2 format

•Various spreadsheet formatsVarious spreadsheet formats

Supported Import FormatsSupported Import Formats

Page 20: Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Example: World Ocean Database FormatExample: World Ocean Database Format

B4133478575489905141591985 1 122110452-3480452-41232280 411410120101301019010191B4133478575489905141591985 1 122110452-3480452-41232280 4114101201013010190101911 5156712751811774473000013440630314330929172201321044060002291107291110329977021 51567127518117744730000134406303143309291722013210440600022911072911103299770200612601100004421860005533588000332545003328150022013004421826005533588000332546006126011000044218600055335880003325450033281500220130044218260055335880003325460033281900220260044218220055335910003325390033282100220390044218040055335900003300332819002202600442182200553359100033253900332821002203900442180400553359000033254200332821002206600442172400553358200033254600332823002209800442160300553357302542003328210022066004421724005533582000332546003328230022098004421603005533573000332532003328200033013000442154200553356600033252700332820003301960044215100055003325320033282000330130004421542005533566000332527003328200033019600442151000553356300033252800332818003302620044214800055335580003325280033281800330328004421333563000332528003328180033026200442148000553355800033252800332818003303280044213960055335430003325160033281600330393004421344005533534000332517003328160033052909600553354300033251600332816003303930044213440055335340003325170033281600330529003329790055334790003324850033280900330660003326460055334440003325520033280800330033297900553347900033248500332809003306600033264600553344400033255200332808003307790033254500553343200033256300332807004401016003323550055334240003325520033280477900332545005533432000332563003328070044010160033235500553342400033255200332804004401252003322920055334330003324940033280000440149700332278005533450000332436000044012520033229200553343300033249400332800004401497003322780055334500003324360033279800440182200332308005533468000332454003328010044019800033231200553347600033332798004401822003323080055334680003324540033280100440198000332312005533476000332467003328020044023960033233600553349000033253600332806004402540003323150055334824670033280200440239600332336005533490000332536003328060044025400033231500553348800033256600332801004403099003322570055334880003325450033280900440337400332214008000332566003328010044030990033225700553348800033254500332809004403374003322140055334840003325340033280900440364800332137005533474000332507003328060044039600022553348400033253400332809004403648003321370055334740003325070033280600440396000222560055334710003324900033280400440419800222290055334700003325560033281000440445625600553347100033249000332804004404198002222900553347000033255600332810004404456002222000553346800033251200332806004404715002222000--- 002222000553346800033251200332806004404715002222000--- B4138078526776745107211985 1 13321527754835833785-1110167100 01811 4166B23914113B4138078526776745107211985 1 13321527754835833785-1110167100 01811 4166B2391411330172144401027229110729977020061264126115111103141101173301912163321522303301722301721444010272291107299770200612641261151111031411011733019121633215223033017221319115508525700123311000013331100002103303000021722015002202206800227441100030213191155085257001233110000133311000021033030000217220150022022068002274411000302284426810002307704282000001911550888020012331100001333110000210330100002171102002844268100023077042820000019115508880200123311000013331100002103301000021711020022022068002273313333022844268100023077042820000018115508576700123311000013331100220220680022733133330228442681000230770428200000181155085767001233110000133311000021022050002202206800227331167302284426810002307704282000001811550857560012331100210220500022022068002273311673022844268100023077042820000018115508575600123311