Antabif training

ANTABIF Traininggetting your data online

Bruno Danis, Anton Van de Putte and Nabil Youdjou

Wednesday 26 October 11

Objectives

• familiarize with ANTABIF

• learn about architecture, functionalities tools and standards we offer

• hands on exercises with dummy and *real* data

• collect feedback on the fitness for use for this community

On the Menu Today

• Background about ANTABIF

• Technical overview

• Standards, tools and resources

• Functionalities

• Future directions

• Hands on

Background

Antarctic Treaty« In order to promote international cooperation in scientific investigation in Antarctica, […], the Contracting Parties agree that, to the greatest extent feasible and practicable: […]

Scientific observations and results from Antarctica shall be exchanged and made freely available. »

SCAR-MarBIN & ANTABIF

• www.scarmarbin.be

• www.antabif.be or www.biodiversity.aq

• Core funding: BELSPO.be

• International Polar Year 2007/08

• Census of Antarctic Marine Life

• Ocean Biogeographic Information System

• Global Biodiversity Information Facility

General Philosophy

• Build an electronic ecosystem

• Offer free and open access to data and technology

• Expose all the (biodiversity) data and metadata, in multiple contexts

• Remain community-driven, and collaborative

• Adopt strong standardization

• Work for science, conservation, management

Achievements

• The first RAMS

• Board of 60+ editors

• Feeds WoRMS, CoL and EoL

• 17,098 taxa (RAMS)

• Building a dynamic RAS

• 24,248 taxa (RAS)

Achievements

• 1,288,441 records

• 198 datasets

• 5,235 taxa

• Feeds OBIS, GBIF

• Downloadable

• WebGIS

• Webservices

Achievements

• Up since Oct 2005

• open access

• 909,915 visitors

• 8,093,774 hits

• 51,416,196 dld records

• Citations: 183

• Cited Publications: 38

Achievements

Records SMB ANTABIF Progress

Metadata 198 7.200 36,4

Occurrence 1.288.441 2.659.392 2,1

Taxonomy 17.184 30.472 1,8

Nuts and Bolts

100% Open Source

• Language: Ruby

• Framework: Rails(ActiveRecord) and YUI

• (smart) Search engine: Full text (Elasticsearch-Lucene)

• Database/GIS server/SpatialDB: PostGresql/Geoserver/PostGIS

• Mapping client: OpenLayers

• Web services: RESTish (all resources)

• Protocols/Standards: DIF, DwC, DwC-A, Tapir…etc

• GBIF tools : HIT, IPT

• Hosting: BeBIF (ULB/VUB joint IT Center)

• Metadata systems: GCMD API (DIF)

Data flow

Your data

standardize

upload publish

IPT ANTABIF

publish

Data Paper

(your point of view)

Data flow(our point of view)

Standards, tools, resources

MetadataInformation about datasets deteriorates over time!

Metadata

• preferred MD catalogue = Antarctic Master Directory (subset of GCMD)

• standard = DIF (Data Interchange Format)

• used by the whole SCAR community

• crawled by Google, Scopus...

DarwinCore

"A vocabulary of words that biologists, hackers, and citizen scientists use to broadly describe the biodiversity of life on earth."

DarwinCore Archive

• Complete package of data

–One file

–Multiple files

• Text Files…

• Self-documenting

• Intended to be shared/distributed

DarwinCore Archive

The core data file is a text file.

Archives always have a ‘core’ data file

My_data.txt

DarwinCore Archive

The core data file is a text file.

Archives always have a ‘core’ data file

My_data.txt

DarwinCore Archive

meta.xml describes the mappings in thecore data file (species.txt)

Darwin Core Archive (two files)

DarwinCore Archive

Columns in extensions are mapped to Darwin Core using the meta.xml file

Multiple extensions are available

DarwinCore Archive

h?p://rs.gbif.org/extension/

Many extensions are available

Spreadsheet templates

• Metadata - describe a database or other data resource.

• Species Occurrence - store basic species collections or observational data

• Species Checklists – recording and storing simple annotated species checklists.

Spreadsheet processor

• web application: Excel spreadsheet to DwC-A.

• Excel files contain data entry and GBIF metadata profile.

• Worksheet supports publication of primary biodiversity data

• Processor performs data validation and transformation and returns a validated DwC-A

DwC-A validator

• tests Darwin Core Archives

• validates the content against the known extensions and terms registered within the GBIF network for sharing biodiversity data.

IPT - Integrated Publishing Toolkit

• Publishing primary biodiversity data

• Resources

• Metadata

• Source Data (text, zip, SQL)

• Source Mappings

• Visibility

• Published Release

The Data Paper concept

• A scholarly journal publication whose primary purpose is to describe a dataset or group of datasets, rather than to report a research investigation.

• Benefits of the Data Paper

–Scholarly credit to Data Publishers

–Describe the data in structured human readable form

–Bring the existence of the data to the attention of the scholarly community

Data Paper: Incentivising Data Discovery

Data PaperMetadata document

Reward data publishing

• Complete metadata of a dataset using metadata editor in IPT 2.0.2

• Generate ‘Data Paper’ manuscript (menu: Manage Resource – RTF Download)

• Submit the manuscript for possible publication in one of the PenSoft publication (ZooKeys, PhytoKeys, BioRisks, NeoBiota).

• Revision (if any) is carried out using metadata editor in IPT 2.0.2 and manuscript re-submitted to PenSoft Open Journal System

Step-by-Step

• Digital Object Identifier is assigned to the Data Paper

• Paper is published in (a) print format, (b) PDF format, (c) semantically enhanced HTML, and (d) XML is archived in PubMedCentral

• DoI of the Data Paper is linked with the Persistent Identifier of the metadata document in the GBIF Registry

• Data Paper is indexed by Web of Knowledge (ISI), PubMedCentral, Scopus, Zoological Record, Google Scholar, CAB Abstracts, Directory of Open Access Journal (DOAJ), EBSCO.

Once paper is accepted

• Metadata is complete in all the respect

• All the claims are adequately substantiated

• Data described in ‘Data Paper’ is freely available at the time of submission of the manuscript

Important to consider

ORC• GBIF’s Online Resource Center

• Provides access to documents, best practices, tools and links

• Wide thematic scope

• Different ways of accessing resources

• Enabling community contributions

• Different levels of resource access

• Multilanguage supportWednesday 26 October 11

Functionalities

www.biodiversity.aq

• general website

• latest news

• contact

• sponsors

• governance

• links

www. biodiversity.aq

data. biodiversity.aq

• find primary biodiversity data

• visualize occurrence data on map

• view taxonomic data

• download data

• view metrics

• send feedback

• access technical documentation

data. biodiversity.aq

ipt. biodiversity.aq

• prepare and clean your data

• publish primary biodiversity data

• publish metadata

• push data and metadata to ANTABIF & GBIF

• get a Data Paper

ipt. biodiversity.aq

afg. biodiversity.aq

• (nice-looking) Identification aid

• Publication/sharing platform for customized Field Guides

• High quality (useful) pictures

• Expert Descriptions

• Built dynamically from various sources

afg. biodiversity.aq

share. biodiversity.aq

• download shared resources

• reports, communication material

• original datasets, tools, resources

share. biodiversity.aq

• polarcommons.org

• Emergency solution for orphan datasets

• Setup of a commons

• IT cloud

• Set of norms

• All polar data (IPY)

• Simple procedure!

www.polarcommons.org

Future directions

Architecture

• A network of IPTs

• Enhanced data flow

• Community involved in data management

• Enhanced interoperability

• Optimization of research efforts/resources

• Integrative, connected science

• Factual, adaptative conservation

Challenges ahead

• Data intensive science

• Data deluge

• Digital divides

• Other data types and integration

• Orphan datasets

• Cultural change

Hands on now

The rest of the day

• Using the portals

• Using data tools

• templates

• data validation

• documentation

• publishing

http://share.biodiversity.aq/training/

Antabif training

Technology

Business intelligence training for students, recruiters, managers, job seekers - erp training - etl training - excel training - excelsius training - sap training

Antabif on mars

Joomla Training ManualJoomla Training ManualJoomla Training ManualJoomla Training ManualJoomla Training ManualJoomla Training ManualJoomla Training ManualJoomla Training ManualJoomla

initial training : Social Fund periodic training : FCBO Training

Ab Initio Online Training | ABinitio training Tutorial | Online Abinitio Training | Online Abinitio Training

Medical Coding Training | SEO Training | Web Design Training

windows training | windows training pdf | windows training course | windows training videos

Certifying Officers Legislation Training (COL Training) Training... · Certifying Officers Legislation Training (COL Training) To access the COL training class you must first open

Training Methods Interval Training Continuous Training Fartlek Training Circuit Training Plyometric Training Flexibility Training Resistance Training

informix training | informix training courses | informix training uk | informix online training

METHODS of TRAINING. There are 5 principle training methods: 1.INTERVAL TRAINING 2.CONTINUOUS TRAINING 3.FARTLEK TRAINING 4.CIRCUIT TRAINING 5.WEIGHT

ccna training | ccna training videos | ccna online training | ccna training course

Professional Training Solutions IT Training · PDF fileProfessional Training Solutions IT Training Brochure ... • Training Course Development ... Professional Training Solutions

PHP training || Java training || J2EE training || Dot net training || in Malleswaram || Bangalore

Danis antabif kickoff

140712 antabif egbamm

Cultural diversity training, organizational leadership training, diversity sensitivity training, diversity awareness training

CU Staff Training Teller Training Lending Training Collection Training IT Training And Much More

OSHA Training Requirements DOT Training Requirements EPA Training … User Guide.pdf · OSHA Training Requirements DOT Training Requirements EPA Training Requirements Other (SafeLand/RigPass/SafeGulf)

Antabif general