co-funded by the European Community eContentplus programme

The NATURE-SDIplus Solution

for Data Harmonisation

2

PRESENTATION OVERVIEW The DH-TWG The DH methodology The procedure for data transformation The procedure for metadata transformation The guidelines The matching tables The transformation tools A practical example of data remodeling The methodology to facilitate and to monitor the status of

the DH process

3

Data harmonisation process involves: Different players (data providers, technological

partners, research partners) Operational implementation of DH impacts on

different tasks

WHY A DH-TWG?

3

Need of a dedicated technical coordination DH-TWG

4

T5.2: Data accessibility and usability evaluation

(Fraunhofer)

T2.3: Data set analysis and systematisation

(UNIABDN)

T3.1: Mmultilingual and multicultural issue

(CNR-IMATI)

T3.2: Metadata profile (IRD)

T4.1 Harmonised datasets (Tracasa )

T5.1: Data interoperability validation (NEN)

T5.3: Quality evaluation and datasets generalization

(AGI)

T4.2: Geoportal specification (GT)

T 3.3 Data model (Tracasa)

T3.4:Procedures for metadata and model implementation

(Tracasa)

T4.3: Geoportal (INGR)

WP2WP2

WP4WP4

WP5WP5

WP3WP3

WFS

WMS

T6.1: Guidelines for service provision (INGR)

WP6WP6

CSW

LINKED TASKS

THE OVERALL DH METHODOLOGY (1/3)

SOURCE SIDE TARGET SIDE

Selection of the target schema

Analysis of the target schema

Creation of the Matching table

Matching analysis

Data transformation

HARMONISED DATASET

TOOLSGUIDELINES

&PROCEDURES

Selection of the sample DS

Analysis and schematisationof the sample DS

5

THE OVERALL DH METHODOLOGY (2/3)

Provider A Data Model

Geoportal

.SHP

.TAB

...

Provider A Provider B Provider C

Tool CTool A Tool B

OGC Services: WMS,WFS, ...

GeoDataBase CGeoDataBase B

GeoDataBase A

<GML><GML>

OG

C S

ervi

ces

(WM

S, W

FS

, ..)

.

OG

C S

ervi

ces

(WM

S, W

FS, .

.).

OGC Services (WMS, W

FS, ..).

SOURCE DATA MODEL

TRANSFORMATION TOOLS

NATURE SDI+ DATA MODEL

NATURE SDI+ Intranet

Dow

nload (GM

L, ZIP)

Dow

nloa

d (G

ML,

ZIP

)

Download (GML, ZIP)

GeoDataBase A

<GML><GML>

<GML><GML>

Web Map Server Web Map Server Web Map Server

Downlo

ad (G

ML,

ZIP

)

(*)(*)(*)

(*) : The best data format for creating services Depending on:

- Trasnformation tool - the Web Map Server software

6

THE OVERALL DH METHODOLOGY (3/3) The services we have created:

Web Map Services (WMS) and Web Feature Services (WFS) for the Data

Catalogue Web Services (CSW) for the Metadata Once processed, harmonised, transformed and made

accessible through the Geoportal, spatial datasets, metadata and network services (accessibility and usability) have been validated

7

THE PROCEDURE FOR DATA TRANSFORMATION Identify source

data model

Data Model? Create a simple

GeoData Structure

Fill Matching Table

Matcheable?

Perform Transformation

Publish Harmonised Data

Document

NatureSDIplus Data Model

An

y kind

D

ata

Mo

de

lWithout

Data Model

NO

YE

S

Start Harmonisation Process

Finish Harmonisation Process

Choose Transformation Tool

Store Tranformation Tools for Reuse

Create the Matching Table

Create the Matching Table

Step

1 S

tep 2

Step

4 S

tep 3

Step

5

Identify a source data model Create a simple geodata

structure Fill the Data matching table Document the process Choose Transformation Tool Perform Transformation Store Transformation Rules Publish harmonised Data

8

Identify source metadata profile

Metadata?

Fill Matching Table

Matcheable?

Create or UpdateMetadata

Publish Harmonised

Metadata

Document

NatureSDIplus Metadata Profile

An

y m

eta

da

tap

rofile

No Metadata

NO

YE

S

Start Harmonisation Process

Finish Harmonisation Process

Choose MetadataEditor

Store Tranformation Tools for Reuse

Create the Matching Table

Create the Matching Table

Ste

p 2

S

tep

3

Ste

p 4

Ste

p 1

Identify a source metadata profile

Fill the Metadata matching table

Document the process Choose Metadata Editor Create or Update Metadata Store Transformation Rules Publish harmonised Metadata

THE PROCEDURE FOR METADATA TRANSFORMATION

9

THE GUIDELINES

Procedures for metadata profile and data model implementation, including Quality control for the

harmonisation process

10

Spatial Datasets: Final Matching table for PS (Annex I) Final Matching Tables for BR, HB, SD (Annex III)

Metadata: Final Matching table for PS (Annex I) Final Matching Tables for BR, HB, SD (Annex III)

THE MATCHING TABLES (1/3)

11

THE MATCHING TABLES (2/3)

12

THE MATCHING TABLES (3/3)

13

THE TRANSFORMATION TOOLS

Transformation tools for metadata: MDweb (IRD), INSPIRE Metadata Editor,

CatMDEdit, GeoNetwork, MIG Metadata Editor, disy Preludio.

Transformation tools for spatial datasets: GeoConverter, GeoMedia Fusion, Humboldt

Alignement Editor, Go Publisher

Tools surveyed, investigated and under testing by Technical Partners, used by DPs

14

Tool capabilities surveyed1. Reading non ISO 19115 profile

2. Reading ISO 19115 profile

3. Allowing to define / load specific profiles (in our cases Nature-SDIplus)

4. Allowing manual / semiautomatic / automatic mapping processes

5. Allowing save and reuse automatic process

6. Perform quality mapping control: Any? Specify

7. Publish metadata catalogue (CSW)

8. Allowing multilingualism

9. License

10. Allowing different export formats

11. Other interesting characterises

12. System Requirements Software, Hardware

SURVEY OF THE TOOLS FOR METADATA TRANSFORMATION

15

Tool capabilities surveyed1. Enumerate input formats

2. Enumerate output formats

3. Read input data

4. Change Coordinate reference System

5. Allowing to define / load specific target model

6. Allowing manual / semiautomatic / automatic mapping

7. Allowing to save transformation process

8. Any transformation quality control. Specify

9. Allowing multilingualism

10. License

11. System Requirements Software, Hardware

SURVEY OF THE TOOLS FOR DS TRANSFORMATION

16

EXAMPLE OF APPLICATION OF DH PROCEDURE – STEP 1

STEP 1.1: Selection of thesample source dataset

Natura2000 dataset of Greece,source: EIONET; free download

STEP 1.2: Deep analysisof the source dataset

cntrygr_ENG_SCI-SPA_Aug_2009.mdb

(MS Access mdb)

GR_Natura2000_v27.shp +

Commission Decision 97/266/EC of18.12.1996 concerning

a site information formatfor proposed Natura2000 sites

17

EXAMPLE OF APPLICATION OF DH PROCEDURE – STEP 5

WFS deployment withGO Publisher WFS

Harmonised PSdatasets

viewed with Gaia

18

MONITORING DH PROCESS

Prepared a template to collect feedback from DP about Data Harmonisation

Prepared a template to collect feedback from DP about Metadata Harmonisation

Prepared a tool (excel spreadsheet based) to monitor the status of the DH proces

19

MONITORING DH PROCESS

20

14 different “tool configurations” used by DPs in the Metadata Harmonisation Process

21

16 different “tool configurations” used by DPs in the Datasets Harmonisation Process

22