7/13/2011

1

Delivering Access to Harmonised Spatial Data

Don Murray Mark Döring

President & Co-founder, Project Manager

Safe Software con terra

June 2011

INSPIRE Initiative

Make Data Available in a standard format through standard services

INSPIRE InitiativeFME 2011: Makes you the Superhero!

Achieve Total Spatial Data Mastery

7/13/2011

2

INSPIRE Initiative

Data (Historic + Today + Tomorrow)

+

Analysis

=

Better Decisions

Standard Format

World of Applications is Relational

XML/GML is Object Oriented

7/13/2011

3

How do they map to each other? What we need!

?

What we do …

We build data bridges

Data Model is King

� Working with GML requires solving the format

problem AND the data model problem

� Semantic data translation is key!

7/13/2011

4

XML Expert Not Required! XML/GML: 2 Strategy Options

Option #1

� Leverage industry XML tools such as XSLT and XQuery� Users must know these complex technologies.

XML/GML 2-Fold Strategy

Option #2

� Make it Easy

� Minimal understanding of XML required

Data Creator challenge

GML

Produce INSPIRE GML

7/13/2011

5

XML Writing Made Easier XML Writing Transformers

XMLTemplator

� Convert FME attributes to XML

XMLFormatter� Formats and beautifies XML documents.

XMLValidator

� Ensures XML is valid

Writing XML - XMLTemplater

<feederObject objectID="{fme:get-attribute("objectID")}">

<feederName>{fme:get-attribute("feederName")}</feederName>

<feederNo>{fme:get-attribute("feederNo")}</feederNo>

<eaLoc>{fme:get-attribute("eaLoc")}</eaLoc>

</feederObject>

XML Writing Example

� Sample XML:� Source of XML

templates

� Add Xquery: replace attribute values with Xquery statements

Sample XML <substation objectID="Vancouver Substation">

<mapLocation>

<coord>

<X>669170.169</X>

<Y>1000199.534</Y>

</coord>

</mapLocation>

<facilityID>5E67B377</facilityID>

<sectionID>RPG123</sectionID>

<phaseCode>ABC</phaseCode>

<feederList>

<feederObject objectID="8-64">

<feederName>10-24</feederName>

<feederNo>8763</feederNo>

<eaLoc>9D2D</eaLoc>

</feederObject>

<feederObject objectID="8-65">

<feederName>10-25</feederName>

<feederNo>8766</feederNo>

<eaLoc>9D3F</eaLoc>

</feederObject>

</feederList>

<name>Vancouver Central</name>

</substation>

<feederObject objectID="{fme:get-attribute("objectID")}">

<feederName>{fme:get-attribute("feederName")}</feederName>

<feederNo>{fme:get-attribute("feederNo")}</feederNo>

<eaLoc>{fme:get-attribute("eaLoc")}</eaLoc>

</feederObject>

�

7/13/2011

6

XML Writing continued…

� XMLTemplater requires a sample XML

Document!

What if you don’t have a sample?

Use XMLSampleGenerator to

generate XML from XSD!

Data Consumer challenge

GML

Use INSPIRE GML

XML Reading Made Easier XML Reading

Use the GML Reader

XMLFragmenter

� Split XML documents into manageable “features”

� Includes “flatten option” in FME 2011

� Functionality also in XML Reader

No XQuery or xfMap needed!!!

7/13/2011

7

XML Reading Example INSPIRE Solution Pack for FME Simplifying INSPIRE Schema Mapping Challenges

INSPIRE Solution Pack for FME

� The aim is to design the schema

mapping as simple as possible

� Uses FME Standard functionality

(ETL)

� Extends FME with INSPIRE specific

information and functionalities

Initial situation of INSPIRE schema mapping

� INSPIRE expert knowledge and domain expertise are required

� High complexity of the source data and the INSPIRE destination model

� It has to be accounted for local characteristics (quality, history, contents)

- Internal data models

- Meta data

- Data history

- Data quality

- Expertise (Domain)

- INSPIRE data models

- INSPIRE specifications

- INSPIRE legislation

- INSPIRE requirements

- Expertise (Annex 1)

INSPIRE Solution Pack for

7/13/2011

8

ArcGIS for INSPIREINSPIRE Solution Pack for

FME

Data model as a common base

ETL

Consumer

Internal Information-/

Data Management System

European

SDI

INSPIRE

Data Models & Services

Predefined INSPIRE template Workspaces per Annex theme

ETL with INSPIRE Solution Pack for FME

Connection to individual source data situation

individual mapping

predefined

mapping

Import

source

schema

Use ESRI

INSPIRE GDB

schema

Load data

into ESRI

INSPIRE GDB

INSPIRE ETL Workflow Description

INSPIRE

Solution Pack

Schema

transformation

and mapping

Conclusion:

Why is the INSPIRE Solution Pack simplifying the mapping process?

You only deal with the tip of the iceberg

7/13/2011

9

INSPIRE

Feature

The tip of the iceberg Model

existing

Feature

INSPIRE

Data Validation

Database

Design

Feature

Relations

XML

Validation

XSD

Schema

UML / GML

FME feature based mapping

INSPIRE Solution Pack for FME

complex things are hidden

INSPIRE Solution Pack for FME mapping

OSIRIS (FFH) >>> protected Sites

(simple / full schema)

ESRI Shapes files representing the geometry

Non spatial data separated in 2 databases and about 200 tables

Source: OSIRIS datamdo1 INSPIRE Protected Sites –

Full Schema (ISP Template)

Slide 35

mdo1 Mark Döring, 5/16/2011

7/13/2011

10

Complex Source Data Modell

> Domain knowledge from the customer (LANUV) needed

> INSPIRE GDB knowledge from con terra

Complex Destination Modell

> INSPIRE Protected Sites full schema

Information Exchange

> simple excel sheet with attributes

> Process with iterations

Main Mapping Challenges Mapping in Two Steps

Custom OSIRIS Reader

>>> restructure and fusion of source data

> Result: feature structure close to INSPIRE

Mapping with INSPIRE Solution Pack for FME template >>> attribute and value Mapping

> Result: INSPIRE compliant data

Custom Reader for OSIRIS FFH

ISP Mapping for INSPIRE GDB

Modell

Much less complexity of FME Workbench

Reusable OSIRIS reader

INSPIRE Mapping with template Workspace Result: Filled ArcGIS for INSPIRE GDB

7/13/2011

11

INSPIRE-GMLINSPIRE Solution providers

con terra – www.conterra.de

Dotted Eyes – www.dottedeyes.com

Metria – www.metria.se

Spatialworld- www.spatialworld.fi

INSPIRE FME Solutions

� Lithuania

� Swedish National Land Survey

� Finland National Land Survey

� Turkish Ministry of Environment

� State Agency for Nature, Environment and Consumer Protection NRW

� UK Environment Agency

� LK Oberhavel

Thank You!

� Questions?

� Contact Information� Email: don.murray@safe.com

� Email: m.doering@conterra.de

� @DonAtSafe� @McMarkinger

� www.safe.com/inspire� www.conterra.de/isp