50
CONNECT. TRANSFORM. AUTOMATE. INSPIRE Workshop Dean Hintz, Ken Bragg and Sören Dupke

16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Workshop

Dean Hintz, Ken Bragg and Sören Dupke

Page 2: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Agenda

FME & INSPIRE INSPIRE GML reading INSPIRE GML writing Schema mapping Conterra ISP

INSPIRE Annex II and III Buildings Natural Hazard Zones

FME Web Services

Page 3: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Workshop Setup

Please use latest FME 2014 SP2 from safe.com

For updated training materials go to: http://fme.ly/8zq (Google: FME Parcels) http://fme.ly/gjg (Google: INSPIRE WFS) ftp://ftp.safe.com/outgoing/forDean/inspire/INSPIRE-

GML.zip

Page 4: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.@SafeSoftware

95+ exuberant employees

95+ exuberant employees

Partners World-Wide

Partners World-Wide

Located in Surrey, British Columbia

Located in Surrey, British Columbia

Thousands of happy customers

Thousands of happy customers

#fmewebinar

Page 5: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE. #fmewebinar

Convert data

Transform data

Share data

Integrate data

Validate data

And more

FME transforms data to use and share.

What is FME?

Page 6: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Complex GML Exercises

Reading INSPIRE Samples and data challenges

Writing INSPIRE: Cadastral Parcels Adding a writer and constructing geometry

Validation Metadata AIXM Airports INSPIRE Buildings

Page 7: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME and INSPIRE

Consume INSPIRE – Leverage existing INSPIRE content and services

Schema Transformation* – the hard problem that FME makes easier and automates. (e.g. conterra’s ISP for FME)

Publishing INSPIRE – INSPIRE writer and web service support – easily meet INSPIRE requirements - no code!

Annex II and III – FME’s flexible, modular approach: future proofed as requirements evolve

Web Services - workspace as web service broker via FMEServer**

Page 8: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME 2014 GML Developments

Improvements to GML Reader to capture full schema model

New GML writer – write any GML that FME can read

New generic web services published workspace handles

message brokering and data publish virtually any web service

Page 9: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME 2014 GML Developments (cont’d)

New INSPIRE & AIXM writers Improvements to GML / INSPIRE reading Null support Bug fixes / More geometry types

Ability for server to parse input URL 2014 SP1 Pretty printing List copying ( list1{} to list2{}.name etc)

Page 10: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME 2014 GML Developments (cont’d)

Conterra’s ISP for FME v2.0 to include GML writer ESRI / ArcGIS for INSPIRE not required - est Fall 2014

HALE extension for FME More training materials: webinars, FMEpedia, etc FME 2014 SP2 INSPIRE schema update Enhancements to support nested geometry for

Annex III buildings etc CityGML fixes

Page 11: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME – The tool for INSPIRE GML

FME 2014!The most complete tool for creating, transforming, distributing and using complex GML such as INSPIRE and AIXM.

No coding! No XSLT!

Page 12: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Consuming Complex GML data

FME takes the pain out of reading and leveraging complex GML and web services

Benefit from the diverse array of freely available published data sources

New Data Inspector makes it easy to visualize all types of data: 2D or 3D, vector or raster, non-spatial or complex geometries

See web services webinar, August 2013

Page 13: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

XML vs. Relational

attribute1 attribute2 Active Date_From

Active Date_To

John Vancouver 11-22-99 12-11-09

June Surrey 02-25-05 9-15-10

Relational

XML documents are often very nested or object oriented.GIS is geared to working with flat or relational structures.

Page 14: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Page 15: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Writing INSPIRE: Typical Workflow

1. Format translation (CAD/GIS reading)2. ID generation3. Reprojection to ETRS894. Augmentation with date and area info5. Data Transformation to match INSPIRE

requirementsi. Schema mappingii. Geometry transformation

6. Write out GML

Page 16: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Your data to / from INSPIRE

FME can read or write over 325 formats FME has supported xsd based GML reading for some time New in FME 2014: GML writer application schema mode Complete support for complex schemas – xsd’s

If you can read it – you can write it!

Page 17: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Key points on the FME GML Writer

GML writing in schema mode uses destination model captured from the application schema (xsd)

map directly to destination feature type fields, like other formats

multiple, complex geometry support

geometry names and traits

voidable attributes in output GML / FME null support

XMLTemplater no longer needed for GML writing, but still useful for other XML generation like metadata

Page 18: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Writing

1. Open INSPIREwriter_A1.CadastralParcels - Start.fmw, run workspace and inspect output

2. Add INSPIRE writer and theme: 'CadastralParcels:3.0'3. Go to Writer - Import feature type

i. Select only 'CadastralParcels:3.0'ii. Select only CadastralZoning and CadastralParceliii. connect outputs

4. Set output path5. Run workspace and inspect output using INSPIRE readerResult = INSPIREwriter_A1.CadastralParcels - Complete.fmw

Page 19: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Writer: Add Writer

Page 20: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Writer: Import Feature Type

Page 21: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Parcels Destination Feature Type

Page 22: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE GML Writing: Parcels

Page 23: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Geographic Names: GML Result

Page 24: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE: Cadastral Parcels

Page 25: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Schema Mapping Tools for INSPIRE

The challenge: Map and transform your data and attributes into

the INSPIRE schema.

Page 26: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Schema Mapping Tools for INSPIRE

Feature Type Mapping Attribute Name Mapping Transformers Attribute Value Mapping Transformers Schema Mapper Transformer

Geometry and Coordinate System Transformations

Page 27: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Example INSPIRE Solutionsby FME Partners

INSPIRE Solution Pack from con terra (> 20 implementations across Europe)

Metria, Sweden (Protected Areas Pilot; Swedish Department of Transportation)

1-Spatial, UK AED Sicad (NAS to INSPIRE conversions) Spatialworld, Finland (National Land Survey) Veremes, France (INSPIRE writer testing) Vicrea, NL GIM, BE Please provide us with updates from your work!

Page 28: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

con terra – FME INSPIRE Solution Pack Highlights

Simplify data transformation and schema mapping for ArcGIS for INSPIRE

Predefined FME Workbench templates help jump start the data migration and Harmonization process

Connect your existing databases to the standardized ESRI INSPIRE Geodatabase

Automate data load and update processes

Quality assurance and metadata

Publish once and use many times

Page 29: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Validation with FMEDoes your data comply with the schema?

XMLValidator transformer (syntax and schema) Many, many other FME validation transformers to

check attribute values, geometry etc Don’t forget to inspect! Logical validation – business rules

Page 30: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Key FME Metadata Capabilities

• Reading• Writing• Updating• Harvesting• Validating• Integration with web services

Page 31: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Metadata Reading

Metadata attributesXML Reader /

Fragmenter with Feature Paths and flattening

HTTPFetcher

Reading from database

Page 32: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Metadata Writing

XMLTemplaterTemplates for • FGDC• ISO 19115

Database write mode: geodatabase

Page 33: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Metadata Updating

XMLUpdater: Insert, Delete, Replace, Replace Contents

Page 34: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME AIXM Support Prior to 2014

AIXM 4.5 reading / writing AIXM 5.1 reading Work with ESRI on PLTS /

Aeronautical Solution XMLTemplater based writing

– limited use cases

Page 35: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME 2014 and Air Transport Networks

Closely related to AIXM New AIXM 5 writer Schema mapping tools: GIS <-> AIXM AIXM <-> INSPIRE

XML tools: parsing, validation, formatting

New licensing: no extra cost

Page 36: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME Server and AIXM

Data distribution (4.5, 5.1) Data QA (XML validation, geometry, rules) Data upload Web services (WFS etc) Notification services FME Cloud - scalability

Page 37: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Air Transport Networks Demo:World Airports

Page 38: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME for Annex II and III

1. Annex II raster themes such as DEM and orthophoto can be produced to specification with FME

2. Annex III 3D Buildings, natural hazard zones

Page 39: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Annex II: EU DEM

No INSPIRE specific delivery standard yet

Mostly GeoTIFFslinks via websites

FME Server’s Data Download Service has always been able to support this use case

Page 40: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

CityGML and Annex III Buildings

CityGML has strongly influenced the INSPIRE BU model - based on City GML v2.0

Differences: INSPIRE names for

attributes common to other themes (ids, time)

part can’t have parts appearances simplified fields added to support

INSPIRE requirements (environmental policy)

Page 41: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE ADE for CityGML

Application domain extensions (ade’s) extend CityGML with additional fields and feature types

CityGML ADE BuildingsCore3D_ADE.xsd is an alternative encoding for Buildings3D and adds fields needed for INSPIRE (core3d_*)

Produced by teams at TU Munich and University of Bonn

Extended 3D ADE (BuildingsExtended3D) coming soon

Page 42: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Buildings: Annex III core schema

Just buildings other citygml themes

covered elsewhere Closely related

geometries and IDs need renaming to INSPIRE conventions

No textures yet?

Page 43: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Use FME Server for INSPIRE Download Web Services (more in the OGC Services Talk)

Page 44: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

FME Workspace as Web Service Broker

FME WxSWorkspace

GetCapabilities Request

Response XML

GetFeature Request

Response GMLFME Server

Page 45: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Demonstration INSPIRE WFSOn FME Cloud

http://inspire-safe-software.fmecloud.com:80/fmedatastreaming/INSPIRE/INSPIRE_WFS.fmw

Page 46: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Road Map:2015 and Beyond

New tree based schema mapper GUI / transformer Continued improvements to list support CityGML / ADE improvements (some in SP1): splines, instances, xlinks, etc

More Annex II, III testing – data please! OGC templates for WFS 2.0, WMTS, WCS etc* more themes on Safe’s demo wfs what do you need most?

True data streaming (5GB GetFeature?)

Page 47: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Get Involved!

fmepedia.com/community

fmepedia.com/knowledge

@SafeSoftware

youtube.com/FMEChannel

blog.safe.com#fmewebinar

Page 48: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

INSPIRE Resources

Safe.com/inspire

fmepedia.safe.com/articles/How_To/INSPIRE-GML

fmepedia.safe.com/articles/How_To/GML-Writing

fmepedia.safe.com/articles/Samples_and_Demos/Streaming-XML-with-FME-Server

Page 49: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Summary – FME and INSPIRE

Consume INSPIRE – Leverage existing INSPIRE content and services

Schema Transformation – the hard problem that FME makes easier and automates

Publishing INSPIRE – New GML writer, validation and web service support make meeting INSPIRE requirements a breeze -no code!

Annex II and III – FME’s flexible, modular approach means you are future proofed as requirements evolve

Web services - workspace as web service broker via FMEServer

Page 50: 16.06 Aud 2 14.00 Inspire-Gml-Safe-Conterra-Mon2pm ...inspire.ec.europa.eu/events/conferences/inspire... · FME can read or write over 325 formats FME has supported xsd based GML

CONNECT. TRANSFORM. AUTOMATE.

Thank You!

Questions? [email protected] [email protected]

For more information on FMEpedia: http://fmepedia.safe.com/articles/How_To/GML-

Writing http://fmepedia.safe.com/articles/How_To/INSPIRE

-GML http://fmepedia.safe.com/articles/How_To/AIXM