Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Workshop
Dean Hintz, Ken Bragg and Sören Dupke
CONNECT. TRANSFORM. AUTOMATE.
Agenda
FME & INSPIRE INSPIRE GML reading INSPIRE GML writing Schema mapping Conterra ISP
INSPIRE Annex II and III Buildings Natural Hazard Zones
FME Web Services
CONNECT. TRANSFORM. AUTOMATE.
Workshop Setup
Please use latest FME 2014 SP2 from safe.com
For updated training materials go to: http://fme.ly/8zq (Google: FME Parcels) http://fme.ly/gjg (Google: INSPIRE WFS) ftp://ftp.safe.com/outgoing/forDean/inspire/INSPIRE-
GML.zip
CONNECT. TRANSFORM. AUTOMATE.@SafeSoftware
95+ exuberant employees
95+ exuberant employees
Partners World-Wide
Partners World-Wide
Located in Surrey, British Columbia
Located in Surrey, British Columbia
Thousands of happy customers
Thousands of happy customers
#fmewebinar
CONNECT. TRANSFORM. AUTOMATE. #fmewebinar
Convert data
Transform data
Share data
Integrate data
Validate data
And more
FME transforms data to use and share.
What is FME?
CONNECT. TRANSFORM. AUTOMATE.
Complex GML Exercises
Reading INSPIRE Samples and data challenges
Writing INSPIRE: Cadastral Parcels Adding a writer and constructing geometry
Validation Metadata AIXM Airports INSPIRE Buildings
CONNECT. TRANSFORM. AUTOMATE.
FME and INSPIRE
Consume INSPIRE – Leverage existing INSPIRE content and services
Schema Transformation* – the hard problem that FME makes easier and automates. (e.g. conterra’s ISP for FME)
Publishing INSPIRE – INSPIRE writer and web service support – easily meet INSPIRE requirements - no code!
Annex II and III – FME’s flexible, modular approach: future proofed as requirements evolve
Web Services - workspace as web service broker via FMEServer**
CONNECT. TRANSFORM. AUTOMATE.
FME 2014 GML Developments
Improvements to GML Reader to capture full schema model
New GML writer – write any GML that FME can read
New generic web services published workspace handles
message brokering and data publish virtually any web service
CONNECT. TRANSFORM. AUTOMATE.
FME 2014 GML Developments (cont’d)
New INSPIRE & AIXM writers Improvements to GML / INSPIRE reading Null support Bug fixes / More geometry types
Ability for server to parse input URL 2014 SP1 Pretty printing List copying ( list1{} to list2{}.name etc)
CONNECT. TRANSFORM. AUTOMATE.
FME 2014 GML Developments (cont’d)
Conterra’s ISP for FME v2.0 to include GML writer ESRI / ArcGIS for INSPIRE not required - est Fall 2014
HALE extension for FME More training materials: webinars, FMEpedia, etc FME 2014 SP2 INSPIRE schema update Enhancements to support nested geometry for
Annex III buildings etc CityGML fixes
CONNECT. TRANSFORM. AUTOMATE.
FME – The tool for INSPIRE GML
FME 2014!The most complete tool for creating, transforming, distributing and using complex GML such as INSPIRE and AIXM.
No coding! No XSLT!
CONNECT. TRANSFORM. AUTOMATE.
Consuming Complex GML data
FME takes the pain out of reading and leveraging complex GML and web services
Benefit from the diverse array of freely available published data sources
New Data Inspector makes it easy to visualize all types of data: 2D or 3D, vector or raster, non-spatial or complex geometries
See web services webinar, August 2013
CONNECT. TRANSFORM. AUTOMATE.
XML vs. Relational
attribute1 attribute2 Active Date_From
Active Date_To
John Vancouver 11-22-99 12-11-09
June Surrey 02-25-05 9-15-10
Relational
XML documents are often very nested or object oriented.GIS is geared to working with flat or relational structures.
CONNECT. TRANSFORM. AUTOMATE.
CONNECT. TRANSFORM. AUTOMATE.
Writing INSPIRE: Typical Workflow
1. Format translation (CAD/GIS reading)2. ID generation3. Reprojection to ETRS894. Augmentation with date and area info5. Data Transformation to match INSPIRE
requirementsi. Schema mappingii. Geometry transformation
6. Write out GML
CONNECT. TRANSFORM. AUTOMATE.
Your data to / from INSPIRE
FME can read or write over 325 formats FME has supported xsd based GML reading for some time New in FME 2014: GML writer application schema mode Complete support for complex schemas – xsd’s
If you can read it – you can write it!
CONNECT. TRANSFORM. AUTOMATE.
Key points on the FME GML Writer
GML writing in schema mode uses destination model captured from the application schema (xsd)
map directly to destination feature type fields, like other formats
multiple, complex geometry support
geometry names and traits
voidable attributes in output GML / FME null support
XMLTemplater no longer needed for GML writing, but still useful for other XML generation like metadata
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Writing
1. Open INSPIREwriter_A1.CadastralParcels - Start.fmw, run workspace and inspect output
2. Add INSPIRE writer and theme: 'CadastralParcels:3.0'3. Go to Writer - Import feature type
i. Select only 'CadastralParcels:3.0'ii. Select only CadastralZoning and CadastralParceliii. connect outputs
4. Set output path5. Run workspace and inspect output using INSPIRE readerResult = INSPIREwriter_A1.CadastralParcels - Complete.fmw
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Writer: Add Writer
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Writer: Import Feature Type
CONNECT. TRANSFORM. AUTOMATE.
Parcels Destination Feature Type
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE GML Writing: Parcels
CONNECT. TRANSFORM. AUTOMATE.
Geographic Names: GML Result
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE: Cadastral Parcels
CONNECT. TRANSFORM. AUTOMATE.
Schema Mapping Tools for INSPIRE
The challenge: Map and transform your data and attributes into
the INSPIRE schema.
CONNECT. TRANSFORM. AUTOMATE.
Schema Mapping Tools for INSPIRE
Feature Type Mapping Attribute Name Mapping Transformers Attribute Value Mapping Transformers Schema Mapper Transformer
Geometry and Coordinate System Transformations
CONNECT. TRANSFORM. AUTOMATE.
Example INSPIRE Solutionsby FME Partners
INSPIRE Solution Pack from con terra (> 20 implementations across Europe)
Metria, Sweden (Protected Areas Pilot; Swedish Department of Transportation)
1-Spatial, UK AED Sicad (NAS to INSPIRE conversions) Spatialworld, Finland (National Land Survey) Veremes, France (INSPIRE writer testing) Vicrea, NL GIM, BE Please provide us with updates from your work!
CONNECT. TRANSFORM. AUTOMATE.
con terra – FME INSPIRE Solution Pack Highlights
Simplify data transformation and schema mapping for ArcGIS for INSPIRE
Predefined FME Workbench templates help jump start the data migration and Harmonization process
Connect your existing databases to the standardized ESRI INSPIRE Geodatabase
Automate data load and update processes
Quality assurance and metadata
Publish once and use many times
CONNECT. TRANSFORM. AUTOMATE.
Validation with FMEDoes your data comply with the schema?
XMLValidator transformer (syntax and schema) Many, many other FME validation transformers to
check attribute values, geometry etc Don’t forget to inspect! Logical validation – business rules
CONNECT. TRANSFORM. AUTOMATE.
Key FME Metadata Capabilities
• Reading• Writing• Updating• Harvesting• Validating• Integration with web services
CONNECT. TRANSFORM. AUTOMATE.
Metadata Reading
Metadata attributesXML Reader /
Fragmenter with Feature Paths and flattening
HTTPFetcher
Reading from database
CONNECT. TRANSFORM. AUTOMATE.
Metadata Writing
XMLTemplaterTemplates for • FGDC• ISO 19115
Database write mode: geodatabase
CONNECT. TRANSFORM. AUTOMATE.
Metadata Updating
XMLUpdater: Insert, Delete, Replace, Replace Contents
CONNECT. TRANSFORM. AUTOMATE.
FME AIXM Support Prior to 2014
AIXM 4.5 reading / writing AIXM 5.1 reading Work with ESRI on PLTS /
Aeronautical Solution XMLTemplater based writing
– limited use cases
CONNECT. TRANSFORM. AUTOMATE.
FME 2014 and Air Transport Networks
Closely related to AIXM New AIXM 5 writer Schema mapping tools: GIS <-> AIXM AIXM <-> INSPIRE
XML tools: parsing, validation, formatting
New licensing: no extra cost
CONNECT. TRANSFORM. AUTOMATE.
FME Server and AIXM
Data distribution (4.5, 5.1) Data QA (XML validation, geometry, rules) Data upload Web services (WFS etc) Notification services FME Cloud - scalability
CONNECT. TRANSFORM. AUTOMATE.
Air Transport Networks Demo:World Airports
CONNECT. TRANSFORM. AUTOMATE.
FME for Annex II and III
1. Annex II raster themes such as DEM and orthophoto can be produced to specification with FME
2. Annex III 3D Buildings, natural hazard zones
CONNECT. TRANSFORM. AUTOMATE.
Annex II: EU DEM
No INSPIRE specific delivery standard yet
Mostly GeoTIFFslinks via websites
FME Server’s Data Download Service has always been able to support this use case
CONNECT. TRANSFORM. AUTOMATE.
CityGML and Annex III Buildings
CityGML has strongly influenced the INSPIRE BU model - based on City GML v2.0
Differences: INSPIRE names for
attributes common to other themes (ids, time)
part can’t have parts appearances simplified fields added to support
INSPIRE requirements (environmental policy)
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE ADE for CityGML
Application domain extensions (ade’s) extend CityGML with additional fields and feature types
CityGML ADE BuildingsCore3D_ADE.xsd is an alternative encoding for Buildings3D and adds fields needed for INSPIRE (core3d_*)
Produced by teams at TU Munich and University of Bonn
Extended 3D ADE (BuildingsExtended3D) coming soon
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Buildings: Annex III core schema
Just buildings other citygml themes
covered elsewhere Closely related
geometries and IDs need renaming to INSPIRE conventions
No textures yet?
CONNECT. TRANSFORM. AUTOMATE.
Use FME Server for INSPIRE Download Web Services (more in the OGC Services Talk)
CONNECT. TRANSFORM. AUTOMATE.
FME Workspace as Web Service Broker
FME WxSWorkspace
GetCapabilities Request
Response XML
GetFeature Request
Response GMLFME Server
CONNECT. TRANSFORM. AUTOMATE.
Demonstration INSPIRE WFSOn FME Cloud
http://inspire-safe-software.fmecloud.com:80/fmedatastreaming/INSPIRE/INSPIRE_WFS.fmw
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Road Map:2015 and Beyond
New tree based schema mapper GUI / transformer Continued improvements to list support CityGML / ADE improvements (some in SP1): splines, instances, xlinks, etc
More Annex II, III testing – data please! OGC templates for WFS 2.0, WMTS, WCS etc* more themes on Safe’s demo wfs what do you need most?
True data streaming (5GB GetFeature?)
CONNECT. TRANSFORM. AUTOMATE.
Get Involved!
fmepedia.com/community
fmepedia.com/knowledge
@SafeSoftware
youtube.com/FMEChannel
blog.safe.com#fmewebinar
CONNECT. TRANSFORM. AUTOMATE.
INSPIRE Resources
Safe.com/inspire
fmepedia.safe.com/articles/How_To/INSPIRE-GML
fmepedia.safe.com/articles/How_To/GML-Writing
fmepedia.safe.com/articles/Samples_and_Demos/Streaming-XML-with-FME-Server
CONNECT. TRANSFORM. AUTOMATE.
Summary – FME and INSPIRE
Consume INSPIRE – Leverage existing INSPIRE content and services
Schema Transformation – the hard problem that FME makes easier and automates
Publishing INSPIRE – New GML writer, validation and web service support make meeting INSPIRE requirements a breeze -no code!
Annex II and III – FME’s flexible, modular approach means you are future proofed as requirements evolve
Web services - workspace as web service broker via FMEServer
CONNECT. TRANSFORM. AUTOMATE.
Thank You!
Questions? [email protected] [email protected]
For more information on FMEpedia: http://fmepedia.safe.com/articles/How_To/GML-
Writing http://fmepedia.safe.com/articles/How_To/INSPIRE
-GML http://fmepedia.safe.com/articles/How_To/AIXM