FME & Data Validation

Preview:

Citation preview

Data Validation

F M E& D a t a

Validation

A spectrum of data compliance tools

• Schema / Data Model

• Attributes

• CAD / GIS 2D Geometry

• 3D Geometry

• Topology

• Networks

• …

Single Item Validation

GeometryValidator

Comparative Validation

SpatialRelator

Compliance Validation QA/QC

- Trust & Verify -

Improving Data Compliancy Using

FME

• City or Kitchener, near Toronto.

• Centralized GIS in ESRI SDE

environment.

• Maintain ~400 GIS layers

• User of FME for last ~8 years.

David van Riel- GIS Technologist -

Full Presentation

Digital Submission Compliancy

• CAD Standards Checker

• Attribute Checker*o Complete attribute data

o Correct attribute data

• Topology Checker**Relative Checks

CAD Standards checkers

developed by

• FME reads submitted

AutoCAD Map 3D files

plus Excel files

containing validation

settings.

• Requirements :

1. GIS or AutoCAD, and

text or Excel outputs.

2. Easily customizable

settings for changing

needs.

CAD Standards Checker

Key transformer:

• FeatureMerger

CAD Standard

CAD Standards Checker

Key transformer:• StatisticsCalculator

Error Reports

Attribute Checker

Attribute Checker

Key transformer:

• Joiner

Attribute Checker

Topology Checker

12 rules:• node edge snap

• node end snap

• floating node

• duplicate node

• line end snap

• line edge snap

• crossed line

• line end node

• duplicate line

• floating service

• one line two nodes

• both line ends snap

Topology Checker

Key transformers:

• Joiner

• NeighbourFinder

Loading Data into CoK Database

• After drawing has passed all checkers the

data is ready to be exported from

AutoCAD and loaded into the GIS

database.

Digital Submission / Data Compliancy

BENEFITS

• Time saving.

• Accuracy/completeness of data

• Defined deliverables based on

standards

• Everyone is happy!

vs.

Validation Workflows on

FME Server

FMEpedia:

Upload & Validate

FME Server

Useful links & resources

• Safe blogThe Ultimate Geospatial Data Validation Checklist

• More great data validation customer stories at: safe.com/events

– FME User Conference

– FME World Tours

Questions?

Recommended