18
Data Validation

FME & Data Validation

Embed Size (px)

Citation preview

Page 1: FME & Data Validation

Data Validation

Page 2: FME & Data Validation

F M E& D a t a

Validation

Page 3: FME & Data Validation

A spectrum of data compliance tools

• Schema / Data Model

• Attributes

• CAD / GIS 2D Geometry

• 3D Geometry

• Topology

• Networks

• …

Single Item Validation

GeometryValidator

Comparative Validation

SpatialRelator

Page 4: FME & Data Validation

Compliance Validation QA/QC

- Trust & Verify -

Page 5: FME & Data Validation

Improving Data Compliancy Using

FME

• City or Kitchener, near Toronto.

• Centralized GIS in ESRI SDE

environment.

• Maintain ~400 GIS layers

• User of FME for last ~8 years.

David van Riel- GIS Technologist -

Full Presentation

Page 6: FME & Data Validation

Digital Submission Compliancy

• CAD Standards Checker

• Attribute Checker*o Complete attribute data

o Correct attribute data

• Topology Checker**Relative Checks

CAD Standards checkers

developed by

• FME reads submitted

AutoCAD Map 3D files

plus Excel files

containing validation

settings.

• Requirements :

1. GIS or AutoCAD, and

text or Excel outputs.

2. Easily customizable

settings for changing

needs.

Page 7: FME & Data Validation

CAD Standards Checker

Key transformer:

• FeatureMerger

CAD Standard

Page 8: FME & Data Validation

CAD Standards Checker

Key transformer:• StatisticsCalculator

Error Reports

Page 9: FME & Data Validation

Attribute Checker

Page 10: FME & Data Validation

Attribute Checker

Key transformer:

• Joiner

Page 11: FME & Data Validation

Attribute Checker

Page 12: FME & Data Validation

Topology Checker

12 rules:• node edge snap

• node end snap

• floating node

• duplicate node

• line end snap

• line edge snap

• crossed line

• line end node

• duplicate line

• floating service

• one line two nodes

• both line ends snap

Page 13: FME & Data Validation

Topology Checker

Key transformers:

• Joiner

• NeighbourFinder

Page 14: FME & Data Validation

Loading Data into CoK Database

• After drawing has passed all checkers the

data is ready to be exported from

AutoCAD and loaded into the GIS

database.

Page 15: FME & Data Validation

Digital Submission / Data Compliancy

BENEFITS

• Time saving.

• Accuracy/completeness of data

• Defined deliverables based on

standards

• Everyone is happy!

vs.

Page 16: FME & Data Validation

Validation Workflows on

FME Server

FMEpedia:

Upload & Validate

FME Server

Page 17: FME & Data Validation

Useful links & resources

• Safe blogThe Ultimate Geospatial Data Validation Checklist

• More great data validation customer stories at: safe.com/events

– FME User Conference

– FME World Tours

Page 18: FME & Data Validation

Questions?