Embed Size (px)
Citation preview
Building a Local Government Spatial Data Infrastructure
Barry Doyle: Roscommon County Council
Jon Hawkins: Waterford City & County Council
The Situation
• Lots of people looking to get their hands on LA datasets with the aim of using these within their own systems and apps, integrating these with their own datasets, and in building national views, but.... – 31 independent Local Authorities
– Not all LA’s create and store the same spatial datasets, in accordance with the same schemas, to the same quality standards, in the same formats
– Large overhead on LA in processing data requests
– Large overhead on 3rd party in acquiring and integrating datasets
Building a LG SDI Thursday 17th October
Who is looking for LA Spatially Referenced Data
Other Local Authorities
Building a LG SDI Thursday 17th October
Local Authority Spatial Datasets
• Approximately 80 spatial datasets created by LA’s though this varies and number continues to grow
• Some required under Legislation (Development Plans, Road Schedule, etc.)
• 40% of datasets created are identified as being shared with or required by Public Agencies *
• 40% of datasets created are identified as being shared with the Public *
* ‘GIS – Spatial Information’ Business Case for Shared Services Network
Thursday 17th October Building a LG SDI
LA Spatial Data Management
• Data creation and management practices traditionally geared to satisfying local requirements
• Local solutions or local implementations of common solutions
• Data stored in combination of flat files and Spatial RDBMS
• Lack of standards between LA’s: – Schema’s – Quality – Formats – Metadata
Building a LG SDI Thursday 17th October
Local Authority 1
Agency 1
Local Authority 2 Local Authority 3 Metadata
Transform
Validate
Agency 2 Agency 3 Transform
Validate
Merge Current Situation
Building a LG SDI Thursday 17th October
The Solution
• A Local Government Spatial Data Infrastructure (LGSDI)
• More than a data warehouse it is a framework of geographic data, metadata, users and tools
• Based on the application of standards – Schema’s
– Quality
– Metadata
• Enables data to be discovered, accessed, and used in an efficient manner
Thursday 17th October Building a LG SDI
Benefits
• Single point of access to LA data • Single version of data • Standardised data • Supports data sharing and re-use
– LG Portal – GeoPortal.ie – data.gov.ie – MyPlan.ie – ...
• Reduced overhead on LA in dealing with data requests • Reduced overhead on 3rd parties gathering, processing, and
integrating datasets
Thursday 17th October Building a LG SDI
The Question
• Will FME Server, implemented as a shared LA service, provide the technical architecture required to support: – Multiple source data format reconciliation and
storage
– Transformation of source data to structured schemas and integration
– Data validation
– Data management
– Data delivery
Thursday 17th October Building a LG SDI
What is FME Server? • Enterprise based Spatial ETL Tool (Extract, Transform,
Load)
• Create and Publish workspaces (workflows) from FME Desktop
• Extract, transform, validate and load data to central repositories
• Apply business logic to incoming data
• Receive requests, process and deliver data in real-time
Thursday 17th October Building a LG SDI
Thursday 17th October Building a LG SDI
Scope of Pilot
• Planning Applications data – Based on agreed Local Government Schema
1. Extract from local Planning Systems and load to central repository – Various systems in use
2. Validate and load to central database
3. Extract and deliver data on demand – Data Streaming
– Data Download
Thursday 17th October Building a LG SDI
Thursday 17th October Building a LG SDI
Field Description Field Name Mandatory/Optional
County CountyName M
Planning Authority PlanningAuthority M
Application Number PlanningNumber M
Date Received ReceivedDate M
Current Status ApplicationStatus M
Application Type ApplicationType M
Description Description O
Applicant Name ApplicantName O
Location Location O
Decision Decision O
Decision date DecisionDate O
Decision due date DecisionDueDate O
Appeal Decision AppealDecision O
Appeal Decision Date AppealDecisionDate O
Link to application details on LA website LinkAppDetails O
Link to documents on LA website LinkAppDocuments O
Easting IG IGEasting M
Northing IG IGNorthing M
Easting ITM ITMEasting M
Northing ITM ITMNorthing M
Latitude WGS84 WGS84Latitude M
Longitude WGS84 WGS84Longitude M
Schema
Demonstration [tried and tested so far]
Thursday 17th October Building a LG SDI
PostGIS
LA
Desktop
Transform & Distribute
TAB
SHP KMZ
KML
Data Download
Data Streaming
LA
LA
LA
LA
CSV
CSV
CSV
CSV
Post
Post
Post
Post
Post CSV
Validate & Merge
Where from here
• Additional datasets:
– Zoning datasets
– Council Services
• Other functionality
– Validation
– Business Logic
– Real-time
Thursday 17th October Building a LG SDI
![Spatial Data Infrastructure (SDI) “[Spatial Data Infrastructure] provides a basis for spatial data discovery, evaluation, and application for users and](https://img.pdfslide.us/doc/110x75/56649d5f5503460f94a3f713/spatial-data-infrastructure-sdi-spatial-data-infrastructure-provides.jpg)
