Deep Deep FME Server integration with DWDS: Yesterday, Today, Tomorrow
Terry Lanktree, DataBC
David van Blankenstein, Forte Consulting
Context
• What is the DataBC?
• What is the Data Distribution Service?
• What is the grand vision?
• How does FME Server make the magic?
Provincial Spatial & Open Data Infrastructure
Data Custodian gather and verify the data, which is then replicated into Warehouse; allowing a single point for access of spatial needs. Access tools have been built to allow clients (individuals, industry, gov’t) to interact with data.
DWDS Was Launched
Clip, zip and ship
Built on FME Objects
In 2003, Distribution Service has
warehouse products
Thousands of packaged products
Theme bundles
Security
Accountability
App DB Server
Oracle
APP_DW Schema
Msg Queue
LRDW
FilesRemote
Files
Packaged Products
Clean Order
DB App Mount for Packaged
Product dirs
Temp
Dir
Config
Log Files
LRDW Layers/
Tables
LRDW DB Server
Oracle
Clean
Distribution
Directory
App
FTP Server
DWDS
Tables
Dwds.jar
FME Objects
FME Scripts
Order Fulfillment
App
OF ServerApp Server
Mail Server
DWDS Order
Creation App
SMTP Server
Discovery
Service
DWDS URL
DWDS: Time for Change
New data formats
API (rest end point – OFI)
OAS -> Tomcat
FME Objects or FME Server
BEANS
Scalability/maintenance
Backend focused
Implementation of the components
Web Service (OFI)
User Interface
FME Server/Workbench
Translation Services and Product Packaging
Step One: Talk to your users!
Survey says!
1. Internal personnel
2. Data Suppliers (major warehouse contributors)
3. Data Consumers (870 respondents)
Step One: Talk to your users!
DataBC already has a lot of the functionality to provide a very robust user interface and experience
Creating a more seamless interaction will greatly improve the flow
Creating more awareness about DataBC service offerings will increase usage
DWDS Future Behavior
Trusted Site
DWDS Call?
Order Fulfiller Interface
------(requires
parameters to pass through,
some mandatory, some can
have defaults)
DWDS_OF(ETL)
Delayed Response (Send email)
Immediate Response
(Error handling)
Catalogue Service
Security Service
Delayed Response
(Order URL)
YES
Search Service
Parameter passing required
New module
Existing code
Other applications
FME Server In Action
Support for version 9 and 10 Geodatabase
2 pythons
Licensing approach
Better tracking of AOI
Named areas
Supports SQL Clauses
More formats, projections
Improved Packing Slips
Thank You!
Questions?
For more information:
Terry Lanktree – [email protected]
David van Blankenstein - [email protected]
www.data.gov.bc.ca