Embed Size (px)
Citation preview
Use of FME ServerFully automated extraction of detailed map
data for deliveries to the Norwegian
commercial market
Knut Olav Sunde
Product Manager - Geodata
Online Content
Content
• Introduction
– About Norwegian large scale mapping
– About Geodata Online
– About Infoland and the NE/Geodata co-operation
• Technical approach
– Architecture
– Services
– Lessons learned
About Norwegian large scale
mapping
• FKB (Joint Map Database)– Detailed map data, various
mapping standards 1:500-1:5000 based on SOSI
– Covers about 70 % of Norway
– Originally approx. 13000 SOSI textfiles
• FKB is output from Geovekst– A nationwide mapping co-
operation between organisations
About Geodata Online
• Geodata’s Online Services Initiative
• We provide a wide range of Geospatial Online and Hosting
Services
– Cached and Dynamic Map Services
– Search and Geoprocessing Services
– Data Download Services
– .... and more
• Served from a virtual enviroment in the Cloud (hosted by
Amazon Web Services)
• Based on the whole stack of public Norwegian Geospatial
data
– Stored by us as seamless ArcGIS GDB’s that are continously
updated from original SOSI files
About the NE/Geodata co-operation
• NE - Norsk Eiendomsinformasjon– Distributes public and legal
land information towards the professional market in Norway
– Infoland is their Web-based marketplace
– Detailed map data is just one of the products
– Delivered by consumption of GDO Web Services
• Geodata– Detailed map data
deliveries as GDO Web Services to Infoland
– «Fresh» data from GDO’s seamless GDB
– Clips AOI defined by customer
– Delivers UTM and NTM coordinate systems
– Delivers SOSI, DXF, Shape (and PDF) formats
About the Infoland Marketplace
• Product selection
• For detailed map data– AOI drawing/selection
– Theme, CS and format options selection
– Price Calculation
• Ordering
• Billing
• Product Download
Order and Delivery Process
NE GDO
InfolandInfoland GDO Application ServerGDO Application Server GDO Database ServerGDO Database Server
Infoland Order Service
Infoland Integration
Service
SOAP
FME ServerData Download
ServicesREST
ZIP-file
ArcGIS GDB
HTTPInfoland Delivery
StoreFTP
Monitoring
Delivery
UpdatesOrder
• Typical time consumption for handling an order: 1-5 minutes
Technology
• Currently
– FME Server 2010
– FME Desktop 2010 ESRI Edition
– ArcGIS ArcInfo 10.0
– ArcGIS ArcSDE 10.0 over SQL Server
– GeoSOSI Professional (SOSI Plugin for FME)
• Moving to
– FME Server 2012
– FME Desktop 2012 ESRI Edition
– ArcGIS ArcInfo 10.1
– ArcGIS File Geodatabase
– GeoSOSI Professional (SOSI Plugin for FME)
FME Server Services Used
• Utility
– GetLayerAvailability.fmw
– ClipperTest.fmw
– UTMZoneFinder.fmw
– NTMZoneFinder.fmw
• Data Download
– FKBDownloadSOSI_NE.fmw
– FKBDownloadDXF_NE.fmw
– FKBDownloadShape_NE.fmw
ClipperTest
• Checks geometry against rules (max area)
• Returns the area of the AOI
• Returns result in an XML
UTMZoneFinder
• Calculates local UTM Zone from an overlay between
municipality polygons and Clipper Coords Center of Gravity
• Returns result (EPSG code) in an XML
NTMZoneFinder
• Calculates local NTM Zone by testing Clipper Coords
Center of Gravity against Zone values
• Returns result (EPSG code) in an XML
FKBDownloadSOSI
• Extracts desired themes for the AOI as a set of SOSI-files
(according to the FKB Standard) in the desired Coordinate
System
• Returns result as a ZIP-file
FKBDownloadDXF
• Extracts desired themes for the AOI as one DXF-file
(layered according to the FKB Standard) in the desired
Coordinate System
• Returns result as a ZIP-file
FKBDownloadShape
• Extracts desired themes for the AOI as a set of Shape-files
(according to the FKB Standard) in the desired Coordinate
System
• Returns result as a ZIP-file
Complete sample REST URL (SOSI)
http://ip-
0AE701CA/fmedatadownload/Infoland/FKBDownloadSOSI_NE.fmw?ORDER_ID=2&WHERECLAUSE=OMRADEID%3D1601&SEARCHENVELOPECOORDSYS
=EPSG%3A25833&CLIPPERCOORDSYS=EPSG%3A25833&opt_servicemode=sync&MAXX=276297&CLIPPERCOORDS=276114+7041453+276114+704162
8+276297+7041628+276297+7041453+276114+7041453&MAXY=7041628&FEATURE_TYPES=GIS.FKB_EIENDOMLINJE+GIS.FKB_VANNFLATE+GIS.F
KB_TEKST1000LINJE+GIS.FKB_KULTURMINNEKFAPUNKT+GIS.FKB_VEGLINJE+GIS.FKB_PBLTILTAKPUNKT+GIS.FKB_TEKST1000PUNKT+GIS.FKB_L
EDNINGVAPUNKT+GIS.FKB_VANNLINJE+GIS.FKB_TEKST5000LINJE+GIS.FKB_EIENDOMFLATE+GIS.FKB_BYGNINGLINJE+GIS.FKB_LUFTHAVNPUNKT
+GIS.FKB_NATURINFOLINJE+GIS.FKB_AREALBRUKPUNKT+GIS.FKB_KULTURMINNEKFALINJE+GIS.FKB_BYGNANLEGGLINJE+GIS.FKB_LUFTHAVNLIN
JE+GIS.FKB_VEGPUNKT+GIS.FKB_BYGNANLEGGFLATE+GIS.FKB_BANELINJE+GIS.FKB_KULTURMINNEKFFFLATE+GIS.FKB_FASTMERKETREKANTPUNK
T+GIS.FKB_AREALBRUKLINJE+GIS.FKB_HOYDEKURVER5MPUNKT+GIS.FKB_KULTURMINNEKSIPUNKT+GIS.FKB_LEDNINGELTELEPUNKT+GIS.FKB_HOY
DEKURVER5MLINJE+GIS.FKB_KULTURMINNEKFFPUNKT+GIS.FKB_PBLTILTAKLINJE+GIS.FKB_FASTMERKELANDSNETTPUNKT+GIS.FKB_BYGNINGPUNK
T+GIS.FKB_VEGFLATE+GIS.FKB_AREALBRUKFLATE+GIS.FKB_LUFTHAVNFLATE+GIS.FKB_VERNLINJE+GIS.FKB_AR5PUNKT+GIS.FKB_EIENDOMPUNK
T+GIS.FKB_TEKST5000PUNKT+GIS.FKB_BYGNANLEGGPUNKT+GIS.FKB_KULTURMINNEKBFPUNKT+GIS.FKB_HOYDEKURVERLINJE+GIS.FKB_KULTURMI
NNEKFAFLATE+GIS.FKB_KULTURMINNEKSIFLATE+GIS.FKB_AR5FLATE+GIS.FKB_PBLTILTAKFLATE+GIS.FKB_KULTURMINNEKOFFLATE+GIS.FKB_FA
STMERKENIVFMPUNKT+GIS.FKB_VERNPUNKT+GIS.FKB_ADRESSEPUNKT+GIS.FKB_LEDNINGELTELELINJE+GIS.FKB_NATURINFOFLATE+GIS.FKB_KUL
TURMINNEKOFLINJE+GIS.FKB_TEKST1000TEKST+GIS.FKB_AR5LINJE+GIS.FKB_VBASELINJE+GIS.FKB_KULTURMINNEKFFLINJE+GIS.FKB_BYGNIN
GFLATE+GIS.FKB_HOYDEKURVERPUNKT+GIS.FKB_NATURINFOPUNKT+GIS.FKB_KULTURMINNEKSILINJE+GIS.FKB_VBASEPUNKT+GIS.FKB_VERNFLAT
E+GIS.FKB_VANNPUNKT+GIS.FKB_TEKST5000TEKST&DESTCOORDSYS=%22ESRIWKT%7CNorsk_Transversal_Mercator_sone_5%7CPROJCS%5B%22N
orsk_Transversal_Mercator_sone_5%22%2CGEOGCS%5B%22GCS_ETRS_1989%22%2CDATUM%5B%22D_ETRS_1989%22%2CSPHEROID%5B%22GRS_198
0%22%2C6378137.0%2C298.257222101%5D%5D%2CPRIMEM%5B%22Greenwich%22%2C0.0%5D%2CUNIT%5B%22Degree%22%2C0.0174532925199433%
5D%5D%2CPROJECTION%5B%22Transverse_Mercator%22%5D%2CPARAMETER%5B%22False_Easting%22%2C100000.0%5D%2CPARAMETER%5B%22Fal
se_Northing%22%2C1000000.0%5D%2CPARAMETER%5B%22Central_Meridian%22%2C5.5%5D%2CPARAMETER%5B%22Scale_Factor%22%2C1.0%5D%
2CPARAMETER%5B%22Latitude_Of_Origin%22%2C58.0%5D%2CUNIT%5B%22Meter%22%2C1.0%5D%5D%22&MINY=7041453&MINX=276114
• Parameters: OrderID, ClipperCoordSys (EPSG),
ClipperCoords, SearchEnvelope, FeatureTypes,
WhereClause, DestCoordSys (ESRI WKT)
Monitoring jobs in SharePoint
We also deliver also PDF’s produced
with ArcGIS Server GP Services
• Used for Real Estate sales prospects
A couple of lessons learned
• Different formats has diffent limitations – must be
handled differently.
Generic Writer not usable, too few parameters available
Separate services needed to support each supported
format
• Different users have different expectations to
different formats and same format is handled
differently in different GIS- and CAD packages
Special translations has to be done on the fly in the
services to support all the combinations
• SAFE SW licensing is not Cloud friendly (!)
Sample 1: Arches and Ellipses
• Autodesk Clients cannot handle centre points for arches and ellipses in 2D (as they are in the original data), while other CAD clients can
• Solution Filter Arches and Ellipses out and
set Z for the Centre Point to 0
Sample 2: Combination of 2D and 3D
vertices
• Original data contain features with a combination og 2D and 3D vertices (fully allowed in SOSI) CAD users do not like to see this
(vertical spikes in 3D)
• Solution Force all features with an
elevation attribute into 3D and force all other features with a combination og 2D and 3D vertices into 2D
Sample 3: Text in Shape
• Shape format does not support text (annotations)
• Solution: Create point and line features from horizontal and curved annotations to be used for labeling
FME Server licensing
• Not Cloud friendly!
• Licenses are bound to Mac address
– When an AWS instance is stopped and started (ex.
nighttime) the IP address and hostname changes
– When a new AWS instance is created from an image of
an old one and replaces it (normal scaling procedure)
the hostname and the IP and Mac addresses changes
– ...
• Limits abilities to get the advantages and savings
using a Cloud environment
Finally, on the customer side:
• Detailed map data for any AOI ordered and loaded into any GIS or CAD client in just a few minutes!
Thanks for your attention!
Any questions?
