Embed Size (px)
Citation preview
SendingAutomatedChangestoSDE
EricArmstrong
GeraldMarbury
Agenda– Background– AboutEricArmstrong– AboutGeraldMarbury/GeospatialExtensions– MilsoftESRIDataSyncTool– Demo– Discussion
AboutEricArmstrong• BSinComputerScience• 2.5yearsinWindMilMapSupportatMilsoftUtilitySolutions
3
AboutGeraldMarbury• MSElectricalandComputerEngineering• 7yearsatAlabamaPower/SouthernCompany• 3yearsasR&DDirectorofUtilityAutomationIntegrators• 4yearsasDirectorofSoftwareDevelopmentofPDA/Origin
GIS• InfluentialinNRECA’sMultiSpeak®Initiative• 14yearsatGeospatialExtensions,Inc
4
• Benefits – Milsoft’s connectivity and network editing tools – Milsoft’s advance symbology – Access to 100’s of the Core E&O fields – ESRI’s advanced symbology – ESRI’s editing tools
• Technical Characteristics - The data is really in a linked local model (LLM) - Consumes a Milsoft license - Can only be opened from a 32Bit process
- ArcMap, ArcCatalog, ArcPy, etc - Some field name are greater than 31 characters - String fields are 255 characters in length
Milsoft Custom Geodatabase
WhatistheMilsoftESRIDataSyncTool
• TwoExtensions1. ExtensiontoArcGISforServer
• RequiresArcGISServerLicense• Runs“Automagically”
2. ExtensiontoArcGISforDesktop• RunsinArcCatalogandArcMap• Usefulforremoteconfigurationofserver• NotAutomatic
ComparisonswithImportEXT• Milsoftbackedexcellentsupport• Nofunctionaldifference• 32Bitversus64Bit• Allupdateswillbeavailable
WhatisM.E.D.S.• Providesone-way
integrationtothegeodatabasefrommultipleandvariousdatasources.
SQL Server
Text Files Oracle
Excel Access
ODBC OLEDB ADO.Net 3 Key APIs
GDB
XML Services
Json
ESRI
3KeyDatabaseAPIs
ODBC OLEDB ADO.NET
1992 1996 2002
1000’s of providers and drivers http://www.sqlsummit.com/oledbVen.htm http://www.sqlsummit.com/ODBCVend.HTM http://www.sqlsummit.com/DataProv.HTM http://www.connectionstrings.com/
“DRIVEITIN”“Ifthere’sadriverforit,thenyoucan
bringitin.”
AMI
Work Orders
OMS
CIS
SCADA
AVL
EA
HowdoesM.E.D.Sfitin?
ImportEXT
HowdoesM.E.D.Sfitin?Oracle
SQL Server
Access
Excel
DBF
MySQL
AS400
CSV
PostGre
Outlook
SQLite
DB2 S
patial Data
WhatisImportEXT
• One-wayintegrationtogeodatabase
HowdoesMEDShelp?• “Ineedamapof………….”
– Customerswithlowvoltageasofyesterday– Customersthathaveblinkedexcessivelyinthelastweek.– Mykeycustomersthatwereinanoutageinthelastmonth– Wherearethetruckscurrently– Canyouaddafieldfromthe“……”systemtothemap?
Manual steps to display non-spatial data
Internal customer would query tabular data
Export to DBF or CSV Put on Shared
Drive
Create relates & joins in GIS Export Data to
Shapefile
Produce a map Repeat!
Convert Key Field to Match
GIS
Publish Map Service
Steps to display non-spatial data now
Configure Import
Specification
Create Dynamic
Map
ToolFeaturesandConfiguration
ImportSpecificationorRule• Describesanintegrationfrom
sourcedatatoadestinationtableorfeatureclass
• Sourcedatacanbeatable,view,featureclassorrawSQL,XMLdatasource,Jsondatasource,orevenanothergeodatabase.
• Eachisaseparate“interface”• Canhaveasmanyasdesired
CreateDestinationFields&Tables• Automaticallycreatesmissingdestinationsfieldstomatchsource
datatypes.• Createsthedestinationtableorfeatureclassifit’smissing.• Cleansfieldnamesasitcreatesthem
– AFIELDWITHSPACESbecomesA_FIELD_WITH_SPACES– Set’saliastooriginalname.
• HandlesfieldstoolongforSDE– dbo_ServiceLocation_Ext:TRANS_POLENUMBERbecomes
wmextdbo_ServiceLocation_Ext__9
• Determinesfieldlengthsbasedontheactualldata– ThelengthofwmUplineFeederchangesfrom255to5
• Copiessourcedomains
PrimaryKeyOptions• SupportsMultiplePrimaryKeys• KeyMatchingOptions
– Converttodouble– Converttointeger– Converttostring– Trimstrings– Trimspecifiedleadingcharacters– Trimspecifiedendingcharacters– Removenon-numericcharacters
234-023-004 = 000234023004
Incrementalupdates• Inserts,UpdatesandDeletes• Ifnospatialdata,disallowsinsertsof
featureclass• Automaticallyconvertsfieldtypes
whileimporting– StringtoInteger– StringtoDouble– StringtoBoolean– DatetoString– DoubletoDouble– FormattedStringtoDate
• DestinationClearFields– Alternativetodelete
CreatesorupdatesESRIgeometry• Projectsfromsourceto
destinationcoordinatesystem• SourceSpatialOptions:
– X,Y,Zcoordinatesfields– Latitude,Longitudefields– OGISFields
• WKT:WellKnownText• WKB:WellKnownBinary
– SQLServerGeographyfields• RequiresSQLServer2008
– Geocoding– RelatedESRIfeatureclass
RelatedFeatureClassExample
DestinationGeodatabaseExternalGeodatabaseExternalShapefile
SDE.ServLoc OBJECTID
Address
Location
MeterNo
SHAPE
LowVoltagePt
ReadingID
Date
Voltage
MeterNumber
SHAPE
Where V < 110
“Low Voltage” layer in dash board
AMR.Voltage ReadingID
Date
Voltage
MeterNumber
AScheduleforeachRule• Strikesevery5minutes• AVLevery90seconds• Metersat7pm• Tamperingeverymonth• Peaksevery6months• Nameplatedataevery
quarter.
DownloadandImportText,XMLandJSON
• UNC,FTP,HTTP,HTTPS,sFTP• Text:CSV,Tab,Pipe• Jsondata,XMLdata
– Flattensnestedelements
• Supportsencryptednetworkcredentials
• Candeleteorignorepreviousprocessedfiles
ConvertTablestoCodedValueDomain
• ConvertanyTableorViewtoacodedvaluedomain
• Oneafieldforthecodevalue• Canchoosemultiplefieldsforthe
description.• Canconvertabitgatetoacodedvalues
Periodicstatusreportviaemail• Onkeyevents
– ServiceStopped– ServiceStarted– ConfigurationChanged
• Periodically– Inserted– Changed– Deleted– Resourcesinuse– Exceptions– Typicallyeveryday
Scheduledcompressions• AnalyzesandCompresses
Geodatabase• Canbescheduledor
disabled• Rebuildsspatialindexes• Successfulnotificationsent
viaemail
RunasaScriptorScheduledTask• HasascriptingAPI• CreateObject• Examples
– VBscript– cscript– powershell
SystemRequirements• ArcGISSoftware
– ArcGISforDesktop10.2through10.6– ArcGISforServer10.2throughArcGISEnterprise10.6
• OperatingSystem– Windows7.1through10– WindowsServer2000–2014– WhateverESRIofficiallysupports
• SupportedGeodatabases– ArcSDE(Personal,WorkgrouporEnterprise)– FileGDB– PersonalGDB
DemonstrationandQuestions
Scenario1–GettingStartedLowVoltageLine
• WhatcanIconnectto?• ViewSource• Createthedestinationtable• Keys• Userfunctions
– Processselectedtable– Processselectedgeo-database– Processselectedfeaturedataset
What’sPossibleUnionPower:Arealwordexample
ArcCatalogUse• Administrativefunctions
– ConfigureImportExt– CreateSourceFieldsonDestination
• Userfunctions– Processselectedtable– Processselectedgeo-database– Processselectedfeaturedataset
Scenario2–SpatialData• CustomersNamed• Createthedestinationtable• Userfunctions
– Processselectedtable– Processselectedgeo-database– Processselectedfeaturedataset
ConfigurationDemo
ArcMapUse• Administrativefunctions
– None• Userfunctions
– Processconfiguredtables
ArcMapUse• Administrativefunctions
– None• Userfunctions
– Processconfiguredtables
Notes • Introductions
• BackgroundofTool• FeaturesoftheTool• ArcServerConfiguration• WebDemo
• DisSpatch
• Outages• Historical
• Mobile• FaultCurrentsearch• WindMill• HyperLinks• Mobile
