Editing Strategies for Enterprise Geodatabase · Enterprise GIS. Transforming the Role of GIS....

Editing Strategies for Enterprise Geodatabase

Ty Fabling – Esri Solution Engineer

February 9–10, 2015 | Washington, DC

Federal GIS Conference

Server Online Content and Services

Desktop Web Device

A Complete PlatformEnabling GIS Everywhere

Available in the Cloud . . . . . . and On-Premises

SimpleIntegratedOpen

Portal

Enterprise GIS

Transforming the Role of GIS

ArcGIS

Executive Access

PublicEngagement

WorkAnywhere

Knowledge Workers

EnterpriseIntegration

Professional GIS

Making Mapping and GIS Available across Your Organization

Esri Defined Pattern Areas

DataManagement

Planning & Analysis

Field Mobility

Operational Awareness

ConstituentEngagement

Transform Data Into Actionable

Information

Collect, Organize, & Exchange Data

Get Information Into and Out of

the Field

Disseminate Information Where

and When it is Needed

Get Feedback and Make Informed

Decisions

Mobile & Runtimes Web api’s GeodatabaseGeodatabase Geoprocessing Web api’s

Enterprise Web / Cloud Device Pervasive

LocationAnalytics

Add a spatial component to the decision making

process

Integrated w/ BI

ArcGIS Platform - Complete Integration of Patterns

Back Office Patterns Front Office Patterns

1

2

3

4

Multiple Implementation PatternsLeveraging Common Computing Architecture

File Based Database Centric Server Centric Web Centric

Evolution of Editing GIS softwareTechnology progress

ArcGIS Desktop 1999ARC/INFOCoverages - LibrarianArcStorm

ArcSDE (View)

Tightly scripted software code Object relational software Service-oriented architecture

Platform performance change over time

>> 10x faster hardware >> 3.5x faster hardwareBetter networks

Scripts Objects Services

ArcGIS Server 2004- REST API- Rich Internet clients

Tile Cache

Hardware virtualization

Cloud computing

ArcGIS OnlinePortal for ArcGIS

- Feature ServicesArcSDE (Edit)

Versioned Geodatabase

>> 1.2x faster hardwareImproved networks

Cloud

…Technology drives innovation

Mobile GIS

1975 1995

20 years 10 years

20052010

2015

5 years 3+ years

AML VBA Python

Roll-your-own GIS Client / Server HTTP/SOAP REST

3G Broadband 4G

SDE Direct ConnectWorkstation GIS Web GIS Portal for ArcGIS

Enterprise GIS Federated GISDepartmental GIS

1 2 3 4

JavaScriptPython

Gartner Magic Quadrant for Business Intelligence and Analytics Platforms

MagicQuadrant

Cognos

Sharepoint

Emerging Technology Trends in GIS

Con

nect

ivity

Integration

MagicQuadrant

File Based

Database Centric

Server Centric Web Centric

12

34

1 2

43

Static Content Dynamic Content

PersistentConnections

TightlyCoupled

StatelessConnections

LooselyCoupled

LAN

WAN

Internet

REST

BasemapsIntranet

From ArcView to ArcGIS OnlineArcGIS Online – Significant GIS Innovation in 20 years

Desktop

ArcView1992

ArcGIS Online2013

Web Map

Shapefile Feature Service1 4

Web Centric

File Based

Database Centric

Server Centric Web Centric

1 2

43

REST

Basemaps

Web GIS Provides a New Pattern for IntegrationMaking Data Sharing and Access Easier

Enabling a Flexible and Agile Approach

Distributed ServicesDatabases

2

4 File Based

Database Centric

Server Centric Web Centric

1 2

43

REST

Basemaps

Web GIS Dynamically Integrates InformationCombining and Analyzing Information

Helping to Discover and Understand Relationships . . .

Mashup

Visual Overlay

Modeling

Spatial Analysis

3 4

Static Maps Dynamic Services

File Based

Database Centric

Server Centric Web Centric

1 2

43

REST

Basemaps

Evolving GIS Mission Support Pattern

Same GIS Data and Services served up new ways

Device

Portal

Reporting

Developers

Non-GIS Users

Desktop

APIs

ServerDesktop

Databases

Other Data

Browser

Basemaps

Microsoft Office

GIS Professionals

GP Services

Apps

GIS Users

GIS Data Layer Concepts

Operational Layers

Foundational Layers

Basemap Layer

Dynamic Data

Static Tile Cache

Static Data

Mission Layers Semi-Static Data

User Layers Dynamic Data

2

3

4

4

24

2

ArcGIS for ADS&CI (Q)

Global Regional Local FloorAware

1:1,000,000 1:200,000 1:24,000 1:500Scale:

Scope:

Scale and Scope

1:250 1:100 1:50

InsideRooms

RoomsSpecialized/Urban

1:1,000

GIS Open DataVector Data Model

& Raster DataFacilities Management /

Building Interior Space DM

Campus/ Buildings

1:500

Devices

Campus GISVector Data Model

& Tile Cache

BasemapsTile Cache

SRTM (30 m)

Imagery: Landsat (30 m)

NAIP(1 m)

Aerial(>1 m)

LiDAR(cm / 3D)

LiDAR(1 m >)

2D2D (3D Bldgs)

2D+/3D

MODIS (90 m)

Fire

wal

l

3DGlobe

1 2 3 4 5 7 8 9 106Levels:

1

23 44 2

4

2 3

GIS Data Editing Strategies

Primary GIS Architectural GoalsPrioritize & Balance

• Functionality• Performance• Security• Governance

- Policy- Standards- COTS

- Versions

Make it WorkMake it FasterMake it SecureMake it Compliant

With each option consider: Three Components, Two NetworksAsk three key questions

Where is…?1. The User2. The GIS App3. The GIS Data

User App Data

LAN or WAN LAN

Editing a Versioned GeodatabaseDifferent workflows - Depending on the Network Connection

ArcMap or Pro

LAN

WAN

SQL Expressor

Runtime Geodatabase

Sync

Feature Service

Disconnected Editing

Citrix (VDI)

Direct Connect

ArcGISServer

CitrixServer

ArcSDEGeodatabase

Server

1

2

3

4

2

Remote Desktop

Stand-alone Desktop

3

FGDBShapefiles

2

FTP

Desktop Editing

• (Shapefiles)• File-based Geodatabase

- Check-in / Check-out

• MS SQL Express- Local ArcSDE Geodatabase

• Runtime Geodatabase- SQLite

• ETL- Extract – Translate – Load - Data Interoperability Extension - FME: Safe Software

Stand-alone Workstation / Laptop

No Network

File Based SQL Expressor

Runtime Geodatabase

ArcMap or ArcGIS Pro

LocallyAttached

Drives

Geodatabase EditingClient / Server - Multi-User Versioned Editing

• ArcSDE Geodatabase- SQL Server- Oracle- PostgreSQL- DB2- Informix

• Native Database Support- SQL Server (Geometry, Geometric)- Oracle (SDO)- PostgreSQL (PostGIS)

• Query Layers

Database Centric

ArcMap or ArcGIS Pro*

LAN

Esri Training:“Configuring and Managing the Multiuser Geodatabase”

Direct ConnectPersistent Connection

* Pro - Simple Features Only

Web Editing

• ArcGIS for Server- Feature Services- GeoData Services (Sync)

• Examples:- ArcGIS Online Editing- Portal Editing- Esri Maps for Office- Crowd Sourcing Apps

Connected - Web Service-based

Last-in wins if updating a geodatabase through a feature service

Server Centric

WANStateless ConnectionHTTP XML Packets

Web AppBuilder for ArcGIS: Web Editing Templates – Batch Editor Widget

Mobile EditingSometimes Connected

• Feature Services

• Disconnected Editing (Sync)- Runtime Geodatabase- Work Offline

• Examples:- Collector- Runtime Apps

Server Centric

WAN

Local Cache

ArcGISfor DevelopersWork Offline

Work Offline

Portal for ArcGISHosted Feature Data

• Feature Services (Hosted Data)- Tile Service- Feature Collection - New

• Disconnected Editing (Sync)- Runtime Geodatabase

• Other options:- Local Data- Runtime Geodatabase

Hosted Feature Dataon Portal

WAN

LAN

Data Store (10.3)

ArcGIS 10.3 Platform ArchitecturePortal for ArcGIS

Hosted DataArcGIS For Server

Non-Portal Data & ServicesGeoEvent Processor

Real-time Data

Web Tier

App Tier

Data Tier

Web Tier

Editing with ArcGIS Pro

• Projects: Local Data Sets• Enterprise Geodatabase

- Simple Features Only

• Portal Data• Feature Services

• Disconnected Editing (Sync)- Runtime Geodatabase

New!

Designed to easily interface with ArcGIS Online and Portal

ArcGIS Pro

Distributed Editing Workflows

• US Federal Data Center Consolidation Initiative• Moved databases away from editing workstations• Performance issues due to network latency• Editing Workstation and the geodatabase must be on the same LAN

• Only two options:1. Centralize the Desktop – close to the geodatabase

- Citrix XenApp- Virtual Desktop Infrastructure (VDI)

2. Distribute the geodatabase- Geodatabase Replication- Must be a DBMS- GeoData Sync

Enterprise GIS Geodatabase

State ID vs Data_Time Stamp

Bob Baldwin – FAS GIS Manager FAS – Foreign Agricultural Service

Esri Mapping and Charting Solutions

• ArcGIS for Aviation• ArcGIS for Maritime• Esri Defense Mapping• Esri Production Mapping

• TDM- Topographic Data Manager

Previously Professional Services Production Line Tool Set (PLTS)

Streamline your GIS data and cartographic production with Esri's mapping and charting solutions

NGA’s GROOVE and TFDM programs

NGA Content Management (National Geospatial-Intelligence Agency)

GROOVE TFDM

GeoWhereHouse

GROOVE – Geospatial Requirements One-stOp Visualization EnvironmentTFDM – Topographic Feature Data Management

Enterprise Product On Demand Service (ePODS) Provides Aeronautical, Nautical (Maritime), and Topographic Maps, Charts, and Data

US Federal Agencies with Production GIS Editing Environments

• NOAA Ocean

Weather

Coastal

• USDA – US Dept. of Agriculture FAS – Foreign Ag Service

FSA – Farm Service Agency (CLU)

FS – Forest Service

NRCS – Natural Resources Conservation Service

• DOI – Dept. of Interior BLM – Bureau of Land Management

• USGS – US Geologic Survey

• DOD Army

Marines

Navy

Air Force

Coast Guard

National Guard

• Intel Community NGA

• Many Others…

Don’t forget to completethe session evaluation form!

February 9–10, 2015 | Washington, DC

Federal GIS Conference