Bruce Harold – Esri

Christian Berger – Safe Software

Using ETL for Interoperability & Productivity

Light on Slides, Heavy on Demos

Presentation Thumbnail

What Does ArcGIS Data Interoperability Do?Integrates apps A,B… data, optionally transformed

• What kind of apps can A & B… be?

• From A,B,C… to D,E,F… at once?

• Local data or web too?

• What can I do on the way?

• Is this part of Geoprocessing?

• Can I automate this on a schedule?

• Does it understand authentication?

• Can I work with FME?

• Do I have to write code?

Data Interoperability Use Cases

• Migration

- Format translation: Import and Export

• Transformation

- Geometry, property, or attribute manipulation

• Validation

- Business rules for correctness, completeness, compliance

• Integration

- Storage technologies, web protocols, web APIs, web formats

• Sharing

- Download, upload, synchronization, web storage, web tools, email

Classic ETL

Workshop DemosArcGIS Data Interoperability

• Quick Import

- Demo: CSV example, out of 387 available formats

• Basic ETL

- Demo: Quick Import

• Advanced ETL

- Demo: The Workbench Application

• Working with a Challenging Format

- Demo: Extracting data from Adobe GeoSpatial PDF

• Powerful Use Case

- Demo: Change Detection

• Web File System

- Demo: Pushing GeoPackages to Cloud Storage

• Scheduled Integrations:

- Demo: Synchronize 3rd Party WFS to ArcGIS Online

Where is Data Interoperability in Pro?Separately installed and licensed

• Workbench App is

- Authors and persists Spatial ETL Tool source

- In the Analysis Ribbon

- In Extension Toolset

• ETL tools are just tools

- Add to ModelBuilder

- Call with Python

Please ask questions, we’ll both learn something

Demos, Discussion

CSV with XY & Field Types

Discovered

Quick Import

Quick Import

Easy Conversion to File Geodatabase

Hands-Free if you want

Access to format-dependent fine grained control

First Look at Workbench

Simple schema manipulation

Basic ETL

Basic ETL

• First look at Workbench

• Easy visual programming (no code!)

• First look at Readers, Writers, Transformers

• Showed controlling the output schema

- Field Name

- Field Type

- Field Width

• Most ETL tools are this simple

Bulk Restructuring

Advanced ETL

Advanced ETL

• Conditional Values

- Compare to SQL and Case statements

• String, Math, DateTime, Geometry etc. functions available with pickers

- Still no coding required

- No SQL dialects to learn

Adobe GeoSpatial PDF

Challenging Format

Challenging FormatAdobe GeoSpatial PDF

• First look at a format with multiple feature types

• Vector and raster feature types

• Workbench can process everything at once

• LiDAR, 3D MultiPatch and Scene Layers are supported too

Daily EV Charging Station Pricing

Change Detection

Change Detection

• First look at feature interactions

• First look at list (multi-value) attributes

• It can be coded but there is no need!

Push GeoPackage to Cloud

Web Sharing

Web Sharing

• First look at web data sources

- HTML Table

- CSV from a URL

- Create a GeoPackage

- Push to OneDrive

• Cloud storage is easy to incorporate!

3rd Party WFS to ArcGIS Online

Cross Platform Sync

Cross Platform Synchronization

• Happened to be WFS URLs

- Could be any web protocol like REST/JSON or XML or messaging or sockets…

- You only have to understand the basics of the target technology

• Powerful Use Case

- Maintain a hosted feature layer from any data source

- Opens up many Esri apps once you have a feature service

• Easily run on a schedule

- Scheduling built in at ArcGIS Pro 2.5

Data Interoperability; Integration in the Modern Commercial Enterprise

Customer

Support

Analytics

& BI

CRM

Design

Business

Process

Automation

+

ERP

Datastores

Cloud File SystemsEnsuring ArcGIS Presence in Low-Code App Environments

Integration

Services

ArcGIS

Marketing &

Social

Print Your Certificate of Attendance

Print Stations Located in 150 Concourse Lobby

Tuesday12:30 pm – 6:30 pm

Expo

Hall B

5:15 pm – 6:30 pm

Expo Social

Hall B

Wednesday10:45 am – 5:15 pm

Expo

Hall B

6:30 pm – 9:30 pm

Networking Reception

Smithsonian National Museum

of Natural History

Download the Esri

Events app and find your event

Select the session

you attended

Scroll down to

“Survey”

Log in to access the

survey

Complete the survey

and select “Submit”

Please Share Your Feedback in the App