25
2013 Ohio GIS Conference Designing for the Future September 11-13, 2013 Exploiting Real-Time Data with ArcGIS GeoEvent Processor for Server Eric J. Rodenberg

Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Embed Size (px)

Citation preview

Page 1: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

2013 Ohio GIS ConferenceDesigning for the FutureSeptember 11-13, 2013

Exploiting Real-Time Data with ArcGIS GeoEvent Processor for ServerEric J. Rodenberg

Page 2: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

GIS data• GIS data typically represents state at a specific

moment in time: “historic”, “current”, or “future”.

Credit: iStockphoto/chris_lemmens

Page 3: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Real-time GIS data

WebDesktopRuntime

Mobile

Applications

FeaturesChallenge #1

Police PersonAmbulance

Police Car

110°

StormWind

TemperatureEarthquake

Wild Fire

Network SensorWarehouse Item

…continuous stream of events flowing from sensors representing the latest state.

Page 4: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Analyzing real-time GIS data

…Are my field personnel working within the designated project area?

WebDesktopRuntime

Mobile

ApplicationsFeaturesEquipment

Alert

Challenge #2

ContinuousAnalysis

BoundaryOutside

Boundary

Page 5: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Analyzing real-time GIS data

• …Tell customer when their delivery truck is 15 minutes away.

ContinuousAnalysis

WebDesktopRuntime

Mobile

ApplicationsFeaturesDelivery Vehicle

NotificationCustomer AreaEnter

Customer Area

Challenge #3

Page 6: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

ArcGIS supports real-time GIS

Real-time data

ArcGIS Online /Portal for ArcGIS

OperationsDashboard

Collector

ArcGIS Server

GeoEvent Processor

Page 7: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

ArcGIS GeoEvent Processor for Server• Receives real-time streaming data

• Performs continuous processing and analysis

• Sends updates and alerts to anyone on any device

Continuous Processingand Analysis

Continuous Processingand Analysis

Connectors

Connectors

im

ws://

Alerts

Real-Time Data FeaturesWebDesktop

Runtime

Mobile

ApplicationsArcGIS Server

GeoEvent Processor

Page 8: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Working with real-time data

Page 9: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

You can add your own connectors.

Receiving real-time data• You can easily integrate real-time data with ArcGIS

by using a connector that meets your needs.

Input connectors…

Real-time dataReal-time data

ArcGIS for Server

GeoEvent Processor

Receive NMEA

Receive Sierra Wireless

Receive Tweets

Receive Instagram

Receive Trimble

Receive GPX

NMEA

GPX Receive Vessels

Receive Geomessages

Receive Air Traffic Control

Receive Cursor-on-Target

Receive VMFCoT

VMF

Message Geo

Watch a folder for new Files

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

Poll an ArcGIS Server

Poll an external website

ws://

http://

http://

Receive RSS

Receive from a Socket

Receive from a Web Socket

Receive on a REST Endpoint

ws://

http://

Receive from a Socket

Receive from a Web Socketws://

Page 10: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

DemonstrationTwitter monitoring

Page 11: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Sending real-time data• You can easily send resulting streams to anyone on any device using a

connector.

Output connectors…

WebDesktopRuntime

MobileArcGIS for Server

GeoEvent ProcessorReal-time dataReal-time data

You canadd your

ownconnectors

Send to RabbitMQ

Send to ActiveMQ

Send to HornetQ

Write to Hadoop

Write to MongoDB

Send a Tweet

Send to CESIUM

im

ws://

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send to Tracking Analyst

Send a Text Message

Publish to REST Endpoint

Send to a Web Socket

Send to a Socket

Write to a File

im

ws://

Send an Instant Message

Send an email

Update a Feature

Add a Feature

Send to Tracking Analyst

Send a Text Message

im

Update a Feature

Add a Feature

Send to Tracking Analyst

Update a Feature

Add a Feature

Page 12: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

ArcGIS for Server

Sending real-time data to featuresUsing local feature services

GeoEvent Processor

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a FeatureUpdate a Feature

Add a FeatureAdd a Feature

Operations Dashboard for ArcGIS

ArcGIS Online / Portal

operation view

web map

Your DashboardsYour

ApplicationsYour

Applications

Web APIsJavaScript

Flex

Silverlight/WPF

Mobile GISiOS

Android

Windows Phone

RuntimesWindows Store

Mac OS X

Java

Qt

Real-timedata

Real-timedata

feature layersfeature layers

Page 13: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

YourApplications

YourApplications

Web APIsJavaScript

Flex

Silverlight/WPF

Mobile GISiOS

Android

Windows Phone

RuntimesWindows Store

Mac OS X

Java

Qt

ArcGIS Online / Portal

operation view

web map

Sending real-time data to featuresUsing remote feature services…

ArcGIS for Serverfeature layersfeature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a FeatureUpdate a Feature

Add a FeatureAdd a Feature

Operations Dashboard for ArcGIS

Your Dashboards

Real-timedata

Real-timedata

Page 14: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

YourApplications

YourApplications

ArcGIS Online / Portal

operation view

web map

Sending real-time data to featuresUsing ArcGIS Online feature services…

feature layers

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Update a FeatureUpdate a Feature

Add a FeatureAdd a Feature

Web APIsJavaScript

Flex

Silverlight/WPF

Mobile GISiOS

Android

Windows Phone

Operations Dashboard for ArcGIS

Your Dashboards

RuntimesWindows Store

Mac OS X

Java

Qt

Real-timedata

Real-timedata

Page 15: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Real-timedata

Sending real-time data to big data stores

• GIS Tools for Hadoop

- http://github.com/Esri/gis-tools-for-hadoop ArcGIS for DesktopGeoprocessing

GIS Tools for HadoopGIS Tools for Hadoop

2013/03/06/10/vehicles-2013-03-06-10.json2013/03/06/10/vehicles-2013-03-06-10.json2013/03/06/11/vehicles-2013-03-06-11.json2013/03/06/11/vehicles-2013-03-06-11.json2013/03/06/12/vehicles-2013-03-06-12.json2013/03/06/12/vehicles-2013-03-06-12.json2013/03/06/13/vehicles-2013-03-06-13.json2013/03/06/13/vehicles-2013-03-06-13.json

2013/03/06/10/vehicles-2013-03-06-10.tsv2013/03/06/10/vehicles-2013-03-06-10.tsv2013/03/06/11/vehicles-2013-03-06-11.tsv2013/03/06/11/vehicles-2013-03-06-11.tsv2013/03/06/12/vehicles-2013-03-06-12.tsv2013/03/06/12/vehicles-2013-03-06-12.tsv2013/03/06/13/vehicles-2013-03-06-13.tsv2013/03/06/13/vehicles-2013-03-06-13.tsv

GeoEvent Processor

ArcGIS for Server

Filters Processors

Inpu

ts

Out

puts

GeoEvent Services

Write to HadoopWrite to Hadoop

Write to MongoDBWrite to MongoDB

Write to a Hadoop Distributed File System (HDFS)Write to a MongoDB Document Store

Page 16: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Performing continuous processing and analysis

Page 17: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

WebDesktopRuntime

Mobile

im

ws://

Continuous processing and analysis• A GeoEvent Service configures the flow of GeoEvents

- the Filtering and GeoEvent Processing steps to perform- what input(s) to apply them to- and what outputs(s) to send the results to

GeoEvent Services…

ArcGIS for Server

GeoEvent Processor

Real-time dataReal-time data

Twitter Input Add Tweet FeatureFilterGeolocated

Filter

Write Tweets to Hadoop

Twitter Monitor (GeoEvent Service)Twitter Monitor (GeoEvent Service)

Page 18: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Continuous processing and analysis•Calculate new fields on a geoevent: GeoTagger , Field Calculator•Modify a geoevent: Field Enricher , Field Reducer•Derive a new geoevent: Field Mapper , Incident Detector

GeoEvent ServiceGeoEvent Service

GeoTagger

Field Calculator

Field Enricher

Field Reducer

Field Mapper

Incident Detector

Input 1 Output 1

ArcGIS Server with GeoEvent Processor

Processors…

Page 19: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Continuous processing and analysis

• An Incident Detector processor- creates an incident upon an opening condition being met,- maintains state for the duration of the incident,- closes the incident based on a closing condition or expiration .

GeoEvent ServiceGeoEvent Service

Incident Detector

91909265689091909281736866

CloseIncident

81

OpenIncident

90noiseDecibel >= 90

Opening Condition

Input 1 Output 1

Derive a new geoevent…

Page 20: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

DemonstrationNoise incident detection

Demo

GeoEvent Processor

ArcGIS for Server

GeoEvent ServiceGeoEvent Service

ws:// ws://JSON

GeoEvent Processor

ArcGIS for Server

GeoEvent ServiceGeoEvent Service

ws:// feature

external internal

featureincident detectorNoise App

Page 21: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Solutions and sample applications• A number of sample applications and solutions leverage GeoEvent

Processor to enable real-time GIS capabilities within them including: - Defense and Intelligence: http://resources.arcgis.com/en/communities/defense-and-intelligence/

- ArcGIS for the Military- ArcGIS for the National Guard- ArcGIS for Intelligence

- Asset Monitor- Route Monitor

Applying real-time GIS

ArcGISfor the Military

ArcGIS forIntelligence

RouteMonitoring

AssetMonitoring

Page 22: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

DemonstrationVehicle monitoring

Demo

Page 23: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent

Real-time GIS with GeoEvent Processor• ArcGIS is a dynamic platform that enables real-

time visualization, continuous analysis, and understanding of our world.

• GeoEvent Processor allows you to:- be alerted when interesting events occur- react and make smarter decisions faster- to know what is happening, as it happens

• Product Page- http://pro.arcgis.com/share/geoevent-processor

Summary

Page 24: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent
Page 25: Exploiting Real-Time Data with ArcGIS GeoEvent Processor ...gis3.oit.ohio.gov/OGRIPWeb/OhioGIS/2013/Presentations/2013Thu_110… · Exploiting Real-Time Data with ArcGIS GeoEvent