36
ArcGIS GeoEvent Server: Real-Time GIS Anthony Myers Local Government Solutions Engineer Kevin Armstrong Public Safety Solutions Engineer

ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

  • Upload
    others

  • View
    14

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

ArcGIS GeoEvent Server:

Real-Time GIS

Anthony Myers

Local Government Solutions Engineer

Kevin Armstrong

Public Safety Solutions Engineer

Page 2: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

E M E R A L D

S A P P H I R E

T H A N K Y O U T O

OUR SPONSORS

Page 3: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Agenda

What is Real-Time GIS?

Working with Real-Time Data

Applying Real-Time Analytics

Integrating Real-Time Data in Web Apps

Wrap-up

1

2

3

4

5

Page 4: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

ArcGIS Enterprise

GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise …

GeoEvent Server – Real-time and big-data capabilities

• Ingest high velocity real-time

data into ArcGIS

• Perform continuous analytics

on events as they are received

• Store observations in a

spatiotemporal big data store

• Run batch analytics on

stored observations

• Visualize high velocity &

volume data:

- as an aggregation

- as discrete features

• Notify those who need to

know about patterns of

interest

DesktopWeb Device

visualization

live & historic

aggregates & features

map & feature servicestream service

live features

ArcGIS

Enterprise

GeoEvent

Server

spatiotemporal

big data store

storage

ingestion

analytics

GeoAnalytics

Server

analytics

Page 5: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

What is Real-Time GIS1

Page 6: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

GIS Data

The ‘current’ snapshot is outdated almost as soon as it’s created …

What has happened, what is happening, what will happen

Credit: iStockphoto/chris_lemmens

Page 7: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Real-Time GIS Data

Each event represents the latest state of the sensor…

Continuous stream of events flowing from a data feed

Features

ApplicationsNetwork Sensor

Warehouse Item

110°

Storm

Wind

Temperature

Earthquake

Wild Fire

Police Person

Ambulance

Police Car

Page 8: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Real-Time Analytics

What fishing vessels are inside designated ‘no fishing’ zones?

FeaturesContinuous

Analysis

Inside

Boundary

Vessel

Alert

Applications

Continuous processing on event data as it is received …

Page 9: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Real-Time Notifications and Alerting

Alerting stakeholders on discovered

patterns of interest in real-time …

Tell a parent when their child leaves school property

Continuous

AnalysisFeatures

Outside

Boundary

Child

Applications

Page 10: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Working with Real-Time Data2

Page 11: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Ingesting real-time data into ArcGIS

Input connectors

You can create

your own

connectors.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent Services

Poll an ArcGIS Server for Features

Poll an external website for GeoJSON, JSON, or XML

Receive Features, GeoJSON, JSON, or XML on a REST endpoint

Receive RSS

Receive GeoJSON or JSON on a WebSocket

Receive Text from a TCP or UDP Socket

Subscribe to an external WebSocket for GeoJSON or JSON

Watch a Folder for new CSV, GeoJSON, or JSON Files

Ou

t o

f th

e B

ox

REST

.csv

WS

WS

HTTP

Esri

Gallery

ActiveMQ

CAP

Instagram

Exploitation Support Data

Cursor-on-Target

RabbitMQ

NMEA 0183

MQTT

Sierra Wireless (RAP)

KML

Kafka *

Trimble (TAIP)

Twitter

Part

ner

Gallery

CompassLDE

enviroCar

GNIP

FAA (ASDI)

exactEarth AIS

Waze

Valarm

Networkfleet

OSIsoft *

*

*

*

Zonar *

Amazon IoT

Azure IoT

Page 12: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Storing real-time data in ArcGIS and alerting

Output connectors

You can create

your own

connectors.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent Services

Ou

t o

f th

e B

ox

Add or Update a feature

Publish Text to a UDP Socket

Send a Text Message

Send an Email

Push Text to an external TCP Socket

Push GeoJSON or JSON to an external WebSocket

Push GeoJSON or JSON to an external Website

Send an Instant Message

Send Features to a Stream Service

Write to a CSV, GeoJSON, or JSON File .csv

WS

im

HTTP

Add a Feature to a Spatiotemporal Big Data Store

Update a feature in a Spatiotemporal Big Data Store

ActiveMQ

Esri

Gallery

Cursor-on-Target

Hadoop

Kafka

MongoDB

MQTT

RabbitMQ

Twitter

Amazon IoT

Azure IoT

Page 13: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

GeoEvent Services

• A GeoEvent Service defines the flow of event records

- The input(s) ingesting event data

- The filtering and processing performed on each event record

- The output(s) to which event records are sent

Page 14: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Working with Real-Time Data

Update features in real-time to produce

a common operational display …

Making features come alive

• Connect an output to your feature/stream service

• Import the schema of your feature as a GeoEvent Definition

• Configure an input to receive real-time data

• Author and publish a GeoEvent Service

• Visualize your real-time features

GeoEvent Extension

Ou

tpu

ts

Inp

uts

GeoEvent Services

ArcGIS Server

feature services

GeoEvent Definitions

Operations Dashboard

for ArcGIS

stream services

operation views

web maps

ArcGIS Online /

Portal for ArcGIS

Page 15: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Tracking Live Traffic Incidents from Waze

Making Features

Come Alive

Page 16: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Tracking Live Traffic Incidents from Waze

Archiving FeaturesWaze-BDS

Page 17: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Applying Real-Time Analytics3

Page 18: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Filters

Event records are allowed to pass when a filter’s expression evaluates TRUE …

• A Filter eliminates GeoEvents based on an expression

=

=

=

=

Page 19: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Using filters and filter expressions

Filtering

Page 20: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Processors

Processors generally alter event records they receive …

You can create

your own

processors.

GeoEvent Extension

Inp

uts

Ou

tpu

ts

GeoEvent Services

Buffer Creator

Convex Hull Creator

Difference Creator

Envelope Creator

Field Calculator

Field Enricher

Field Mapper

Geotagger

Incident Detector

Intersector

Projector

Simplifier

Symmetric Difference

Track Gap Detector

Field Reducer Union Creator

Ou

t o

f th

e B

ox

Add XYZ

Esri

Gallery

Bearing

Ellipse

Event Volume Control

Extent Enricher

Field Grouper

GeoNames Lookup

Range Fan

Reverse Geocoder

Service Area Creator

Symbol Lookup

Track Idle Detector

Unit Converter

Visibility

Motion Calculator Query Report

• Use a Processor to calculate new values, enrich events, project geometry, …

Page 21: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Detecting Events of Interest

Processing

Page 22: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Spatial Operators

In GeoEvent Server, any geometry can serve as a geofence …

Used by both filters and processors to determine spatial relationship

inside outside

enter exit

intersects disjoint

touches contains

crosses equals

overlaps within

Page 23: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Spatial Operators - Example

Incoming weather hazard intersects a geofence modeled as a point geometry

Page 24: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Spatial Operators: Scope

• Intersects All geofences• Intersects Any geofence

Page 25: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Spatial Operators - Example

Vehicles enter or leave assigned area

Page 26: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Spatial Aggregation – Hex Bin

Data is visualized in high volume

Page 27: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Integrating Real-Time Data in Web Apps4

Page 28: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Visualizationchoosing a service type: stream service, feature service, map service

Stream Layer

Map Layer

Feature Layer

• Stream layers in apps subscribe to stream services to immediately visualize observations

- Does not require storage, low latency, no playback

• Map & Features layers in apps periodically poll to visualize most current observations

- Backed by an enterprise geodatabase (EGDB) or a spatiotemporal big data store (BDS)

- History can be retrieved & queried for playback

desktop

device

web

ArcGIS

Enterprise

Stream Service

Send Features to a Stream Service subscribe (push)

polling (pull)

Map Service

Feature Service

GeoAnalytics

Server

Add a Feature to a BDS

Update a Feature in a BDS

spatiotemporal

big data store

Add or Update a Feature

EGDBGeoEvent

Server

Page 29: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Real-Time Data

Demonstration

Page 30: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Wrap-up5

Page 31: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Summary

GeoEvent Server is Real-Time GIS for your ArcGIS Enterprise

Real-Time GIS: GeoEvent Server

• ArcGIS Enterprise is a full-featured mapping and analytics platform

• GeoEvent Server brings real-time capabilities to the ArcGIS Enterprise

• Licensing roles allow ArcGIS Server, a component of the enterprise,

to be licensed in different ways

http://server.arcgis.com/en/server/latest/get-started/windows

- GIS Server …/what-is-arcgis-gis-server-.htm

- Image Server …/what-is-arcgis-image-server-.htm

- GeoEvent Server …/what-is-arcgis-geoevent-server.htm

- GeoAnalytics Server …/what-is-arcgis-geoanalytics-server-.htm

- Business Analyst Server …/what-is-arcgis-business-analyst-server-.htm

Page 32: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Summary

Know what is happening, as it happens, so you can make smart decisions faster …

Real-Time GIS: GeoEvent Server

• GeoEvent Server:

- Simplifies real-time data ingest with configurable out-of-the-box inbound connectors

- Enables continuous analytics to be executed on event data as it arrives

- Extends options for data storage with an enterprise spatiotemporal no-sql data store

- Works with GeoAnalytics Server to make batch analytics on high volume data possible

- Provides solutions for high volume data visualization with on-the-fly aggregation

- Supports stakeholder notification of patterns of interest as they are discovered in real-time

Page 33: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Summary

Self-paced training and introductions to GeoEvent Server

Real-Time GIS: GeoEvent Server

• Step-by-Step Tutorials, free to download

- Introduction

- Stream services

- Spatiotemporal Big Data Store

- Notifications

• Blogs and discussions on the forum

- http://links.esri.com/geoevent-forum

Page 34: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Please take our Survey

Download the Esri Events App for iOS or Android

Page 35: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent

Questions / Feedback?

Please visit us at the booth

Kevin Armstrong

Public Safety Solutions Engineer

[email protected]

Anthony Myers

Local Government Solutions Engineer

[email protected]

Page 36: ArcGIS GeoEvent Server: Real-Time GIS · 2017-05-12 · ArcGIS Enterprise GeoEvent Server is a “server role” extending the capabilities of your ArcGIS Enterprise … GeoEvent