37
Josh Joyner Gregory Christakos ArcGIS GeoEvent Server: Visualizing Real-Time Data

ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Josh Joyner

Gregory Christakos

ArcGIS GeoEvent Server:

Visualizing Real-Time Data

Page 2: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

analytics storage

visualization

ArcGIS GeoEvent ServerReal-Time GIS for ArcGIS Enterprise

ingestion

actuation

Apps

DesktopAPIs

Page 3: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Agenda:

Visualization Overview

Visualizing Stream Layers

Visualizing Features using the STBDS

Resources & Wrap-Up

1

2

3

4

Page 4: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

1 Visualization Overview

Page 5: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Stream Layers vs. Feature Layers

• Stream layers subscribe to stream services to immediately visualize observations

- Does not require feature record storage, but does not support playback

• Map & Feature layers periodically poll to obtain the most current observations

- Storage requires an enterprise geodatabase (EGDB) or spatiotemporal big data store (BDS)

- Stored feature records can be retrieved and queried for playback

Stream Layer

Map LayerFeature Layer

ArcGISEnterprise

Send Features to a Stream Service subscribe (push)

poll (pull)

GeoAnalyticsServer

Add a Feature to a BDS

Update a Feature in a BDS

spatiotemporalbig data store

Add or Update a Feature

EGDBGeoEvent

Server

Apps

Desktop

APIs

Stream Service

Map ServiceFeature Service

Page 6: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Stream Layers – Advantages

• More responsive and more efficient than feature layers

• Display data records immediately and refresh automatically

• Data is sent to the client only once

Stream Layer

PUSHWeb

Socket

ArcGIS Server

Feature service

GETHTTP

FeatureLayer

RESPONSE

ArcGIS Server

GeoEvent

Server

Stream service

Page 7: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualizing Stream Layers2

Page 8: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to a web map

• Navigate to ‘My Content’

and select the layer item

• Note that stream layers

have a different icon

than feature layers

• Select the content item

and open it in the web

map viewer

Page 9: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to a web map

Page 10: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to a web map

You can also:

• open the ArcGIS REST

Services Directory

• navigate to the stream

service’s web page

• copy the service’s URL

Page 11: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to a web map

https://caramon.esri.com/server/rest/services/AVL-Broadcast/StreamServerPaste the URL into the text

field as illustrated here:

Page 12: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to an ArcGIS Pro Map

• Add an Enterprise portal or ArcGIS

Online content item

• Add an item from a server connection

• Add data using a local path or URL

Page 13: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Adding a stream layer to an ArcGIS Pro Map

• Set Renderer

- Single Symbol

- Unique Values

- Graduated Symbols

- Graduated Colors

• Current / Previous Observations

• Feature Labeling

• Open Attribute Table

• Vary by attribute

- Transparency

- Rotation

- Size / Color

Page 14: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualizing

Stream Layers

Page 15: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

3 Visualizing Features

Page 16: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualization of observational data

• Visualize discrete feature records while inspecting feature-level attributes

Page 17: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualization of observational data

• Visualize on-the-fly aggregations while inspecting feature-level attributes

• Feature thresholds specify when layers switch from feature view to an aggregation

Page 18: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualization of observational data

• Visualize custom aggregations based on feature-level attribute statistics

Page 19: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualization of observational data

• Choose to display data using content-dependent or scale-dependent rendering

Page 20: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualization of observational data

• Replay historic observations for either discrete features or aggregations

Page 21: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• Aggregation styles support on-the-fly aggregation using

- geohash

- squares

- pointy / flat hexagons

- pointy / flat triangles

You can delete aggregation styles you do not want or intend to use

Page 22: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• A geohash is a way of encoding latitude and longitude values as strings

• It divides the world into a grid of 32 cells (four rows and eight columns)

• Each cell can be further divided into 32 cells to provide 12 levels of detail (LOD)

Page 23: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• The spatiotemporal big data store continuously updates

a geohash spatial index as data is written into a dataset

lodType=geohash&lod=9

geohash aggregation (based on a geohash index)

Page 24: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• The spatiotemporal big data store can continuously update

a square spatial index as data is written into a dataset

geohash aggregation (based on a geohash index) square aggregation (based on a square index)

Page 25: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• The spatiotemporal big data store can continuously update

spatial indices for pointy and flat triangles as data is written into a dataset

flat triangle aggregation (based on a flat triangle index)pointy triangle aggregation (based on a pointy triangle index)

Page 26: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• The spatiotemporal big data store can continuously update

spatial indices for pointy and flat hexagon as data is written into a dataset

flat hexagon aggregation (based on a flat triangle index)pointy hexagon aggregation (based on a pointy triangle index)

Page 27: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• Additional indexes created and maintained include:

- A temporal index on the time field

- An inverted index on each attribute field

Page 28: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• Map service aggregation supports point, polyline, and polygon feature geometry

Aggregations are computed using the centroid for non-point geometries

Page 29: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Spatiotemporal big data store

• Aggregation settings are specified when

creating a BDS feature record set

• They can be updated by clicking to edit a

published BDS map service

Page 30: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Visualizing

Features

Page 31: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

4 Resources & Wrap-Up

Page 32: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

ResourcesSelf-Paced Training and Resources

• ArcGIS GeoEvent Server resources

- http://enterprise.arcgis.com/en/geoevent

- Updated Documentation

- Installation Guides

- System Requirements

- Tutorials

• Blogs and discussions on the forum

- http://links.esri.com/geoevent-forum

• Video recordings of technical workshops

- http://www.esri.com/videos

Page 33: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

• StreamLayerAPI help:

– 4.x: https://developers.arcgis.com/javascript/latest/api-reference/esri-layers-StreamLayer.html

– 3.x: https://developers.arcgis.com/javascript/3/jsapi/streamlayer-amd.html

• Sample stream services with simulated data:

– https://geoeventsample1.esri.com:6443/arcgis/rest/services

• Sample applications on GitHub:

– https://github.com/Esri/aggregation-viewer-server-map-service

• Tutorials:

– http://links.esri.com/geoevent-tutorials

• Discussions & Blogs (on GeoNet):

– https://geonet.esri.com/community/gis/enterprise-gis/geoevent/content

Sample Applications & Tutorials

Helpful Links

Page 34: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Real-Time & Big Data Technical Workshops

• Tuesday

– 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction

– 3:00 - 4:00 ArcGIS GeoEvent Server: An Introduction

• Wednesday

– 11:00 - 12:00 ArcGIS Analytics for IoT: An Introduction 2nd offering

– 1:30 - 2:30 ArcGIS GeoEvent Server: An Introduction 2nd offering

– 2:45 - 3:45 Real-Time and Big Data GIS: Best Practices Only Offering

– 4:00 - 5:00 ArcGIS GeoEvent Server: Applying Real-Time Analytics Only Offering

– 5:15 - 6:15 ArcGIS GeoEvent Server: Visualizing Real-Time Data Only Offering

Page 35: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Print Your Certificate of Attendance

Print Stations Located in 150 Concourse Lobby

Tuesday12:30 pm – 6:30 pm

Expo

Hall B

5:15 pm – 6:30 pm

Expo Social

Hall B

Wednesday10:45 am – 5:15 pm

Expo

Hall B

6:30 pm – 9:30 pm

Networking Reception

Smithsonian National Museum

of Natural History

Page 36: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Download the Esri

Events app and find your event

Select the session

you attended

Scroll down to

“Survey”

Log in to access the

survey

Complete the survey

and select “Submit”

Please Share Your Feedback in the App

Page 37: ArcGIS GeoEvent Server - esri.com · Real-Time & Big Data Technical Workshops •Tuesday – 1:45 - 2:45 ArcGIS Analytics for IoT: An Introduction – 3:00 - 4:00 ArcGIS GeoEvent

Josh Joyner

ArcGIS GeoEvent ServerProduct Manager

[email protected]

Gregory Christakos

ArcGIS GeoEvent ServerProduct Engineer

[email protected]

Comments?

Questions?