3D MAPPING FORUMIntroduction to Modeling and Simulation in Real-Time 3D ArcGISMorakot Pilouk, Ph.D.Senior Software Developer/Consultant

Source: http://en.memory-alpha.wikia.com/wiki/Holodeck

Source: http://therundownlive.com/scientists-create-real-life-wireless-holodeck/

Outline

• Modeling and Simulation- Modeling- Simulation

• ArcGIS Supporting Technologies- Real-Time GIS- ArcGIS 3D

Modeling and Simulation

• A discipline based on - Computer Science, Systems Engineering, Software Engineering, Artificial Intelligence, and more”

• Means different things to different people• In this context:

- Aspects relating to space and time

Modeling and Simulation Life Cycle

Real World Context Conceptual Model

Computer ModelResult

Validate Implement

Simulation

ModelingSimplify

Refinement

Execute

Modeling

Modeling

• The purposeful abstraction of reality - resides on the abstraction level

• The formal specification of - a conceptualization- assumptions- constraints

What is a Model?

• Relating to 3D- Oxford:

- A three-dimensional representation of a person or thing or of a proposed structure, typically on a smaller scale than the original

- Webster:- A miniature representation of something

• Relating to Behavior or Process- Oxford:

- A simplified description, especially a mathematical one, of a system or process, to assist calculations and predictions

- Webster:- A system of postulates, data, and inferences presented as a mathematical description of an

entity or state of affairs

A Model

• A representation of some key aspects of the subject• Captures the essential aspects of the subject• May not represent other aspects well• May have some simplifications or generalizations

Model Examples

• Schematics diagram of a physical network

- Simplified/generalized- Misrepresents some aspects, e.g.

distances, locations- Captures the connectivity

Model Examples

• Mathematical models

See: http://www.math.rug.nl/models/

Model Examples

• Physical models

See: http://www.3dsystems.com/3d-printers/personal/cubex

A 3D printer

Model Examples

• Terrain Model

Model Examples

Solid Terrain Modeling (www.stm-usa.com)

Sand Table by Simtable(www.simtable.com)

Model Examples

• Touch table

3D Topographic Map Table by Applied Minds and Northrop Grumman

Model Examples

• Vehicles• Human figures• Plants

https://3dwarehouse.sketchup.com

Acquiring Digital Models

• Digitizing/Scanning- LiDar- Sonar- Manual

• Digital Sculpting• Automatically generated

- Stereo fusion- Procedural

www.uav-lidar.com

Motion Capture: http://www.capturelab.com/

Model Behaviors

• Controlled by human - using input from hardware

• Controlled by software – a model may be controlled by other models- Artificial Intelligence- Mathematical model (e.g. Physics model)

Simulation

Simulation

• An execution of a model over time• Resides on the implementation level

Why using Simulations

• Are cheaper and safer than- Actual exercises- Physical prototypes

• Are more realistic than traditional experiments• Can be conducted faster or slower than real time• Allow setting up a coherent synthetic environment

Simulation Advantages

• Players can practice in a safe, protected environment• Players can interact among one another• Players may be:

- Human, computer controlled or mixed

• Observers can observe without distracting the players• Supervisors can assist, guide, assess• Scene/scenarios can be selected or adjusted

- Supports what-if

• Repeatable• Comparable

- E.g. compared with previous runs

Elements of Simulation

• Process- weather, traffic, lighting, wind

• Procedure- steps of operation

• Subject- things to practice on

Source: Meller G. A typology of simulators for medical education. J Digital Imaging, 1997 Aug: 10

Type of Simulators

• Passive- Provides element of realism – scene decorators, base-map

• Active- Elements change over time- Changes driven by:

- Sequence of snapshots- Calculations- Combination of the above (e.g. tweening, dead-reckoning, interpolation)

• Interactive- Elements change in response to player, e.g. agent-based, AI

Fidelity of Simulation

• Low fidelity- Simple simulation- Individual player- Involves only a few elements- Focus on specific subject

• High fidelity- Complex simulation- Involves many elements, passive, active, and interactive- Involves many subject matter experts- Involves many players

Adapted from: http://www.faculty.londondeanery.ac.uk/

Collecting Data for Simulation Project

• Too many data points will overload the system- Poor performance- Require hardware sizing adequately

- NVIDIA Quadro K6000 with 2800+ cores, $4,500+- Storage capacity- Data communication bandwidth

• Sparse data points- Reduce fidelity of the representation and simulation- Not enough realism

System Components

Inputs

• Keyboard• Mouse• Touch screen• Joystick• Steering wheel• Weapon interface• Eye/head tracking• Motion/Gesture

- Kinect- Leap Motion- Myo Armband

• Microphone

Inputs – IoT Sensors

• Air quality – airqualityegg.com• Atmospheric Pressure – pressurenet.io• CO2

• Temperature• Humidity• Light• Sound• …

Outputs

• 3D Visualization- Head-mounted Display- Monitors- Projectors- Hologram

• 3D Sounds- Speakers, headphones

• Haptic• Scent• Air flow

http://tradeshowhologram.com/

Integrated Inputs and Outputs

Environment/Platform

• Touch table• Sand table• CAVE

- Northrop Grumman VIPE

• Holodeck

Source: https://www.evl.uic.edu/core.php?mod=4&type=1&indi=424

Source: http://therundownlive.com/scientists-create-real-life-wireless-holodeck/

Software Components• Modeling

- Scene/Environment authoring- 3D base-maps- Behavior control – simulation engine

- Repast/ArcGIS Agent Analyst- NetLogo/AgenScript- Swarm- Agent-based Modeling (ABM)

- Data logger/recorder

• Real-time analytics- Geofencing- Trigger- Alert- …

GeoEvent Extension

ArcGIS Server

YourApplications

Stream Layer

Map ServicesFeature Services

Feature Layer

feature layers

Update a FeatureAdd a Feature

EGDB

Polling(Pull)

Stream Services

Send Features to a Stream Service

Data Communication

• Communication protocols- Distributed Interactive Simulation (DIS) – IEEE 1278- High Level Architecture (HLA) – IEEE 1516- Test and Training Enabling Architecture (TENA)- …

• Real-time data streaming- Positions- Orientations- States

• Messaging• Time synchronization

Simulation Authoring

• Unit/Track creation- Unit catalog- Map/Scene- Drag and drop unit onto map- Track authoring- Unit type- Terrain factor, e.g. elevation, slope, type of ground cover

• Track playback tool• Tracks orchestration

- Timeline placement- Time synchronization

• Simulation recording tool

Questions and Answers

Selected 3D Sessions

• 3D Analysis: An Overview - Tue 7/21/2015 08:30 AM - 09:45 AM Room 10- Thu 7/23/2015 08:30 AM - 09:45 AM Ballroom 06 E

• 3D Cartographic Techniques: An Introduction - Tue 7/21/2015 08:30 AM - 09:45 AM Room 31 B - Thu 7/23/2015 03:15 PM - 04:30 PM Room 17 A

• Creating 3D Campuses - Tue 7/21/2015 03:15 PM - 04:30 PM Room 14 A

• 3D Analyst: An Introduction - Wed 7/22/2015 08:30 AM - 09:45 AM Room 02

• ArcGIS API for JavaScript: Building 3D Web Apps - Wed 7/22/2015 08:30 AM - 09:45 AM Room 10

Selected 3D Sessions

• Working with 3D Analyst and CityEngine- Wed 7/22/2015 08:30 AM - 09:45 AM Room 14 A

• ArcGIS for 3D Cities: An Introduction - Wed 7/22/2015 01:30 PM - 02:45 PM Room 15 A- Thu 7/23/2015 01:30 PM - 02:45 PM Room 05 B

• Advanced workflows for creating 3D Web Scenes in ArcGIS Online - Wed 7/22/2015 03:15 PM - 04:30 PM Room 14 B

• Sharing 3D Content on the Web - Wed 7/22/2015 03:15 PM - 04:30 PM Room 15 A

Real-Time GIS Sessions• Real-Time GIS: GeoEvent Extension

- Tue 10:15-11:30am, Room 17 A- Wed 10:15-11:30am, Room 14 B

• Real-Time GIS: Leveraging Stream Services- Tue 8:30-9:45am, Room 01 A/B- Wed 8:30-9:45am, Ballroom 06 D

• Real-Time GIS: Applying Real-Time Analytics- Tue 10:15-11:30am, Room 15 B- Wed 8:30-9:45am, Room 14 B

• Real-Time GIS Use Cases and Implementation Patterns- Tue 2:30-3:15PM, Demo Theater 6 - Geodata

• ArcGIS Intelligence: Discern Activities of Interest through Advanced Analytics- Wed 10:15-11:30am, Omni Ballroom A/B

• Real-Time GIS: The Road Ahead- Wed 1:30-2:45pm, Room 14 B

• Real-Time GIS: Best Practices- Thu 8:30-9:45am, Room 14 B

• Real-Time GIS for Asset Readiness, Event Preparation, and Intervention- Thu 8:30-9:45am, Room 29 C