MAR Reference Model

CD Document Structure, September 2014

Online version of the MAR RM available here: http://wg11.sc29.org/augmentedReality/

MAR Reference Model

1 SCOPE 2 DOCUMENT STRUCTURE 3 SYMBOLS AND ABBREVIATED TERMS 4 MAR DOMAIN AND CONCEPTS 5 MAR REFERENCE MODEL USAGE EXAMPLE 6 MAR TERMINOLOGY 7 MAR REFERENCE SYSTEM ARCHITECTURE 8 MAR CLASSIFICATION FRAMEWORK 9 MAR SYSTEM CLASSES 10 PERFORMANCE 11 SAFETY 12 SECURITY 13 PRIVACY 14 USE CASE EXAMPLES AND COVERAGE BY MAR REFERENCE MODEL 15 EXISTENT MAR RELATED SOLUTION/TECHNOLOGIES AND THEIR

COVERAGE OF MAR-RM ANNEX A (INFORMATIVE) PATENT STATEMENTS

MAR Reference Model

4 MAR DOMAIN AND CONCEPTS

!

The MAR concept as combining representations of physical objects and

computer mediated virtual ones in various modalities.

!

The Mixed Reality Continuum

MAR Reference Model

5 MAR REFERENCE MODEL USAGE EXAMPLE

Designing a MAR application or service

Deriving a MAR business model

Extend existing or create new standards for MAR

MAR Reference Model

6 MAR TERMINOLOGY

MAR Reference Model

7 MAR REFERENCE SYSTEM ARCHITECTURE

!

!

!

Enterprise, Computational and Informational Viewpoint

MAR Reference Model

8 MAR CLASSIFICATION FRAMEWORK Component Dimension Types Pure Sensors Modality Visual Auditory Electro-magnetic waves (e.g. GPS) Haptic/Tactile Temperature Other physical properties

Source type Live Pre-captured

Real World capturer Modality Visual Auditory Haptics properties Other

Form of Visual Modality Stil image 2D Video 3D Video (video + depth) 3D mesh Other Source type Live Pre-captured

Recognizer Form of Target Signal Image patch 3D primitives 3D Model Location (e.g. earth- reference coordinates) Audio patch Other Form of the Output Event Recognized or not Additional data: Type, Timestamp, Recognition confidence level, other attributes Execution place Local Remote

Tracker Form of Target Signal Image patch 3D primitives 3D Model Earth- reference coordinates Audio patch Other Form of the Output Event Spatial (2D, 3D, 6D, …) Aural (Intensity, Pitch, …) Haptic (Force, Direction, …) Execution place Local Remote

Space Mapper Space type Spatial Audio Haptics Others Event Mapper Modality Visual Temporal Aural Location Others Simulator Space & time 2D + t 3D + t

User Interactivity Yes No Execution place Local Remote Hybrid Number of simultaneous users Single-user Multi-user

Renderer Modality Visual Aural Haptics Other Execution place Local Remote Hybrid

Visual Display Presentation Optical see through Video see through Projection Mobility Fixed Mobile Controlled No of channels 2D (mono) 3D stereoscopic 3D holographic

Aural Display No of channels Mono Spatial Acoustic space coverage Headphones Speaker

Haptics Display Type Vibration Pressure Temperature UI Interaction type Touch Click Drag Gesture Other

MAR Reference Model

9 MAR SYSTEM CLASSES

MAR Class V augmenting the 2D visual data captured by real or virtual camera MAR Class R augmenting the 2D visual data continuously captured by one or several

real cameras and reconstructing the 3D environment (note: SLAM, PTAM)

MAR Class A augmenting the aural modality MAR Class H augmenting the haptics modality MAR Class G using global position system to register synthetic objects in the real world

MAR Class 3DV augmenting the 3D visual data captured by multiple cameras or video

plus depth cameras MAR Class 3DA augmenting the scene by using 3D audio data

MAR Reference Model

14 USE CASE EXAMPLES AND COVERAGE BY MAR REFERENCE MODEL

!

!

!

MAR Reference Model

15 EXISTENT MAR RELATED SOLUTION/TECHNOLOGIES AND THEIR COVERAGE OF MAR-RM

!

KML/ARML/KARML

X3D

Junaio

ARToolKit/OSGART

Vuforia Layar

OpenCV / OpenVX

ARAF