Virtual Reality Analytics

Virtual Reality AnalyticsKeynote

by Joerg OsarekIT-avant-gardist, Business-IT-Architect

Skilltower Institute

Business Intelligence Streamat the DOAG Conference 2015

November 17th 2015, v1.LNuremberg, Germany

Virtual Reality AnalyticsKeynote

by Joerg OsarekIT-avant-gardist, Business-IT-Architect


Business Intelligence Streamat the DOAG Conference 2015

November 17th 2015, v1.LNuremberg, Germany

2Joerg Osarek © Skilltower Institute, Nov. 2015

Virtual Reality: The power of Immersion

VR / MR puts tough guys under a spell unlike any other mediumranging from

delight to pure horror

Try it yourself after the keynoteor visit our VR Meetup in Frankfurt.


What is happening at VR / MR? - VR is not just headsets!

Display Technology

2015: Samsung Gear, Oculus DK2, 2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++

2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer VersionPlaystation VR (Morpheus)Playstation VR (Morpheus)HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking)Microsoft Hololens for DevelopersMicrosoft Hololens for Developers



Display Technology



FulldomesFulldomes

Leia HolodisplayLeia Holodisplay

Magic LeapMagic Leap



Display Technology Recording



FulldomesFulldomes



Google Jump Google Jump + Youtube VR+ Youtube VR

JauntVR NeoJauntVR NeoLightfield CamLightfield Cam

Lytro ImmergeLytro Immerge



Display Technology Recording

Interacting 2015: Samsung Gear, Oculus DK2, 2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++


FulldomesFulldomes



Google Jump Google Jump + Youtube VR+ Youtube VR

JauntVR NeoJauntVR NeoLightfield CamLightfield Cam

LeapMotionLeapMotion

Fairy LightsFairy LightsTouchableTouchableHologramHologram

VR SculptingVR Sculpting

Google SoliGoogle SoliRadar ChipRadar Chip

Disney DISHDisney DISH

ILM X-LabsILM X-Labs

Lytro ImmergeLytro Immerge


What is happening next?

Voice Mood Analysis (e.g. cogito App)

Brain Wave interfaces (e.g. NeuroSky Neuro Headset)

Nerve Induction? (e.g. direct projection into retina or nerves)

Mark Zuckerberg: „we'll be able to send emotions to each other soon“*

* Article at theverge.com from Rich McCormick on June 30, 2015.* http://www.theverge.com/2015/6/30/8873819/mark-zuckerberg-facebook-sending-emotions-soon



Quelle: Woman and pan: combined of two public domain images from www.pixabay.com

Mark Zuckerberg: „we'll be able to send emotions to each other soon“… could look like this:



Quelle: Woman and pan: combined of two public domain images from www.pixabay.com , Quelle: Angry driver: Vladimir Mucibabic/123rf.com #4554701_l

Mark Zuckerberg: „we'll be able to send emotions to each other soon“… could look like this:

LIKE ?


VR Analytics comes in two flavours

a) Visualization of analytics data in VR


VR Analytics comes in two flavours

a) Visualization of analytics data in VR

We don't cover this today.

b) Analyze VR experiences in your DWH


Let's Play


Level 1: Your Mission

BUILD ME THE PERFECTVR ANALYTICS PLATFORM.

MUHAHAHA...


Level 2: Make or buy? - Status VR Analytics vendorsLevel 2: Make or buy? - Status VR Analytics vendors

Election.tvElection.tv Engages Kosher Virtual Reality Analytics For Exclusive 2016 US Engages Kosher Virtual Reality Analytics For Exclusive 2016 US Election Tech Polling Partnership (Election Tech Polling Partnership (Kosher.tvKosher.tv, a media ventures company), a media ventures company)

retinadVR.comretinadVR.com (Unity Plugin) → joined (Unity Plugin) → joined rothenbergventures.comrothenbergventures.com (investing in frontier tech startups)(investing in frontier tech startups)

Some BI / DWH experts start to broaden their portfolio Some BI / DWH experts start to broaden their portfolio (like (like its-peopleits-people and and skilltower instituteskilltower institute))

It is quite early for the large BI / DWH software vendors but we should watch It is quite early for the large BI / DWH software vendors but we should watch trendsetterstrendsetters like: like: IBM, SAP, Qlik, Oracle, SAS, Information Builders, IBM, SAP, Qlik, Oracle, SAS, Information Builders, MicrostrategyMicrostrategy and and challengerschallengers like: like: Microsoft, Tableau, Tibco, Infor, Microsoft, Tableau, Tibco, Infor, BoardBoard and some more. and some more.

http://Election.tv/

http://www.kosher.tv/

http://retinadVR.com/

http://rothenbergventures.com/

http://www.its-people.de/

http://www.skilltower.com/


Level 3: Approaches for displaying VR in headsets

Hybrid Rendering

Nozon.com Presenz

some light field tech

Live 3D in Game engine

(Unity3D, CryengineUnreal Engine 4, ...).

Pre-rendered

YouTube VR or 360°

VR Player apps, ...


measurement data, e.g.:measurement data, e.g.:Position 5,3,1Position 5,3,1Rotation 23°left, 18°upRotation 23°left, 18°upSpeed of movementSpeed of movement(eye position, parallax)(eye position, parallax)......

Mapping:Mapping:Position in VRPosition in VRObjects watchedObjects watchedInteractionsInteractions……

Merging with otherMerging with other

Data WarehouseData WarehouseContentContent

Enriched AnalysisEnriched Analysis

determinedeterminemeaningmeaning

MeasureMeasureAnalyzeAnalyze

← ← (Interactive live return path) ←(Interactive live return path) ←

Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics? Meta Layer for VR Analytics?


depends on the particular VR/MR experience. depends on the particular VR/MR experience.

meaning must be mapped manually or... meaning must be mapped manually or...

(soon) can be mapped automatically by autonomous analysis algorithms (soon) can be mapped automatically by autonomous analysis algorithms (Google/Facebook recognize objects, text and speech in images, videos, (Google/Facebook recognize objects, text and speech in images, videos, audio) e.g. Google Translate Augmented Reality or Youtube Transcriptionaudio) e.g. Google Translate Augmented Reality or Youtube Transcription

Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics? Meta Layer for VR Analytics?


Level 5: add more data sources like heart rate, voice, ...

SmartWatch:SmartWatch:heart rateheart rate

voice and moodvoice and moodanalysisanalysis

facial expressionfacial expressionrecognitionrecognition

NLP* eye NLP* eye movementsmovements

*NLP = Neuro Linguistic Programming:*NLP = Neuro Linguistic Programming: an approach to communication, personal development, and psychotherapy an approach to communication, personal development, and psychotherapy

created by Richard Bandler and John Grinder in California, United States in the 1970s.created by Richard Bandler and John Grinder in California, United States in the 1970s.


Level 5: facial expression analysis

Science Fiction? Only for Headsets?

predicted in 2012 at DOAG for 2017, predicted in 2012 at DOAG for 2017, already reality todayalready reality today




www.affectiva.comwww.affectiva.com

The video, that watches you.The video, that watches you.analysis of facial expressions and your moodanalysis of facial expressions and your moodwith a simple webcam → Emotion Database with APIwith a simple webcam → Emotion Database with API

http://www.affectiva.com/




Yesterday:Yesterday:What did the user do while interacting?What did the user do while interacting?

Today:Today:What is the user doing while interacting?What is the user doing while interacting?

Tomorrow:Tomorrow:What is the user going to do What is the user going to do while interacting?while interacting?


Mission accomplishedMission accomplished

measurement data → semantic layer

combination withadditional data(heart rate, facial expressions,eye movement)

combination withclassic data warehousedata streams

enables (NLP)conclusionsclose to thought reading andprediction of behaviour

YES. YES.MUHAHAHA...


Level Up: Entering the USEMIR era

Q-GRINS technologies introduce artificial intelligence (strong AI) and hyper intelligence into our world. Corporations, organizations, countries, AIs and HIs will be able to read our thoughts.

Eventually we are confronted with U.SE.MIRU.SE.MIR –

UUbiquitiousbiquitious SESEnsiblensible MIMIxedxedRRealityeality

QuantumQuantumTechTech

GeneticsGenetics RoboticsRobotics ITIT Nano-TechNano-Tech Space-TechSpace-Tech


I have an idea.

Let's provide themwith technology

to read our thougts.

Quelle: Wikimedia.org – Erstellt 1590 – Public Domain

Who ought to know what about us? - a comparable encounterWho ought to know what about us? - a comparable encounter

Joerg Osarek © Skilltower Institute, Nov. 2015 25

With great power comes great responsibility (Stan Lee)With great power comes great responsibility (Stan Lee)

John F.Kennedy mastered this burden facing the cuba crisis and saved John F.Kennedy mastered this burden facing the cuba crisis and saved us from a nuclear desaster.us from a nuclear desaster.

What is our burden / fear at the eve of VR analytics, of machines What is our burden / fear at the eve of VR analytics, of machines capable of reading thoughts and of the technological singularity?capable of reading thoughts and of the technological singularity?


What choices do we have?

back to the caves?back to the caves?

prepare to be terminated?prepare to be terminated?


What choices do we have?

Wrong question!Wrong question!Why do we fear a Terminator-Scenario?Why do we fear a Terminator-Scenario?

Is there a third choice?Is there a third choice?

Why don't we consider ourselves as self-confident honourable partners?Why don't we consider ourselves as self-confident honourable partners?

Do we want to work on ourselves and stop being the trickster?Do we want to work on ourselves and stop being the trickster?


The third choice:We can qualify for the 22nd century by cultivating chivalry and wisdom.

Q22=C+W

humbleness, honour, kindness, confidence,

politeness, courage and bravery, clemency, moderate behaviour ,

continuity, loyalty, dignity, discipline and decency


The third choice:We can qualify for the 22nd century by cultivating chivalry and wisdom.

Q22=C+W

self confidence by acting honourable

working togetheras civilizationto boost our development

EARNING BONUS POINTS:EARNING BONUS POINTS:

appearing as self confident

and honourable examples and

partners


LEVEL UP!LEVEL UP! INSERT COINSINSERT COINSTO CONTINUETO CONTINUE

The rest is up to you now.

Make your choice and shape our future.


Contact and further information on VR Analytics

Dossier Virtual Reality Analyticspublication date: 2016


Joerg OsarekFounder and CEO

Triftstr. 30D-61350 Bad HomburgGermany

mailto:[email protected].: +49(0)151-23 0 24 333

www.skilltower.com

mailto:[email protected]

http://www.skilltower.com/


background information: Joerg Osarek

ManagementManagement

IT-avant-gardeIT-avant-garde

Virtualization (VMware)Virtualization (VMware)

Oracle, LinuxOracle, Linux

Virtual Reality AnalyticsVirtual Reality Analytics

Cinematic VRCinematic VR


Reports from the future – my passion ever since

1989: Hewlett Packard

Computer viruses – digital threator scare tactics?



1998: DOAG: VRML – The futureof the internet

Many thanks toWolfgang Taschner for

his archived copy



always some Years Ahead of Mainstream (YAM)

1989: HP: Computer viruses: 10 YAM

1998: DOAG: VRML – The future of the internet 9 YAM (2ndLife 2007)

2007: DOAG: How does SOA influence Business Intelligence?: 3 YAM

2010: DOAG: Cloud Computing and the Technology Monster: 2 YAM

2011: DOAG: The Organic Computing age 9 YAM?

2012: DOAG: SoMoLo (Social, Mobile, Local) / Big Data 3 YAM

2015: DOAG: Virtual Reality Analytics 3-5 YAM?

Data & Analytics

Virtual Reality Analytics