Virtuelle Realität

1

Part 21:

Augmented Reality

Virtuelle RealitätWintersemester 2006/07

Prof. Bernhard Jung

Prof. B. Jung Virtuelle Realität, WS 2006/07

Overview

Introduction to Augmented RealityAugmented Reality DisplaysExamplesAR Toolkit – an open source software library for building AR applications

Further ReadingO. Bimber & R. Raskar. Spatial Augmented Reality: A Modern Approach to

Augmented Reality. B & T. 2005. see also: http://www.spatial-ar.com/courses.htm

http://www.augmented-reality.org/http://www.howstuffworks.com/augmented-reality.htm

Virtuelle Realität

2

Prof. B. Jung Virtuelle Realität, WS 2006/07

Mixed Reality

The Reality-Virtuality Continuum

P. Milgram, H.Takemura, A.Utsumi, F. Kishino:Augmented Reality: A class of Displays on the Reality-Virtuality ContinuumSPIE Vol. 2351, Telemanipulator and TelepresenceTechnologies, 1994.

Prof. B. Jung Virtuelle Realität, WS 2006/07

Augmented Reality (AR)

images projected over the real worldaircraft head-up displaysemi-transparent goggleshandhelds (PDA, smartphone)projecting onto a desktop…

types of informationunrelated – e.g. reading email with wearable

related – e.g. virtual objects interacting with world

issuesregistration – aligning virtual and realeye gaze direction Vampire Project

Visual Active Memory Processes and Interactive Retrieval (U Bielefeld)

Virtuelle Realität

3

Prof. B. Jung Virtuelle Realität, WS 2006/07

Applications of ARNavigation SystemsMaintenance

overlay instructionsdisplay schematic

MuseumsGaming…

howstuffworks.com

microvision.comhttp://www.research.ibm.com/journal/sj/384/spohrer.html

Prof. B. Jung Virtuelle Realität, WS 2006/07

Augmented Interaction

Goal: enhance the real world sensation with useful informationUsers see real and virtual objectsLocation-dependent additional information can be provided (display menu cards for restaurants)The real sensation can be partially disabled (replace all billboards with pictures from last holiday ...)Photo-realism not necessarily first goal but in the ultimate system, people cannot decide whether parts are virtual or real

http://www.csl.sony.co.jp/person/rekimoto/uist95/uist95.html

Virtuelle Realität

4

Prof. B. Jung Virtuelle Realität, WS 2006/07

Augmented Reality - What do we need for the combination of read and virtual worlds?

Locations and optical properties of the viewer (or camera) and the displayCalibration of all devicesCombination of all local coordinate systems centered on the devices and the objects in the scene in a global coordinate systemRegistration of models of all 3D object of interest with their counterparts in the sceneTracking of objects over time when the user moves and interacts with sceneRealistic merging requires:

Objects to behave in physically plausible manner when manipulatedOcclusionCollision detectionShadowsDetailed description of the physical scene Source: Cindy Robertson (Georgia Tech)

Prof. B. Jung Virtuelle Realität, WS 2006/07

AR Displays: Overview and Classification

Bimber & Raskar

Virtuelle Realität

5

Prof. B. Jung Virtuelle Realität, WS 2006/07

Retinal Displays

Bimber & Raskar

Prof. B. Jung Virtuelle Realität, WS 2006/07

Head Mounted Displays

Bimber & Raskar

Virtuelle Realität

6

Prof. B. Jung Virtuelle Realität, WS 2006/07

Handheld Displays Bimber & Raskar

Prof. B. Jung Virtuelle Realität, WS 2006/07

Screen-based Video See-Through Displays

Bimber & Raskar

Virtuelle Realität

7

Prof. B. Jung Virtuelle Realität, WS 2006/07

Spatial Optical See-Through DisplaysBimber & Raskar

www.laser-magic.comhttp://io2technology.com

Prof. B. Jung Virtuelle Realität, WS 2006/07

Projection-based Augmentation

Bimber & Raskar

Virtuelle Realität

8

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: DigitalDesk (Wellner, Xerox, 1992)

Extending the desktop metaphor to the real deskVirtual (displayed) and real documents share the same space

http://www.xrce.xerox.com/competencies/past-projects/ip/digitalDesk.html

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: Augmented Reality for New Gaming ExperiencesResearch Project: Virtual Reality and Hypermedia in Future Telecommunication Products and ServicesUniversity of Oulu, Finlandhttp://www.infotech.oulu.fi/Annual/2000/VIRGIN.html

Virtuelle Realität

9

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: Augmented Reality for New Gaming Experiences

Mozzies Game on Siemens SX1 mobile phone

The mosquitoes can be seen as they are placed on the live video feed from the camera. Aiming is done by moving the phone around so that the mosquitoes are at the cross hair. The Camera is used to detect the motion.

http://en.wikipedia.org/wiki/Siemens_SX1

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: AR Quakehttp://wearables.unisa.edu.au/projects/ARQuake/www/

Virtuelle Realität

10

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: Steve Mann – "Cyborg"

Steven Mann (MIT, now Toronto University)"Steve Mann is the world’s first real cyborg, a man who exists in harmony with technology." Canadian Film Institute, 2001 Started to develop ‚Cyborg‘ equipment in schoolSince the 1980s he is constantly wearing his ‚WearComp‘His main research is for privacy and social impacts He noticed two main trends:

The technology diminished (everything moved into sunglasses)His ‚Cyborg‘-feeling has been growing over the years

http://www.eyetap.org/

2007

http://www.imdb.com/title/tt0301145/

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: Reality Window Manager (EyeTap)

Window manager for XWindows that overlays xterms and other windows onto planar patched in the environmentAllows for real-time tracking, replacement and rendering

http://www.eyetap.org/, http://wearcam.org/

Virtuelle Realität

11

Prof. B. Jung Virtuelle Realität, WS 2006/07

Example: Third-person perspective in augmented reality (???)

Salamin, P., Thalmann, D., and Vexo, F. 2006.http://vrlab.epfl.ch/Publications/pdf/Salamin_Thalmann_Vexo_VRST_06.pdf

Prof. B. Jung Virtuelle Realität, WS 2006/07

ARToolKit – an open source software library for building AR applications

ARToolKit uses computer vision algorithms to solve the problem of tracking the users viewpoint calculates the camera position and orientation relative to physical markers in real timehttp://www.hitl.washington.edu/artoolkit/