32
Pseudo-Haptics and Interaction Techniques to Improve Integration of Haptics in VE A. Lécuyer, INRIA [email protected] www.irisa.fr/bunraku/GENS/alecuyer/ IEEE VR 2008 Tutorial : « Integration of Haptics in VE », March 9th, Reno, US

Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

Pseudo-Haptics and Interaction Techniques to Improve

Integration of Haptics in VE

A. Lécuyer, [email protected]

www.irisa.fr/bunraku/GENS/alecuyer/

IEEE VR 2008 Tutorial : « Integration of Haptics in VE », March 9th, Reno, US

Page 2: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Outline

IntroductionPseudo-haptic texturing

Pseudo-haptic techniqueApplications

Haptic interaction techniques for VETechnique for under-actuated devicesTechnique for small workspaces

Conclusion

Page 3: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Introduction

Importance of perception in the design of virtual reality set-upExample : Not collocated vs. Collocated?

vs.

Page 4: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Influence of spatial collocation

Psychophysical experimentMeasure the weight of both the visual and haptic informationResults : when vision and touch are not collocated the weight ofhaptics decreases (=vision dominates much more)

Strong impact on VR Set-ups

(Congedo, Lécuyer and Gentaz, Presence, 2006)

Page 5: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Influence of C/D ratio

Control/Display ratio = “Visual gain” of the mouseInfluence on perception of mass of virtual objects? Psychophysical experiment :

>> visual motion amplification makes haptic objects feel lighter

Impact in haptic simulations

video

(Dominjon et al., IEEE VR, 2005)

Page 6: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

Pseudo-haptic textures

Page 7: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Objective

Simulate tactile sensations related to textures Give the feeling of touching images

No use of haptic device

Page 8: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Pseudo-haptic textures

Modify the motion (speed) of the cursor Change the Control/Display gain as function of the heightSimulation of a bump:

Unchanged motion of the cursor

Decelerated motion

Bump (as displayed on the screen, i.e. in top-view)

Unchanged motion of the cursor

Accelerated motion

(Lécuyer et al., ACM CHI, 2004)

Page 9: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Bumps and holes (video)

Page 10: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

« Tactile images »

Generic algorithm Web demos : www.inria.fr/tactiles

Video

Video

Page 11: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Pseudo-haptic textures 2 : the “size technique”

Second pseudo-haptic technique : the “size technique”Concept : change the size of the cursor (zoom-in and out)Simulation of a Hole :

Hole displayed on the screen

(i.e. in top -view)

Disk-shape cursor

Video Bump

Page 12: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Experimental evaluation

Five experiments (see paper) Combination of both techniques

Conflict situation : Bump (Speed technique) and Hole (Size technique) at the same time

Main results 1. Size technique slightly dominated speed technique2. The consistent combination of

both size and speed technique performs better

Videoconflict

Green cursor

White mask

(Lécuyer et al., ACM TAP, in press)

Page 13: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Pseudo-haptic feedbackSimulation of haptic properties using visuo-haptic combination : friction, stiffness, weight, texturesTransfer into several applications: training, medical, entertainment, etc

www.irisa.fr/bunraku/GENS/alecuyerwww.irisa.fr/bunraku/GENS/alecuyer

(Lécuyer et al., IEEE VR, 2000 and 2001)

Bibin (Univ. Paris 5) « Peripheral nerve Blocks on DVD : Lower and upper limbs », LippincottWilliams & Wilkins

Page 14: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Outline

IntroductionPseudo-haptic texturing

Pseudo-haptic techniqueApplications

Haptic interaction techniques for VETechnique for under-actuated devicesTechnique for small workspaces

Conclusion

Page 15: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

“A4”: A Technique to Improve Perception of Contacts

with Under-Actuated Haptic Devices

α

b

N

A2

A2

A3 A1

Rotation motion

Page 16: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Under-actuation?

More sensors than actuators : Ns > NaPHANToM OMNI is under-actuated in rotationWearable haptic devices ***

Problems : unrealistic sensations of contact [Barbagli and Salisbury, 2003]Focus of our study:

Point-based interactionCartesian devices

Page 17: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

A4 technique

Concept Rotation of the scene in case of contact

α

b

N

A2

A2

A3 A1

Rotation motion

a

N

Virtual object of the scene

Manipulated object

A2

A3 A1

c A2

N

N is now aligned with A2

A2

A3 A1

Automatic Alignment with the Actuated Axes of the device (A.A.A.A or « A4 »)

(Lécuyer et al., WorldHaptics, 2005)

Page 18: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Experimental evaluation

Experimental task Follow the contour of virtual objects in 2D

Results Positive influence of A4 on performance in under-actuation cases>> Use A4 in applications where haptic perception is fundamental

O3

O1 O2

O4

v i d e ov i d e o

Page 19: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

Using haptic devices with limited workspace : Haptic Hybrid Control

Page 20: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Bubble technique

Translation and point-based interaction (cursor) « Bubble » displayUse Hybrid Position/Rate Control (e.g. Microsoft Excel)Use Force-Feedback to emulate elastic input device

(Dominjon et al., LNCS, 2006)

Page 21: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Evaluation of BubblePainting task PHANToM in a CAVE3 Conditions

Bubble vs. Clutching vs. Scaling

video

Page 22: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Results

Bubble as fast as ScalingBest paintings with BubbleHigh subjective preference

Page 23: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Haptic Hybrid Rotations

Context6D Manipulation of objectsLarge rotations

Virtual shapes : cone, torsion springs

boundingvirtual cone

device handle

(Dominjon et al., IEEE VR, 2006)

Page 24: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Evaluation of Haptic Hybrid Rotations

Task : Build a pyramid of blocks3 Conditions

Clutching Scaling Haptic Hybrid Rotations

ResultsHaptic Hybrid Rotations are significantly fasterNo significant loss of accuracySubjectively preferred

Page 25: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Haptic Hybrid Control

Interaction paradigm to use haptic interfaces with limited workspace in large VE :

> Bubble Technique (translations) > Haptic Hybrid Rotations (rotations)

Fast motions, precise actions, subjective preferenceIntegrated in VIRTUOSE API (Haption Company)

(Dominjon et al., Visual Computer, 2007)

Page 26: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

General ConclusionKnowledge in perception may influence VR design

Influence of spatial collocation of visual and haptic displays on multimodal integrationInfluence of C/D ratio on haptic perception

Pseudo-haptic textures Techniques that do not use haptic interfaces : “size” and “speed”of the cursorMany applications : entertainment, training, GUI, etc

Interaction techniques may improve integration of hapticsin VE

Under-actuated devices : the “A4” techniqueLimited workspace : Haptic Hybrid Control = Bubble technique, Haptic Hybrid Rotations

Page 27: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, INRIA, [email protected]/bunraku/GENS/alecuyer

IEEE VR 2008 Tutorial : « Integration of Haptics in VE », March 9th, Reno, US

Pseudo-Haptics and Interaction Techniques to Improve

Integration of Haptics in VE

QQuestions?uestions?

Page 28: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Introduction

Force-feedback devices have a limited workspaceDifficult to make large motions with objects Difficult to reach far objects

How to « go beyond the limits of haptic interfaces »?

video

Page 29: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Clutching technique« Freeze » the virtual object

Temporarily suspend the mapping motion

DrawbacksAwkward [Preusche et al., 00]Slow [Zhai, 96]

video

Page 30: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Scaling technique

Amplification of user’s motionNon-isomorphic rotations [Poupyrev et al., 00]

DrawbacksDifficult to control, accuracy ? [Poupyrev et al., 00]Can not apply « infinite » rotations

video

Page 31: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Results

Haptic Hybrid Rotations are significantly fasterNo significant loss of accuracySubjectively preferred

0

50

100

150

200

250

300

scaling clutching hybrid

total task completion time (s)

Page 32: Pseudo-Haptics and Interaction Techniques to Improve ...people.rennes.inria.fr/Anatole.Lecuyer/lecuyer.pdfA. Lécuyer, « Pseudo-Haptics and Interaction Techniques » Medical simulator

A. Lécuyer, « Pseudo-Haptics and Interaction Techniques »

Medical simulator

Training to nerve stimulation in regional anesthesia Palpation before insertion of needlePseudo-haptics : detection of hollow, organs

Bibin (Univ. Paris 5) « Peripheral nerve Blocks on DVD : Lower and upper limbs », Lippincott Williams & Wilkins