Virtual Reality and Health - UNC Health Sciences Library · Virtual Reality and Health Jason Jerald, PhD @TheVRBook. Jason Jerald, PhD @TheVRBook ... Jason Jerald, PhD @TheVRBook

Jason Jerald, PhD @TheVRBook

Virtual Reality and Health

Jason Jerald, PhD

@TheVRBook


Jason Jerald, PhD20+ years of VR expertise40+ organizations70+ projects

2


What is Virtual Reality?

“A computer-generated digital environment

that can be experienced as if that

environment was real.”

—The VR Book

3


What is Virtual Reality(video)

4


The XR Continuum

Real

Reality

Virtual

Reality

5


VR is not New!1830s to 1990s

Images Courtesy of The VR Book (with permissions from original sources)

6


VR Applications Beyond Entertainment• Real Estate• Medical Visualization• Command & Control• Scientific Visualization• Computer-Aided Design• Education• Simulation & Training• Telepresence• Tourism• Design Review/Markup• Proposals

• Advertising and Marketing• Location Based Exhibits• Retail• Crime Scene Investigation• Psychological studies• Human performance/factors

engineering• Rehabilitation• Pain Distraction• Immersive Film• Sports

7


Today’s Two VR Applications

• Medical Visualization• Neuroscience Education

8




9


Medical Visualization

iMedic by Immersive Medical Environment for Distributed Interactive Consultation

Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center

10



iMedic by Immersive Medical Environment for Distributed Interactive Consultation

Congressional funding provided by the U.S Army’s Telemedicine & Advanced Technology Research Center

11


Medical Teleconsultation

iMedic by

12



iMedic by

(video)

13



iMedic—how does it work?

– 3D Multitouch• Appropriate for abstract non-realistic interactions• Content/data independent• Written Specifically for immersive interaction• Solves gorilla arm• Reduces sim sickness

14




15


Education• What does our workforce need in the future?

• The ability to operate across a broader span of tasks and

situations, creating new demands:

–Increased complexity of work

–Continuous competency development

–Different ways of thinking

–Cognitive overloadSource: US General Services Administration

16


Education

“Tell me and I will forget.Teach me and I will remember.Involve me and I will learn.”

—Benjamin Franklin

17


Education

Image Courtesy of The VR Book (adapted from Dale [1969])

18


Neuroscience education by

Education

19

Funding provided by


Education(video)

20


Education(video)

21


Education(video)

22


EducationVR Immigrants

• Conventional speed• Linear processing• Text first• Step by step• Stand-alone• Passive• Work• Patience• Reality• Technology-as-foe

VR Natives

• Twitch speed• Parallel processing• Graphics first• Random access• Connected• Active• Play• Payoff• Fantasy• Technology-as-friend

23


Education

“The illiterate of the 21st century will not be

those who cannot read and write, but those

who cannot learn, unlearn, and relearn.”

—Alvin Toffler

24

Jason Jerald, PhD @TheVRBook 25


Questions

26


Additional Slides

27


Adverse Health Effects—Challenges• Injury• Motion sickness• Headset Fit• Hygiene• Aftereffects• Seizures

• Physical Fatigue• Eye strain

– Flicker– Accommodation-vergence

conflict– Occlusion-binocular

Conflict

28


Factors of Adverse Health EffectsSystem

• Latency• Calibration• Tracking accuracy & precision• Field of View• Refresh rate• Judder & Flicker• Display response & persistence• Vergence/Accommodation• Stereoscopic cues• Real world peripheral vision• Fit/Weight/center of mass• Motion platforms• Hygiene• Temperature• Dirty screens

Application

• Frame rate• Locus of control• Visual acceleration• Physical head motion• Duration• Vection• Binocular-occlusion conflict• Virtual rotation• Gorilla arm• Standing vs sitting• Rest frames• Binocular disparity• VR entrance & exit• Luminance• Repetitive strain

Human

• History of motion sickness• VR experience• Health• Thinking about Sickness• Belief• Gender• Age• Mental model/expectations• Interpupilary distance• Not knowing• Sense of balance• Flicker fusion frequency

threshold• Real-world task experience• Migraine history

29


Adverse Health Effects

Cables and Safety– Sit in a Chair– Safe audio levels– Use a human spotter– Constrain/limit haptics– Provide harnesses, railing, and/or padding– Spend the time to arrange cables nicely. Cable tie them to

desk, etc. And then leave them.

30


Adverse Health Effects

Warning Grids

31


Motion SicknessThe Basics• The biggest problem is motion sickness

– Varies greatly from person to person

• As users:– Stop at the first sign of sickness– Be well-hydrated– Not hungry– Not hung over

• As demoers– Remind users not to “tough it out”– Choose comfortable applications

32


Motion Sickness

• Sensory Conflict• Evolution/Poison Theory• Postural Instability Theory• Rest Frame Hypothesis• Eye Movement Theory

33


Locomotion

• Physical walking• Teleportation• Dynamic field of view• Dynamic rest frames

34


Physical Walking

• Real-world one-to-one walking• Treadmill walking• Redirected walking• Walking in place

35


Teleportation

• Popularized byCloudHead Games

• Zero motion sickness

• Results in disorientationBowman & Hodges 199

Trainexus by

36


Dynamic Field of View

Image Courtesy of

Fernandes & Feiner 2016

37


Rest Frames

• Stabilized cues relative to real world Prothero & Parker (2003)

• Reduces sensory conflict between what you are seeing and what you are feeling

• Example: Cockpit

EVE Valkyrie by CCP Games

38


Rest Frames

39


Dynamic Rest Frames

Looking ahead with no DRF Looking ahead with DRF Looking to Right with DRF

by

40


Head-Mounted Displays

41


Desks

The Nanomanipulator

42


DDRIVE by and

CAVEs

43


CAVEs

44


Phones & Tablets

Zoo-AR by

45


VR Input Devices

46


1_Q&A

47



1_Q&A

49


1_Q&A

50



Try the Merge Things for Yourself!

Go toBit.ly/MThings

52

http://bit.ly/MThings


Today’s Five VR Applications

• Training• Medical Visualization• Computer-Aided Design• Retail• Education

53


Computer-Aided Design

• Immersive modeling challenges– Not just polygons & special effects– Large number of options– Precision

54


by , , &


55


by , , &

Computer-Aided Design(video)

56



by , , &

57


Where is Technology Going?The Past

• Expensive• Dedicated hardware• Train key jobs• Formal• Defense dominates• Experts create• Sequential learning• Accidental engagement

The Future

• Inexpensive• Multiuse (e.g., phones)• Train many jobs• Informal• Commercial dominates• Users create• Free-form learning• Intentional Fun

58


The Future

“The best way to predict the future is to invent it.”

—Alan Kay

59

Documents

Virtual Reality and Health - UNC Health Sciences Library · Virtual Reality and Health Jason Jerald, PhD @TheVRBook. Jason Jerald, PhD @TheVRBook ... Jason Jerald, PhD @TheVRBook