42
Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor [email protected] Director, Tele-Rehabilitation Institute http://www.ti.rutgers.edu Electrical and Computer Engineering Department

Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor [email protected] Director,

Embed Size (px)

Citation preview

Page 1: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Welcome to14:332:376 Virtual Reality and

16:332:571 Virtual Reality TechnologySpring 2012

Grigore C. Burdea Ph.D.Professor

[email protected], Tele-Rehabilitation Institute

http://www.ti.rutgers.edu

Electrical and Computer Engineering Department

Page 2: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Class web site:

https://sakai.rutgers.edu/portal

Textbook site:

www.vrtechnology.org

Page 3: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Grading Criteria (376): Quizzes 20%,

Midterm 40%

Final 40%Attendance penalty – one letter grade lost for 4 absences. Midterm and Final are mandatory to passCheating is an automatic F. All exams and quizzes are closed books/notes/etc. Quizzes are announced.

Laboratory assignments graded separately (for 378 – co req)

TA Mr. Timothy Phan [email protected]

Page 4: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Grading Criteria (571):

Quizzes 10%,

Midterm 25%

Final 25%

Laboratory 40%

Attendance penalty – one letter grade lost for 4 absences.

Midterm, Final and Laboratory Term Project Mandatory to pass. Quizzes announced, Cheating results in an F.

Page 5: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Textbook: Burdea and Coiffet, Virtual Reality Technology, 2nd Edition, Wiley, 2003

Page 6: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Textbook web site: www.vrtechnology.org

Page 7: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Textbook web site: www.vrtechnology.org

Page 8: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Laboratory Hardware

Page 9: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Updated class notes (PowerPoint) will be posted on the webhttps://sakai.rutgers.edu/portal

Quiz and Exam Solution on Sakai

Supplemental materials, surveys, links to companies and labs on the textbook site.

Virtual Reality - Introduction

Page 10: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Topics

Page 11: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

IntroductionIntroduction

Page 12: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

What is Virtual Reality?

Page 13: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

It is not augmented reality….

Introduction

Page 14: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

What is Virtual Reality?

“A high-end user-computer interface that involves real-time simulation and interaction through multiple sensorial channels.” (vision, sound, touch, smell, taste)”

Introduction

Page 15: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

http://games.yahoo.com/braingames/brain-teasers-games/phantom-square-255

Introduction

Page 16: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Sensorama Simulator, US Patent #3,050,870, 1962

Introduction

Page 17: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

VR Short History

1963+ Ivan Sutherland's doctoral theses: SKETCHPAD: stereo HMD, position tracking, and a graphics engine. 1966+ Tom Furness: display systems for pilots; 1967+ Brooks developed force feedback GROPE system;

Page 18: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Ivan Sutherland’s HMD

(1966+)

Page 19: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Brooks’s Grope Project (1977)

Page 20: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

VR Short History

1977 Sandin and Sayre invent a bend-sensing glove

1979 Raab et al: Polhemus tracking system

1989 Jaron Lanier (VPL) coins the term virtual reality

1994 VR Society formed

Page 21: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The first complete system was developed by NASA “Virtual Visual Environmental Display” (VIVED early 80s; they prototyped the LCD HMD;

Became “Virtual Interface Environment Workstation” (VIEW) 1989

IntroductionNASA … a pioneer in VR

Page 22: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

NASA VIEW system (1992)

Introduction

Page 23: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Large simulation and training needs;

Could not send humans to other planets;

Relatively small budgets.

Introduction

Why NASA?

Page 24: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Towards Commercialization…

The first commercial VR systems appeared in the late 80s produced by VPL Co. (California):

The VPL “Data Glove” and

The VPL “Eye Phone” HMD

Introduction

Page 25: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The VPL DataGlove (1987) cost $8,500

Introduction

Page 26: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The Matel PowerGlove (1989)

Introduction

Page 27: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The first commercial VR glove for entertainment –

Mattel Power Glove $50 (1989)

Page 28: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The Flight Helmet (ca. 1990) weighs 5 lbs

Early HMDs were massive

Page 29: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

…and had poor resolution

Page 30: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Virtual Reality in the early 90s….

Emergence of first commercial Toolkits:

WorldToolKit (Sense8 Co.);

VCToolkit (Division Ltd., UK);

Virtual Reality Toolkit VRT3 (Dimension Ltd./Superscape, UK);

Cyberspace Developer Kit (Autodesk)

Introduction

Page 31: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Superscape VRT3 Development System

Page 32: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Virtual Reality in the early 90s….

Emergence of first non-commercial toolkits:

Rend386;

Later Virtual Reality Modeling Language (VRML 1.0);

Later still Java and Java 3D;

Introduction

Page 33: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Scene created with Rend386Successor is AVRIL ("A Virtual Reality Interface Library“) C library for authoring. Created at U. Waterloo, Canadaece.uwaterloo.ca/~broehl/avril.html

Page 34: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Virtual Reality in the early 90s….

PC boards still very slow (7,000 – 35,000 polygons/sec);

First turnkey VR system – Provision 100 (Division Ltd.)

Emergence of faster graphics rendering architectures at UNC Chapel Hill:

“Pixel Planes”;

Later “Pixel Flow”;

Introduction

Page 35: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Stride PC graphics accelerator

35,000 polygons/sec;

$26,000 (with two co-processors)/card

Require up to 6 PC slots for stereo version

Page 36: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Provision 100 VR turnkey system (Division Ltd., UK)

35,000 polygons/sec;

$64,000 (including texture generator, tracker, 3-D audio, HMD and software)

Page 37: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Introduction

Pixel Planes 5 VR system (UNC)

~ 1 Million triangles/sec;

Page 38: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Rendering speed comparison SGI vs. PCs

xBox 360500 Million poly/sec

2005

Page 39: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

Laboratory VR Station prices (2002)PRODUCT Price/user % of Budget

PC 1.7 GHz

FireGL 2 accelerator

2,347 48

Polhemus 3D tracker

4 receivers

1,823 37

5DT sensing glove

five-sensor version

482 10

Stereo Glasses wired 179 3

Force feedback Joystick 88 2

Java and Java3D - -

VRML - -

Total 4,919 100

Page 40: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

VR Market growth

Page 41: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The key elements of a conventional VR System

Page 42: Welcome to 14:332:376 Virtual Reality and 16:332:571 Virtual Reality Technology Spring 2012 Grigore C. Burdea Ph.D. Professor burdea@jove.rutgers.edu Director,

The key elements of a modern VR System