17
Classifying 3D Input Devices by Robert W. Lindeman WPI, Dept. of Computer Science [email protected]

Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

Cla

ssify

ing 3

D In

put D

evic

es

by

Robert W

. Lin

dem

an

WPI, D

ept. o

f Com

pute

r Scie

nce

gogo@

wpi.e

du

Page 2: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

2

Motiv

atio

nThe m

ouse a

nd k

eyboard

are

good fo

r genera

l deskto

pU

I tasks

Text e

ntry

, sele

ctio

n, d

rag a

nd d

rop, s

cro

lling, ru

bber

bandin

g, …

Fix

ed c

om

putin

g e

nviro

nm

ent

2D

mouse fo

r 2D

win

dow

s

How

can w

e d

esig

n e

ffectiv

e te

chniq

ues fo

r 3D

?U

se a

2D

devic

e?

Use m

ultip

le n-D

devic

es?

Use n

ew

devic

es?

Use 2

D in

terfa

ce w

idgets

?

Need n

ew

inte

ractio

n te

chniq

ues!

Page 3: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

3

Motiv

atio

n (c

ont.)

Gam

ing a

nd V

irtual R

eality

Tig

ht c

ouplin

g b

etw

een action a

nd reaction

Need fo

r pre

cis

ion

VR c

an g

ive real firs

t-pers

on e

xperie

nces, n

ot

just v

iew

sH

ead-m

ounte

d D

ispla

yIn

ord

er to

look b

ehin

d y

ou, tu

rn y

our h

ead!

Sele

ctin

g/m

anip

ula

ting a

n o

bje

ct

Reach y

our h

and o

ut a

nd g

rab it!

Tra

vel

Just w

alk

(well, n

ot q

uite

)!

Doin

g th

ings th

at h

ave n

o p

hysic

al a

nalo

g is

more

pro

ble

matic

Page 4: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

4

Com

mon In

put D

evic

es

TrackPoint

TrackB

allTouchPad

Mouse

Keyboard

Joystick

Tablet

MightyM

ouse

Page 5: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

5

Gam

e C

ontro

llers

Sourc

e: h

ttp://w

ww

.axess.c

om

/twilig

ht/c

onsole

/

Atari 2600(1977)

Intellivision(1980)

PlayStation2(2000)

Xbox 360(2005)

Revolution(2006?)

CL

IP

Page 6: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

6

Cla

ssific

atio

n S

chem

es

Rela

tive v

s. A

bsolu

te m

ovem

ent

Inte

gra

ted v

s. S

epara

ble

degre

es o

ffre

edom

Dig

ital v

s. A

nalo

g d

evic

es

Isom

etric

vs. Is

oto

nic

devic

es

Rate

contro

l vs. P

ositio

n c

ontro

l

Specia

l-purp

ose v

s. G

enera

l-purp

ose

devic

es

Dire

ct v

s. In

dire

ct m

anip

ula

tion

Page 7: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

7

More

on C

lassific

atio

ns

Rela

tive v

s. A

bsolu

te m

ovem

ent

Mouse v

s.T

able

t

Inte

gra

ted v

s. S

epara

ble

degre

es o

ffre

edom

Mouse h

as in

tegra

ted X

, Y c

ontro

lEtc

h-a

-sketc

h h

as s

epara

te X

, Y c

ontro

lM

otio

ns th

at a

re e

asy w

ith o

ne a

re h

ard

with

the

oth

er

Analo

g d

evic

es a

llow

more

sensitiv

ityFor e

xam

ple

, analo

g g

am

e c

ontro

llers

Page 8: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

8

Isom

etric

vs. Is

oto

nic

Input

Devic

es (Z

hai)

No m

otio

n v

s. N

o re

sis

tance

Actu

ally

a c

ontin

uum

of e

lastic

ityTra

ckPoin

t (mostly

isom

etric

) vs. m

ouse

(mostly

isoto

nic

)

Many d

evic

es a

re re

-cente

ring (e.g.,

joystic

ks)

Page 9: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

9

Rate

Contro

l vs.

Positio

n C

ontro

l (Zhai)

Mouse is

norm

ally

used fo

r positio

n c

ontro

l

Mouse s

cro

ll-wheel

Positio

n c

ontro

lClic

k-d

rag fo

r rate

contro

lled s

cro

lling

Tra

ckballs

typic

ally

use p

ositio

n c

ontro

l

Joystic

ks: C

ontro

l positio

n (c

ross-h

air), o

rContro

l velo

city

(airc

raft)

Rate

contro

l elim

inate

s n

eed fo

rclu

tchin

g/ra

tchetin

g

Iso

ton

ic-r

ate

co

ntr

ol a

nd

iso

metr

ic-p

ositio

nco

ntr

ol te

nd

to p

ro

du

ce p

oo

r p

erfo

rm

an

ce

(Zhai)

Page 10: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

10

Specia

l-Purp

ose v

s. G

enera

l-Purp

ose In

put D

evic

es (B

uxto

n)

Gam

e c

ontro

llers

are

desig

ned to

support

many ty

pes o

f gam

es

Gam

e d

evelo

per d

ecid

es o

n m

appin

g

No "s

tandard

" mappin

gs ->

each g

am

ediffe

rent

Som

e s

pecia

l-purp

ose d

evic

es e

xis

tLig

ht g

uns

Ste

erin

g w

heels

RPG

keyboard

/joystic

k

Dru

m k

its, d

ance p

ads, b

ongos, etc.

Page 11: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

11

Dire

ct v

s. In

dire

ct M

anip

ula

tion

Dire

ct

Clu

tch a

nd d

rag a

n ic

on w

ith m

ouse o

r sty

lus

Touch s

cre

ens, P

DAs u

se d

irect m

anip

ula

tion

Work

s w

ell fo

r thin

gs th

at h

ave a

physic

al a

nalo

g

Indire

ct

Use s

om

e w

idget to

indire

ctly

change s

om

eth

ing

Pro

ble

ms w

ith d

irect m

anip

ula

tion

Som

e th

ings d

o n

ot h

ave a

physic

al a

nalo

g

Pre

cis

ion m

ay b

e la

ckin

g

Sele

ctio

n/d

e-s

ele

ctio

n m

ay b

e m

essy

Page 12: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

12

PHA

NT

OM

Om

niH

aptic Device

3D

Input D

evic

es

SpaceBall

SpaceMouse

HM

D w

ith3-D

OF tracker

Tracked Paddle for 2D

Interaction

CyberG

love II

Page 13: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

13

Oth

er O

ptio

ns

Som

e a

ltern

ativ

es

Speech

Gestu

res: p

oin

ting to

fly

Devic

e a

ctio

ns (e.g., b

utto

ns, jo

ystic

ks)

Head/g

aze d

irecte

d

Hybrid

Speech a

nd g

estu

re (e.g., "P

ut th

at, th

ere

.")

Page 14: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

14

Mappin

g D

evic

es to

Actio

ns

For e

ach (u

ser, ta

sk, e

nviro

nm

ent)

For th

e fo

ur b

asic

VR ta

sks

For e

ach d

evic

e D

OF

Choose a

mappin

g to

an a

ctio

n

We a

lso n

eed to

easily

sw

itch b

etw

een

actio

ns!

Page 15: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

15

Pla

cin

g D

evic

es in

Conte

xt

… … …

Isoto

nic

Inte

gra

ted

Absolu

teG

love

Both

Genera

lPositio

nIs

oto

nic

Dig

ital

Inte

gra

ted

Rela

tive

Mouse

Dir/Ind

Spec/Gen

Rate/Pos

Isom/Isot

Dig/Ana

Int/Sep

Rel/Abs

Device

Table

?

Page 16: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

16

Verific

atio

n a

nd C

om

paris

on

Fra

mew

ork

for u

ser s

tudie

s

Inte

restin

g to

fill in th

e e

mpty

spaces

Isoto

nic

positio

n c

ontro

l for ro

tatio

n?

Oth

er n

ovel c

om

bin

atio

ns?

Very

activ

e fie

ld rig

ht n

ow

ACM

CH

I, IEEE V

R, 1

st 3

DU

I Sym

posiu

mACM

SIG

GRAPH

Page 17: Classifying 3D Input Devices - WPIPurpose Input Devices (Buxton) Game controllers are designed to support many types of games Game developer decides on mapping No "standard" mappings

R.W

. Lin

dem

an - W

PI D

ept. o

f Com

pute

r Scie

nce

17

More

Info

Shum

in Z

hai a

t IBM

Alm

aden

Bill B

uxto

n a

t U. o

f Toro

nto

(Alia

s|W

avefro

nt)