69
patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo ramos phosphor

Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

Embed Size (px)

Citation preview

Page 1: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

patrick baudischmicrosoft research, ASI, interaction focus

desney tan, maxime collomb, dan robbins, ken hinckley,maneesh agrawala, shen zhao, gonzalo ramos

phosphor

Page 2: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

demo

Page 3: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

visual language

Page 4: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

performance benefits

Page 5: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

motivation

Page 6: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

people operating

GUIs make mistakes…

Page 7: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

…asking every time can be slow…

Page 8: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

…andusers have trouble

following whatothers are doing

Page 9: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

[Expose]

animation can help…

Page 10: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

…but animation oftenforces users to wait

Page 11: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

animationanimatio

npast future

can we do without the “lag”?

Page 12: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

phosphor

Page 13: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

phosphor transition :=1. show outcome of the change instantly and

2. explain the change in retrospect usinga diagrammatic depiction

Page 14: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

animationanimationpast future

phosphorpast phosphor

future

Page 15: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

animationexplains transition first and then shows outcome

phosphorexplains transition and outcome at the same time

phosphor lets users choose whether to attendto a transition or to ignore it

Page 16: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

afterglow (specific case of phosphor effect) :=• show previous state and• show how it changed

Page 17: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

demoafterglowfades over timemultiple on screen

Page 18: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

1. afterglow = visual buffer for changes

helps users follow activities in bursts

2. afterglow has (almost) no notion of time

users read transitions at their own pace

3. afterglow can be read back and forth

helps undoing undesired changes

users benefit

Page 19: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

1. users choose to attend to transition; wait never

2. giving extra time (to the inexperienced) is cheap

3. free application designersfrom hand-optimizing animation speed(just pick reasonable upper bound)

designers benefit

Page 20: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

susceptible to clutter

however

Page 21: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

related

Page 22: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

cartoon animation

[thomas01]

animation

[chang93]

( )

Page 23: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

chrono photography

[marey 1878]

photography

Page 24: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

photography

Page 25: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

comics

Page 26: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

comics

[mccloud93]

understanding comics

Page 27: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

storyboards

[Joshua Siegel]

Page 28: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

[haller04]

games

non-photorealistic rendering

Page 29: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

APEX

[feiner85]

visualization

Page 30: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

visualization

lithium

[hobbler04]

Page 31: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

action synopsis

[assa05]

visualization

Page 32: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

chrono volumes

[woodring03]

visualization

Page 33: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

transient visual cues for scrolling

[kaptelinin02]

user interface

Page 34: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

[mac os x]

user interface

( )

Page 35: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

high density cursor

[baudisch03]

user interface

previous cursorposition

current cursorposition

Page 36: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

telepointer traces

[gutwin02]

user interface

Page 37: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

MAUI groupware toolkit

[hill&gutwin03]

user interface

Page 38: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

mnemonic rendering

[bezerianos5min ago]

user interface

Page 39: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

drag-and-pop

[baudisch03]

user interface

Page 40: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

•can we apply comic transitions to GUI widgets?

•what visual language?

•are there performance benefits?

questions

Page 41: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

phosphor

Page 42: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo
Page 43: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

space for time1. envision animated transitions

2.project along time axis

x

y

challenges

1. show temporal order

2. avoid occlusion

Page 44: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

initial state

path

target state

names

Page 45: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

stylesstrobe blur speed line

less clutter, better sense of direction,better readable if overlap,

Page 46: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

showing timefading stacking initial

Page 47: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

move copy

temporary

file extract

action

drag-and-pop

Page 48: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

initial animation[chang 93]

resultingphosphortransition

addingverticalmotion

stationary

Page 49: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

reveal initial

reveal initial state omit path

Page 50: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

out-of-band

transparentto opaque

50% alphato opaque

rotation ortransition?

rotation!

Page 51: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

multiple

overlap is not a problem avoidance

Page 52: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

multiple

shorten paths single path

[terveen: “clans”]

Page 53: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

implement

Page 54: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

extract

temporary move copy

rotate

avoidance

null operation

spawn child window

delphi

Page 55: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

flash

Page 56: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

study 1

Page 57: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

task

Page 58: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

interfaces

with phosphor vs. without phosphor

12 participants (1 female)

Page 59: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

performance benefits

Page 60: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

study 2

Page 61: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

task

Page 62: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

Time - Interface x Outcome

phosphor animation

Time - Interface x Task

phosphor animation

phosphor animation phosphor animation

Error

Error

Page 63: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

patrick baudischpatrickbaudisch.com

end

Page 64: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

tableclothdrag&popf+c screens mouse etherhd cursor

large screens

staticanimation

Page 65: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

...swooooosh

Page 66: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

the problemwith animation…

• animation in the UI can help users follow transitions

• right speed is crucial• too fast error rate++• too slow task time++

• right speed also depends on familiarity, distraction… we cannot determine the right speed

Expose

Media Player

Page 67: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

this time: generalize…

Page 68: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

visual language& prototype

opacity

scale

extract

temporary move copy

rotate

avoidance

null operation

spawn child window

Page 69: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo

GUI manipulations…

help remotecollaboratortrack what I do