25
PicoTales: Collaborative Authoring of Animated Stories using Handheld Projectors Simon Robinson, Elina Vartiainen, Matt Jones, Gary Marsden

PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

PicoTales: Collaborative Authoring of Animated Stories

using Handheld Projectors

Simon Robinson, Elina Vartiainen, Matt Jones, Gary Marsden

Page 2: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Photo: http://www.flickr.com/photos/kodomut/3616896096/

Page 3: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Mobile Stories (Fails et al.)

TellTable (Cao et al.)KidPad (Druin et al.)

UbiSketch (Weibel et al.)

Page 4: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

{

Page 5: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Background

• Handheld projector interaction – Cao et al.

• Multi-user handheld projection – Willis et al.

• Projected collaboration – Shilkrot et al.

• Flashlights, lasers – Ghali et al., Olsen et al.

• Sensor-based mobile spatial interaction – Williamson et al.

Page 6: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Pico projector

Nokia 5800

Sensor pack

Our approach: PicoTales

Page 7: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

(interaction video)(interaction video)

Page 8: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Benefits

• Sketch storytelling anywhere

• No extra tracking systems required

• Automatic recording & rendering of projected content for later reuse

• Projection as input

Page 9: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Research questions

• 1: Technical: Can we track story authors’ positions and movements accurately enough?

• 2: Authoring: How do people use the system to animate stories?

• 3: Viewing: To what extent can other people understand the stories that are created?

Page 10: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Technical evaluation

• Q1: Can we track story authors’ positions and movements accurately enough?

• 16 participants (8M; 8F), working in pairs

• Calibration tasks:

• 3 distances from a wall; 5 distances from each other

• Tracking tasks:

• 3 distances from a wall; 14 target markers

Page 11: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Technical: results

Primary position estimation accuracy0.0

1.0

1.5

2.0

2.5

3.0

Dis

tanc

e fr

om s

urfa

ce (

m)

0.5

median

mean

min, max

Projection surface

Actual distances

Distance estimates

• Closer = more accurate

Page 12: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Authoring evaluation

• Q2: How do people use the system to animate stories?

• 6 pairs of story authors

• Sketch a story; move to animate

• No pre-planning

• Narrate while authoring

• Think aloud during playback

Page 13: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Authoring: results

Page 14: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

(animation video)

Authoring: results

(animation video)

Page 15: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

(animation video)

Authoring: results

(animation video)

Page 16: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

(animation video)

Authoring: results

(animation video)

Page 17: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Authoring: results

• Projection technique appreciated

• Simple interface can be a benefit

• But: tracking accuracy improvements needed

“The simplicity is a good

thing, because it takes away the focus on the

technology rather than the story”

“Overall the drawing was fine but the positioning was

slightly off”

“I liked it; I wanted to draw more than one character at once”

“The likeness is spot on but they’re not quite in unison”

Page 18: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Viewing• Q3: To what extent can

other people understand the stories that are created?

• 79 participants; web-based; subtitled video

• Rate:

• understanding; utility; sketches, interaction

Page 19: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Viewing: results

Measure Result

Understanding 4.7 (sd: 1.7)

Do sketches match story 4.7 (sd: 1.5)

Usefulness of animations 4.0 (sd: 1.7)

Were interactions meaningful 4.0 (sd: 1.6)

Was low resolution a problem 3.3 (sd: 1.8)

Page 20: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Viewing: results

• Story understanding & meaningful sketched interactions depended on sketch quality

vs.

Page 21: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Summary

• Sensor-based tracking shows potential

• Accuracy improvements needed for more effective authoring

• Stories are still understandable by other people who have no experience of the system

Page 22: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Future work

• Technical:

• Accuracy improvements

• Interface enhancements

• Authoring:

• Post-storytelling editing

• Performative projection

Page 23: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Thank you

Contact: [email protected]

Research funded by EPSRC projectsEP/J000604/1 and EP/I001778/1.

Elina Vartiainen was supported byThe Wihuri Foundation.

Page 24: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Technical: distance estimation

• Sensor-based, rather than video-based

1 m

d

θPri.

Page 25: PicoTales: Collaborative Authoring of Animated Stories ...cssimonr/presentations/PicoTales.pdf · Background • Handheld projector interaction – Cao et al. • Multi-user handheld

Technical: distance estimation

• Sensor-based, rather than video-based

Sec.Pri.Sec.Pri.