Roger J. Chapman Multimodal Slide Shows as Asynchronous Presentation Reviews The University of Hawaii, at Hilo Computer Science Department

Roger J. ChapmanRoger J. Chapman

Multimodal Slide Shows

as Asynchronous Presentation Reviews

The University of Hawaii, at HiloComputer Science Department

Roger ChapmanISECON, November 2nd 2001

2

Slide Shows

• Advantages:– Memory and

structuring aid– Common view for

instructors and students

– Easily stored, edited, reused, and shared

• Disadvantages:– Can “fly through”

slides– Can simply read the

slides’ contents– Hardwired structure

may breakdown during an interactive class


3

Deictic Gesturing

• Instructors often talk through a slide making a series of linking deictic gestures– Pointing at something while speaking, to

gesture “this”, “that” or “there”.– Increases efficiency and accuracy of the

communication


4

Multimodal Reviews

• Hardcopies of slide shows– help students follow the material covered

during a class– help students review later in their own time

• Can more natural reviews be simply created when it is not necessary to capture a lot of software dynamics?

• How useful might that be?


5

Other Systems

• Can add audio to PowerPoint presentations, but not pointing

• ScreenCam and HyperCam capture dynamics, but video files are large

• Compressed video on the Internet (e.g. RealPresenter) is becoming common, but still not always practical for dial-up students to stay online


6

Research on Multimodal Communications

• Chapanis (1975)

• Bly (1988); Tang (1991)

• Oviatt (1999)

• Faraday and Sutcliffe (1997)

• Neuwirth et al. (1994)

• Daly-Jones et al. (1997)

• Bergeron et al. (1999, 2001)


7

C-SLANTC-SLANT (Collaborative Slide

Annotation Tool):• Simple screen capturing• Slide show structure for

asynchronous messages• Synchronized voice and mouse

movement recording + other annotation tools

• 97% of the participants made deictic gestures

• Combined deictic gestures with other annotations markings

• Slide show structure needed overarching messaging structure


8

Point ‘n’ Talk

• Simple Asynchronous Presentation System

• Synchronized Speech and Pointing over an image

• Play only mode for students

• Tested in a Data Structures and Program Design Class with 17 students


10

Point ‘n’ Talk


11

Authoring Issues

• Sometimes difficult to record in “one take”– Trying to be very succinct– Recording in “chunks” helped

• Didn’t always need to point– E.g. Talking about the entire slide as one topic– Sometimes mouse was moved into white space

while not gesturing


12

Online Survey Results


13

Online Survey Results

• Things liked:– Synchronized speech and pointing (7)– Ease of use– Asynchronous “presence”

• Things disliked:– Download time– Unnecessary pointer movement (5)– Fixed size images


14

Point ‘n’ Talk Enhancements

• A text window to help scripting and annotating a slide

• In addition to starting and stopping recording with mouse-commands or function keys:– Recording voice only, Record pointing

only, Record voice and pointing modes

• Actual size and best-fit image display


15

2001 SIGCSE Questionnaire

• Special Interest Group on Computer Science Education (SIGCSE)– 58 instructors responded

– “Do you ever use a slide show to structure material to be covered in your classes?”

• 46(79%): yes; 12(21%): no

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

1-20% 21-40% 41-60% 61-80% 81-100%

Average time spent in class using slidesF

req

ue

ncy


16

Slide Show Usage

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

1-20% 21-40% 41-60% 61-80% 81-100%

Average time spent in class using slides

Fre

qu

en

cy


17

2001 SIGCSE Questionnaire

– “Do students have access to the same set of slides?”

• 44(96%): yes; 2/46(4%) no

– “Do you use annotated copies of your slides as part of your preparation for teaching your classes?”

• 20/43(47%): yes; 23(53%) no; (3 gave no answer)


18

Conclusions

• A lot of slide show use• Multimodal slide shows with deictic

referencing over static images– Useful to review some material– Simple for instructors and students

• Popular with students• Need to record to compact discs and/or

use streaming technology

Documents

Roger J. Chapman Multimodal Slide Shows as Asynchronous Presentation Reviews The University of Hawaii, at Hilo Computer Science Department