22
Hybrid Approach of Augmented Clas sroom Environment with Digital Pe ns and Personal Handhelds Motoki Miura Susumu Kunifu ji Japan Advanced Institute of Sci ence and Technology JAIST http://css.jaist.ac.jp/~miur amo/

Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

Embed Size (px)

Citation preview

Page 1: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Han

dhelds

Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Han

dhelds

Motoki Miura Susumu KunifujiJapan Advanced Institute of Science and Te

chnology ( JAIST )http://css.jaist.ac.jp/~miuramo/

KES2006 @ Bournemouth

Page 2: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

2

Outline

“Augmented Classroom” project System “AirTransNote”

What is “AirTransNote” ? What was lacking for “learning support syst

em”? How we changed the system?

What’s the typical usage in lecture?

Page 3: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

3

What is “AirTransNote” Devices: Digital Pen and PDA(WLAN) Capture student’s handwritten note on paper, and transmit

to teacher’s PC immediately Share by Projecting Store, Analyze, and Review the note Student can get feedback via PDA

Page 4: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

4

ATN Mediator (student)(2) The sensors detect theultrasonic waves, and calculateposition data of the pen tip

(1) Tap the pen tip on the paper, ultrasonicwave is diffused

(3) The data is sent to PDA via infrared connection

(4) PDA transmits the data via wavelan

Page 5: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

5

 ATN Manager (Teacher)

Page 6: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

6

 

Start video

Page 7: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

7

Purpose of AirTransNote Basic Functions :

Capture students’ note and transmit Teacher can show the note with projector

Reduce times to re-write on Blackboard Purpose :

Facilitate communication between class members Encourage active learning

A successor of response analyzer (ex. EduClick[Huang 2001])

Page 8: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

8Feasibility Study40 1st-y high school students (15-16 yrs-old), Math class, March 2004

Page 9: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

9

Page 10: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

10

Page 11: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

11

Teacher’s Remote for direct note selection

Page 12: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

12

Our concept: “Augmented Classroom”

Enhance the ability of classroom with calm technology Based on ubiquitous/pervasive computing par

adigm KBD , Mouse→Paper and Pen, RFID

However, we should focus on “learning effects” of the system

Page 13: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

13

Re-design of AirTransNotewith consideration of learning

Feedback/interaction is the key factor Shift to “Collaborative learning”

Limitation of feedback with paper-centered approach Make full use of PDA for giving feedback Complementary use PDA and Paper

→Improve the system to cover the shortages

Page 14: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

14

Four learning effects enhanced by AirTransNote

Student

Teacher

Mediator

Student

Interaction betweenteacher and Student

Interactionamong Students

Self Reflection

Interaction betweenSystem(Mediator) and Student

Page 15: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

15

Four learning effects enhanced by AirTransNote

Self reflection by student Re-check note on PDA

Interaction b/w system⇔student Feedback depends on student response

Interaction b/w teacher⇔student Recognition of student’s progress and learning statu

s Interaction among students

Sharing/Browsing notes with PDA Tagging/Annotating

Page 16: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

16

Checking note from PDA

Page 17: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

17

System improvenents Previewing with paper image context on PDA

Ease of checking Connect with handwriting recognition engine

Support for various responces Feedback editor for teacher We attached web server to teacher’s system

For checking progress (by teacher) For browsing student note images (by teacher/stude

nt)

Page 18: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

18

Advantages of Digitized note

△ Show idea with note drawing We can use document camera

○ Capture drawing alone Flexiblity of showing ( ex. overlap to compare )

○ Capture time series of note Reproducing note with writing order

Ex. Check order of Chinese character Ex2. Show direction of electric current flow ( 電流方向 )

Writing order may reflect thinking process

Page 19: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

19

Experiment

(20 graduate students, geometry test and IQ quiz with sound feedback)

Page 20: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

20

Finding

Realtime feedback is accepted by student Feedback may alleviate stress

Student can know whether his/her answer is correct or wrong before making public.

Further experiment is required

Page 21: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

21

Conclusion

Re-design of AirTransNote System for facilitating communication in lectur

e Improved to support “collaborative learning”

Future work: Conduct experiment to check “active learning

mind” with various conditions

Page 22: Hybrid Approach of Augmented Classroom Environment with Digital Pens and Personal Handhelds Motoki Miura Susumu Kunifuji Japan Advanced Institute of Science

22

Thank you!!

Motoki [email protected]://css.jaist.ac.jp/~miuramo/