1

A Haptic Multimedia Handwriting Learning System

Mohamad A. Eid, Mohamed Mansour, Abdulmotaleb H. El Saddik, Rosa Iglesias

Emme '07: Proceedings of the international workshop on Educational multimedia and multimedia education

Speaker: Jacob.

2

Outline

Introduction Haptic Learning System Algorithms Conclusion

3

Introduction

Certain learning need physically interact. Handwriting, medical procedures, painting, sports, etc.

Handwriting is a complex daily life task that needs attention, memory and cognition, motor skills.

Haptics refers to the emerging that studies the sense of touch and human interaction via the sense touch.

The authors are using haptic-audio-visual playback for learning handwriting.

4

Haptic Learning System

5

The Language Repository

It contains study material, symbol images, pronunciation files and the haptic stimuli (position trajectory to draw character).

Contents are made visible to the outside world using an XML-based description.

6

The audio-visual player

Character symbol.

Pronunciation.

The students can review the character shape and sound as many times as they want.

7

The Haptic Player

Three modes of operationRecording mode: retrieving, filtering, and

storing the data sent from database.Full guidance playback mode: can be used

with beginners to lead them through the writing of the alphabets.

Partial guidance playback mode: check user’s movement and applies partial forces to correct the path.

8

GUI (Graphical User Interface)

9

Algorithm

Haptic Virtual Whiteboard.

Partial Guidance Playback.

Move-to-Departure Algorithm.

10

Haptic Virtual Whiteboard

The reaction force from the virtual whiteboard plane can be computed as:

X=position coordinates of the haptic device.Xp=plane position along the same direction.g and K=stiffness and elasticity of the virtual paper.

11

Partial Guidance Playback

The offset between the user’s startup position and the desired startup position eliminates translational errors.

While user is drawing, the result is computed along the paper plane using MSE (Mean Square Error).

Total accumulated error is calculated and compared to a threshold that reflects the level of guidance.

12

Partial Guidance Playback

(Xip, Yip)=current position (Xid, Yid)=Desired position coordinate. n=number of points from the startup point

up until the current point.

13

Move-to-Departure Algorithm

This algorithm makes the device more smoothly from its current position to the startup position of the stimulus.

14

Conclusions

Its very useful for Chinese, Thai, Japanese, Arab, Korea and the other countries which have their own character.

We have to write often to remember a new character. So keep writing.