8
IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň ([email protected])

IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

Embed Size (px)

DESCRIPTION

IBM - CVUT Student Research Projects 3 Features User head tracking using eyes Speech simulation using mouth Speech output through speaker using speech synthesizer Facial mimics simulation Touch sensitivity

Citation preview

Page 1: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

Robotic Head with Mimic Facial Movements

Jan Kofroň ([email protected])

Page 2: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

2

Guidelines

• Design and realize mechanic and electronic part of robotic head

• Design API for client computer application• Create simple demonstrating application

– Cooperate with Talking Head project

Page 3: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

3

Features

• User head tracking using eyes• Speech simulation using mouth• Speech output through speaker using

speech synthesizer• Facial mimics simulation• Touch sensitivity

Page 4: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

4

Current version (mechanical part)

• Eye movements– Horizontal direction– Vertical direction

• Mouth opening• Head horizontal rotation

Page 5: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

5

Current version (electronic part)

• ATmega32 microcontroller (design board)– 2 PWMs for driving servos– TIMER for servo multiplex (up to 8 servos)– TIMER for stepper motor moves

• Communication via RS232 with client app– Simple command protocol (see

documentation)

Page 6: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

6

Next version (mechanical part)

• Modeled face (funny fairy-tale creature)• Moveable

– mouth, eyelids, eyebrows, cheeks, funny ears• Touch sensitivity

Page 7: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

7

Next version (electronic part)

• AT90USB1287 (own PCB)– Up to 16 servos– Up to 4 stepper motors

• Communication via USB with client app– User space driver and DLL implementing API

• DAC, Amplifier and Speaker– Speech synthesis output

Page 8: IBM - CVUT Student Research Projects Robotic Head with Mimic Facial Movements Jan Kofroň

IBM - CVUT Student Research Projects

8

Conclusion

• Project brings me new experiences with– Connecting existing projects together– Schematic and PCB design– Tiny mechanics