Embed Size (px)
Citation preview
CS4710 Senior ProjectCS4710 Senior Project 11
Awnalisa McCarty
Tim Hollist
J.R. Burningham
CS4710 SENIOR PROJECTDecember 6, 2002
CS4710 Senior ProjectCS4710 Senior Project 22
H : The Digital Pet
CS4710 Senior ProjectCS4710 Senior Project 33
Overview
Goals:
1. JStamp
2. Voice Extreme
3. CMUcam
4. Sonar
JStamp
VoiceExtreme
CMUCam
Sonar
CS4710 Senior ProjectCS4710 Senior Project 44
Overview (Cont)Commercial Possibilities:
Enormous market potential for young children.
Entertainment: With improving technology, the general populous is looking for new and interesting toys to interact with.
Aibo: Sony’s electronic dog is the first “affordable” digital pet.
CS4710 Senior ProjectCS4710 Senior Project 55
Project DetailsFunctional Partition:
CS4710 Senior ProjectCS4710 Senior Project 66
Project Details (Cont)Original Project Objectives:
1. Determine capabilities of JStamp
2. To use CMUcam well enough to drive to (or away) from a specific color.
3. To get VoiceExtreme chip to work with all the words we wanted so that we could talk to ‘H’ and have it respond non-repetitively.
4. Get Sonar module to work in conjunction with the camera.
5. Get Chipcorder to work, which would allow for numerous random responses and a real “personality.”
CS4710 Senior ProjectCS4710 Senior Project 77
Project Details (Cont)Software Flow Chart (Java):
CS4710 Senior ProjectCS4710 Senior Project 88
Project Details (Cont)Problems Encountered:
1. Lack of legos.2. Voice Extreme microphone problems.3. Speaker Independent vs. Speaker Dependent vocabularies4. Learning curve for Voice Extreme tools 5. J2ME Threads6. Chipcorder 7. JStamp
CS4710 Senior ProjectCS4710 Senior Project 99
Project Results Machine Vision: We can track most different colors as
long as they are a fairly bright color.
Sonar:
1. We can use the sonar to act as a front sensor to know when we are too close to something and should stop.
2. ‘H’ can use sonar to follow a large, slow moving object, like a person, around.
3. Integration of sonar during color tracking.
CS4710 Senior ProjectCS4710 Senior Project 1010
Project Results
Voice Extreme
1. Merged speaker independent vocabularies with speaker dependent ones.
2. Communication with JStamp over serial port.
3. Playing math game
Improvements:
1. Implement ChipCorder to give “H” more personality.
2. Improve Vision and sonar
CS4710 Senior ProjectCS4710 Senior Project 1111
Achievements:
1. Team Work
Conclusions
2. Gained valuable experience in embedded Java programming.
3. Integration of different hardware components and communication between them.
4. Code Documentation
5. Experience researching information and problems on our own
CS4710 Senior ProjectCS4710 Senior Project 1212
Conclusions (Cont) Regrets:
1. Contact Voice Extreme company (Sensory) earlier.
2. Spend less time on small problems
3. Started with the Voice Extreme from the beginning
CS4710 Senior ProjectCS4710 Senior Project 1313
DemonstrationVoice Commands
1. Back up2. Go Forward3. Left4. Right5. Stop6. Main Menu
1. Ball2. Attack3. Present4. Math5. “Hey H”
7. Activate8. Panic
CS4710 Senior ProjectCS4710 Senior Project 1414
QUESTIONS??
Team Work and Information:
Project Website:
www.cs.utah.edu/~burningh/burning-h
Javadocs:
www.cs.utah.edu/~burningh/burning-h/javadoc
Java Code:
www.cs.utah.edu/~burningh/burning-h/H.jar
Voice Extreme Code:
www.cs.utah.edu/~burningh/burning-h/VE.zip
