49
Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1 ]

Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Embed Size (px)

Citation preview

Page 1: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Voice-Activated Television Remote Control (VAR)

Senior Design I

Final Presentation

[1]

Page 2: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR Team Members

Team LeaderElectrical Engineer

• Design• Hardware• Documentation

Computer Engineer

• Website• Voice Recognition Coding• PIC programming

Computer Engineer

• Website• Voice Recognition Coding• PIC programming

Adviser: Dr. Pan Li

Electrical Engineer

• Hardware • Research •Debugging

Melissa Webb

David TrosclairBobby Britton

Bader Yaseen

Page 3: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Outline

• Problem• Solution• Constraints

• Technical• Practical

• Testing• Prototype • Future Tasks• Questions

Page 4: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Problemand

Solution

Page 5: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Problem

Some people do not have the ability to operate a standard hand-held television remote control.

Our market is the elderly and/or disabled.

 

“During the 20th century, the number of people in the United States aged 65 or over increased by a factor of 11, growing from 3 million to 33 million” [2, 3].

Page 6: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Solution

The VAR will allow users to operate their television by using voice commands.

By speaking into a microphone, the user is able to control 6 key functions of the television:

- Power - Mute

- Volume Up - Volume Down

- Channel Up - Channel Down

Page 7: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

What is the VAR?

• The user will speak the commands into a microphone attached to a computer with our voice recognition software.

• The software will translate and wirelessly send the signal to the VAR.

• A microprocessor will convert from the wireless input to an IR signal and output to the television.

VAR

Page 8: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Technical and PracticalConstraints

Page 9: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Technical Constraints

Name Description

Power SupplyThe VAR must operate from a standard 120V wall outlet.

Response TimeTarget time for complete process is less than two seconds.

Transmission Distance

The wireless signal and the IR signal’s maximum distances are 15 feet.

Voice Commands The VAR will recognize six vocal commands.

IR AccuracyThe IR signal must be transmitted and received accurately 98% of the time.

Page 10: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

System Overview

Page 11: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Practical Constraints

Name Description

Product Size The VAR will be no larger than 8” x 8” x 3”.

Operating System The VAR will be Windows OS compatible.

Page 12: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Practical Constraints Manufacturability: Product Size

The VAR will be no larger than 8’’ x 8’’ x 3’’.

• Convenient for user

• Easily fits into any space

• Portable

• Comparable to devices such as modems and routers

Page 13: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Practical Constraints Manufacturability: Operating System

The VAR software will be Windows OS compatible.

• Microsoft Windows is one of the most commonly used operating systems for personal computers [4].

• Executable files of the program can easily be made.

Page 14: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing

Page 15: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Voice Recognition Software

Page 16: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Voice Recognition Software

Extra Functions:

Volume Up/Volume Down- Intervals of 5

Channel Numbers- 1 through 9

Channel Key Words- PlayStation: TV’s Input Channel (A/V)

Page 17: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Voice Recognition Software

User Percent Error for each User (%)

Power Volume Up

Volume Down

Channel Up

Channel Down Mute

Bader 0 0 0 0 0 0

Bobby 0 0 0 10 10 10

David 0 0 0 0 0 0

Melissa 0 0 0 0 10 10

Page 18: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Bluetooth

Page 19: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Bluetooth

Char value sent from Bluetooth transmitter to Bluetooth receiver.

Each command has a char value.

Page 20: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Microcontroller

Page 21: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Microcontroller

Page 22: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Microcontroller

Page 23: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: IR Transmitter Accuracy

Command Accuracy (%)15 ft. Straight Ahead

15 ft. 15° to right

15 ft. 15° to left

Obstructed View

Power 100 100 100 0

Volume Up 100 100 100 0

Volume Down 100 100 100 0

Channel Up 100 100 100 0

Channel Down 100 100 100 0

Mute 100 100 100 0

Page 24: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Latency

Command Time (s)

Power 0.65

Volume Up 0.66

Volume Down 0.61

Channel Up 0.70

Channel Down 0.73

Mute 0.51

Page 25: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Sunny Day Case

• User enters correct COM port

• VAR is connected

• User says key word “Listen”

• Command is recognized

• User says command “Power”

• Television responds by turning on or off

Page 26: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Sunny Day Case

Page 27: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

• User enters the correct COM port.

• Software informs user that the COM port is closed i.e. VAR is off

• VAR still tries to connect.

• Once the connection is made, the VAR is connected and normal operation continues.

Testing: Rainy Day Case- Bluetooth not Connected

Page 28: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Rainy Day Case- Bluetooth not Connected

Page 29: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Rainy Day Case-Unrecognized Command

• User enters the correct COM port

• VAR is connected

• User says key word “Listen”

• Command is recognized

• User says command “Power”

• Command is not recognized

• User prompted to repeat command

Page 30: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Testing: Rainy Day Case-Unrecognized Command

Page 31: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Working Prototype

Page 32: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

Page 33: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

On/Off Switch

Page 34: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

Status LED

Page 35: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

BlueSMiRF Silver Bluetooth Receiver

Page 36: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

PIC24HJ64GP502

Page 37: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Breadboard

IR Transmitter

Page 38: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR System Setup

Page 39: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR System Setup

TV

Page 40: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR System Setup

VAR

Page 41: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR System Setup

PC

Page 42: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

VAR System Setup

Mic

Page 43: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Video

Page 44: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Future Tasks

Page 45: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Future Tasks

• Software Refinement

• PCB Design using Eagle layout

• PCB Populating

• Enclosure

• Testing

Page 46: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

August September October November

Software Refinement

PCB Design

PCB Populating

Enclosure

Testing

Timeline

Page 47: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Enclosure

Page 48: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

References

[1] (2012, February 18). “Elderly Couple Watching TV,” in fotosearch. [Online]. Available: http://www.fotosearch.com/photos-images/television-programme.html

[2] F. Hobbs. (2012, January 21). “The Elderly Population,” in U.S. Census Bureau. [Online]. Available: http://www.census.gov/population/www/pop-profile/elderpop.html

[3] (2012, January 21). “Sixty-Five Plus in the United States,” in U.S. Census Bureau. [Online]. Available: http://www.census.gov/population/socdemo/statbriefs/agebrief.html

[4] (2012, February 18). “Operating System,” in StatCounter Global Stats. [Online]. Available: http://gs.statcounter.com/#os-ww-monthly-201202-201202-bar

Page 49: Voice-Activated Television Remote Control (VAR) Senior Design I Final Presentation [1]

Voice-Activated Television Remote Control (VAR)

Senior Design IEnd-Semester Presentation

Questions?