31
EYE- CONTROLLED WHEELCHAIR PROJECT MEMBERS RINKU LAL GAUTAM PRAFUL CHUGHA NEHA WADHVA RAJIV PARWANI PROJECT GUIDE Mrs. ARCHANA SINGHI B.E. ELECTRONICS & TELECOMMUNICATIONS (2010-2011) WATUMULL INSTITUTE OF ELCTRONICS ENGINEERING & COMPUTER TECHNOLOGY.

Ecw Ppt Final Ppt for Presentation

  • Upload
    manoj

  • View
    920

  • Download
    8

Embed Size (px)

Citation preview

Page 1: Ecw Ppt Final Ppt for Presentation

EYE- CONTROLLEDWHEELCHAIR

EYE- CONTROLLEDWHEELCHAIR

PROJECT MEMBERSRINKU LAL GAUTAM

PRAFUL CHUGHANEHA WADHVA RAJIV PARWANI 

 PROJECT GUIDE

Mrs. ARCHANA SINGHI

B.E. ELECTRONICS & TELECOMMUNICATIONS (2010-2011)

WATUMULL INSTITUTE OF ELCTRONICS ENGINEERING & COMPUTER TECHNOLOGY.

Page 2: Ecw Ppt Final Ppt for Presentation

TOPIC SURVEY

1.RAMAN AMPLIFIER

2.MOBILE CONTROLLED ELECTRICAL APPLIANCES

3.CONTROLLED WHEELCHAIR

9/11/2009 EYE CONTROLLED WHEELCHAIR 2

Page 3: Ecw Ppt Final Ppt for Presentation

CONTROLLING WHEELCHAIR

1.JOYSTICK CONTROLLED

2.SENSOR CONTROLLED

3.EYE CONTROLLED

9/11/2009 EYE CONTROLLED WHEELCHAIR 3

Page 4: Ecw Ppt Final Ppt for Presentation

CONTENTS

1. OBJECTIVE.

2. ABSTRACT.

3. INTRODUCTION.

4. VARIOUS EYE TRACKING MECHANISMS.

5. DETAILED BLOCK DIAGRAM.

6. CIRCUITS.

7. SOFTWARE LOGIC.

8. WHEEL MECHANISM.

9. FUTURE SCOPE.

10.REFERENCES.

11.A PIECE OF ADVISE.

9/11/2009 4EYE CONTROLLED WHEELCHAIR

Page 5: Ecw Ppt Final Ppt for Presentation

• Improve quality of handicapped patients’ life.

• Lets patients maneuver with the wheelchair more conveniently and avoid calamities.

• The optical pupil tracking and wheelchair control are

combined to provide mobility to completely paralysed people.

• Two different research domains, namely, the optical pupil tracking and wheelchair control are combined to provide a control device for people with physical disabilities.

• The domain of this project is “Human-Computer Interface (HCI)”.

OBJECTIVE

9/11/2009 5EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 6: Ecw Ppt Final Ppt for Presentation

ABSTRACT

• Describes an eye-control wheelchair, based on “Human-Computer Interface (HCI)”.

• Consists of a standard electric wheelchair with an on-board computer, electric circuits and a graphic user interface run by the computer.

• This control technique could be useful in multiple applications, such as mobility and communication aid for handicapped persons primarily helping patients suffering from quadriplegic and paraplegic diseases.

Page 7: Ecw Ppt Final Ppt for Presentation

INTRODUCTION

• A wheelchair aid’s persons with moderate/severe physical disabilities or chronic diseases.

• Various kinds of interface have been developed for wheelchair control such as joystick control,heart beat and through censors.

• Difficulty in maneuvering .

• Mistakes in maneuvering the wheelchair may bring calamities such as overturn,fall out of the wheelchair,etc.

9/11/2009 7EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 8: Ecw Ppt Final Ppt for Presentation

VARIOUS TYPES OF EYE TRACKING MECHANISMS

There are three systems that can be used to compute the position of pupil .They are as follows:

1.Electro-Oculogram method(EOG)method.

2. Lens System .

3. Head Mounted Camera System.

Page 9: Ecw Ppt Final Ppt for Presentation

EOG METHOD PROCEDURE.

• The electrodes will be attached to the user’s face .

• A total of five electrodes will be used .

• One electrode will be placed to the side of the left eye and another to the side of the right eye.

• One electrode will be placed above the left eye and another below the left eye.

• A fifth electrode will be attached by the ear.

A

C

DE

B

Page 10: Ecw Ppt Final Ppt for Presentation

ADVANTAGES AND DISADVANTAGES OF EOG METHOD.

Electrodes methods:

ADVANTAGES

• Both eyes can be recorded together

• Least expensive

• Simple to use

DRAWBACKS

• It is limited to horizontal and vertical movements

• Poor accuracy for absolute positioning

9/11/2009 10EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 11: Ecw Ppt Final Ppt for Presentation

LENS SYSTEM PROCEDURE

• A non slipping contact lens fits over corneal bulge.

• Tracking is recorded by affixing a magnetic coil or mirror to the lens.

• Mechanism employing lens to detect eye movements is shown in the figure.

Page 12: Ecw Ppt Final Ppt for Presentation

HEAD MOUNTED CAMERA METHOD

PROCEDURE

1.Uses a camera to capture eye images, and tracks pupil motion by means of image processing program.

2. The centre position of the moving pupil is computed at the computer.

3. The calculated result is then transmitted to the powered wheelchair through serial port.

Page 13: Ecw Ppt Final Ppt for Presentation

3. Head Mounted Camera method

ADVANTAGES

• Doesn’t restrict the user’s head movements.

DRAWBACKS

• More awkward to use than the desk-based system as the user has to have instrument mounted to head

9/11/2009 13EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 14: Ecw Ppt Final Ppt for Presentation

TYPES OF DETAILED BLOCK DIAGRAM

There are 2 types of block diagrams for eye controlled wheelchair.

1.WIRELESS.• The wireless version of the wheelchair suits the

scenario where similar wheelchairs operate within a certain region (such as hospitals etc) .

2.WIRED• Works on the similar lines as the one employing

wireless means of communication• It does not involve the encoder—decoder and

the transmitter—receiver modules.

Page 15: Ecw Ppt Final Ppt for Presentation

WIRELESS BLOCK DIAGRAM COMPONENTS

1.COMPUTER.

2.OPTO-ISOLATOR.

3.ENCODER(HT12E).

4.TRANSMITTER MODULE.

5.RECEIVER MODULE TUNED TO 315 MHZ.

6.DECODER.

7.MOTOR DRIVING CIRCUIT.

Page 16: Ecw Ppt Final Ppt for Presentation

EXPLANATION OF COMPONENTS IN DETAIL

1.COMPUTER.• Computer terminal serves the main purpose of

accepting real time video from source (webcam\ stored video) .

• Processes it to generate motor actuation signals.

• Sampling real time video at a considerably higher rate and generate a series of images.

• Processed to determine the eye movements using image processing.

• Corresponding actuation signals are released through the parallel port.

Page 17: Ecw Ppt Final Ppt for Presentation

EXPLANATION OF COMPONENTS IN DETAIL

2.ISOLATOR• Additional stage used for isolation of transmitter circuitry

and computer port. . We use MCT2E opto-isolator.

3.ENCODER.• Main purpose of encoder IC is to synchronize the

movement of receiver . encoder used here is HT12E .

4.TRANSMITTER MODULE.• ASK technique of modulation is used .• Carrier frequency chosen is 315MHz.• RF module is used.• ¼ wave antenna (17 cm) is used to radiate signals.

Page 18: Ecw Ppt Final Ppt for Presentation

EXPLANATION OF COMPONENTS IN DETAIL

5.RECEIVER MODULE.• The receiver, tuned to 315 MHz, is basically an ASK

demodulator .• It gives digital data stream at its output, which is further

decoded.

6.DECODER.• Converts the serial data stream into parallel data. HT12D

decoder IC is used .

7.MOTOR DRIVERS.• Decoded data is used for controlling the operation of the

motors. • Used to switch the motors to move in clockwise or

anticlockwise direction.

Page 19: Ecw Ppt Final Ppt for Presentation

DETAILED BLOCK DIAGRAM

Wireless

9/11/2009 19EYE CONTROLLED WHEELCHAIR

ENCODERENCODER

DECODERDECODER

MOTOR DRIVING CIRCUITMOTOR DRIVING CIRCUIT

OPTO ISOLATOROPTO ISOLATOR

RECEIVER MODULERECEIVER MODULE

TRANSMITTER MODULETRANSMITTER MODULE

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 20: Ecw Ppt Final Ppt for Presentation

9/11/2009 EYE CONTROLLED WHEELCHAIR 20

DETAILED BLOCK DIAGRAM

Wired

MOTOR DRIVING CIRCUITMOTOR DRIVING CIRCUIT

OPTO ISOLATOROPTO ISOLATOR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 21: Ecw Ppt Final Ppt for Presentation

9/11/2009 EYE CONTROLLED WHEELCHAIR 21

CIRCUIT DIAGRAM (MOTOR DRIVE CIRCUIT)

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 22: Ecw Ppt Final Ppt for Presentation

STEP 1: Start

STEP 2: Reset the system’s initial values.

STEP 3: Set the counter value to zero.

STEP 4: Take Real Time Video from Source (Camera or Webcam or stored video).

STEP 5: Convert Real Time Video into frames.

STEP 6: Store the frames in form of matrix.

STEP 7: Prepare the digital negative of the matrix.

STEP 8: Determine the quadrant in which pupil lies.

STEP 9: Is there any change in direction? If YES go to STEP 3, else go to next step.

STEP 10: Increment counter value by 1.

STEP 11: Is counter value greater than threshold value? If NO go to STEP 4, if YES determine the direction of movement.

STEP 12: Generate activation signals for the relay motor driving circuit. Go to STEP 4 and continue.

ALGORITHM

9/11/2009 22EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 23: Ecw Ppt Final Ppt for Presentation

Reset Initial values

Set Counter value to zero

Take Real Time Video from source

Store the frames in form of matrix

Divide the video into frames

Increment Counter value by 1

Generate activation signals

Determine the quadrant

Determine direction

Any change in direction?

Is counter value greater than threshold ?

Start

No

Yes

No

Yes

FLOWCHART

9/11/2009 23EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 24: Ecw Ppt Final Ppt for Presentation

9/11/2009 24EYE CONTROLLED WHEELCHAIR

POSITION: CENTER

Eye Image Negative

OUTOUT OF MATLAB

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 25: Ecw Ppt Final Ppt for Presentation

Wheel Mechanism

FORWARD MOVEMENT

ANTI CLOCKWISE

CLOCKWISE

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 26: Ecw Ppt Final Ppt for Presentation

LEFT MOVEMENT

RIGHT MOVEMENT

ANTI CLOCKWISE

ANTI CLOCKWISE

CLOCKWISE CLOCKWISE

Wheel Mechanism

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 27: Ecw Ppt Final Ppt for Presentation

FUTURE SCOPE

• Faster processing

• Lens controlled

• Brain Controlled

• Multi-Application Auto Mobility System .

• Impact on bollywood.sanjay leela bhansali is making a movie in which he uses a wheel chair controlled by the patients heart beat.

9/11/2009 EYE CONTROLLED WHEELCHAIR 27

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

WHEEL MECHANISM

FUTURE SCOPE

REFERENCES

Page 28: Ecw Ppt Final Ppt for Presentation

REFERENCES

[1] A. Haro, M. Flicker and I. Essa, “Detection and tracking eyes by using their physiological properties, dynamics and appearance,” Proceedings of IEEE CVPR 2002.

[2] P. Smith, M. Shah, N. Lobo, “Monitoring head/eye motion for driver alertness using one camera,” Proceedings of the International Conference on Pattern Recognition, 2000.

[3] C. Morimoto, Eye Tracking, 2003, http://www.ime.usp.br/~hitoshi/framerate/node2.html

[4] Robert J.K. Jacob. "Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces". Human-Computer Interaction Lab. Naval Research Laboratory. Washington, D.C.

[5] Reference Manual, Intel Image Processing Library, Document 663791-005, Intel Corporation, 2000, http://www.cs.nott.ac.uk/~jzg/nottsvision/ipldoc.pdf

[6] www.matlabcentral.com

9/11/2009 28EYE CONTROLLED WHEELCHAIR

OBJECTIVE

INTRODUCTION

PROPOSED SYSTEM

VARIOUS EYE TRACKING MECHANISMS

DETAILED BLOCK DIAGRAM

CIRCUITS

SOFTWARE LOGIC

FUTURE SCOPE

REFERENCES

Page 29: Ecw Ppt Final Ppt for Presentation

A PIECE OF ADVISE TO THE VIEWERS

• Please respect and help people who are disabled

• According to our group they are not disabled but differently abled and far more superior than all of us .

• They are people with a golden and a strong heart.

• This project we have made from our heart and our brain has assisted us.

• This project is close to our heart.

Page 30: Ecw Ppt Final Ppt for Presentation

FAMOUS ACHIEVERS

• STEPHEN HAWKING• Dr. SURESH ADVANI• CHRISTOPHER REEVES• FRANKLIN D. ROOSEVELT

9/11/2009 EYE CONTROLLED WHEELCHAIR 30

Page 31: Ecw Ppt Final Ppt for Presentation

THANK YOU

9/11/2009 EYE CONTROLLED WHEELCHAIR 31