BLUE EYES TECHNOLOGY

OUTLINE• INTRODUCTION• WHAT IS BLUE EYES TECHNOLOGY• THE TERM BLUE EYES• WHY BLUE EYES• SYSTEM OVERVIEW• EMOTIONAL SENSORS• TYPES OF EMOTIONAL SENSORS• ADVANTAGES• DISADVANTAGES• FUTURE APPLICATIONS• CONCLUSION• REFERENCES

INTRODUCTION• Human cognition depends primarily on the

ability to perceive, interpret, and integrate audio-visuals and sensoring information.

• The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings.

• The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.

WHAT is Blue Eyes Technology?

• Aims at creating computational machines that have sensory abilities like those of human beings.

• Use camera and microphone to identify user actions and emotions.

The term Blue Eyes

• BLUE : in the term stands for Bluetooth, which enables reliable wireless communication.

• EYES : because the eye movement enables us to obtain a lot of interesting and important information.

• Bluetooth device + Eyes tracking Device

WHY Blue Eyes?

• To avoid and reduce Human limitation such as:– Tiredness – Oversight– Mental illness, etc…– Monitoring of conscious brain involvement

(automation, long driving)• To built a machine that can understand your

emotions• Verify your identity, feels your presence and

interact with you.

System Overview• Blue eyes system monitors the status of the

operator’s visual attention through measurement of saccadic activity.

• The system checks parameters like heart beat rate and blood oxygenation against abnormal and triggers user defined alarms.

• BlueEyes system consists of – Mobile measuring device (DAU)– Central System Unit (CSU)

Data Acquisition Unit

Features :– Lightweight– Runs on

batteries - low power consumption

– Easy to use– ID cards for

operator authorization

Atmel 89C52microcontroller

JazzMulti sensor

Bluetooth

Bluetooth ModuleMicro Controller

Multi Sensors

Central System Unit• Components :

– CONNECTION MANAGER – main task to perform low-level bluetooth communication

– DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition

– DATA LOGGER MODULE – provides support for storing the monitored data.

– VISUALIZATION MODULE – provides user interface for the supervisors

Central System Unit• Features :

– Maintains Bluetooth connections

– Data processing– Records conclusion for

further exploration– Provides visualization

interface

Data Analysis

VisualizationModule

Bluetooth ConnectionManager

DataLogger

Emotional Sensors• Simplest way

• People spend approximately 1/3 of their total computer time touching input device.

• Physiological data is obtained and emotional state is determined.

• A user model will built the reflection of the personality of user.

Types of Emotion Sensors

• For Hand:1)Emotion Mouse2)Sentic Mouse

• For Eyes:1)Expression Glasses2)Magic Pointing3)Eye Tracking

• For Voice:1)Artifical Intelligence Speech Recognition

For Hand:1)Emotion Mouse

2)Sentic Mouse

1. Emotion Mouse• Emotion mouse sense

the mood by analyzing pressure , temperature and heart beat of the user.

• Analyzing these parameters six types of mood can be sensed by computer.

EMOTION MOUSE

Samples obtained by Emotion Mouse

2. Sentic Mouse• It is a modified

computer mouse.

• Includes a directional pressure sensor foraiding in recognition of emotional valence (liking / attraction vs. disliking / avoidance ) .

For eye:

1)Expression Glasses

2)Magic Pointing

3)Eye Tracking

1. Expression Glassess

• A wearable device which allows any viewer to visualize the confusion and interest levels of the wearer.

Expression Glassess

2. MAGIC• MANUAL AND GAZE

INPUT CASCADED (MAGIC) POINTING is the technique of tracking eye movement of the user and perform the desired operation.

• Webcam is used to quickly determine the glints and pupils of the user under variable and realistic lightning conditions.

• Reduce the cursor movement needed for target selection.

MAGIC POINTINGTwo magic pointing techniques

- Liberal- Conservative

• LIBERAL APPROACH

To warp the cursor to every new object user looks at

• CONSERVATIVE APPROACH

Does not warp the cursor target until the manual input device has been actuated

3. Eye Tracking• A camera is focus on one or both eyes and record

their movement as the viewer looks at some kind of stimulus.

• Image of pupil of user’s eye is tracked using an infrared light source .

• Eye trackers use the center of the pupil and infrared collimated light to create corneal reflection.

EYE TRACKING• The vector between the pupil center and the

corneal reflection can be used to compute the point of regard on surface or gaze direction.

For Voice:ARTIFICIAL INTELLIGIENT

SPEECH RECOGNITION

ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION

• Input words are scanned and matched against internally stored words.

• Identification causes some action to be

taken ,User speaks to the computer through microphone.

• Filtered and then stored in RAM

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION

APPLICATIONS

• To control weapons by voice commands.

• Pilot give commands to computers by speaking into microphones.

• Can be connected to word processors and instead of writing, simply dictate to them.

Advantages• Physiological condition monitoring

• Reduces manual work

• Increases efficiency

• Minimization of ecological consequences

• financial loss a threat to a human life

Disadvantages

• Not 100% accurate.

• System is bulky, needs minimization.

• Expensive

Future Applications• In retailing record and interpret customer movements • In automobile industry• In video games • Military• Power station• Flight control centres• Ovens and refrigerators

CONCLUSION

• Provide more delicate and user friendly facilities in computing devices

• Gap between the electronic and physical world is reduced

• The computers can be run using implicit commands instead of the explicit commands

REFERENCES• www.seminar4u.com/blue_eyes_technology

(refered on 1-9-15)• www.authorstream.com/presentation/divya-moha

n-blue-eyes-technology/ (refered on 1-9-15)

• www.wikipedia.com/blue_eyes_technology (refered on 11-9-15)

• www.slideshare.net/colloquium/blue-eye-technology-2333478 (refered on 13-9-15)

ANY Queries ??

THANK YOU