IEEE paper on image processing based on the title Blue Eyes Technology

8/13/2019 IEEE paper on image processing based on the title Blue Eyes Technology

1/12

BLUE EYE TECHNOLOGY

PRESENTED BY:

M.SARANYAA

P.PRIYANKAMUTHAYAMMAL ENGINEERING COLLEGE

RASIPURAM

EMAIL ID:

Ponpriyanka1!"#ai$.%o#


2/12

ABSTRACT:

Is it possible to create a

computer which can interact with us as

we interact each other? For example

imagine in a fine morning you walk on

to your computer room and switch on

your computer, and then it tells you

Hey friend, good morning you seem

to be a bad mood today. And then it

opens your mailbox and shows you

some of the mails and tries to cheer

you. It seems to be a fiction, but it will

be the life lead by !"# #$#%& in

the 'ery near future. (he basic idea

behind this technology is to gi'e the

computer the human power. )e all

ha'e some perceptual abilities. (hat is

we can understand each others

feelings. For example we can

understand ones emotional state by

analy*ing his facial expression. If we

add these perceptual abilities of human

to computers would enable computersto work together with human beings as

intimate partners. (he !"# #$#%&

technology aims at creating

computational machines that ha'e

perceptual and sensory ability like

those of human beings.

lue #yes uses sensing

technology to identify a user+s actions

and to extract key information. (his

information is then analy*ed to

determine the user+s physical,

emotional, or informational state,

which in turn can be used to help make

the user more producti'e by

performing expected actions or by

pro'iding expected information. For

example, in future a lue #yesenabled

tele'ision could become acti'e when

the user makes eye contact, at which

point the user could then tell the

tele'ision to -turn on-. (his paper is

about the benefits and interconnection

of 'arious parts in'ol'ed in the blue

eye& technology.


3/12

.

INTRODUCTION:

!"# #$#% is a technology,

which aims at creating computational

machines that ha'e perceptual and

sensory abilities like those of human

beings. (he basic idea behind this

technology is to gi'e computer human

power. For example, we can

understand humans emotional state by

his facial expressions. If we add these

perceptual abilities to computers, we

would enable them to work together

with human beings as intimate

partners.

It pro'ides technical means for

monitoring and recording human

operators physiological condition.

It has the ability to gather information

about you and interact with you

through special techni/ues like facial

recognition, speech recognition, etc.Human cognition depends primarily on

the ability to percei'e, interpret, and

integrate audio'isuals and sensoring

information. Adding extraordinary

perceptual abilities to computers would

enable computers to work together

with human beings as intimate

partners. 0esearchers are attempting to

add more capabilities to computers that

will allow them to interact like

humans, recogni*e human presents,

talk, listen, or e'en guess their

feelings.

EMOTION&COMPUTING:

#motions are important to the

computing community. A nonin'asi'e

way to obtain information about a user

is through touch. 1eople use theircomputers to obtain, store and

manipulate data. (he proposed method

for obtaining user information through

touch is 'ia a computer input de'ice,

the mouse. (he computer determines

the user+s emotional state by a simple

touch. %ensors in the mouse sense

physiological attributes, which are

correlated to emotions using a

correlation model.

2ouse is embedded with

sensors that can sense the

physiological attributes like

(emperature

ody 1ressure


4/12

1ulse 0ate

(ouching %tyle etc.

(he computer determines the users

emotional states from these inputs.

0osalind 1icard 345567

describes why emotions are important

to the computing community. (here

are two aspects of affecti'e computing8

gi'ing the computer the ability to

detect emotions and gi'ing the

computer the ability to express

emotions. 9ot only are emotions

crucial for rational decision making as

1icard describes, but emotion detection

is an important step to an adapti'e

computer system. An adapti'e, smart

computer system has been dri'ing our

efforts to detect a persons emotional

state. y matching a persons

emotional state and the context of the

expressed emotion, o'er a period of

time the persons personality is being

exhibited. (herefore, by gi'ing the

computer a longitudinal understanding

of the emotional state of its user, the

computer could adapt a working style

which fits with its users personality.

(he result of this collaboration could

increase producti'ity for the user. :ne

way of gaining information from a user

nonintrusi'ely is by 'ideo. ;ameras

ha'e been used to detect a persons

emotional state 3


5/12

blood pressure. He then recorded the

measurements as the participants were

instructed to mimic facial expressions

which corresponded to the six basic

emotions. He defined the six basic

emotions as anger, fear, sadness,

disgust, @oy and surprise.

%ix participants were trained to exhibit

the facial expressions of the six basic

emotions. )hile each participant

exhibited these expressions, the

physiological changes associated with

affect were assessed. (he measures

taken were %0, heart rate, skin

temperature and general somatic

acti'ity 3%A7. (hese data were then

sub@ect to two analyses. For the first

analysis, a multidimensional scaling

32%7 procedure was used to

determine the dimensionality of the

data. (his analysis suggested that the

physiological similarities and

dissimilarities of the six emotional

states fit within a four dimensional

model. For the second analysis, a

discriminant function analysis wasused to determine the mathematic

functions that would distinguish the six

emotional states. (his analysis

suggested that all four physiological

'ariables made significant,

nonredundant contributions to the

functions that distinguish the six states.

2oreo'er, these analyses indicate that

these four physiological measures are

sufficient to determine reliably a

persons specific emotional state.

ecause of our need to incorporate

these measurements into a small, non

intrusi'e form, we will explore taking

these measurements from the hand.

(he amount of conducti'ity of the skin

is best taken from the fingers.

Howe'er, the other measures may not

be as ob'ious or robust. )e

hypothesi*e that changes in the

temperature of the finger are reliable

for prediction of emotion. )e also

hypothesi*e the %A can be measured

by change in mo'ement in the

computer mouse.

MANUAL AND GA*E INPUT

CASCADED:

A techni/ue in whichpointing and selection were aided by

ga*e tracking is designed. (he idea is

to use ga*e to dynamically redefine

3warp7 the position of the pointing

cursor to be at the 'icinity of the target.:nce it has been redefined, the user

would need to make a small mo'ement

to and click on the target, that is,

achie'e 2anual Ac/uisition with a*e

Initiated ;ursor 32AI;7 pointing.

(he beauty of 2AI; is that

it enables the hand and the eye to do

what each does best. (he I2+s


6/12

approach takes ad'antage of the eye to

reduce the effort re/uired for manual

pointing. (o the user, pointing is still

done by the natural organ for

manipulation, the hand. ut the cursor

always appears in about at the right

place needed, as if by magic. y

combining eye tracking and input

technology, you get 2AI; 1ointing.

(wo specific 2AI; pointing

techni/ues are designed8

Li+,ra$ )arps the cursor to e'ery

new ob@ect the user looks at. ;ursor

waits readily in the target area. (he

user mo'es the cursor once he decides

to ac/uire the target he is looking at.

Con-,ra/i, oes not wrap a cursor

to a target until the manual input

de'ice has been actuated. :nce it is

actuated, the cursor is warped to the

ga*e area. (he user would the steer the

cursor manually towards the target to

complete target ac/uisition.

THE TECHNOLOGY:

Artificial intelligence 3AI7 in'ol'es

two basic ideas. First, it in'ol'es

studying the thought processes of

human beings. %econd, it deals with

representing those processes 'ia

machines 3like computers, robots, etc7.

AI is beha'ior of a machine, which, if

performed by a human being, would be

called intelligent. It makes machines

smarter and more useful, and is less


7/12

expensi'e than natural intelligence.

9atural language processing 39!17

refers to artificial intelligence methods

of communicating with a computer in a

natural language like #nglish. (he

main ob@ecti'e of a 9!1 program is to

understand input and initiate action.

(he input words are scanned and

matched against internally stored

known words. Identification of a key

word causes some action to be taken.

In this way, one can communicate with

the computer in ones language. 9o

special commands or computer

language are re/uired. (here is no need

to enter programs in special language

forcreatingsoftware.

SPEECH&RECOGNITION:

(he user speaks to the

computer through a microphone,

which, in usedB a simple system may

contain a minimum of three filters. (he

more the number of filters used, the

higher the probability of accurate

recognition. 1resently, switched

capacitor digital filters are used

because these can be custombuilt in

integrated circuit form. (hese are

smaller and cheaper than acti'e filters

using operational amplifiers. (he filter

output is then fed to the A; to

translate the analogue signal into

digital word. (he A; samples the

filter outputs many times a second.

#ach sample represents different

amplitude of the signal .#'enly spaced

'ertical lines represent the amplitude

of the audio filter output at the instant

of sampling. #ach 'alue is then

con'erted to a binary number

proportional to the amplitude of the

sample. A central processor unit 3;1"7

controls the input circuits that are fed

by the A;%. A large 0A2 3random

access memory7 stores all the digital

'alues in a buffer area. (his digitalinformation, representing the spoken

word, is now accessed by the ;1" to

process it further. (he normal speech

has a fre/uency range of CDD H* to 6

kH*. 0ecogni*ing a telephone call is

more difficult as it has bandwidth

limitation of >DD H* to>.> kH*. As

explained earlier, the spoken words are


8/12

processed by the filters and A;s. (he

binary representation of each of these

words becomes a template or standard,

against which the future words are

compared. (hese templates are stored

in the memory. :nce the storing

process is completed, the system can

go into its acti'e mode and is capable

of identifying spoken words. As each

word is spoken, it is con'erted into

binary e/ui'alent and stored in 0A2.

(he computer then starts searching and

compares the binary input pattern with

the templates. t is to be noted that e'en

if the same speaker talks the same text,

there are always slight 'ariations in

amplitude or loudness of the signal,

pitch, fre/uency difference, time gap,

etc. ue to this reason, there is ne'er a

perfect match between the template

and binary input word.

(he 'alues of binary input words are

subtracted from the corresponding

'alues in the templates. If both the

'alues are same, the difference is *ero

and there is perfect match. If not, thesubtraction produces some difference

or error. (he smaller the error, the

better the match. )hen the best match

occurs, the word is identified and

displayed on the screen or used in

some other manner. (he search process

takes a considerable amount of time, as

the ;1" has to make many

comparisons before recognition occurs.

(his necessitates use of 'ery high

speed processors. A large 0A2 is also

re/uired as e'en though a spoken word

may last only a few hundred

milliseconds, but the same is translated

into many thousands of digital words.

It is important to note that alignment of

words and templates are to be matched

correctly in time, before computing the

similarity score. (his process, termed

as dynamic time warping, recogni*es

that different speakers pronounce the

same words at different speeds as well

as elongate different parts of the same

word.

SIMPLE USER INTEREST

TRACKER

(he %imple "ser Interest

(racker or the %"I(:0 finds out the

areas of interest of the user and

pro'ides more information on these

areas, which the user may access

con'eniently. (he %"I(:0 monitors

the user and keeps track of whatdocument the user is reading and to

which area in the document the ga*e is

fixed. It then identifies the area and

searches the entire computer for

materials related to what the user is

reading. )hen the user finishes

reading the document he can find the


9/12

additional information on his desktop,

which he can access at his will.

SYSTEM&O0ER0IE:

!"##$#% system pro'ides

technical means for monitoring and

recording the operators basic

physiological parameters. (he most

important parameter is saccadic

acti'ity4, which enables the system to

monitor the status of the operators

'isual attention along with head

acceleration, which accompanies large

displacement of the 'isual axis

3saccades larger than 4E degrees7.

;omplex industrial en'ironment can

create a danger of exposing the

operator to toxic substances, which can

affect his cardiac, circulatory and

pulmonary systems. (hus, on the

grounds of lethysmographic signal

taken from the forehead skin surface,

the system computes heart beat rate

and blood oxygenation. (he

!"##$#% system checks abo'eparameters against abnormal or

undesirable 'alues and triggers user

defined alarms when necessary. uite

often in an emergency situation

operators speak to themsel'es

expressing their surprise or stating

'erbally the problem. (herefore, theoperators 'oice, physiological

parameters and an o'erall 'iew of the

operating room are recorded. (his

helps to reconstruct the course of

operators work and pro'ides data for

longterm analysis. (his system

consists of a mobile measuring de'ice

and a central analytical system. (he

mobile de'ice is integrated with

luetooth module pro'iding wireless

interface between sensors worn by the

operator and the central unit.

TOOLS&DE0ELOPED:

In creating the hardware part

of the A" we built a de'elopment

board, which enabled us to mount,

connect and test 'arious peripheral

de'ices cooperating with the

microcontroller. uring the

implementation of the A" we needed

a piece of software to establish and test

luetooth connections. )e therefore

created a tool called lue entist. (he

tool pro'ides support for controlling

the currently connected luetooth

de'ice. Its functions are8 local de'icemanagementGconnection

management. (o test the possibilities

and performance of the remaining parts

of the 1ro@ect it 3computer, camera

and database software7 we created

lue;apture (he tool supports

capturing 'ideo data from 'arious

sources 3"% webcam, industrial


10/12

camera7 and storing the data in the 2%

%! %er'er database. Additionally, the

application performs sound recording.

After filtering and remo'ing

insignificant fragments 3i.e. silence7

the audio data is stored in the database.

Finally, the program plays the recorded

audio'isual stream. )e used the

software to measure database system

performance and to optimi*e some of

the %! /ueries 3e.g. we replaced

correlated %! /ueries with cursor

operations7. %ince all the components

of the application ha'e been tested

thoroughly they were reused in the

final software, which additionally

reduced testing time. )e also created a

simple tool for recording . )e could see its use in 'ideogames where, it could gi'e indi'idual

challenges to customers playing 'ideo

games. (ypically targeting commercial

business. (he integration of children+s

toys, technologies and computers is

enabling new play experiences that

were not commercially feasible until

recently. (he Intel 1lay >


11/12

;omputer 2icroscope, the 2eC;am

with Fun Fair, and the ;omputer

%ound 2orpher are commercially

a'ailable smart toy products de'eloped

by the Intel %mart (oy !ab in. :ne

theme that is common across these 1;

connected toys is that users interact

with them using a combination of

'isual, audible and tactile input G

output modalities.

J. (he familiar and useful come

from things we recogni*e. 2any of our

fa'orite things+ appearance

communicate their useB they show the

change in their 'alue though patina. As

technologists we are now poised to

imagine a world where computing

ob@ects communicate with us insituB

where we are. )e use our looks,

feelings, and actions to gi'e the

computer the experience it needs to

work with us. eyboards and mice will

not continue to dominate computer

user interfaces. eyboard input will be

replaced in large measure by systems

that know what we want and re/uireless explicit communication. %ensors

are gaining fidelity and ubi/uity to

record presence and actionsB sensors

will notice when we enter a space, sit

down, lie down, pump, iron, etc.

E. ;urrent interfaces between

computers and humans can present

information 'i'idly, but ha'e no sense

of whether that information is e'er

'iewed or understood. In contrast, new

realtime computer 'ision techni/ues

for percei'ing people allows us to

create -Faceresponsi'e isplays- and

-1ercepti'e #n'ironments-, which can

sense and respond to users that

'iewing them. "sing stereo'ision

techni/ues, we are able to detect, track,

and identify users robustly and in real

time. (his information can make

spoken language interface more robust,

by selecting the acoustic information

from a 'isuallylocali*ed source.

#n'ironments can become aware of

how many people are present.

CONCLUSION:!"# #$#% emphasi*es

the foundations of the pro@ect

luetooth technology and the

mo'ements of the eyes. luetooth

pro'ides reliable wireless

communication whereas the eye

mo'ements enable us to obtain

information. (he !"# #$#%technology ensures a con'enient way

of simplifying the life by pro'iding

more delicate and userfriendly

facilities in computing de'ices. 9ot

only computational de'ices, in future,

ordinary household de'ices such as

tele'ision, refrigerators, and o'ens

will do their @obs when we look at


12/12

them and speak to them. (he day is not

far away that this technology will push

its way into our household, making us

more comfortable.

(he sprit of science says 2, 3a,

%on/in4,5 /o 5i-%o,r an5 ,6p$or,7.

(his process will ne'er end.

Documents

IEEE paper on image processing based on the title Blue Eyes Technology