People express their mental states, including emotions, thoughts, and desires, all the timethrough facial expressions, vocal nuances and gestures. This is true even when they areinteracting with machines. Our mental states shape the decisions that we make, governhow we communicate with others, and affect our performance. The ability to attributemental states to others from their behavior and to use that knowledge to guide our ownactions and predict those of others is known as theory of mind or mind-reading.Existing human-computer interfaces are mind-blind — oblivious to the user’s mentalstates and intentions. A computer may wait indefinitely for input from a user who is nolonger there, or decide to do irrelevant tasks while a user is frantically working towardsan imminent deadline. As a result, existing computer technologies often frustrate the user, have little persuasivepower and cannot initiate interactions with the user. Even if they do take the initiative, like the now retiredMicrosoft Paperclip, they are often misguided and irrelevant, and simply frustrate the user. With the increasingcomplexity of computer technologies and the ubiquity of mobile and wearable devices, there is a need for machinesthat are aware of the user’s mental state and that adaptively respond to these mental states.Ø What is mind reading?A computational model of mind-readingDrawing inspiration from psychology, computer vision and machine learning, the team in the ComputerLaboratory at the University of Cambridge has developed mind-reading machines — computers that implement acomputational model of mind-reading to infer mental states of people from their facial signals. The goal is toenhance human-computer interaction through empathic responses, to improve the productivity of the user and toenable applications to initiate interactions with and on behalf of the user, without waiting for explicit input fromthat user. There are difficult challenges:Using a digital video camera, the mind-reading computer system analyzes a person’s facial expressions in real timeand infers that person’s underlying mental state, such as whether he or she is agreeing or disagreeing, interested orbored, thinking or confused.Prior knowledge of how particular mental states are expressed in the face is combined with analysis of facialexpressions and head gestures occurring in real time. The model represents these at different granularities, startingwith face and head movements and building those in time and in space to form a clearer model of what mentalstate is being represented. Software from Nevenvision identifies 24 feature points on the face and tracks them inreal time. Movement, shape and colour are then analyzed to identify gestures like a smile or eyebrows being raised.Combinations of these occurring over time indicate mental states. For example, a combination of a head nod, witha smile and eyebrows raised might mean interest. The relationship between observable head and facial displays andthe corresponding hidden mental states over time is modeled using Dynamic Bayesian Networks.Ø Why mind reading?The mind-reading computer system presents information about your mental state as easily as a keyboard andmouse present text and commands. Imagine a future where we are surrounded with mobile phones, cars andonline services that can read our minds and react to our moods. How would that change our use of technology andour lives? We are working with a major car manufacturer to implement this system in cars to detect driver mentalstates such as drowsiness, distraction and anger.Current projects in Cambridge are considering further inputs such as body posture and gestures to improve theinference. We can then use the same models to control the animation of cartoon avatars. We are also looking at theuse of mind-reading to support on-line shopping and learning systems.The mind-reading computer system ma
Citation preview
MIND -READING COMPUTER By BHAWESH KUMAR M.TECH(CSE),1st
Semester,ROLL NO- 001210502032
*
CONTENT1.Introduction.2.What is Mind-Reading Machine?3.Why mind
reading?4.How does it work?5.Advantages and
uses6.Disadvantages7.Conclusion8. References
*
1. Introduction Problems with existing computer. a. Receive
input from slow tools. b. Require explicit input. c. Mind-Blind
Theory of Mind-Reading The ability to attribute mental states to
others from their behaviour and to use that knowledge to guide our
own actions and predict those of others .
. Need of Mind-Reading machine *
2. What is Mind-Reading Machine?*Machines that represent
computational model of mind-reading to infer mental states of
people from their facial signals. Developed by a team of cambridge
university, taking inspiration from Psychology, Computer vision and
Machine Learning.Prior knowledge of how particular mental states
are expressed through face in real time is required. Software from
Nevenvision identifies 24 feature points on the face and tracks
them in real time. Movement, Shape and Colour are then analyzed to
identify gestures like smile etc.
*
3. Why mind reading?Input to computer with incredible speedTo
support on-line shopping and learning systems. To control the
animation of cartoon avatars.To detect driver mental states such as
drowsiness, distraction and anger.To monitor and Suggests
improvement in human-human Interaction.
*
4. How does it work?Electroencephalograph(EEG) a device used by
medical researchers to pick up electrical currents from various
parts of the brain.Functional near-infrared spectroscopy (fNIRS)
Technology which measures the volume and oxygen level of the blood
around the subject's brain. Futuristic headband that sends light
into the tissues of the head where it is absorbed by active,
blood-filled tissues. then it measures how much light was not
absorbed. *
4. How does it work?Wearing the fNIRS sensor , experimental
subjects were asked to count the no. of squares on a rotating
onscreen cube . The subjects were then asked to rate the difficulty
of the tasks, 83% time it is matched with fNIRS system.NASA has
developed a computer program which can read silently spoken words
by analyzing nerve signals in our mouth and throats . Just the
slightest movement in the Voice box and tounge is enough to
work.Initially scientists trained the software program to recognize
six words-including go , left , right and 10 numbers. Participants
hooked up to the sensors silently , said the words to themselves
and the software correctly picked up the signals 92% of the
time.*
*
5. Advantages and uses Mind controlled wheelchair developed by
university of electrocommunications in Japan to feel you like half
professor X and half Stephen Hawking except with the theoretical
physics skills of the former and the telekinetic skills of the
latter.The result of this is that you can move the wheelchair
solely with the power of your mind. Dumb people can talk.The
sensors have been tested to do simple web searches and may help
space-walking astronauts in future.The system can send commands to
rovers on other planets.
*
5. Advantages and uses contd.Help injured astronauts to control
machines, or aid disabled people.For screening suspected terrorists
as well as for predicting future dangerousness more generally. We
are closer than ever to the crime-prediction technology .The pilot
of a high-speed plane or spacecraft, for instance, can order some
vital flight information by thought only . No need to search the
right dials or switches on crowed instrument panel.
*
6. Disadvantages and problems FMRI results have to account for
heart rate, respiration , motion and a number of other factors that
may cause variance in the signal.Individual brains differ, so
scientists need to study a subject's patterns before they can train
a computer to identify those patterns or make prediction.Tapping
Brains for Future Crimes we cannot reliably predict human behavior-
so, we risk criminalizing the innocent.Question upon the
fundamental principles of our criminal justice system.
*
6. Disadvantages and problems contd. We aren't particularly good
at rehabilitationOur society is not ready The initial tests may
have been successful because of the short lengths of the words .
The initial success doesn't mean it will scale up. It is necessary
to repeat the tests on many different people and check whether
sensor is working on everyone or not.Small vocabulary, Isolated
word recognition is a quite different problem than conversational
speech, not just in scale but in kind also. *
7. Conclusion * If 3 year project of Tufts university becomes
successful, then we can allow computers to respond to the brain
activity of the user.These computers can perform telephaty , by
translating brain activity into words. If it will be known that
which air traffic controllers were overloaded , the next incoming
plane would be assigned to another controller. Hence if we get 100%
accuracy these computers may find various applications in many
fields, specially in electronics where we have very less time to
react.
