1st pre. (2)

8/7/2019 1st pre. (2)

1/26

Sixth Sense Technologyand its use in normal day to day

life

VYAS BHARGAVBHARGAV

5th semesterComputer engineering

8/7/2019 1st pre. (2)

2/26

History

over millions of years to sense the world around us ,

and to perceive information we use our five natural senses

which includes eye, ear, nose, tongue, mind.

But arguably the most useful information that

can help us make the right decision is not naturallyperceivable with our five senses, namely the data,

information and knowledge that mankind has to rely

everything on online.

8/7/2019 1st pre. (2)

3/26

The minimization of computing device allows

us to carry pockets computer always connected to

digital world.

But it doesnt provide any physical link or any

interaction to digital world.

Massachusetts Institute Technology(MIT)has

developed a group, which includes seven graduatestudents, were thinking about how a person could be

more integrated into the world around them and access

information without having to do something like take

out a phone.

8/7/2019 1st pre. (2)

4/26

Introduction

Sixth Sense bridges this gap, bringing intangible,

digital information out into the tangible world, and

allowing us to interact with this information via naturalhand gestures.

Our ordinary computers will soon be able to sense

the different feelings accumulated in the surroundings

and it is all a gift of the Sixth Sense Technology newly

introduced.

8/7/2019 1st pre. (2)

5/26

Sixth Sense is a wearable gestural interface that

augments the physical world around us with digitalinformation. .

It allows us to use natural hand gestures to interact

with that information.

The digital world is shifted to physical world.

8/7/2019 1st pre. (2)

6/26

Mastermind of the

technology Pranav Mistry, 28 year old, of Indian origin is the

mastermind behind the sixth sense technology.

He is a PhD student at MIT and he won the

Invention of the Year 2009 - by PopularScience.

Currently working with one of the Mit professor to

implement the technology in normal human life.

8/7/2019 1st pre. (2)

7/26

Construction

The prototype was built from an ordinarywebcam and a battery-powered projector, with an

attached mirror all connected to an internet-

enabled mobile phone.

The setup allows the user to project informationfrom the phone onto any surface walls, the body of

another person or even your hand.

Mistry wore the device on a lanyard around hisneck, and colored Magic Marker caps on four fingers

(red, blue, green and yellow) helped the camera

distinguish the four fingers and recognize his hand

gestures. .

8/7/2019 1st pre. (2)

8/26

Components

camera

projector

Mirror

Mobile component

Colour markers

8/7/2019 1st pre. (2)

9/26

8/7/2019 1st pre. (2)

10/26

Camera

Captures an object in view and

tracks the users hand gestures usingcomputer-vision based techniques.

It acts as a digital eye, connecting you tothe world of digital information.

8/7/2019 1st pre. (2)

11/26

Projector

The projector projects visual information enabling

surfaces and physical objects to be used as interfaces.

The project itself contains a battery inside, with

3hours of battery life.

A tiny LED projector displays data sent from the

smart phone on any surface in viewobject, wall, or

person.

8/7/2019 1st pre. (2)

12/26

Mirror & Smart-phone

The usage of the mirror is significant as the

projector dangles pointing downwards from the neck.

A Web-enabled smart phone in the users pocket

processes the video data

Other software searches the Web and interprets the

Hand-Gestures.

8/7/2019 1st pre. (2)

13/26

ColourMarkers

It is at the tip of the users fingers .

Marking the users fingers with red, yellow, green,and blue tape helps the webcam recognize gestures.

The movements and arrangements of these makersare interpreted into gestures that act as interaction

instructions for the projected application interfaces.

8/7/2019 1st pre. (2)

14/26

Working

It has a camera, a mirror and a projector and is

connected wirelessly to a bluetooth smart phone that

can slip comfortably into ones pocket.

The camera recognizes individuals, images,

pictures, gestures one makes with their hands

Information is sent to the Smartphone for processing.

The downward-facing projector projects the

output image on to the mirror

Mirror reflects image on to the desired surface.

8/7/2019 1st pre. (2)

15/26

8/7/2019 1st pre. (2)

16/26

Gestures

Gesture recognition is a topic in computer

science and language technology with the goal of

interpreting human gestures via mathematical

algorithms.

Gestures can originate from any bodily

motion or state but commonly originate from the

face or hand.

Current focuses in the field include emotion

recognition from the face and hand gesture recognition.

\Many approaches have been made using cameras and

computer vision algorithms to interpret sign language.

8/7/2019 1st pre. (2)

17/26

8/7/2019 1st pre. (2)

18/26

Applications in normal life

Make a call You can use the Sixth Sense toproject a keypad onto your hand,

then use that virtual keypad to

make a call. Calling a number also

will not be a great task with the

introduction of Sixth Sense

Technology.

No mobile device will be required, just type in the number

with your palm acting as the virtual keypad. The keys will come

up on the fingers. The fingers of the other hand will then be used

to key in the number and call.

8/7/2019 1st pre. (2)

19/26

Call up a map

The sixth sense also implements map whichlets the user display the map on any physical

surface and find his destination and he can use

his thumbs and index fingers to navigate the map,

for example, to zoom in and out and do other

controls.

Check the time

Sixth Sense all we have to do is draw a

circle on our wrist with our index finger to geta virtual watch that gives us the correct time.

The computer tracks the red marker cap or

piece of tape, recognizes the gesture, and

instructs the projector to flash the image of a

watch onto his wrist.

8/7/2019 1st pre. (2)

20/26

Video in Newspaper

The SixthSense system also augments physical objects the user is interacting

with by projecting more information about these objects projected on them. For

example, a newspaper can show live video news or dynamic information can be

provided on a regular piece of paper. Thus a piece of paper turns into a video

display.

Zoom in andZoom out

The user can zoom in or zoom

out using their hand movements.

8/7/2019 1st pre. (2)

21/26

We can get information aboutflight status whether its delayed or

cancelled.

We can rate the books and can

know information about author and

stories.

8/7/2019 1st pre. (2)

22/26

Advantages

Portable

Inexpensive

Multi-sensory

Any time accessibility

8/7/2019 1st pre. (2)

23/26

Disadvantages

Every mobile doesnt support external camera

feed in real time o.s.

Hardware is to be carried out everywhere.

Battery life is of just 3hrs.

Live video streaming cannot be done.

8/7/2019 1st pre. (2)

24/26

8/7/2019 1st pre. (2)

25/26

Referances

http://www.pranavmistry.com/projects/sixthsense/

http://en.wikipedia.org/wiki/SixthSense

http://theviewspaper.net/sixth-sense-technology-will-revolutionize-the-

world/

http://mobilebeyond.net/sixt-sense-technology-mobile-augmented-

reality/#axzz13aPzCIqq

http://gizmodo.com/5167790/sixth-sense-technology-may-change-how-

we-look-at-the-world-forever

8/7/2019 1st pre. (2)

26/26

Any Queries ?????

Documents

1st pre. (2)