SIXTH SENSE TECHNOLOGY

ByJYOTHI

(1210312406)

Out lineIntroductionComponentsTechnology behind sixth senseHow it works?ApplicationsCostAdvantages & LimitationsConclusion and future

Introduction

“Sixth Sense is a wearable gestural interface device that augments the physical world with digital information and lets people use natural hand gestures to interact with that information”.

ComponentsA pocket projectorA mirrorA cameraMobile componentColored markers

Technology behind sixth sense

Hardware setupSoftware setupEvents and gesturesSystem architecture

Hardware setup

MOBILE:Nokia n95 smart phone is used.It has multitasking capability.Built in camera provides execution of bothGesture tracking engine.Gesture enabled applications.

PROJECTOR: Pocket projector pk101 from optima is used.It augments near by surfaces.It is a LED based projector.Suitable for mobile usage.

Software setup

Applications are implemented using JAVA 2 MICRO edition.Computer vision library is written in symbian c++.The software for sixth sense technology prototype is developed on a Microsoft Windows platform using WPF and open CV.

Events and gestures

Colored markers .Zoom in or out .Index fingers used as a pen.Free hand gestures(postures).

ImagesPicturegestures

Info on surface

captureSend for processing

Send info Project image

Reflect on desired surface

How does it works??

ApplicationsClick images

Portable mobile:You hold up your left hand ,fingers pointing to right .The system recognizes that you want to make a call , and projects a dialing pad onto your fingers. You tape the virtual keypad with your right hand to dial the call.

Rate the books

Video annotations on newspaper

Browsing net

Real time clock

Costs The current prototype costs approximately $350 to build , mainly due to the micro projector. The software may be available for free on the model of open and editable freeware.

Portable.Inexpensive.Multi-sensory.It is a open source.Data access directly from machine in real time.

Advantages

Limitations

Hardware limitations of the devices, that we currently carry around with us.For example many phones will not allow the external camera feed to be manipulated in real time. Post processing can occur however.

Future of sixth sense technology

Interactive Advertisements. 3d visualizations. Solar batteries via small solar panel. Camera can act as a third eye for the blind person .

“According to researchers ,after 10 years we will be here with the ultimate sixth sense brain implant”

“Imagination is the only limit for technologies like this one. It augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information .It will change the way we interact with people not only with physical world”

conclusion

Any queries??