Google Project Soli

CHAPTER 1INTRUDCTION

Project Soli is a new technology that uses radar to enable new types of touch less interactions. This technology considers the design of a human gesture recognition system based on pattern recognition of signatures from a portable smart radar sensor.

The movements of gestures from a human can be captured using a radar sensor, and by detection of theses gestures, some special task on a device can be done. The project is under research by Google ATAP, and it is termed as Project Soli.

Project soli technology a Radar sensor along with a capturing system is made into a small chip and this chip can be connected to any device like Computer, Smartphone etc. The different functions in these devices like Call, Volume control, Zoom etc. can be done using specific gesture without having to touch or use another interaction method.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 1

Google Project Soli

CHAPTER 2

ABOUT PROJECT SOLI

Project Soli is using radar to enable new types of touch less interactions one where the human hand becomes a natural, intuitive interface for our devices. The Soli sensor can track sub-millimeter motions at high speed and accuracy. It fits onto a chip, can be produced at scale, and can be used inside even small wearable devices.

We want to break the tension between the ever-shrinking screen sizes used in wearables as well as other digital devices, and our ability to interact with them. Check out our presentation at Google I/O.

Gesture-based systems are usually attached to video game consoles like the Microsoft Kinect or your computer like the Leap Motion. Google's ATAP team figured that the smaller form factor of the smart watch segment needed its own finger-waving way to control the devices without having to rely on the Smartphone. Its Project Soli replaces the physical controls of smart watches with your hands using radar to capture your movements.

The Project Soli team is planning to release a dev kit that will allow developers to create new interactions and applications. The figure of the soli chip is shown in below fig 2.1

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 2

Google Project Soli

Fig2.1: Soli Chip

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 3

Google Project Soli

CHAPTER 3

SOLI DEV KIT

Project Soli is Google’s Post-Touch experiment and it looks like they are about ready to start sending out developer units. According to Android Police who received an anonymous tip, it appears that Google is emailing interested developers. So it would appear that Soli isn’t quite ready yet, but will be soon, for developers to play around with.

In the email from Google, the company says that they are looking for just about anything. When it comes to possible applications with Soli, which include Health, art, interactive installations and much more.

The email also states that those selected to receive a Dev Kit will also get a development board and SDK. Additionally these developers will be able to participate in a Soli Alpha developer workshop in the future. The date and place of this workshop has yet to be announced

Google is also asking for developers to be patient. It’s understandable that these things are going to take some time. Projects like Soli are best when they are not rushed. But in the mean time, Google has a Google Group which is limited to those looking to get in and develop on Soli.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 4

Google Project Soli

CHAPTER 4

WHAT IS A RADAR

Radar is a Technology

Radar is an object-detection system that uses Radio Waves to determine the range, angle, or velocity of objects.

It is used by Army and Defence agencies to track movements of enemy

Sends Radio waves towards the target and its receiver intercepts the motion

Fig4.1: Detecting Objects Using Radar

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 5

Google Project Soli

CHAPTER 5

RADAR TO GESTURE

Project Soil’s gesture-tracking takes a particularly unique approach in that it depends on radar. Radar, which detects objects in motion through high frequency radio waves, enables what Project Soil’s design lead Carste Schwesig calls a "fundamentally different approach" to motion tracking.

"A typical model of the way you think about radar is like a police radar or baseball where you just have an object and you measure its speed," explains Schwesig.

"But actually we are beaming out a continues signal that gets reflected by an arm, for example...so you measure the differences between the emitted and the received signal. It's a very complex wave signal and from that we can provide signal processing and machine learning techniques to detect gestures."

Gesture-based controllers are not, in themselves, new. Companies like Leap Motion and, more recently, Intel (via Real Sense) have been experimenting with motion controllers for some time. But these systems rely on cameras for their motion-tracking abilities, which limits the effectiveness and accuracy of the devices, says Schwesig.

Since Solis sensors can capture motion at up to 10,000 frames per second, it is much more accurate than camera-based systems Since Soil’s sensors can capture motion at up to 10,000 frames per second, it is much more accurate than camera-based systems, which track motion at much lower frame rates, Schwesig says. And unlike cameras, radar can pass through certain types of objects, making it adaptable to more form factors than a camera.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 6

Google Project Soli

"You can do things you would never be able to do with a camera," Schwesig tells Mashable. "The speed doesn't mean you have to move extremely fast, it just means you can detect very high accuracy."

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 7

Google Project Soli

CHAPTER 6WHAT IS PROJECT SOLI?

Project Soli is a sensor that can easily be used in even the smallest wearables. It is capable of accurately detecting your hand movements in real-time, meaning it's a lot like Leap Motion and other gesture-tracking controllers. But instead of using cameras, Project Soli uses radar technology that fits within a tiny chip.

Google ATAP has basically realized that our hands are the best way to interact with devices. We have such fine control with our fingers; just think about how fast and seamlessly yours can transition from, let's say, typing on a keyboard to untangling a bunch of wires. Project Soli wants to apply that capability to gesture control.

Project Solis founder, Ivan Poupyrev demoed the sensor. Because Project Soli can recognize fine gestures, rather than the large ones needed by most other motion-based controller systems, it will be able to replace all current interfaces and allow you to gesture-control wearable’s without ever touching a display.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 8

Google Project Soli

CHAPTER 7

WORKING

This contactless device control is achieved through the embedding of a tiny chip –around the size of a finger nail –containing radar technology into various devices. Theoretically, this chip could be embedded into any device to allow for control. Immediately, we’re able to see the benefit of making use of this technology in smart phones, but other technology could benefit from contactless control, also.

The chip, as mentioned, contains radar technology which is capable of capturing any movement you make, including “finger micro-motions”, and interpreting that movement as input to control your connected devices and smart phones.

The tiny circuit board is able determine the hand size, motion and velocity. It then uses machine-learning to translate these movements to pre-programmed commands.Doppler effect is used to detect speed of hand motion.

There are some of the action and operations will be performed by the gesture by using hand motion as shown in below figures

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 9

Google Project Soli

Fig7.1: Clicking action

Fig7.2: swiping action

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 10

Google Project Soli

Fig7.3: Radar response

Fig7.4 Navigation

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 11

Google Project Soli

Fig7.5 Smart Watch Operating

Fig 7.6 Controlling Music Player

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 12

Google Project Soli

CHAPTER 8

APPLICATIONS

In a field of medical

For playing an games

Smartphone can be controlled by using soli

In smart watch

Gadgets

Fig8.1: In medical

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 13

Google Project Soli

Fig8.2 Gaming

Fig8.3 Smartphone operating

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 14

Google Project Soli

CHAPTER 9

WHAT ARE THE BENEFITS OF GOOGEL’S PROJECT SOLI?

The teams involved in the development of this technology, Project Soli, are incredibly excited about it and it’s not hard to see why. The Google team is hoping for the Project Soli technology to be used in computers, wearable devices, smart phones, and implemented in virtual reality gaming. There are many benefits to using the radar to interpret your movements.

The technology is incredibly intuitive and precise, being able to interpret even the slightest movement of the human hand. The way the technology works negates the possibility of hitting the wrong button that we often experience with touch screen smart phones and similar technology.

The Google developed technology can be used almost anywhere, as an IT company in Knoxville, we’re pretty excited about this. Although there are already cameras that work in a similar way to the radar chip, they’re very large and their accuracy can leave a lot to be desired. The Project Soli team found compressing the technology into a small enough form that it could be embedded into a chip to be their biggest challenge. The portability and small size of the chip is a massive benefit to users, both those using it for personal and entertainment reasons and industrial purposes.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 15

Google Project Soli

CHAPTER 10

ADVANTAGES

Allows to control Gadgets with gestures.

Allows free hand typing.

Good Accuracy over control.

Need not to carry gadgets while using them.

DISADVANTAGES

It has a very small radar range.

Multiple gestures could not be possible.

Highly Expensive.

Security Threat.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 16

Google Project Soli

CHAPTER 11

CONCLUSION

One of the big problems with wearable devices right now is inputs - there's no simple way to control these devices. Therefore gestures will be used by individuals to carry out certain functions with electronic machines such as Smartphone's and desktops.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 17

Google Project Soli

REFRENCES

http://techxplore.com/news/2015-08-tipster-google-soli-kit.html https://www.google.com/atap/project-soli/ https://groups.google.com/forum/#!forum/soli-announce http://www.theserverside.com/news/4500247445/Googles-Project-Soli-

replacesthe- keyboard-and-mouse-with-radar-and-logic http://whatis.techtarget.com/definition/Google-ATAP-Advanced-

Technologiesand- Productshttps://www.youtube.com/watch?v=0QNiZfSsPc0http://

mashable.com/2015/05/30/google-project-soli-analysis/#dZaALB26Vqql https://www.google.com/atap/project-soli/ - Google ATAP, Project Soli

Official Site Gesture recognition for smart home applications using portable radar

sensors- QianWan ;Electr. &Comput. Eng. Dept., Texas Tech Univ., Lubbock, TX, USA ; Yiran Li ; Changzhi Li ; Pal, R.

DEPARTMENT OF INFORMATION SCIENCE AND ENGINEERING

APPA INSTITUTE OF ENGINEERING AND TECHNOLOGY, GULBARGA 18