Depth-Sensing Technology

RealSense cameras feature three lenses, a standard 2D camera for regular photo and video, along with an infrared camera and an infrared laser projector. The infrared parts allow RealSense to see the distance between objects, separating objects from the background layers behind them and allowing for much better object, facial and gesture recognition than a traditional camera. The devices come in three flavors: front-facing, rear-facing and snapshot.

Uses so far

1. Realistic Avatars

RealSense is really good at scanning faces and turning them into objects that can be used, not only in 3D printing but also in software. I tested FaceShift, an application that replaces your real face with an avatar for video chats.

2. 3D Scanning for 3D Printouts

Though you won't be able to buy a system with a rear-facing RealSense camera until later in the year, Intel has a prototype tablet that can scan people's torsos and then 3D print them as decorative crystal paperweights.

The potential is there to create not just interesting paperweights, but fully-functional 3D-printed objects. Just imagine 3D scanning one screw in so you can print out another one.

3. Green Screening Without a Screen

If you're doing a video chat and want someone to see your face, but not the messy living room behind you, a program called Personify will automatically remove the background and replace it with a graphic or a plain white space. In the past, you needed to film against a solid color background to separate your torso from the objects behind you, but RealSense's depth-sensors can tell the difference on its own.

4. Measuring Distances in Pictures

The Dell Venue 8 7000 tablet has the RealSense Snapshot camera, which adds depth information to photos it takes. With photos taken on the tablet, I was able to measure the distance between two points by drawing a line on the picture with my finger. For example, the software told me that the radius of a bike wheel in a photo was 27 inches.

5. Holographic Navigation

Intel has shown a prototype PC with a virtual nav bar that appeared to float on air in front of the lower screen bezel. RealSense didn't create the holograph itself but it allowed me to interact with the virtual buttons by judging whether my fingers were at the right height to tap them.

6. Accurate Gesture Control

You can do gesture control with a regular 2D camera, but it doesn't always work well, particularly if your hand blends into the background or you put one hand in front of another. RealSense can easily distinguish all your fingers from each other and from your body and the world behind you.