25
Introducing Intel™ RealSense® Robotics Perception Devices Amit Moran, Robotics Innovation Team Leader Matt Curfman, Senior Robotics Architect

Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

  • Upload
    lekhue

  • View
    221

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Introducing Intel™ RealSense® RoboticsPerception Devices

Amit Moran, Robotics Innovation Team Leader

Matt Curfman, Senior Robotics Architect

Page 2: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Last year…

2

Amit showed you our exciting new Intel® RealSense™ 3D Camera R200

Page 3: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Intel® RealSense™ 3D Camera R200 / LR200

Depth camera enabling optimized for Robotics

computer vision capabilities

Intel® RealSense™ 3D Camera SR300

Close range depth camera optimized for

Background Segmentation and Facial Tracking

Intel® RealSense™ 3D Camera ZR300

Adds 6DOF / SLAM capabilities to LR200 camera

Announced new Intel® RealSense™ Technology

3

Page 4: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Released new Robot Development Platforms

Intel® NUCIntel® Robotic Developer Kit

Intel® Joule

4

Page 5: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Kit contains:

• Intel® RealSense™ 3D camera R200

• Intel® Atom™ x5-Z8350 processor single board computer

- 40-pin general purpose I/O interface

- USB 3.0 OTG and USB 2.0

- Full-speed gigabit Ethernet

- HDMI*

• Open source with support for Ubuntu*

• Power supply and cables

Everything you need to equip your robot with advanced depth

vision

Intel® RealSense™ Robotic Development Kit

Page 6: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

6

• Development platform for rapid prototyping and easy transition to volume production (SOM)

• Higher performance, lower power consumption, in a smaller form factor

• Wi-Fi* and Bluetooth*, 4K video, MIPI CSI & DSI, up to 48 GPIO

• Multiple OSs supported, including reference Linux* IoT OS, Ubuntu*, Snappy, and Windows* IoT Core

• Enhanced support for Intel® RealSense™ technology

• Developer kit includes module, expansion board, Wi-Fi antennas, USB cable, and SD card with software

Intel® Joule™ Developer Kit

Rapid prototype-to-production for robotics development

Page 7: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Released as Open Source

7

• Released an open source interface

for Linux*, MacOS*, and Windows*

• Released an open source ROS*

camera node

http://wiki.ros.org/RealSense

Page 8: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Added Intel® RealSense™ Support for Turtlebot*

8

Support for Turtlebot, for

ROS* Indigo and ROS Kinetic,

packaged in ROS build farm

Page 9: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

And Worked With Great Partners…

Page 10: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Intel® Euclid™Compute-Communicate-Sense

*The product, product specifications and data may be subject to change without notice

Page 11: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

11

Intel® Euclid™ - Highlights

Complete

Standard/Community

Easy to use/ “zero-installation”

Roboticist/Makers vision solution

*The product, product specifications and data may be subject to change without notice

Page 12: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

12

Intel® Euclid™ - Highlights

Complete

Standard/Community

Easy to use/ “zero-installation”

Roboticist/Makers vision solution

ZR300 (Depth & Motion)

Coms: WiFi, BT, USB3, UART, HDMI

Audio: Mics, SpeakerEnvironmental Sensors

Internal Storage Memory

Soft buttons Detachable Battery

Intel® Atom™ Quad-Core SOC

Disclaimer

THE PRODUCT, PRODUCT

SPECIFICATIONS AND DATA

MAY BE SUBJECT TO

CHANGE WITHOUT NOTICE

*The product, product specifications and data may be subject to change without notice

Page 13: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

13

Intel® Euclid™ - Highlights

Complete

Standard/Community

Easy to use/ “zero-installation”

Roboticist/Makers vision solution

16.04

*

*

*

*The product, product specifications and data may be subject to change without notice

Page 14: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

14

Intel® Euclid™ - Highlights

Complete

Standard/Community

Easy to use/ “zero-installation”

Roboticist/Makers vision solution

*The product, product specifications and data may be subject to change without notice

Page 15: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Intel® Euclid™ – High Level Software components

14*The product, product specifications and data may be subject to change without notice

Page 16: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Intel® Euclid™ – High Level Software components

14*The product, product specifications and data may be subject to change without notice

Page 17: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Intel® Euclid™ – High Level Software components

Euclid

ROS Kinetic Kame

Euclid Automation nodes

Sample Code Apps

Automation Layer

Ubuntu 16.04

Camera API - librealsense RealSense Linux SDK

C&C Web interface

RealSense-ROS wrappers

15*The product, product specifications and data may be subject to change without notice

Page 18: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

18

Intel® Euclid™ - C&C Web interface

ROS –

javascript interface

video web server

log system

*The product, product specifications and data may be subject to change without notice

Page 19: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

19

Intel® Euclid™ - C&C Web interface

Euclid automation nodes

Javascript client

TopicsServices

rosserial client

*The product, product specifications and data may be subject to change without notice

Page 20: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

20

Intel® Euclid™ - C&C Web interface

*The product, product specifications and data may be subject to change without notice

Page 21: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

21

Intel® Euclid™ - C&C Web interface

Scenarios

ROS nodes configuration standard

Dynamic Reconfigure

*The product, product specifications and data may be subject to change without notice

Page 22: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

22

Intel® Euclid™ - Arduino compatibility

Based on rosserial and rosserial_arduino libraries

which allow any communication of ROS messages

from a host computer to an Arduino device.

• Web interface integration• Regenerate the Arduino libraries

remotely from web interface• Run rosserial from the web interface

• Start, edit and stop scenarios from Arduino

*

*The product, product specifications and data may be subject to change without notice

Page 23: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

23

Intel® Euclid™ - Extensible

23

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

?

?

?

?

?

?

?

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

! !

!

!

!

!

!

! !

!

!

!

!

!

!

!

!!

! !

!

!

!

!

!

! !

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!

!!!

!!*The product, product specifications and data may be subject to change without notice

Page 24: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

24

Intel® Euclid™*The product, product specifications and data may be subject to change without notice

Page 25: Introducing Intel RealSense® Robotics Perception Devices · PDF fileIntel® RealSense™ 3D Camera R200 / LR200 Depth camera enabling optimized for Robotics computer vision capabilities

Thank You!Learn more at our booth!

25