28
Proprietary & Confidential | 1 Proprietary & Confidential | 1 & Integrated Sensing Cognition System

Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 1Proprietary & Confidential | 1

&Integrated Sensing

Cognition System

Page 2: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 2Proprietary & Confidential | 2

The lastgeneration of drivers

Page 3: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 3Proprietary & Confidential | 3

Company Overview

⁺ Addressing the heart of the autonomous vehicle challenge;

Understanding the changing environment with the most advanced 3D sensing and cognition algorithms

⁺ Our offering:⁺ AI sensor fusion platform

⁺ “Point and Shoot” LiDAR

⁺ Founded in Feb 2016

⁺ Raised seed in July 2017AI

Deep learning

Computervision

3D modeling

System architecture

Page 4: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 4Proprietary & Confidential | 4

Autonomous Vehicles

Driving Control

Driving Decisions

Cognition/Fusion

Sensors

Page 5: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 5Proprietary & Confidential | 5

Driving Control

Driving Decisions

Cognition/Fusion

Sensors

Autonomous VehiclesIntegrated Sensing & Cognition System

Page 6: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 6Proprietary & Confidential | 6

⁺ Sensors: Camera, Lidar Radar

⁺ Basic fusion

⁺ High accuracy

⁺ Low latency

⁺ High reliability

⁺ Affordable

Main challenge for L3 and higher autonomous cars

Solutions need to be:

But current solutions are lacking:

Page 7: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 7Proprietary & Confidential | 7

Legacy Fusion Solutions

Driving Decisions & Control

Basic Fusion/Cognition

Camera cognition SW

LiDAR cognition SW

RADARcognition SW

Camera LiDAR RADAR

Environment Model

Page 8: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 8

Page 9: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 9Proprietary & Confidential | 9

Raw Data Fusion

Combined Algorithms for a rich environment model

Point & Shoot LiDAR and RADAR

Driving Decisions & Control

Raw Data Fusion/Cognition

CameraLiDAR

Point & ShootRADAR

Point & Shoot

Rich Environment Model

Page 10: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 10

Data Fusion

Raw

Page 11: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 11

Raw Data Fusion

⁺ Integrating sensor data on a pixel level

⁺ Overcome sensor faults

⁺ Optimize detection

⁺ Simplify decision making

Legacy Fusion Solutions

VAYAVISION Raw Data Fusion

Page 12: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 12

& Shoot LiDAR

Point

Page 13: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 13

+ + + + + + + + +

+ + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + + + + + + +

& Shoot LiDAR

Point+

+

+

++ +

++ + +

+ ++

+

+

++ + + + + + + + + +

++

+

+

+++

+++++

++

+

+

+++

+++

+ +

++++++++++++

+++++

++++++

+

+

++

++

+

+

+++++++++

+

+

+

++

+

+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +

+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + +

+ + + + + + + + + + + + + ++ + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + + + +

+ + + + + + + + +

+ + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + + +

+ + + + + + + + + + +

+ + + + + + + + + + ++ + + + + + + + +

+ + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + + +

+ + + + + + + + + +

+ + + + + + + + +

+ + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + +

+ + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + + + + + +

+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +

+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + +

++++++++++++

+++++

++++++

+++++++++

+ + + + + + + + + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + + + + + + +

+ + + + + + + + + + + + + + + + + + + + + + + +

Page 14: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 14

Point and Shoot LiDAR Requirements

⁺ 150m Range @ 10% reflectivity

⁺ 120° x 25° Field of View

⁺ <0.1° Horizontal resolution

⁺ 0.1° Vertical resolution

⁺ <6cm accuracy

⁺ 60 Frames per second

⁺ 5000 points per frame

Page 15: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 15

for a Rich

Environment Model

Combined Algorithms

Page 16: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 16

Rich Environment Model

U1

Free space LaneCar PedestrianUnidentified Obstacle

Traffic lightSignBicycle SLAM

Page 17: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 17Proprietary & Confidential | 17

Combined algorithmic approach

⁺ SLAM

⁺ High Resolution 3DModel

⁺ Free space detection

Page 18: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 18Proprietary & Confidential | 18

Page 19: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 19Proprietary & Confidential | 19

Page 20: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 20Proprietary & Confidential | 20

Page 21: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 21Proprietary & Confidential | 21

Overwhelming amount of data

Page 22: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 22Proprietary & Confidential | 22

Stronger processor

Page 23: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 23Proprietary & Confidential | 23

What we need

⁺Strong CPUs and GPUs

⁺Development Environment

⁺Scalability

⁺Market acceptance

Page 24: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 24Proprietary & Confidential | 24

What we need

⁺Real Time System⁺ CPUs⁺ Interfaces⁺ Peripherals

⁺Algorithms⁺ Strong GPU

acceleration⁺ Development cycle

Page 25: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 25

Best platform

Page 26: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 26

Summary

Change pics

Page 27: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 27

VAYAVISION’s AI Sensor Fusion Platform

⁺ Raw data fusion:⁺ Better cognition algorithms⁺ Can operate with VAYAVISION

LiDAR and 3rd party sensors (Cameras, LiDARs and RADARs)

⁺ Point and Shoot LiDAR⁺ Better resolution and higher frame

rate⁺ Affordable

⁺ Richer environment model

Fusion/Cognition

ADAS/AD

LiDAR Point & Shoot

Camera

RADARPoint & Shoot

GPS

V2X

Map

Cellular

Vehicle Control

HMI

DRIVE PX 2

Page 28: Integrated Sensing Cognition Systemon-demand.gputechconf.com/gtc/2017/presentation/s... · ⁺“Point and Shoot” LiDAR ⁺Founded in Feb 2016 ⁺Raised seed in July 2017 AI Deep

Proprietary & Confidential | 28Proprietary & Confidential | 28