23

Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection
Page 2: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Overview

› Yandex Services

› Yandex.Taxi

› Yandex Technologies

› SDC Yandex Taxi

› Algorithms Design Evolvement

› Car Detection

› 3D Car Detection

› Windup

› Upcoming Plans

Page 3: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

world-class information search

on-demand transport services

navigation products

mobile applications

since1989 search enginetechnology

1997yandex.ru

Page 4: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Search Personal Geo Services InformationalMedia

Search

Ad Tech

Browser Kinopoisk Afisha

Music

TV Program

Taxi Navi

Maps Parking

Traffic Transport

MailDisk

Auto.ru Jobs

Realty Travels

Trains Flights

Weather Health

Market

Zen Launcher

Page 5: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Yandex Taxi – one of the largest online taxi services in Russia & CIS

2–5 minaverage

waiting time

>200 000active cars

6 countries 149cities

Page 6: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Technologies

› Machine learning (MatrixNet)

› Speech recognition

› Language recognition and synthesis (SpeechKit)

› Antivirus technologies

› Computer vision

› Duplicate image detection

› Behaviour analytics technology(Crypta)

› Real-time bidding platform

› Weather forecastingtechnology (Meteum)

› Personal recommendationstechnology (Disco)

Page 7: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection
Page 8: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Algorithms Design Evolvement

Data DeploymentMLLabelling

constant ongoing improvement process

Page 9: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Car Detection Pipeline

Data DeploymentMLLabelling

Page 10: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Data for Car Detection

DATA DATA Collection

Page 11: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Labelling for Car Detection

Objects detection

Labelling

Page 12: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection
Page 13: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

ML for Сar Detection

ML

SSD ModificationsYolo

Page 14: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Deployment for Car Detection

Deployment

Tensor RT FuseNetDrive PX

Page 15: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

3D Car Detection Pipeline

Data DeploymentMLLabelling

Data Recollection

Lidar Detection

Page 16: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Data for 3D Detection

Lidar Detection

Lidar Point Cloud

Page 17: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

ML for 3D Car Detection

Lidar Bird View (BV)

ROI Pooling

Concatenation

Prior boxes classification

Prior boxes coordinates regression

Image (RGB)

Page 18: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Method Moderate Easy Hard Runtime

MV3D (lidaronly)

0,77 0,858 0,689 240ms

MV3D 0,769 0,86 0,684 360ms

Ours (bev only) 0,749 0,821 0, 736 95ms

Page 19: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Deployment for 3D Car Detection

Deployment

Graph freezing DrivePXTensorRT

Page 20: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection
Page 21: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Wind-up

Data

Labelling

ML

Deployment

Constant improvement

process

› image segmentation

› depth estimation

› end-to-end

Page 22: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

Upcoming Plans

сitytest-drives

>=10 cars fleet growth

2018

more sensors =>

more experiments

Page 23: Overview - NVIDIA · Yolo SSD Modifications. Deployment for Car Detection Deployment Drive PX Tensor RT FuseNet. 3D Car Detection Pipeline Data Labelling ML Deployment Data Recollection

+7 926 312-89-55

[email protected]

Thank you! Questions?

Anton Slesarev

Lead computer vision scientist