29
Autonomous Driving or highly automated driving A presentation by Patrick Buchhardt

Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Embed Size (px)

Citation preview

Page 1: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Autonomous

Driving

or highly automated driving

A presentation by Patrick Buchhardt

Page 2: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Contents

Challenges

Sensors

Technologies & assistance systems

BMW

Google

Videos

Problems

2

Page 3: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Challenges

Object recognition and tracking

Traffic lights

Traffic signs

Lane

cars

Pedestrians & cyclists

Other obstacles & road users

Action planning

Real time

3

Page 4: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Sensors

Long-range radar

200-250m

Stereo cameras

Accurate up to 30m

50° field of view

Ultrasonic systems

6m

Small field of view

LIDAR

4

Page 5: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Assistance systems

Adaptive curse control (ACC)

Adjusts the speed to maintain a safe distance

warning

Active brake assist (ABA)

Can evoke emergency braking

Parking assist

Lane change assistance

5

Page 6: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

LIDAR

6

http://img.hexus.net/v2/internationalevents/DARPA_grand_challenge_2007/velodyne_HD_LIDAR_cropped.jpg

• Cost about $70.000

• Highly accurate up to 100m

• Up to 1.3 million readings per second

Page 7: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

LIDAR output visualisation

7

Page 8: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Perception

From “Autonomous Driving in Urban Environments: Boss and the Urban Challenge

8

Page 9: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Moving Obstacle Detection

and Tracking

Classification of objects

Moving or not moving

By velocity

Observed moving or not observed moving

Moving in the last few seconds

Objects can be filtered for specific contexts

e.g. trees are not relevant for distance keeping

9

Page 10: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Architecture

10One specialized sensor layer for each sensor type

Page 11: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Detection

Sensor layers request prediction from fusion layer

Feature extracting

Validation to distinguish between static obstacles and moving

vehicles

validated features (potentially from vehicles)

association with predicted object hypotheses

feature interpretation matches with the object hypothesis old object hypothesis can be replaced by a new one

Result is a proposal: set of new object hypothesis

11

Page 12: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Detection

Generation of observation using the best interpretation

Observation holds all necessary data to update the state

estimation

Some sensors also provide movement observation for

extracted features

Fusion layer updates the object hypothesis list using the

proposals, observations and movement observations

For unassociated features: adding best proposal to the list of

object hypothesis

Result: updated list

12

Page 13: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Current Progress

13

Page 14: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

BMW

high-precision maps

Long-range radar at front and back

Ultrasonic on both sides

4-layer-laser at the front bumper

Laser scanner on both sides and back bumper

Front stereo camera

Classify objects

Detects lights and signs

redundancy

14

Page 15: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

BMW driverless car

15

Page 16: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

BMW driverless car

16

Page 17: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

BMW driverless car

17

Page 18: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Google driverless car

high-precision maps

Long-range radar at front and back

Ultrasonic devices

Front stereo camera

LIDAR

redundancy

18

Page 19: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Google Chauffeur

19

Page 20: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

20

Google Chauffeur

Page 21: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

21

Google Chauffeur

Page 22: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

22

Google Chauffeur

Page 23: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

23

Google Chauffeur

Page 24: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

24

Google Chauffeur

Page 25: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Gesture recognition

25

Page 26: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Problems

recognition of objects behind others

Range

weather

26

Page 27: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

Videos

27

Page 28: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

References

http://www.daimler.com/dccom/0-5-1210218-49-1210321-1-0-0-1210228-0-0-135-0-0-0-0-0-0-0-0.html

http://www.pcwelt.de/videos/BMW_zeigt_selbstfahrendes_Auto_-_Video-Fahrerlos_auf_der_A9-8395931.html

http://www.extremetech.com/extreme/189486-how-googles-self-driving-cars-detect-and-avoid-obstacles

http://www.extremetech.com/extreme/157172-what-is-adaptive-cruise-control-and-how-does-it-work

http://googleblog.blogspot.de/2014/05/just-press-go-designing-self-driving.html

http://www.pcwelt.de/videos/BMW_zeigt_selbstfahrendes_Auto_-_Video-Fahrerlos_auf_der_A9-8395931.html

https://www.youtube.com/watch?v=JbSmSp-fL1g&list=PLc2496NnT82vRe1dXzsfK1gsFiGEu_ty8

http://www.google.com/about/careers/lifeatgoogle/self-driving-car-test-steve-mahan.html

http://www.fieldrobotics.org/users/alonzo/pubs/papers/JFR_08_Boss.pdf

28

Page 29: Autonomous Driving - uni- · PDF fileAutonomous Driving or highly automated driving A presentation by Patrick Buchhardt. Contents Challenges ... LIDAR 4. Assistance systems Adaptive

The End