LiDAR Teach-In - osram-group.de/media/Files/O/Osram... · Photo Detector L e n s DETECTOR L e n s Illuminate the scene in front EMITTER Data visualization or interpretation, analysis,

LiDAR Teach-In

OSRAM Licht AG | June 20, 2018 | Munich

Light is OSRAM

www.osram.com

OSRAM Licht AG

LiDAR Tech Teach-In | June 20, 2018 2

Agenda

• Introduction

• Autonomous driving

• LIDAR technology deep-dive

• LiDAR@OS: Emitter technologies

• Outlook

OSRAM Licht AG


OSRAM has extensive autonomous driving expertise

Rear light

Interior lighting

Ambient lighting

Adaptive cruise control system (LIDAR)Gesture recognition

Pre crash sensing (LIDAR)

Rain sensor

LED/Laser head-

up display

Daytime running light

3-D environment

detection (LIDAR)

Side view and lane detection

Ambient light sensor

Driver monitoring

Headlamp

(e.g. laser, matrix)

LED – Non visibleLED – Visible

OSRAM Licht AG


OS is a long-time partner for lasers in the automotive industry

905 nm pulse Laser,

75 W, 20 ns

OS with pioneer role and a proven track record

• LiDAR Laser supplier to automotive

industry for over 10 years

• over 10 million LiDAR lasers in the field

(~ 200 billion km ) without chip failures

• zero field failures for 7 million bare dies

• more than 20 LiDAR design-ins and -wins

with OS lasers

Technology USP

• Highest Efficiency (30%)

• Best thermal resistance

• First automotive grade pulse laser on the

market

More than 10 car OEMs

use laser based AEB1

systems with

OSRAM´s 905nm laser

already today

Short-range-LiDAR – Cam System

First use of LiDAR since early 2000s

1) AEB: Auto emergency breaking

OSRAM Licht AG


Agenda

• Introduction




• Outlook

OSRAM Licht AG


L0

Driver Only

There are 6 levels of autonomous driving, between no automation (L0) up

to full control by system (L5)

L1 L4 L5L2 L3

Humans always monitor driving functions Humans do not always monitor driving functions

Driving Assistance High Automation System OnlyPartial Automation Conditioned Automation

Role of

driver

Role of

systemNone

Driver always

with full control

Some

automation by

electronics

Driver always

in charge of

monitoring

Driving assis-

tance in specific

and limited

situations

Driver needs

to be ready to

regain control

Perform driving

functions and

recognize limits

Driver only

needs to act in

specific driving

conditions

Full control in

defined driving

conditions

No driver

needed

Full control

Eyes + hands on Eyes on + hands

temporary off

Eyes + hands

temporary off

Eyes + hands off Eyes + hands +

mind off

OSRAM Licht AG


All of today‘s potential sensor solutions for ADAS have specific strengths

and weaknesses; hence all are needed to guarantee full functionality

LIDARCamera Radar

Surround

view

Surround

view

Environment

Mapping

Environment

Mapping

Environment

Mapping

Environment

Mapping

Environment

Mapping

Surround

view

Traffic Sign

recognition

Lane departure

warning

Emergengy braking

Pedestrian detection

Collision avoidance

Environment mapping

Value propositions of different technologies (selection)

Camera Color vision and ability to recognise signs

Radar Speed detection and ability to function in unfavorable

weather conditions / darkness

LiDAR 3D capability and ability to function in unfavorable weather

conditions / darkness

• The vehicles ability to ‚see‘ (= sense its environment)

strongly depends on the environmental conditions, such as

day time or weather

• Full functionality at any environmental condition therefore

requires different and redundant sensors

• In addition, redundancy is being generated using intelligent

algorithms (sensor fusion)

Cross traffic

alert

Blind spot

detection

Rear

collision

warning

OSRAM Licht AG


Only the combination of Camera, Radar and LiDAR will provide the

capabilities required for autonomous driving.

Camera Radar LiDAR

Combination of all

three systems

Range

Resolution / Accuracy

3D capability

Immunity to weather (rain / fog / snow)

Works in dark

Works in very bright light

Interference effects

Price

Detection of speed of objects

Inherent technical capabilities

Environmental conditions

Other

Size

Read signs and see colors

Status today

Status today

• Only the combination of all three systems will provide all technical capabilities needed for autonomous driving

• In addition, redundancies are desired to increase accuracy and mitigate risk through potential technical failures

Detector systems

OSRAM Licht AG


LiDAR will be required for autonomous driving; 6 or more LiDAR modules

for L4/L5

• Co-existence of LIDAR, RADAR and camera sensors in Autonomous Driving (L3 upwards)

• LIDAR crucial for long-range detection in AD, no different substitute technology available, specifically for object identification

• Six or more LiDAR modules expected for L4/L5

LiDAR will play a key role in

autonomous driving

(especially L3 upwards)

≥ 82≥ 1

none1 ≥ 6≤ 1

≥ 3 ≥ 6 ≥ 10

Number of modules needed by automation level

Camera

Radar

LiDAR

Level of automation

L2 L3 L4/5

1) Optional for collision warning, AEB

OSRAM Licht AG


MaaS - Mobility as a Service path

(e.g. waymo)

Two different approaches to autonomous driving: Mobility providers

starting with L5 short term, traditional OEMs evolve from L1 to L5

L3

L5 • Two completely different approaches to

autonomous driving with different dynamics

driven by two distinct groups of players –

mobility-as-a-Service providers (MaaS) and

traditional car manufacturers

• MaaS providers pushing for early

introduction of fully autonomous

vehicles today in significant numbers

• Traditional car manufacturers

moving to L3; introduction of fully

autonomous cars expected for 2024+

• However, in the long run there will likely be a

convergence of the two approaches

ILLUSTRATIVE

• Robo cars

Convergence

L1-2

ADAS1 Level

2018 2020 2022 2024 20262000

10

1) Advanced driver assistance systems

OSRAM Licht AG


The LiDAR (emitter) market will see two waves of growth

2015 2022202120202019201820172016 2023 2024 2025

LiDAR emitter market – total number of laser channels

ILLUSTRATIVE MaaS1:

• Short- and medium-term volume driver with

early introduction of L5 cars

• Consumer-like business with steep ramps,

driven by Tec companies

• AM qualification less important

• Long-range and short-range scanning LiDAR;

large field of view, high resolution

Traditional L3-L5:

• Long-term volume driver: Evolution of

traditional car mass production from L3 to L5

• Mainly traditional OEMs, quality and AM

qualification very important

• Long-range scanning or Solid State LiDAR,

short range FLASH

Traditional – AEB2

• Existing LiDAR business since early 2000s

• Collision mitigation system

• Traditional OEMs

• Short range FLASH LiDAR

1) MaaS: Mobility as a Service 2) AEB: Auto emergency breaking

OSRAM Licht AG


Agenda

• Introduction




• Outlook

OSRAM Licht AG


LiDAR uses reflected light to measure distance to objects; it can be used

for short-range up to a distance of ~300m

Detection principle:

A very short laser pulse travels from

the LiDAR sensor to an object and

back. The sensor measures the

travelling time of the laser pulse and

determines the distance and relative

velocity of the object.

100 m distance 0,6 ms

LiDAR (Light Detection and Ranging) – a Time of Flight measurement

OSRAM Licht AG


Multiple module system to dominate – combination of short / mid range

and long range LIDARs

optional for

collision

warning, AEB

2-4 SRL for

360° sensing

Depending on L-level, different LiDAR systems are used

# SRL1 # LRL2

0-2 0-1

1 LRL

to the front

rear LRL for fast on

coming vehicles

1-22-4 SRL for

360° sensing

optional

2) Long range LIDAR1) Short range LIDAR

L1, L2

L3

L5

L4

Lidars can be used for different distances and use cases

20m

100m

Short range

(<20m)

Medium range

(20 to 100m)

Long range

(>100m)

• Stop & Go

• Automatic Emergency

Breaking (AEB)

• Pre-crash sensing

• Lane departure warning

• Blind spot detection

• Adaptive cruise control (ACC)

• Long Range LiDAR (LRL) for

autonomous vehicles (L4/L5)

OSRAM Licht AG


Laser

A LiDAR system consists of different building blocks

Process captured

signal and

feedback time

stamps to emitter

ASIC1

Capture the

reflected photons

Photo Detector L

e

n

s

DETECTOR

L

e

n

sIlluminate the scene

in front

EMITTER

Data visualization

or interpretation,

analysis, filter,

localization and

control signals

PROCESSING &

CONTROL

LiDAR system overview

• The emitter is triggered by the

ASIC (application specific

integrated circuit) and sends out

invisible light

• The light is reflected from objects in

the field of view and the signal

captured by the detector

• The signal is then processed by the

ASIC1 and forwarded to the

processing unit

• Here, analysis of the signal takes

place, potentially taking signals

from other sensors (e.g. radar or

camera) into account

Key steps for signal acquisition

1) Application specific integrated circuit

OSRAM Licht AG


A LiDAR system consists of different building blocks

Process captured

signal and

feedback time

stamps to emitter

ASIC1

Capture the

reflected photons

Photo Detector L

e

n

s

DETECTOR

Laser L

e

n

sIlluminate the scene

in front

EMITTERPROCESSING &

CONTROL

LiDAR system overview

• The emitter is triggered by the

ASIC (application specific

integrated circuit) and sends out

invisible light

• The light is reflected from objects in

the field of view and the signal

captured by the detector

• The signal is then processed by the

ASIC1 and forwarded to the

processing unit

• Here, analysis of the signal takes

place, potentially taking signals

from other sensors (e.g. radar or

camera) into account

Key steps for signal acquisition

Focus today

Data visualization

or interpretation,

analysis, filter,

localization and

control signals

1) Application specific integrated circuit

OSRAM Licht AG


There are two basic LiDAR technical implementations – flash and

scanning LiDAR

Scanning

LiDARFlash

LiDAR

• The whole FOV is illuminated at once using a

wide-angle beam

• No moving parts in the LiDAR module

• Scanning, narrow emitter beam which is being moved

across the FOV over time

• Mechanical solution or micro-mirrors used for beam steering

EMITTER EMITTER

• High to very high

power needed to

illuminate the whole

scene with one

laser beam

• In the future, laser

bars (edge emitting

laser) with high

power for longer

distances or

potential use of

VCSEL for SRL

• Highly directional

beam with high

power needed

• Good thermal

performance for

high repetition rate

• Today and in

future edge

emitting lasers

operating at

905nm expected

to dominate

OSRAM Licht AG


Agenda

• Introduction




• Outlook

OSRAM Licht AG


Edge emitting lasers at 905nm are the best overall fit for LiDAR

requirements in terms of cost position, efficiency and output

Laser technology VCSEL

Comparison of basic laser technology and wavelength

Fit to LiDAR requirements

• Light emitted from surface

of laser die

Component cost

Temp. stability1)

Conclusion

Output power

Efficiency

Potential use for

short range LiDAR

Eye safety

Technology too

expensiveBest overall fit

to requirements

• In most cases, edge

emitting laser @905nm

expected to be the

winning technology

• 1550nm with better eye

safety, but otherwise

lagging behind and too

expensive for customer

requirements

• VCSEL potentially

useful for short range

LiDAR, but yet to be

automotive qualified

Edge emitting laser

• Light emitted from a small area in the side of the laser die

<1000nm2)

Emitting area

>1000nmtypically <1000nm

1) With regard to power 2) typically 905nm

OSRAM Licht AG


Osram: we offer solutions for all relevant LiDAR technologies based on

905 nm Lasers

FLASHSmart Laser

4 channel SMT Highest Power: Laser Bars

1 channel SMT

1 or 4 channel SMT Integrated versions

Customized laser bars

OSRAM is in

discussion with

all relevant

players from the

LiDAR

ecosystem and

we further

develop our

portfolio based

on their needs

bare laser dies

Today 2018/19

OS product roadmap for different LiDAR technologies

• First AM grade pulse

laser on market

• Best performance in the

market

• Very short pulses

(1ns demonstrated)

• Increased

output power

• More laser channels

• AM qualified

packages

• Customization

• Integrated solutions

• Multichannel

versions / laser bars

Beyond

Evolution of 905nm edge emitting laser

SELECTIVE

MEMS /

Solid

state

Mecha-

nical

ScanningChip- and package variations

based on OS Platform

OSRAM Licht AG


Agenda

• Introduction




• Outlook

OSRAM Licht AG


• Strong position in

emitter lasers

• Evaluating portfolio

fit of detectors

• Signal processing

OSRAM is well positioned to participate in the LiDAR market

Next to our strong position in emitter lasers for LiDAR systems, we are evaluating to extend our portfolio in the area of detector

components and smart modules, concentrating on the essentials of data fusion:

• working closely together with LeddarTech in order to assess the industrialization of LiDAR modules for the automotive mass market.

Specific focus is on affordable long-range LiDAR modules

• acquired a strategic stake in the LiDAR start-up company Blickfeld. Its particular strengths lie in beam steering technology, which

permits a full scanning of the surrounding environment

• smaller, purely financial investment in the start-up company Tetravue, which uses a unique approach for high-resolution depth images

• Optics and beam

control

• High resolution

depth images

• Additional

application fields

beyond automotive

Documents

LiDAR Teach-In - osram-group.de/media/Files/O/Osram... · Photo Detector L e n s DETECTOR L e n s Illuminate the scene in front EMITTER Data visualization or interpretation, analysis,