A new Computer Vision Processor Chip Design for automotive...

A new Computer Vision Processor Chip Design for automotive ADAS CNN applications

in 22nm FDSOI SOI Symposium Santa Clara, Apr. 13th, 2017

Dr. Jens Benndorf MD, COO Dream Chip

Dream Chip Technologies GmbH

Dream Chip Technologies

DCT Company Profile

Dream Chip Technologies …

• Positioned as a Fabless Microelectronic Engineering Company for medium to large SoC designs covering the whole range from Architecture, Specification, Design, Verification to GDSII

• Technologies: 130nm, 40nm, 28nm, 22nm FDX, 14/16nm FF

• 60 Employees/ 52 Engineers with 10 … 20 years SoC design experience

• Based in Hanover (HQ) and Hamburg, Germany

• Member of Silicon Saxony/ Germany

● Cadence Design Center Partner for Tensilica

Dream Chip Technologies GmbH

Dream Chip Technologies

Assisted Driving requires Cameras, Radar and Ultrasonic

Source: Texas Instruments

Dream Chip Technologies GmbH

Dream Chip Technologies

Use Case #1: Digital Mirroring

Source:

Dream Chip Technologies GmbH

Dream Chip Technologies

• Automotive multi camera systems for Bird-View, Rear-View and Panorama-View are a major part of today’s emerging technologies to make driving more safe and comfortable and to move towards autonomous vehicles.

Use Case #1: Digital Mirroring - The Multiview

Dream Chip Technologies GmbH

Dream Chip Technologies

Target Applications

• Automotive Camera-Monitor-Systems, e.g. electronic rear mirror

Key Features

• Works in YUV domain, independent of image sensor • Works on flicker frequencies from 80 Hz up • Unlimited flickering light sources in image • Optimized implementations available for several platforms, including

• Tensilica Vision P6 • TI TDA3 • nVidia CUDA • RTL (Q2 / 2017)

Use Case #1: Digital Mirroring – Flicker Mitigation

Dream Chip Technologies GmbH

Dream Chip Technologies

Use Case #2 : 360 deg Top View Camera

Dream Chip Technologies GmbH

Dream Chip Technologies

Use Case #3 : Pedestrian detection via CNNs

Dream Chip Technologies GmbH

Dream Chip Technologies

Partitioning of Algorithms

Dream Chip Technologies GmbH

Dream Chip Technologies

Introduction – Image Sensor Processing Overview

Dream Chip Technologies GmbH

Dream Chip Technologies

Heterogeneous Cores for Image Sensor Processing

GPU (VP6)

Vector DSP (VP6, HW)

A53

DSP (VP6, A53)

Dream Chip Technologies GmbH

Dream Chip Technologies

MPSoC Chip Architecture

Dream Chip Technologies GmbH

Dream Chip Technologies

I/O IF HEs: Pixel Level

Memory IF

Lock-Step A53: Object Level

Low Power CNN Architecture

VP6: Pixel Level

Dream Chip Technologies GmbH

Dream Chip Technologies

Floorplan

IVP: Pixel Level

Memory IF

Memory IF

Lock-Step

ARM A53: Object L.

• Tape-Out 10.Jan. 2017

• Global Foundries

– 22 FDX GF

– externally adjustable BIAS voltage

– 8x8 mm (64 mm^2)

• Calculation Power

– ARM Cortex A53 quad core

– 4x Tensilica Vision P6

– optimized for ADAS and CNN

– 4x video-in, 1x video-out

• MCM package

– DIE + 2x DDR4 on Silicon interposer

Dream Chip Technologies GmbH

Dream Chip Technologies

MPSoC Chip / Starter Kit

Dream Chip Technologies GmbH

Dream Chip Technologies

System in Package Design

System-on-Module features • 4GB LP-DDR4 3200 RAM Interfaces • Four 300MB/s video inputs • One 300MB/s video output • Gigabit Ethernet

Dream Chip Technologies GmbH

Dream Chip Technologies

Assembling the SOM...

Overview • Power management and

measurement • Chip power supplies included Benefits • Reduced application-specific

baseboard complexity • Interfaces customizable to

application requirements

Dream Chip Technologies GmbH

Dream Chip Technologies

Overview • DCT ADAS Quad-HDMI Base Board • Four HDMI 1.4b inputs • One HDMI 1.4 output • Custom high-speed headers available

Base board features • Video data rates up to 1080p60 • Two Intel MAX10 10M08DC FPGAs • Four high-speed interface headers • Video input synchronization • True output genlock possible

4 x HDMI Application Board

Dream Chip Technologies GmbH

Dream Chip Technologies

Demo

Dream Chip Technologies GmbH

Dream Chip Technologies

Mobile World Congress 2017 Demo

Dream Chip Technologies GmbH

Dream Chip Technologies

Thank You!

Please contact jens.benndorf@dreamchip.de

Dream Chip Technologies GmbH

Steinriede 10 D-30827 Garbsen/Hannover

Germany +49-5131-90805-120