©2013 FUJITSU SEMICONDUCTOR LIMITED Printed in JapanAD04-00052-1E May 2013Edited: Sales Promotion Department

Graphics SoC MB86R20 SeriesIdeally Suitable for Integrated HMI Systems and 360° Wraparound View Systems with Recognition Functions

FUJITSU SEMICONDUCTOR LIMITED

For further information please contact:

North and South AmericaFUJITSU SEMICONDUCTOR AMERICA, INC.1250 E. Arques Avenue, M/S 333Sunnyvale, CA 94085-5401, U.S.A.Tel: +1-408-737-5600 Fax: +1-408-737-5999http://us.fujitsu.com/micro/

EuropeFUJITSU SEMICONDUCTOR EUROPE GmbHPittlerstrasse 47, 63225 Langen, GermanyTel: +49-6103-690-0 Fax: +49-6103-690-122http://emea.fujitsu.com/semiconductor/

KoreaFUJITSU SEMICONDUCTOR KOREA LTD.902 Kosmo Tower Building, 1002 Daechi-Dong,Gangnam-Gu, Seoul 135-280, Republic of KoreaTel: +82-2-3484-7100 Fax: +82-2-3484-7111http://kr.fujitsu.com/fsk/

Asia PacificFUJITSU SEMICONDUCTOR ASIA PTE. LTD.151 Lorong Chuan, #05-08 New Tech Park 556741 SingaporeTel: +65-6281-0770 Fax: +65-6281-0220http://sg.fujitsu.com/semiconductor/

FUJITSU SEMICONDUCTOR SHANGHAI CO., LTD.30F, Kerry Parkside, 1155 Fang Dian Road, Pudong District, Shanghai 201204, ChinaTel: +86-21-6146-3688 Fax: +86-21-6146-3660http://cn.fujitsu.com/fss/

FUJITSU SEMICONDUCTOR PACIFIC ASIA LTD.2/F, Green 18 Building, Hong Kong Science Park,Shatin, N.T., Hong KongTel: +852-2736-3232 Fax: +852-2314-4207http://cn.fujitsu.com/fsp/

All Rights Reserved.FUJITSU SEMICONDUCTOR LIMITED, its subsidiaries and affiliates (collectively, "FUJITSU SEMICONDUCTOR") reserves the right to make changes to the information contained in this document without notice. Please contact your FUJITSU SEMICONDUCTOR sales representatives before order of FUJITSU SEMICONDUCTOR device.Information contained in this document, such as descriptions of function and application circuit examples is presented solely for reference to examples of operations and uses of FUJITSU SEMICONDUCTOR device. FUJITSU SEMICONDUCTOR disclaims any and all warranties of any kind, whether express or implied, related to such information, including, without limitation, quality, accuracy, performance, proper operation of the device or non-infringement. If you develop equipment or product incorporating the FUJITSU SEMICONDUCTOR device based on such information, you must assume any responsibility or liability arising out of or in connection with such information or any use thereof. FUJITSU SEMICONDUCTOR assumes no responsibility or liability for any damages whatsoever arising out of or in connection with such information or any use thereof.Nothing contained in this document shall be construed as granting or conferring any right under any patents, copyrights, or any other intellectual property rights of FUJITSU SEMICONDUCTOR or any third party by license or otherwise, express or implied. FUJITSU SEMICONDUCTOR assumes no responsibility or liability for any infringement of any intellectual property rights or other rights of third parties resulting from or in connection with the information contained herein or use thereof.The products described in this document are designed, developed and manufactured as contemplated for general use including without limitation, ordinary industrial use, general office use, personal use, and household use, but are not designed, developed and manufactured as contemplated (1) for use accompanying fatal risks or dangers that, unless extremely high levels of safety is secured, could lead directly to death, personal injury, severe physical damage or other loss (including, without limitation, use in nuclear facility, aircraft flight control system, air traffic control system, mass transport control system, medical life support system and military application), or (2) for use requiring extremely high level of reliability (including, without limitation, submersible repeater and artificial satellite). FUJITSU SEMICONDUCTOR shall not be liable for you and/or any third party for any claims or damages arising out of or in connection with above-mentioned uses of the products.Any semiconductor devices fail or malfunction with some probability. You are responsible for providing adequate designs and safeguards against injury, damage or loss from such failures or malfunctions, by incorporating safety design measures into your facility, equipments and products such as redundancy, fire protection, and prevention of overcurrent levels and other abnormal operating conditions.The products and technical information described in this document are subject to the Foreign Exchange and Foreign Trade Control Law of Japan, and may be subject to export or import laws or regulations in U.S. or other countries. You are responsible for ensuring compliance with such laws and regulations relating to export or re-export of the products and technical information described herein. All company names, brand names and trademarks herein are property of their respective owners.

FUJITSU SEMICONDUCTOR LIMITEDNomura Fudosan Shin-yokohama Bldg. 10-23, Shin-yokohama 2-Chome,Kohoku-ku Yokohama Kanagawa 222-0033, JapanTel: +81-45-415-5858http://jp.fujitsu.com/fsl/en/

Third-Generation Graphics SoC has high performance CPU/GPU, 6 video inputs, and 3 display output functions

MB86R20 SeriesIn addition to high graphics rendering performance,

these devices come with exhaustive software tools which make them ideally suitable for

the development of integrated HMI systems and 360°

wraparound view systems with recognition functions.

IntroductionIn order to increase the environmental friendliness, safety, Relief,

and comfort of automobiles, there is an increasing need for

“Integrated HMI (Human – Machine Interface) Systems” that are

windows of information linking together people, automobiles,

and the world, and the need is also increasing for “360°

Wraparound View Systems with Recognition Functions” that warn

without fail about dangers surrounding the vehicle in a

three-dimensional manner.

The “MB86R20 series” third-generation graphics SoC, compared

to the second-generation graphics SoC of the “MB86R10 series”,

has its CPU and GPU performances increased by 2 times and 5

times, respectively, and also has 6 video inputs and 3 display

output functions all available at the same time. Further, systems

with one-stop procurement of all necessary items and with lesser

number of man-hours can be developed because the necessary

software is also provided along with the chips.

MB86R20 Series

In order to experience driving that is environment-friendly, safe,

relieved, and also comfortable, the amount of information linking

people, automobiles, and the outside increases dramatically.

Now-a-days, such information spans various aspects such as battery

information of electric vehicles, vehicle fault diagnosis information,

image information from cameras, warning information, navigation

information, smart-phone-linked information, and cloud-linked

information, and so on.

Until now individual display control was being made of such

information using the center display, cluster display, head-up display,

etc. (Figure 1). However, in order to transfer information in real time

and in an easy-to-understand manner between the driver and the

vehicle, it is necessary to aggregate all such information in one

location and to carry out centralized control of how the information is

portrayed to match with the driving situation. This is done by an

integrated HMI system, and this trend is considered to accelerate as

the harmony among people, automobiles, and the environment

increases.

The MB86R20 series has a high-performance CPU/GPU, 6 video inputs,

and 3 display output functions available all at the same time,

aggregates video information from various sources such as a

system of cameras, head unit, etc., and carries out appropriate

display control of the center display, cluster display, head-up

display, etc. to suit the driving situation (Figure 2).

In addition, in an integrated HMI system, each display section is

modularized and platformed, which not only greatly reduces the

component count but also makes it easy to extend the product to

other vehicle types.

In a 360° wraparound view system, the entire surroundings of the

vehicle can be checked clearly and also from any viewpoint by

3-D processing of the images from four cameras installed at the

front, rear, left, and right of the vehicle. Systems using the

MB86R10 series devices, which are second-generation SoC, have

already been introduced in the market and are starting to spread

worldwide (Figure 3).

Tendency of Integrated HMI

Towards Further Safety and Relief (360° wraparound view system with recognition function)

Figure 1 Display control until now (Individual type)

Figure 3 360° wraparound view system using MB86R10 series

FRONT

Front,rear,left, and right camera images

3-D setting of the surrounding area

3-D processing of camera images

Free viewpoint image completed

BACK

RIGHTLEFT MB86R10series

FRONT

BACK

RIGHTLEFT

Figure 2 Display control by MB86R20 series (integrated HMI)

SPI360° wraparound

view 3-D monitoring system

IntegratedHMI

APIX, LVDS

Head unit

Smart-phone

MCU

Head-up display

LED

LEDRSDS RSDS

RSDS

Cluster display

MB88F330LED

Center display

MB88F330

CAN

MB86R20

USB/MHL/WiFi/BT

MB88F330

MB86R20

SPI

APIX, LVDS

MCU

Driver

LED

Sensor

Mirror

Mirror LEDRSDS RSDS

RSDS

Driver

MB88F330

Driver

LED

Sensor

MB88F330

CAN

MB86R20

Cloud

USB/MHL/WiFi/BT

MB88F330

MB86R20

FUJITSU

LED

LEDRGB

RGBSPISPI

T-con

T-con

Center display Cluster display Head-up display

CAN

360° wraparoundview 3-D

monitoring system

Head unit

MB86R20

LED

RGB

SPI

T-con

MCUMCU

MCU

MB86R20

MB86R20

MB86R20

USB/

MH

L/W

iFi/B

T

Driver

Sensor

LED

Sensor LEDRGB

RGBSPISPI

T-con

Driver

T-con

CAN

Frame buffer

Frame buffer

Driver

MB86R20

LED

Sensor

Mirror

RGB

SPI

T-con Frame buffer

MCUMCU

MCU

MB86R20

MB86R20

MB86R20

Internet

USB/

MH

L/W

iFi/B

T

FUJITSUFUJITSU

FUJITSU

MB86R20 Series(The block diagram is shown in Figure 6.)

Figure 4 The MB86R10 series is also compatible with mega-pixel cameras Figure 5 360° wraparound view monitor image with recognition function using the MB86R20 series

MB86R20 Series

Figure 6 Block diagram Figure 7 Example of processing in four rendering layers (possible up to 8 layers)

Display

Graphics board

MB86R12

DeserializerLVDS

DeserializerLVDS

DeserializerLVDS

DeserializerLVDS

Outputs the image

Image processing

MB86R12

1280 x 800 mega-pixeldigital cameras

Frontcamera Connector Deserializer

LVDS

Leftcamera Connector Deserializer

LVDS

Rightcamera Connector

Connector

Deserializer

Memory

LVDS

Rearcamera Connector Deserializer

LVDS

Right camera

Rear camera

Capturedimage

3-Dprojection grid

3-Dcar model

UARTUSART

Gen. PurposeBus 16bit

ARM® Neon™ SIMD ARM® Neon™ SIMD

ARM® Cortex™ -A9

533MHz

ARM® Cortex™ -A9

533MHz

L1-Cache 32/32 KB

L1-Cache 32/32 KB

Internal SRAM

L2 -Cache 512KB

PWR MgmtWatchdog

DDR3/3L 800/106616/32/64-bit (2 x32)

16chDMA

I²C

PWM

I²S

HS-SPISPI

Video Capture

Video Capture

Video Capture

Video Capture

Video Capture

Video Capture

Ethernet MACIEEE1588 CAN

ext. IRQ

USB 2.0

SD/MMC

GPIO

POWERVR™SGX543

3D Engine

OpenGL ES, VG, CL

Iris Core2D Engine

DitheringGamma

SIG Unit

Display CtrlRGB, LVDS

Display CtrlRGB

Display CtrlRGB

MediaLB®

ADC

Dual ARM® Cortex™-A92x 533MHz (automotive) ARM® Neon™ SIMD Engine

Display Controller 2x up to 1920x720p,1x up to 1920x1080p

POWERVR™ SGX5433D Engine 6,4GFLOPS, 1GPix/s,35MPoly @ 200MHzOpenGL® ES, OpenVG™, OpenCL™

Fujitsu proprietary 2D Engine

Video Capture 6 x 1920x1080

DDR3/3L-1066 x16, x32, x64

Standard I/O I²C, I²S, UART, SPI, FPD-Link

Network CAN, Ethernet

Proc

esso

rGr

aphi

csVi

deo

Mem

ory

Períp

hera

ls

Visible application

Layer 1

*Example of four layers

Layer 2

Layer 3

Layer 4

Connector

In the FutureSystem-level Software Tools

* ARM is the registered trademark of ARM Limited in the EU and other countries.

* Cortex-A9 is trademark of ARM Limited in the EU and other countries.

Figure 10 Organizational chart of the CGI Studio Figure 11 Software configuration diagram

Figure 8 Rendering the needles of cluster display and the image of the vehicle Figure 9 Rendering the needles of cluster display and the captured image

2-D engine 2-D engine3-D engine

Video capture

2-D engine 2-D engine

Debugging and compiling environment(E.g. Visual Studio / Eclipse)

MicrosoftWindows

Host development environment(PC) Target platform

Developmen environment forHMI designers

Development environment for embeddedsoftware developers

Software platform

Host constituent element

2DG/OpenGLES 2.0

2DG/OpenGLES 2.0

Green HillsSoftware

eSOLLinux …

3D Modeling tool(3s Max, Cinema 4D)

CPU / GPU

MCU / GPU MB86R20

Host Simulation

Rendering

GUI component

Candera

CGI Constituent element

CAN / MOST…

…

GUIapplication

Real Time OS

CanderaScene Composer

Geometry, Textures, Material, Animation

CGIConstituent

element

DesignImport

Visualize

Application

Sample program

360° wraparound viewlibrary

OS

printed circuit board with MB86R20

Middleware

OS/drivers

Hardware HardwareProvidedby Fujitsu

Semiconductors

Peripheral function drivers Drivers Customer’senvironment

GDC driver Filesystem

360° wraparound viewauthoring tools

SoC’s of the MB86R10 series, the CPU performance has been

increased to about 2 times, and the GPU performance has been

increased to about 5 times. In addition, at the same time, our

company’s excellent 2-D engine realizing warping-on-the-fly, etc.

has been installed. Because these operate independently, a

much higher performance has been obtained.

Multiple video inputs and strengthening of display outputsThis series is compatible with 6 full high-density video inputs and

3 video outputs. High resolution camera images can be input

implying that high resolution contents can be input, and outputs

can be made to several high resolution displays.

Rendering performance exceeding the specificationsIn addition to simultaneously operating 2-D engine, 3-D engine, and

video capture, by having eight rendering layers, optimum image

processing can be done on different rendering layers to suit the

application or the contents. For example, by 2-D/3-D processing of the

rendering of the needle in the cluster display and of the rendering of

the vehicle in different layers, a rendering performance is obtained

that is higher than the specifications (Figures 7 to Figure 9).

The MB86R10 series can accept not only analog cameras but also

mega-pixel digital cameras, whereby the surroundings of the vehicle

can be portrayed as very clear images (Figure 4). Along with the

proliferation of this system, the demand is not only for the ability to

visually verify the surroundings of the vehicle but also fornew

functions that reduce items overlooked by the driver.

The third-generation SoC of the MB86R20 series has much higher

performance CPU/GPU, and it has been possible to realize both

checking of the surroundings from any viewpoint and reduction of

oversight by the driver due to object recognition (Figure 5). In

addition, since 6 camera images can be handled at the same time,

the concerned scene can be enlarged and the degree of freedom of

portraying the 3-D image has been increased.

Strengthening CPU and GPUTwo ARM® CortexTM-A9 are used as the CPU. POWERVRTM SGX543 is

used as the 3-D engine, and compared to the second-generation

Automotive gradeThe high reliability has been realized meeting the demands in

automobile and other fields.

For integrated HMI systems, the authoring tool “CGI Studio” is

provided so that the contents design can be done by the

designer and the engineers by cooperative design (Figure 10).

Using this tool, not only the performance of the MB86R20 series

can be brought out to the maximum extent, but also because of

cooperative design by the designer and the engineer, the

contents visualized by the designer can be reproduced instantly

on the MB86R20, and reworks in the middle of merchandizing

get reduced.

For the 360° wraparound view system with recognition function,

in addition to the conventional set of software tools for 360°

wraparound view system (Figure 11), software products will be

provided successively for realizing recognition functions.

Development of 360° wraparound view system with recognition

functions can be made easily using these system-level software

products.

In the process of people, automobiles, and the environment

becoming more harmonized and automobiles becoming the natural

means of mobility in the day-to-day lives of people, there will be

increasing demand for the window of information linking people,

automobiles, and the world, that is, the “integrated HMI system”,

and the “360° wraparound view system with recognition function”

supporting safety and relief. Our company will continue to provide

LSI products towards the realization of a “human-centric” society in

which people are at the center