1
VISUAL COMPUTING: THE ROAD AHEADJEN-HSUN HUANG, CO-FOUNDER & CEO | CES 2015
2
“Holy Crap, NVIDIA’s New
Tegra K1 Has 192 Cores?!
— Gizmodo
TEGRA K1 THE FIRST SUPERCHIP
”MOBILE ARCHITECTURE
MaxwellKepler
TeslaFermi
Tegra 3Tegra 4
Tegra K1
GEFORCE ARCHITECTURE
3
“…faster, less power hungry, and quieter… once again NVIDIA has landed the technical trifecta”
— Anandtech
4
TEGRA X1 MOBILE SUPERCHIP 256-core Maxwell GPU | 8-core 64-bit CPU | 4Kp60 10-bit H.265/VP9
5
SETTING THE BARRELATIV
E P
ERFO
RM
AN
CE
Tegra K1
0.5x
1.0x
1.5x
0GFXBench 3.0 Manhattan
1080p offscreenGFXBench 2.7 TRex
1080p offscreen3Dmark 1.3 Icestorm
UnlimitedBasemarkX 1.1
6
SETTING THE BARRELATIV
E P
ERFO
RM
AN
CE
0.5x
1.0x
1.5x
0
Tegra K1 A8X
GFXBench 3.0 Manhattan1080p offscreen
GFXBench 2.7 TRex1080p offscreen
3Dmark 1.3 IcestormUnlimited
BasemarkX 1.1
7
RAISING THE BAR. AGAIN.RELATIV
E P
ERFO
RM
AN
CE
0.5x
1.0x
1.5x
0
Tegra K1 A8x Tegra X1
GFXBench 3.0 Manhattan1080p offscreen
GFXBench 2.7 TRex1080p offscreen
3Dmark 1.3 IcestormUnlimited
BasemarkX 1.1
8
SUPER ENERGY EFFICIENCY
Tegra K1
PERFO
RM
AN
CE
Tegra X1
GPU POWER
GFXBench 3.0 Manhattan (1080p, Offscreen)
9
CONSOLE EXPERIENCE.MOBILE POWER.
Tegra X1 Xbox One~10W >>100W
10
11
WORLD’S 1ST TERAFLOPS MOBILE PROCESSOR
Tegra 2 Tegra 3Tegra 4
Tegra K1
0
200
400
600
800
1000
1200
GFLO
PS
Tegra X1 (FP16)
TIME
12
WORLD’S 1ST TERAFLOPS MOBILE PROCESSOR
Tegra 2 Tegra 3Tegra 4
Tegra K1
0
200
400
600
800
1000
1200
ASCI Red1st Teraflops Supercomputer
GFLO
PS
Tegra X1 (FP16)
TIME
13
WORLD’S 1ST TERAFLOPS MOBILE PROCESSOR
Tegra 2 Tegra 3Tegra 4
Tegra K1
0
200
400
600
800
1000
1200
GFLO
PS
FP16/INT16
Core i7
Tegra X1
CPU
GPUGPU
CPU
Tegra X1 (FP16)
Note: 4790K Core i7, CPU @ 4GHz, GPU @ 350 MHz
TIME
14
TEGRA X1 MOBILE SUPERCHIP 256-core Maxwell GPU | 8-core 64-bit CPU | 4Kp60 10-bit H.265/VP9
15
16
0
5
10
15
20
25
PIXELS IN AUTO DISPLAYSPIX
ELS (
MIL
LIO
NS)
2010 2012 2014 2016 2018 2020
780K 1.3M
3.7M
6.6M
9.7M
380K
20M+
17
INTRODUCINGNVIDIA DRIVE™ CXDIGITAL COCKPIT COMPUTER
16.6M pixels maximum resolution
Industry’s most advanced visual computing platform
Maxwell — NVIDIA’s newest GPU architecture
NVIDIA DRIVE Studio
18
DRIVE CXTODAY
19
DRIVE CXTODAY
20
21
22
23
STATE-OF-THE-ART ADAS
24
CAMERA TECH RAPIDLY IMPROVING
25
THE ROAD TO AUTO-PILOT CARS
Environment Model • Situation Awareness • Path Finding • Learning
26
INTRODUCINGNVIDIA DRIVE™ PXAUTO-PILOT CAR COMPUTER
Dual Tegra X1 ● 12 camera inputs ● 1.3 GPix/sec
2.3 Teraflops mobile supercomputer
CUDA programmability
Deep Neural Network Computer Vision
Surround Vision
27
NVIDIA DRIVE PX PIPELINE
Tegra X1
.
.
.
VPE
CPU
ISP
Drive Train
Power Train
Display
DVR
GPU
.
.
.
Environment Model • Situation Awareness • Path Finding • Learning
28
DEEP LEARNING REVOLUTIONIZES VISION
FEATURE DETECTORS
DEEP NEURAL NETWORK
(…)
29
72%
74%
84%
88%
93%
2010 2011 2012 2013 2014
ImageNet Challenge
GPU is 1 of 3 Breakthroughs Revolutionizing Deep Learning
“Neural nets running on GPUs are routinely used by cloud-enabled companies such as Facebook to identify your friends in photos…”
Accuracy
NVIDIA CUDA GPU
30
HOW A DEEP NEURAL NETWORK SEES
Image “Audi A7”
Image source: “Unsupervised Learning of Hierarchical Representations with Convolutional Deep Belief Networks” ICML 2009 & Comm. ACM 2011.Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Ng.
31
ADAS TODAY
pedestrian
32
occludedpedestrian
33
vehicle
34
school bus
35
ambulance
36
37
NVIDIA GPU SUPERCOMPUTER
NVIDIA DEEP LEARNING ARCHITECTURE
Network
Solver
Data ScientistTrained
Deep
Neural
Net
Model
38
NVIDIA DRIVE PXNVIDIA GPU SUPERCOMPUTER
Classified Object!
NVIDIA DEEP LEARNING ARCHITECTURE
Network
Solver
TX1 TX1
Camera
Inputs
Data ScientistTrained
Deep
Neural
Net
Model
39
NVIDIA DRIVE PXNVIDIA GPU SUPERCOMPUTER
Classified Object!
CARS THAT SEE BETTER… AND LEARN
Network
Solver
TX1 TX1
Data Scientist Camera
Inputs
!
Trained
Deep
Neural
Net
Model
40
TEGRA X1 CLASSIFICATION PERFORMANCE
AlexNet
0
10
20
30
Tegra K1 Tegra X1
IMAG
ES /
SECO
ND
41
42
RICKY HUDIEXECUTIVE VP OF ELECTRONICS DEVELOPMENT
43
44
45
46
POWERED BY NVIDIA TEGRA X1
DRIVE CXDIGITAL COCKPIT COMPUTER
DRIVE PXAUTO-PILOT COMPUTER
47