• Home

  • Documents

  • What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel...
81
© 2019 The MathWorks, Inc. 1 © 2015 The MathWorks, Inc. What’s New in MATLAB and Simulink

What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

  • Upload
    others

  • View
    21

  • Download
    0

Embed Size (px)

Citation preview

Page 1: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 1© 2015 The MathWorks, Inc.

What’s New in MATLAB

and Simulink

Page 2: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 2

Page 3: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 3

Algorithms in Everything

Page 4: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 4

Using MATLAB & Simulink to Build Algorithms in Everything

Simplifying your work…

…often at higher levels of abstraction.

Page 5: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 5

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design Outputs

Page 6: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 6

The capability of a machine to

match or exceed intelligent human behavior by

training a machine

to learn the desired behavior

Artificial Intelligence

training a machine

to learn the desired behavior

Page 7: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 7

Output

Program

There are two ways to get a computer to do what you want

Traditional Programming

COMPUTER

Data

Page 8: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 8

Program

Output

There are two ways to get a computer to do what you want

Machine Learning

COMPUTER

Data

Model

Page 9: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 9

Artificial Intelligence

Data Model

Machine

Learning

Deep

Learning

Page 10: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 10

Using MATLAB and Simulink to Build Deep Learning Models

Inputs

Inputs

Design

Design

Outputs

Outputs

Data

Machine

Learning

Deep

Learning

Model

Page 11: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 11

Using Apps for Ground Truth LabelingImage and Video Data

Inpu

ts

Desi

gn

Outp

uts

Computer Vision Toolbox

Page 12: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 12

Using Apps for Ground Truth LabelingSignal Data

Signal Processing Toolbox

Page 13: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 13

Using Apps for Ground Truth LabelingAudio Data

1 2 3

Audio Toolbox

Page 14: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 14

Using Apps for Designing Deep Learning Networks 2 1 3

Deep Learning Toolbox

Page 15: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 15

Using Transfer Learning with Pre-trained Models

Inception-v3 ResNet-101 VGG-16

ResNet-18 GoogLeNet DenseNet-201

SqueezeNet AlexNet ResNet-50

Inception-ResNet-

v2

VGG-19

Deep Learning Toolbox

Page 16: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 16

Using Models from Other Frameworks

(…)Caffe

Keras-

Tensorflow

PyTorch

Open Neural Network Exchange

MATLAB ONNX

CNTK

Caffe2

MXNet

Core ML

2

Deep Learning Toolbox

Page 17: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 17

Deploying Deep Learning Applications

ARM

Compute

Library

Intel

MKL-DNN

Library

1 2 3

Deep

Learning

Networks

Coder

Products

NVIDIA

TensorRT &

cuDNN

Libraries

MATLAB CoderGPU Coder

Inputs

Pre-

processing

Post-

processing

Page 18: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 18

Using MATLAB and Simulink to Build Deep Learning Models

Inputs

Inputs

Design

Design

Outputs

Outputs

Data

Machine

Learning

Deep

Learning

Model

Using MATLAB and Simulink for Reinforcement Learning

Reinforcement Learning Toolbox

Page 19: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 19

Using MATLAB and Simulink for Reinforcement Learning

Reinforcement Learning Toolbox

Page 20: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 20

Using MATLAB and Simulink for Reinforcement Learning

Inputs

Inputs

Design

Design

Outputs

Outputs

Data

Machine

Learning

Deep

Learning

Model

Reinforcement Learning Toolbox

Page 21: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 21

Inputs

Using MATLAB and Simulink for Reinforcement Learning

Inputs Design

Design

Outputs

Outputs

Machine

Learning

Deep

Learning

Model

SimulinkReinforcement Learning Toolbox

Scenario Design

Simulation-based

data generation

Generate Data

Page 22: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 22

Using MATLAB and Simulink for Reinforcement Learning

Reinforcement Learning Toolbox

Page 23: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 24

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs

Inputs

Design

Design

Outputs

Outputs

Page 24: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 25

Inpu

ts

Desi

gn

Outp

utsWorking with Text Data

Page 25: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 26

Inpu

ts

Desi

gn

Outp

utsWorking with Text Data

MATLAB

Page 26: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 27

Inpu

ts

Desi

gn

Outp

utsWorking with Text Data

Deep Learning ToolboxStatistics and Machine Learning ToolboxText Analytics ToolboxMATLAB

Page 27: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 28

Inpu

ts

Desi

gn

Outp

utsWorking with Text Data

Text Analytics ToolboxMATLAB

Page 28: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 29

Creating Your Own Data 1 2

Simulink

Page 29: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 30

1 2

Page 30: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 31

Identifying the Useful Data 2 1

Acquire Data

Identify

Condition

Indicators

Deploy &

IntegrateTrain Model

Preprocess

Data

Visualize data

Extract Features

Select the most

useful features

Machine

Learning

Page 31: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 32

Identifying the Useful Data 2 1

Predictive Maintenance Toolbox

Page 32: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 33

Identifying the Useful Data 2 1

Predictive Maintenance Toolbox

Page 33: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 34

Identifying the Useful Data 2 1

Predictive Maintenance Toolbox

Page 34: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 35

Designing Decision Logic with StateflowDesi

gn

StateflowMATLAB

in MATLAB

Page 35: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 36

Using Stateflow in MATLABDesi

gn

StateflowMATLAB

Page 36: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 37

Editing at the Speed of Thought

Simulink

Page 37: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 38

Editing at the Speed of Thought

Simulink

Page 38: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 39

Editing at the Speed of Thought

Simulink

Page 39: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 40

Editing at the Speed of Thought

Simulink

Page 40: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 41

Editing at the Speed of Thought

Simulink

Page 41: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 42

Controlling the Execution of Model Components

Export Function Model

Schedulable Rate-Based Model

Simulink

Desi

gn

Page 42: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 43

Controlling the Execution of Model ComponentsD

Simulink

Page 43: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 44

Simplifying Integration with External C/C++ Code

Column-Major

Simulink Coder

Page 44: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 45

Simplifying Integration with External C/C++ Code

Row-Major

Simulink Coder

Page 45: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 46

Viewing Generated Code Alongside the Model

Embedded Coder

Page 46: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 47

Viewing Generated Code Alongside the Model

Embedded Coder

Page 47: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 48

Sharing Live Scripts

MATLAB

Page 48: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 49

Sharing Live Scripts

MATLAB

Page 49: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 50

Sharing Live Scripts

MATLAB

Page 50: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 51

Creating Apps

MATLAB

Page 51: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 52

Deploying Web Apps

MATLAB Compiler

Page 52: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 53

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design Outputs

Page 53: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 54

Evaluating Architectures

Architecture

Inputs Design Outputs

Page 54: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 55

Architecture

Evaluating Architectures

Inputs Design OutputsArchitecture

Page 55: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 56

Designing System and Software Architectures

System1Composer1

Architecture

Page 56: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 57

Designing System and Software Architectures

System1Composer1

Inpu

ts

Desi

gn

Outp

utsArchitecture

Page 57: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 59

Designing Beyond System and

Software Architectures

AUTOSAR SoftwareSystems and

SoftwareSoC Hardware

and Software

System Composer SoC Blockset AUTOSAR Blockset

Page 58: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 60

OutputsDesignArchitectureInputs

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design OutputsArchitecture

Spanning

Test & Verification Collaboration Scaling

Page 59: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 61

OutputsDesignArchitectureInputs

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design OutputsArchitecture

Spanning

Test & Verification Collaboration Scaling

Page 60: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 62

OutputsDesignArchitectureInputs

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design OutputsArchitecture

Spanning

Test & Verification Collaboration Scaling

Page 61: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 63

Integrating with Third-party Requirements Tools

Simulink Requirements

SimulinkRequirements

External Requirements

Authored Requirements

External Requirements

Requirements

Management

Tools

ReqIF

Import

Edit

Export

Spanning

Output

s

DesignArchite

cture

Inputs

Page 62: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 64

Include Custom Code in Test & Verification

Simulink Design Verifier

Simulink C/C++ Simulink Design Verifier

Stateflow C/C++

Page 63: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 66

Using the MATLAB Unit Test FrameworkSpanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

MATLAB

Page 64: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 67

Using the MATLAB App Testing Framework

testCase.press(myApp.checkbox)

testCase.choose(myApp.discreteKnob, "Medium")

testCase.drag(myApp.continuousKnob, 10, 90)

testCase.type(myApp.editfield, myTextVar)

MATLAB

Page 65: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 68

Using the MATLAB Performance

Testing Framework Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

MATLAB

Page 66: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 69

Using Continuous Integration

MATLAB https://plugins.jenkins.io/

Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

Page 67: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 70

Using Continuous Integration

MATLAB https://plugins.jenkins.io/matlab

Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

Page 68: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 71

Using Projects in MATLAB

MATLAB

Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

Page 69: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 73

Parallel Simulations in Simulink

SimulinkParallel Computing Toolbox

Simulation Manageraafa

Worker

Worker

Worker

Head

Worker

MATLAB Desktop

Simulation Jobs

Simulation Results

batchsim

Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

Page 70: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 74

Scaling Computations on Clusters and Clouds

MATLAB Parallel Server

Spanning

Inpu

ts

Desi

gn

Outp

utsArchitecture

MATLAB

Parallel Computing Toolbox

Cloud

GPU

Multi-core CPU

…

MATLAB Parallel Server

Page 71: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 75

Inputs Design OutputsArchitecture

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design OutputsArchitecture

Spanning

Test & Verification Collaboration Scaling

Page 72: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 76

Specialized Tools for Building Algorithms

in Everything

Analog Mixed-SignalCommunications Physical interconnects

5G Toolbox SerDes Toolbox Mixed-Signal Blockset

Inputs Design Outputs

Architec

ture

Spanning

Page 73: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 77

Developing Autonomous Systems

Perception

Planning

Control

Page 74: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 78

Evaluate Sensor Fusion Architectures

Sensor Fusion and Tracking Toolbox

Page 75: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 79

Simulate Path Planning Algorithms

Automated Driving Toolbox

Page 76: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 80

Design Lane-following and Spacing

Control Algorithms

Model Predictive Control Toolbox

Page 77: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 81

Developing Autonomous Systems

UAV AlgorithmsLidar Processing

& Tracking

Computer Vision Toolbox

HERE HD Maps &

OpenDRIVE Roads

Automated Driving Toolbox Robotics System Toolbox

Page 78: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 83

Using MATLAB & Simulink to Build Algorithms in Everything

Inputs Design OutputsArchitecture

Spanning

Test & Verification Collaboration Scaling

Page 79: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 85

Read the Release Notes

Page 80: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 86

Get Started

Deep Learning Onramp

Learn to use deep learning techniques

in MATLAB for image recognition.

MATLAB Onramp

Quickly learn the

essentials of MATLAB.

Simulink Onramp

Learn to create, edit, and

troubleshoot Simulink models.

Page 81: What’s New in MATLAB and Simulink...Deploying Deep Learning Applications ARM Compute Library Intel MKL-DNN Library 1 2 3 Deep Learning Networks Coder Products NVIDIA TensorRT & cuDNN

© 2019 The MathWorks, Inc. 87© 2015 The MathWorks, Inc.


Deep Learning Inferencing on IBM Cloud with NVIDIA TensorRT...•class Calibrator(trt.infer.Int8EntropyCalibrator): # from the doc did not work •class Calibrator(trt.infer.EntropyCalibrator):

Deep Learning Inferencing on IBM Cloud with NVIDIA TensorRT...•class Calibrator(trt.infer.Int8EntropyCalibrator): # from the doc did not work •class Calibrator(trt.infer.EntropyCalibrator):

Documents
Deep Learning and GPUs - HPC Advisory Council€¦ · Accelerating Deep Learning: cuDNN GPU-accelerated Deep Learning subroutines High performance neural network training Accelerates

Deep Learning and GPUs - HPC Advisory Council€¦ · Accelerating Deep Learning: cuDNN GPU-accelerated Deep Learning subroutines High performance neural network training Accelerates

Documents
Best Practices For TensorRT Performance · 1.4. Built-In TensorRT Profiling To dig deeper into the performance of inference, it requires more fine-grained timing measurements within

Best Practices For TensorRT Performance · 1.4. Built-In TensorRT Profiling To dig deeper into the performance of inference, it requires more fine-grained timing measurements within

Documents
REAL WORLD PROBLEM SIMPLIFICATION USING DEEP LEARNING … · GPU Servers: Dual Xeon E5-2690 v4@2.6GHz with 16GB PCIe GPUs configs as shown Ubuntu 14.04.5, CUDA 9.0.103, cuDNN 7.0.1.13;

REAL WORLD PROBLEM SIMPLIFICATION USING DEEP LEARNING … · GPU Servers: Dual Xeon E5-2690 [email protected] with 16GB PCIe GPUs configs as shown Ubuntu 14.04.5, CUDA 9.0.103, cuDNN 7.0.1.13;

Documents
cuDNN API Reference · cuDNN API Reference DA-09702-001_v8.0.2 | 1 Chapter 1. Introduction NVIDIA® CUDA® Deep Neural Network library™ (cuDNN) offers a context-based API that allows

cuDNN API Reference · cuDNN API Reference DA-09702-001_v8.0.2 | 1 Chapter 1. Introduction NVIDIA® CUDA® Deep Neural Network library™ (cuDNN) offers a context-based API that allows

Documents
cuDNN Developer Guide · 2020. 7. 28. · cuDNN Developer Guide DU-06702-001_v8.0.2 | 2 Chapter 2. Programming Model The cuDNN library exposes a Host API but assumes that for operations

cuDNN Developer Guide · 2020. 7. 28. · cuDNN Developer Guide DU-06702-001_v8.0.2 | 2 Chapter 2. Programming Model The cuDNN library exposes a Host API but assumes that for operations

Documents
DU-08731-001 v5.0 RC | September 2018 TENSORRT ... · cudax.x, trt4.x.x.x and yyyymmdd with your specific OS version, CUDA version, TensorRT version and package date. The following

DU-08731-001 v5.0 RC | September 2018 TENSORRT ... · cudax.x, trt4.x.x.x and yyyymmdd with your specific OS version, CUDA version, TensorRT version and package date. The following

Documents
Chainer Documentation - Read the Docs · Chainer Documentation, Release 1.18.0 1.2.5Install Chainer with CUDA and cuDNN cuDNN is a library for Deep Neural Networks that NVIDIA provides

Chainer Documentation - Read the Docs · Chainer Documentation, Release 1.18.0 1.2.5Install Chainer with CUDA and cuDNN cuDNN is a library for Deep Neural Networks that NVIDIA provides

Documents
Deploying Deep Neural Networks to Embedded GPUs and CPUs - Matlab · MATLAB Coder and GPU Coder generates code that takes advantage of: NVIDIA® CUDA libraries, including TensorRT

Deploying Deep Neural Networks to Embedded GPUs and CPUs - Matlab · MATLAB Coder and GPU Coder generates code that takes advantage of: NVIDIA® CUDA libraries, including TensorRT

Documents
SWE-SWDOCTRT-001-RELN vTensorRT 5.0.3 | October 2018 ...... TensorRT SWE-SWDOCTRT-001-RELN_vTensorRT 5.0.3 | 1 Chapter 1. TENSORRT OVERVIEW The core of NVIDIA TensorRT is a C++ library

SWE-SWDOCTRT-001-RELN vTensorRT 5.0.3 | October 2018 ...... TensorRT SWE-SWDOCTRT-001-RELN_vTensorRT 5.0.3 | 1 Chapter 1. TENSORRT OVERVIEW The core of NVIDIA TensorRT is a C++ library

Documents
Support Matrix For TensorRT - NVIDIA · Support Matrix For TensorRT SWE-SWDOCTRT-001-SPMT _vTensorRT 5.1.2 RC | 11 ‣ Softplus ‣ Softsign ‣ Transpose ONNX Since the ONNX parser

Support Matrix For TensorRT - NVIDIA · Support Matrix For TensorRT SWE-SWDOCTRT-001-SPMT _vTensorRT 5.1.2 RC | 11 ‣ Softplus ‣ Softsign ‣ Transpose ONNX Since the ONNX parser

Documents
GPU Accelerated Deep Learning for CUDNN V2

GPU Accelerated Deep Learning for CUDNN V2

Documents
cuDNN Release Notes...cuDNN Release Notes RN-08667-001_v8.0.2 | ii Table of Contents Chapter 1. cuDNN Overview.....1 Chapter 2. cuDNN Release 8.x

cuDNN Release Notes...cuDNN Release Notes RN-08667-001_v8.0.2 | ii Table of Contents Chapter 1. cuDNN Overview.....1 Chapter 2. cuDNN Release 8.x

Documents
Fast Neural Network Inference with TensorRT on Autonomous ... · Plugin for Custom OPs in TensorRT 5 Custom op/layer: op/layer not supported by TensorRT => need to implement plugin

Fast Neural Network Inference with TensorRT on Autonomous ... · Plugin for Custom OPs in TensorRT 5 Custom op/layer: op/layer not supported by TensorRT => need to implement plugin

Documents
GPU ACCELERATED DEEP LEARNING WITH CUDNN · Deep learning with COTS HPC systems A. Coates, B. Huval, T. Wang, D. Wu, A. Ng, B. Catanzaro ICML 2013 GOOGLE DATACENTER 1,000 CPU Servers

GPU ACCELERATED DEEP LEARNING WITH CUDNN · Deep learning with COTS HPC systems A. Coates, B. Huval, T. Wang, D. Wu, A. Ng, B. Catanzaro ICML 2013 GOOGLE DATACENTER 1,000 CPU Servers

Documents
RN-08667-001 v8.0 | October 2019 CUDNN Release Notes€¦ · CUDNN OVERVIEW NVIDIA cuDNN is a GPU-accelerated library of primitives for deep neural networks. It provides highly tuned

RN-08667-001 v8.0 | October 2019 CUDNN Release Notes€¦ · CUDNN OVERVIEW NVIDIA cuDNN is a GPU-accelerated library of primitives for deep neural networks. It provides highly tuned

Documents
DEEPSTREAM SDK - User Manual Search Engine · cuDNN 7 & TensorRT 3.0 NVIDIA recommends that DeepStream be run on a hardware platform with an NVIDIA Tesla® P4 or P40 graphics card

DEEPSTREAM SDK - User Manual Search Engine · cuDNN 7 & TensorRT 3.0 NVIDIA recommends that DeepStream be run on a hardware platform with an NVIDIA Tesla® P4 or P40 graphics card

Documents
THE EXPANDING UNIVERSE OF HPC...cuTENSOR 1.0 cuSOLVER 10.3 cuBLAS 10.2 cuDNN 7.6 TensorRT 6.0 DALI 0.15 NCCL 2.5 IndeX 2.1 OptiX 7.0 RAPIDS 0.10 Spark XGBoost 3x in 2 Years 2017 2019

THE EXPANDING UNIVERSE OF HPC...cuTENSOR 1.0 cuSOLVER 10.3 cuBLAS 10.2 cuDNN 7.6 TensorRT 6.0 DALI 0.15 NCCL 2.5 IndeX 2.1 OptiX 7.0 RAPIDS 0.10 Spark XGBoost 3x in 2 Years 2017 2019

Documents
NVIDIA® cuDNN GPU-Accelerated Machine Learningspeech.ee.ntu.edu.tw/~tlkagk/courses/MLDS_2015/NN Lecture/CUDN… · Deep Learning with cuDNN cuDNN is a library of primitives for deep

NVIDIA® cuDNN GPU-Accelerated Machine Learningspeech.ee.ntu.edu.tw/~tlkagk/courses/MLDS_2015/NN Lecture/CUDN… · Deep Learning with cuDNN cuDNN is a library of primitives for deep

Documents
DU-08670-001 v07 | April 2018 CUDNN Installation Guide cuDNN on Linux cuDNN DU-08670-001_v07 | 4 1. Navigate to your directory containing cuDNN Debian file. 2. Install

DU-08670-001 v07 | April 2018 CUDNN Installation Guide cuDNN on Linux cuDNN DU-08670-001_v07 | 4 1. Navigate to your directory containing cuDNN Debian file. 2. Install

Documents
TensorRT Developer's Guide · 2019-10-23 · A.1.26. IUnaryLayer ... For deep learning inference, there are 5 critical factors that are used to measure software: Throughput The volume

TensorRT Developer's Guide · 2019-10-23 · A.1.26. IUnaryLayer ... For deep learning inference, there are 5 critical factors that are used to measure software: Throughput The volume

Documents
CNN INFERENCE WITH cuDNN - Nvidia...2 AGENDA Introduction to cuDNN cuDNN Best Practices: Memory Management Done Right Choosing the Right Convolution Algorithm & Tensor Layout Tensor

CNN INFERENCE WITH cuDNN - Nvidia...2 AGENDA Introduction to cuDNN cuDNN Best Practices: Memory Management Done Right Choosing the Right Convolution Algorithm & Tensor Layout Tensor

Documents
CNN & cuDNN - Piazza

CNN & cuDNN - Piazza

Documents
BRINGING AI-POWERED ROBOTS TO LIFE...Deepstream 1.5 TensorFlow CUDA 9.0 cuDNN 7.0 TensorRT 4.0 Jetpack 4.0/4.1 Deepstream 3.0 + Jetson Xavier CUDA 10 TensorRT 5.0 Ubuntu 18.04 Kernel

BRINGING AI-POWERED ROBOTS TO LIFE...Deepstream 1.5 TensorFlow CUDA 9.0 cuDNN 7.0 TensorRT 4.0 Jetpack 4.0/4.1 Deepstream 3.0 + Jetson Xavier CUDA 10 TensorRT 5.0 Ubuntu 18.04 Kernel

Documents
New MIOVISION DEEP LEARNING TRAFFIC ANALYTICS SYSTEM … · 2017. 5. 11. · embedded system on the Jetson platform. Currently evaluating TensorRT to gain additional performance

New MIOVISION DEEP LEARNING TRAFFIC ANALYTICS SYSTEM … · 2017. 5. 11. · embedded system on the Jetson platform. Currently evaluating TensorRT to gain additional performance

Documents
CUDNN Library (1)

CUDNN Library (1)

Documents
RN-08823-001 v20.02 | February 2020 TENSORRT Release Notes · 2020-02-25 · TensorRT RN-08823-001 _v20.02 | 5 Chapter 4. TENSORRT RELEASE 20.02 The NVIDIA container image for TensorRT,

RN-08823-001 v20.02 | February 2020 TENSORRT Release Notes · 2020-02-25 · TensorRT RN-08823-001 _v20.02 | 5 Chapter 4. TENSORRT RELEASE 20.02 The NVIDIA container image for TensorRT,

Documents
DEEP LEARNING WITH NVIDIA GPUS LEARNING WITH NVIDIA GPUS . 2 ... Deep Neural Network “watches” human drivers , ... Software Systems Hardware cuDNN DIGITS DevBox Titan X Tesla

DEEP LEARNING WITH NVIDIA GPUS LEARNING WITH NVIDIA GPUS . 2 ... Deep Neural Network “watches” human drivers , ... Software Systems Hardware cuDNN DIGITS DevBox Titan X Tesla

Documents
SWE-SWDOCTRT-001-DEVG vTensorRT 5.1.0 RC | January 2019 ... · TensorRT SWE-SWDOCTRT-001-DEVG_vTensorRT 5.1.0 RC | ii TABLE OF CONTENTS Chapter 1. What Is TensorRT

SWE-SWDOCTRT-001-DEVG vTensorRT 5.1.0 RC | January 2019 ... · TensorRT SWE-SWDOCTRT-001-DEVG_vTensorRT 5.1.0 RC | ii TABLE OF CONTENTS Chapter 1. What Is TensorRT

Documents
DIGITS DEEP LEARNING GPU TRAINING SYSTEM · System Management . 10 cuDNN Accelerates key routines to improve performance of neural net training Routines for convolution and cross-correlation

DIGITS DEEP LEARNING GPU TRAINING SYSTEM · System Management . 10 cuDNN Accelerates key routines to improve performance of neural net training Routines for convolution and cross-correlation

Documents