56
© 2019 The MathWorks, Inc. 1 Beyond the “I” in AI Loren Dean

Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 1

Beyond the “I” in AI

Loren Dean

Page 2: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 2

Watt Steam Engine

Page 3: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 3

Artificial intelligence is a transformative technology

based on McKinsey’s latest AI forecast – September 2018

Page 4: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 4

AI has tremendous potential to increase productivity

3x

4x

2x

=

McKinsey Global Institute, September 2018

Page 5: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 5

Yet AI is struggling

Why Most AI Projects FailOct, 2017

Most AI Projects Fail. Here’s How to Make Yours Successful.July, 2018

3 Common Reasons Artificial Intelligence Projects FailMay, 2018

Page 6: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 6

Google Photos AI fail goes viral

01.23.2018

Page 7: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 7

There are many ways Artificial Intelligence can fail

No data scientists

Not enough data

Too much data

Problem is a poor fit for AI

Poor ROI

Beyond the skill of the team

Problem is unsolvable

Incomplete tools

Can’t interact with other systems

Page 8: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 8

AI is more than just the intelligence of the algorithm

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 9: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 9

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 10: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 10

Bring human insights into AI

Select data

Make tradeoffs

Evaluate results

Page 11: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 11

Bring human insights into AI

• We are the domain experts

• Shortage of data scientists

• We need the right tools

Page 12: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 12

Improving New Zealand Dairy Processing• University of Auckland

• Auckland University of Technology

Page 13: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 13

Continuous Plant Process

Powdered Milk

Wanted to detect a bad product earlier

Days later

Raw Milk

Page 14: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 14

Data

Powdered Milk

Raw Milk

Wanted to detect a bad product earlier

AI modelPlant Process Predict Results

Near real-time

Page 15: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 15

Data

Powdered Milk

Raw Milk

They had lots of data

Plant Process

• Millions of data points

• 6 years

• 3 plants

Page 16: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 16

Data

Powdered Milk

Raw Milk

But…

AI modelPlant Process

Page 17: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 17

They made several key insights

1. Results were wrong

Page 18: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 18

They made several key insights

1. Results were wrong

2. Need to build a separate model for each plant

Plants behaved differentlyfrom each another

Page 19: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 19

They made several key insights

1. Results were wrong

2. Need to build a separate model for each plant

3. Plant’s operating state changes each year

Each year was like a completely different plant

Page 20: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 20

True

Cla

ss

Predicted Class

Bulk density prediction results were inaccurate

• Many false positives

• Unused classes

Page 21: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 21

They made several key insights

1. Results were wrong

2. Need to build a separate model for each plant

3. Plant’s operating state changes each year

4. Training data was biased

Page 22: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 22

True

Cla

ss

Predicted Class

100%

90%

83%

93%

93%

93%

97%

10%

10%

3%3%

3%

3%

3%

3% 3%

3%

3%

Resampling data resulted in higher predictive accuracy

• Resampled data

• Reduced the number of bins

Page 23: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 23https://imgur.com/gallery/8B5Tx

“It’s great to sit down with our industry partners and watch their jaws drop when they see how productive we are with MATLAB and how quickly we can analyze and plot data.Our results have enabled them to confirm hypotheses for which they lacked evidence, and have sparked new ideas for process improvement.”- David Wilson, Industrial Information and Control Centre

Page 24: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 24

To be successful with AI, we must …

Combine AI model buildingwith scientific and engineering insights

Along with tools that span both the science and engineering and the data science

Page 25: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 25

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 26: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 26

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 27: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 27

Implementation is about designing the solution

TestingData analysis

Reporting

Developing conceptPrototypingDeployment

Requirements buildingModeling and simulationVerification and validation

Research Manufacturing Autonomous System

Page 28: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 28

“Deliver on the promise of self-driving cars today.”

Page 29: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 29

Voyage’s goal was to quickly get to market

1. Target retirement communities

Page 30: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 30

Voyage’s goal was to quickly get to market

1. Target retirement communities

2. Use off-the-shelf components wherever possible

Page 31: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 31

Voyage’s goal was to quickly get to market

1. Target retirement communities

2. Use off-the-shelf components wherever possible

3. Bring in the right software tools across the entire workflow

Page 32: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 32

Voyage completed their AI system first

AIPerception

System

Page 33: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 33

But they needed to connect the AI to the rest of the system

AIPerception

System

Vehicle ControlSystem

Vehicle Dynamics

Environment

Page 34: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 34

Started with Simulink example that they could build upon

Page 35: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 35

Injected simulated vehicles to interact with while driving

Page 36: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 36

Deployed controller as ROS node and generated code

Robotics System ToolboxEmbedded Coder

Robot Operating System

Page 37: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 37

Train your AI faster with tight simulation loops

Field Data Algorithms

Usage

Better

SyntheticData

Simulated Usage

Page 38: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 38

One example of leveraging simulation for data synthesis

Simulation-based workflow

Simulate Auto-label

Traditional deep learning workflow

Record Label

AI model

Page 39: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 39

“Simulink + ROS allowed us to deploy a Level 3 autonomous vehicle in less than 3 months.” Alan Mond, Voyage

Page 40: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 40

To be successful with AI, we must …

Use tool chains that span the entire design workflow

Page 41: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 41

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 42: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 42

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 43: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 43

Interaction within complex environments

Page 44: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 44

What was the larger system the vehicle had to operate in?

Page 45: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 45

“Proactive patient care”

Page 46: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 46

Statistics and Machine Learning ToolboxSignal Processing ToolboxMATLAB CoderEmbedded Coder

Page 47: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 47

EarlySense’s AI can predict critical events before they happen

ContinuousMonitoring

EarlyDetection

EarlyIntervention

BetterOutcomes

AI AI

Page 48: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 48

Dashboards at nurses’ stations and on hallway monitors

Page 49: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 49

Alerts on hand-held devices carried by staff

Page 50: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 50

Address problems before they become emergencies

Page 51: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 51

To be successful with AI, we must …

Design how our systems will integrate and interact within their environment

Page 52: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 52

AI is a transformative technology But AI projects can and do fail

Success requires more than just intelligence

Page 53: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 53

Page 54: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 54

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

Page 55: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 55

Intelligence

Interaction

Insights

Implementation

Apply domain expertise

Operate within their environment

Span the entire design workflow

How will you apply AI to your projects?

Page 56: Beyond the “I” in AI · “Deliver on the promise of self-driving cars today. ... Microsoft PowerPoint - 2019 Expo Keynote - Beyond the I in AI.pptx Author: ldean Created Date:

© 2019 The MathWorks, Inc. 56

MATLAB Expo 2019

Go Beyond the “I” in AI