19
1 © 2015 The MathWorks, Inc. Analyzing Fleet Test Data Master Class Seth DeLand

Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

1© 2015 The MathWorks, Inc.

Analyzing Fleet Test DataMaster Class

Seth DeLand

Page 2: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

2

Topics

Reasons for analyzing fleet data

MATLAB datatypes for improved productivity

Scaling up analysis with mapreduce and parallel computing

Machine Learning

Moving to production

Page 3: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

3

Why Analyze Fleet Data?

Big-picture view that was previously unavailable

Design Decisions

– Real-world fuel economy

– Emissions

– Vehicle dynamics

– Ride and handling

– Prognostics

– Durability

Algorithm Validation

– Engine

– Prognostics

– ADAS

– Hybrid/EV

Page 4: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

4

Accessing Fleet Data

File I/O• Text

• Spreadsheet

• XML

• CDF/HDF

• Image

• Audio

• Video

• Geospatial

• Web content

Hardware Access• Data acquisition

• Image capture

• GPU

• Lab instruments

Communication Protocols• CAN (Controller Area Network)

• DDS (Data Distribution Service)

• OPC (OLE for Process Control)

• XCP (eXplicit Control Protocol)

Database Access• ODBC

• JDBC

• HDFS (Hadoop)

Page 5: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

5

New MATLAB Datatypes

Table

– Mixed-type tabular data

– Flexible indexing

– Built-in functionality (merge, sort,

join, etc.)

Datetime

– Time stamps, Durations

– Add, subtract, sort, compare, plot

– Customize display formats

– Nanosecond precision

Page 6: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

6

Working with Fleet Data

Goals

Import data from different sources

Clean-up and preprocess data

Merge data

Share analysis with others

Page 7: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

7

Scaling up analysis

Parallel Computing Toolbox

– MATLAB worker on each core of your desktop

– Loops: for -> parfor

– Built-in support in many functions

– MATLAB Distributed Computing Server

Map-Reduce

– Datastore for accessing data

– Mapreduce for processing data

– Run on Hadoop, or on MATLAB Distributed

Computing Server

Page 8: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

8

Event Detection

Parse data, find sudden deceleration

Map Reduce workflow

– Serial on Desktop

– Parallel on Desktop

– Point to HDFS

– Deploy to Hadoop

Page 9: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

9

Machine Learning

Machine learning uses data and produces a program to perform a task

Standard Approach Machine Learning Approach

𝑚𝑜𝑑𝑒𝑙 = <𝑴𝒂𝒄𝒉𝒊𝒏𝒆𝑳𝒆𝒂𝒓𝒏𝒊𝒏𝒈𝑨𝒍𝒈𝒐𝒓𝒊𝒕𝒉𝒎

>(𝑠𝑒𝑛𝑠𝑜𝑟_𝑑𝑎𝑡𝑎, 𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑦)

Computer

Program

Machine

Learning

𝑚𝑜𝑑𝑒𝑙: Inputs → OutputsHand Written Program Formula or Equation

If X_acc > 0.5

then “SITTING”

If Y_acc < 4 and Z_acc > 5

then “STANDING”

𝑌𝑎𝑐𝑡𝑖𝑣𝑖𝑡𝑦= 𝛽1𝑋𝑎𝑐𝑐 + 𝛽2𝑌𝑎𝑐𝑐+ 𝛽3𝑍𝑎𝑐𝑐 +

Task: Human Activity Detection

Page 10: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

10

Overview – Machine Learning

Page 11: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

11

Clustering ExampleGear Selection

Goal

Given data for engine speed and

vehicle speed, identify clusters of data using kmeans

Other applications

– Separating different operating conditions

– Clustering driver/buyer types

Page 12: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

12

Classification ExampleHuman Activity Learning Using Mobile Phone Data

Machine

Learning

Data:

3-axial Accelerometer data

3-axial Gyroscope data

Other applications:

ADAS: Ground-truth

Predictive Maintenance

Page 13: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

13

Overview – Machine Learning

Page 14: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

14

Analysis Domains

Page 15: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

15

Taking MATLAB to Production

Page 16: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

16

Additional Resources

Page 17: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

17

MathWorks Services

Consulting– Integration

– Data analysis/visualization

– Unify workflows, models, data

Training

– Classroom, online, on-site

– Data Processing, Visualization, Deployment, Parallel Computing, Machine Learning

www.mathworks.com/services/consulting/

www.mathworks.com/services/training/

Page 18: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

18

Summary

Reasons for analyzing fleet data

MATLAB datatypes for improved productivity

Scaling up analysis with mapreduce and parallel computing

Machine Learning

Moving to production

Page 19: Analyzing Fleet Test Data · 2 Topics Reasons for analyzing fleet data MATLAB datatypes for improved productivity Scaling up analysis with mapreduce and parallel computing Machine

19© 2015 The MathWorks, Inc.

Questions?