30
Machine Learning Cases Sharing Tony Lin

Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Machine Learning Cases SharingTony Lin

Page 2: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

?

idea profit

Page 3: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Team Data Science Process

Business

Understanding

Data Acquisition

& Understanding

Deployment

Modeling

Intelligent

Application

Web

Services

Mode

l

Store

• Transform, Binning

• Temporal, Text, Image, etc.

• Feature Selection.

Feature

Engineering

•Algorithms, Ensemble

•Hyper-parameter Tuning

•Retraining

Model

Fitting

•Cross Validation

•Model Reporting

Model

Evaluation

• On-Premises vs Cloud

• Database vs Files Data Source

• Streaming vs Batch

• Low vs High Frequency Pipeline

• Structured vs Unstructured

• Data Validation and Cleanup

• Visualization

Data

Wrangling

• On-Premises vs Cloud

• Database vs Data Lake vs ..

• Small vs Medium vs Big Data

Analytics

Environment

Start

EndCustomer

Acceptance

Scoring Performance,

Monitoring, etc.

Page 4: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Overview of Machine Learning Algorithms

Regression

How much? How many?

Classification

Which class does this belong to?

Clustering

Are there different groups? Which group does it belong to?

Anomaly Detection

Is this weird?

Reinforcement Learning

Which should I do?

Supervised

Unsupervised

Page 5: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Option 1 – Easy

idea profitprebuilt AI

Page 6: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Cognitive Services

Infuse your apps, websites and

bots with intelligent algorithms to

see, hear, speak, understand and

interpret your user needs through

natural methods of communication

Page 7: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 8: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Selfies for Security

To safeguard against fraud and

enhance both driver and rider

peace of mind

Page 9: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

End to End Workflow

Data Acquisition Modeling Deployment

Page 10: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 11: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Option 2 – Still Easy, but More Work

idea profitcustomize

prebuilt AI

Page 12: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 13: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Steel Surface

Inspection with Image

Classification

To classify different kinds of defects

with an automated way

Page 14: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 15: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

End to End Workflow

Data Acquisition Modeling Deployment

Nail

Scratch

Smear

Noise

NormalWindows

Machine LearningONNX

Custom Vision

Page 16: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 17: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Option 3 – Hands Will be Dirtied

idea profitcustom AI

Page 18: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Option 3

idea profitcustom AI

data experiment

model deploy

Page 19: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

AI Platform

Artificial Intelligence productivity

for every developer and every

scenario

Page 20: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

The Microsoft AI platform: Azure & AI

Services

Infrastructure

Tools

Page 21: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Steel Surface

Inspection with

Object Detection

There are strong demands on

detecting defects

Page 22: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

End to End Workflow

Modeling DeploymentData Acquisition

Windows

Machine LearningONNX

Page 23: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 24: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Robotic Arm

Anomaly Detection

To identify the abnormal behavior

of robotic arms with electric

current motor sensor

Page 25: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

End to End Workflow

Data Acquisition Modeling Deployment

Page 26: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation
Page 27: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Recap

Page 28: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Prepare data Build and train Deploy

Building your own AI models

Transforming data into intelligence

Page 29: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

Prebuilt AICognitive Services

Customize Prebuilt AICustom Vision Service

Custom AIAzure Machine Learning

AI Services in Azure

Bringing the best of AI to Azure and the best of Azure to AI

Page 30: Machine Learning Cases Sharing - Microsoft... · •Feature Selection. Feature Engineering •Algorithms, Ensemble •Hyper-parameter Tuning •Retraining Model Fitting •Cross Validation

© 2018 Microsoft Corporation. All rights reserved.

Thank you