58
Microsoft BI Consultant Ordina Belgium Mulkens Jan Hermans Kimberly Data Scientist Ordina Belgium Democratizing Data Science With Microsoft

Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Microsoft BI Consultant

Ordina Belgium

Mulkens Jan Hermans Kimberly

Data Scientist

Ordina Belgium

Democratizing Data ScienceWith Microsoft

Page 2: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who am I

Kimberly Hermans

Data Scientist & CRM consultant

Practice Manager: Data Talks

“Bringing big data, data science & visualisation together and

getting rid of the silos is what will get you the return on data”

Page 3: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who am I

Jan Mulkens

Microsoft BI Consultant

Competence Lead: Microsoft Advanced Analytics

@JanMulkens

www.janmulkens.be

www.globalpowerbi.com

Page 4: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ActivitiesBlog:

- www.janmulkens.be

- www.globalpowerbi.com

Speaker:

- Belgian SQL Server user group (DataMinds)

- Belgian Information Worker user group (BIWUG)

- Various other external events

- Webinars

- Guest lectures

Organiser:

- Internal Ordina events

- Virtual user group events

Page 5: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Our employer

Page 6: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What Ordina says

“We increase our customers 'Return on Data' by taking them on a journey to a modern &

innovative data culture. We organically grow into the most focused, fast, flexible, friendly and fun BI & Data Science community on the Belgian

Market employing >100 growing & happy employees”

Page 7: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What we experience

“We increase our customers 'Return on Data' by taking them on a journey to a modern &

innovative data culture. We organically grow into the most focused, fast, flexible, friendly and fun BI & Data Science community on the Belgian

Market employing >100 growing & happy employees”

*Emphasis is my own

Page 8: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Takeaway

Setting expectations

• Targeted at anyone looking to promote data science within their organisation. Including data scientists looking to have the business build upon their work

• Focus is on learning about which tools can help enable citizen data scientists

Tools enable citizen data science.

Microsoft made the tools for you.

What to expect Take-away

Page 9: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

End User Everyone

The age of

Classic BI

End UserIT Analyst

The age of

Self Service BIThe age of

Data Culture

Data Culture

Amir Netz & Kamal Hathi on the Age of Data Culture

https://www.youtube.com/watch?v=rg3lzHRxNqM

Page 10: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Agenda

Intro to Data Science A Fool with a ToolTooling

Page 11: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Intro to Data Science

Intro to Data Science

Page 12: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Why?

Page 13: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Value

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Page 14: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Value

Page 15: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: Gartner (October 2014)http://www.gartner.com/newsroom/id/2881218

Why?

Value

Page 16: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Who?

ML

Researcher

Data

ScientistML Engineer

Citizen Data Scientist

Page 17: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Up to15hrs / week

Up to15hrs / week

Up to15hrs / week

Full work week

Up to 4 hrs / week

Source: Generalized from O’Reilly’s “2015 Data Science Salary Survey” (sep 2015)

ETL Data Cleaning Machine LearningExploratory Data Analysis

Data Science Time Schedule

Page 18: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Citizen Data Scientists- Exploratory Analysis

- Visualization

- Putting insights into action

Come from both the business and IT

- BI Developers & Analysts

- Power users

Page 19: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Why?- Requirements going beyond BI

- Shortage of data scientists

- Ad-hoc analysis doesn’t scale

- Getting direct support from the business and IT for your data science project

- Bigger chance at project success & deployment because of buy-in

Page 20: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Page 21: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationDifferent data problems require different knowledge

Clustering & dimensionality reduction: (e.g. K-means clustering)

Regression: (e.g. Linear regression)

Association: (e.g. Recommenders) Classification: (e.g. Logistic regr., trees)

Machine learning algorithms

Likely buy

BuySimilar

Page 22: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationDifferent data problems require different knowledge

Predict

values

Find

unusual

occurrences

Discover

structure

Predict

categories

Page 23: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 24: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 25: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 26: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

EducationPick a data science process as a guide

Define

Goal

Collect

Data &

explore

Build

Model

Evaluate

Model

Present

Results

Deploy

Model &

monitorKDD

CRISP-DM

CCC Big Data Pipeline

Microsoft Team Data Science Process

...

Page 27: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Create a Data Culture

- Open communication

- Supportive learning environment

- Reviews of models & performance

- Data scientist available to help

Page 28: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

How?Education

- Basic education on required data science topics where necessary

Create a Data Culture

- Open communication

- Safe learning environment

- Reviews of models & performance

- Data scientist available to help

Tooling

- Using the right tools to help non-data scientists develop predictive solutions

Page 29: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 30: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 31: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Data Catalog- Register

- Annotate

- Understand

- Discover

Ingest Prepare Analyze Publish Consume

Page 32: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 33: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 34: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 35: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cognitive Services

Page 36: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 37: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Azure ML Studio- Easy to get started

- Create, Share & Publish

- Supports team collaboration

- Web-Basedhttps://studio.azureml.net

Page 38: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 39: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 40: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 41: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 42: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Cortana Inteligence Gallery

Page 43: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Tooling

Page 44: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Power BI

Page 45: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 46: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing
Page 47: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Azure DS VM- Microsoft R Server

- Anaconda Python

- Julia Pro

- Jupyter Notebooks (R, Python, Julia)

- Visual Studio Community Edition- With Python, R, node.js tools

- Power BI Desktop

- SQL Server 2016 Developer Edition- Including support for in-database analytics with R Server

- Open Source Deep Learning Tools

Page 48: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

What could possibly go wrong?

Page 49: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

A Fool with a Toolss

Page 50: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (logic)

Page 51: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (stability)

Page 52: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Horror stories (relativity)

A B

Page 53: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Source: http://timoelliott.com/blog/wp-content/uploads/2015/03/citizen-data-scientists.png

Wrapup: Be a citizen data scientist

Page 54: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Wrapup: Use tools that enable you

Page 55: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Thank you!

Page 56: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

Resources

Page 57: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ResourcesGet inspired: Amir Netz & Kamal Hathi on “The age of data culture”

- https://www.youtube.com/watch?v=rg3lzHRxNqM

Gartner on Advanced Analytics (Oct 2014)- http://www.gartner.com/newsroom/id/2881218

Azure Data Catalog- https://azure.microsoft.com/en-us/services/data-catalog/

Cortana Intelligence Gallery- https://gallery.cortanaintelligence.com/

Page 58: Democratizing Data Science - Denver SQL · Democratizing Data Science With Microsoft. Who am I Kimberly Hermans Data Scientist & CRM consultant Practice Manager: Data Talks “Bringing

ResourcesPower BI Partner Showcase

- https://powerbi.microsoft.com/en-us/partner-showcase/

Azure Data Science VM- https://azuremarketplace.microsoft.com/en-

us/marketplace/apps/microsoft-ads.standard-data-science-vm

Machine Learning Basics Infographic- https://docs.microsoft.com/en-us/azure/machine-learning/machine-

learning-basics-infographic-with-algorithm-examples

Microsoft Professional Program in Data Science- https://academy.microsoft.com