30
Big Data What does it mean? How do we mine it? John Johansen October 2013 [email protected]

Big Data What does it mean ? How do we mine it?

  • Upload
    miach

  • View
    22

  • Download
    0

Embed Size (px)

DESCRIPTION

Big Data What does it mean ? How do we mine it?. John Johansen October 2013 [email protected]. Session Objective. Who saw  that  coming! Our organizations’ data is increasingly capable of helping us anticipate and plan for the unexpected.  - PowerPoint PPT Presentation

Citation preview

Page 1: Big Data What does it  mean ?  How do we  mine  it?

Big DataWhat does it mean? How do we mine it?

John JohansenOctober [email protected]

Page 2: Big Data What does it  mean ?  How do we  mine  it?

2

Session Objective

Who saw that coming!• Our organizations’ data is increasingly capable of helping us anticipate and plan for

the unexpected.  – Powerful tools are emerging to help identify patterns and make predictions of potential risks and

opportunities.– These predictive analytics will allow companies to focus on the real trouble spots and develop the right

conclusions.

• This session will explore and demonstrate these tools while identifying potential applications and solutions in our day-to-day jobs. 

• At the conclusion of the session participants will understand– The role that analytics can play in supporting your organizational objectives.– How these tools can identify elevated risk and help plan effective strategies to maximize opportunities.

Who saw that coming? You did!

Page 3: Big Data What does it  mean ?  How do we  mine  it?

3

Agenda

• Big Data Explained

• Why Are These Solutions Emerging Now ?

• Some Common and Not-so Common Applications in our Businesses

• The Steps in the Mining Process

• A Real Live Demo of a Mining Process

• Questions

• Wrap - Up

Page 4: Big Data What does it  mean ?  How do we  mine  it?

4

But first… a promise…

Page 5: Big Data What does it  mean ?  How do we  mine  it?

5

But first… a promise…

Page 6: Big Data What does it  mean ?  How do we  mine  it?

6

But first… a promise…

No plunge !

Page 7: Big Data What does it  mean ?  How do we  mine  it?

7

Big Data Explained

Volume

Velocity

RF Tagging

Healthcare Monitoring

Unstructured Data

Sensor Data

Real Time Data

> Peta? Zetta

Voice of the Customer Text Analysis

Page 8: Big Data What does it  mean ?  How do we  mine  it?

8

Four Emitters Connected to the Internet of Things

• Cows & Crops

Page 9: Big Data What does it  mean ?  How do we  mine  it?

9

Transactions, Interactions & Observations

Page 10: Big Data What does it  mean ?  How do we  mine  it?

10

Big Data in the Gartner Hype Cycle

Page 11: Big Data What does it  mean ?  How do we  mine  it?

11

There are less scientific hype indicators

Page 12: Big Data What does it  mean ?  How do we  mine  it?

12

Why Now?

• Chances are, the tools you need are the tools you have.*

• At long last, the data that you need is the data that you have.

• The processing power that you need is the processing power that you have.*

* And if you don’t already have them, they are readily available with very reasonable ROI

Page 13: Big Data What does it  mean ?  How do we  mine  it?

13

Four Emitters Connected to the Internet of Things

• Cows & Crops

• Christmas Trees

Page 14: Big Data What does it  mean ?  How do we  mine  it?

14

Data is Increasingly a Differentiator

Production Reporting

Interactive Dashboards

Data Discovery

Predictive AnalyticsOperational Analytics

Diffe

rent

iatio

n

Sophistication

High

Low

Low High

Page 15: Big Data What does it  mean ?  How do we  mine  it?

Predictive Analytics

15

Page 16: Big Data What does it  mean ?  How do we  mine  it?

16

Potential Challenges

“Prediction is very difficult…

Niels Bohr

Casey Stengel

President Bill Clinton

Especially if it’s about the future.”

Page 17: Big Data What does it  mean ?  How do we  mine  it?

17

Predictive Analytic Solutions

• We see these solutions as a class of software tools that will look through large sets of data to uncover subtle patterns in data, then use those patterns to predict the behavior of a new set of data.

• The impact these solutions are having at companies are generally in the areas of:– Improving the profitability of existing clients by identifying high probability

cross-selling activities.– Improving the effectiveness of direct marketing programs through more

focused, higher likelihood of success programs.– Identifying fraud.– Identifying likely candidates for churn either in the customer-base or in the

channel.– Modeling customer reactions to price or term changes.

Page 18: Big Data What does it  mean ?  How do we  mine  it?

Organizations Embrace Analytics Differently

Page 19: Big Data What does it  mean ?  How do we  mine  it?

Killer Applications

Page 20: Big Data What does it  mean ?  How do we  mine  it?

20

What are the steps?

• As with any other solutions, we suggest starting at the end: Outlining specifically what we are hoping to achieve.

• Next we need to establish at least two sets of data from our existing historical data. One will help us Train the model, the other will be a Test set that will allow us to validate that in fact the model that we create is valid.

• Once we’re sure we’ve got a model that establishes the right relationships, we can run our source data through our model and get our predictions.

• Analyze, Rinse. Repeat.

Page 21: Big Data What does it  mean ?  How do we  mine  it?

21

Four Emitters Connected to the Internet of Things

• Cows & Crops

• Christmas Trees

• Pill Bottles

Page 22: Big Data What does it  mean ?  How do we  mine  it?

22

Demonstrating the Power

• We’ve arranged for a quick demo of the Microsoft tools.

– Churn Prediction

– Claim Amount

– Cross Selling

• It’s interesting to note, that this demonstration is running on a simple server, using software tools that are included, free, with Microsoft SQLServer.

Page 23: Big Data What does it  mean ?  How do we  mine  it?

23

Demonstration – Predicting Churn

Page 24: Big Data What does it  mean ?  How do we  mine  it?

24

Demonstration – Claim Cost

Page 25: Big Data What does it  mean ?  How do we  mine  it?

25

Demonstration – Cross Selling

Page 26: Big Data What does it  mean ?  How do we  mine  it?

26

Four Emitters Connected to the Internet of Things

• Cows & Crops

• Christmas Trees

• Pill Bottles

• Diapers

Page 27: Big Data What does it  mean ?  How do we  mine  it?

27

Questions?

Page 28: Big Data What does it  mean ?  How do we  mine  it?

28

In conclusion…

• Big Data Explained

• Why Are These Solutions Emerging Now ?

• Some Common and Not-so Common Applications in our Businesses

• The Steps in the Mining Process

• A Real Live Demo of a Mining Process

• Questions

Page 29: Big Data What does it  mean ?  How do we  mine  it?

29

In conclusion…

“I figure lots of predictions is best. People will forget the ones I get

wrong and marvel over the rest.”

Alan Cox

Page 30: Big Data What does it  mean ?  How do we  mine  it?

30

Contact

John JohansenPartner

Agile Technologies, LLCOne Easton Oval, Suite 388

Columbus, Ohio 43219

[email protected]

www.agiletech.com