Big Data - What is it Really About?

© TCC 2014, Confidential and Proprietary

BIG DATA: WHAT’S IT REALLY ABOUT?

Rich BruecknerPresident, InsideBIGDATA


AGENDA

• Proper Intro

• It’s Not the Data. It’s What You Use it for.

• How Big Data Got Me Here

• Case Studies

• HPC and Big Data

• Trends- What’s Next?

• Call to Action


THE PROPER INTRODUCTION

insideBIGDATA.com


WHAT BIG DATA IS NOT

• Size matters not.• It’s not about the Data, it’s what you

do with it.• Deriving insight from Data for

purposes for which it was never intended.


FOR TODAY’S DISCUSSION:

BIG DATA = HIGH PERFORMANCE DATA ANALYSIS


BIG DATA IS ABOUT TWO THINGS


BIG DATA IS ABOUT TWO THINGS

First it’s about Money, Lots of Money



SO WHAT’S THE SECOND THING?







“ Bayesian probability provides a rational method for updating beliefs.”

http://en.wikipedia.org/wiki/Bayesian_probability

http://en.wikipedia.org/wiki/Bayesian_probability

http://en.wikipedia.org/wiki/Rationality


Big Data is about Degrees of Belief.

…even about how we feel about data itself.


Can I prove that Big Data is about Degrees of Belief?

These 12 words just cost Facebook $18 billion of value:

"We did see a decrease in daily users specifically among

younger teens."


BIG DATA- WHAT’S CHANGED?

http://bit.ly/1gZ7ZbD

• The nature of the Data: From Sampling to Full Datasets

• Rise of unstructured data

• Acceptance of messiness in the data

• N=All


THE BIG DATA FRONTIER

There is no Eminent Domain


SO WHERE ARE HEADED IN THIS TALK?


BEWARE THE BIG DATA NAYSAYERS WHAT IS THEIR AGENDA?


IF BIG DATA IS SO POWERFUL, WHY CAN’T IT PREDICT THE ECONOMY?

The Stock Market is all about Degrees of Belief!

• The economic system is non-linear.

• Therefore, even a small stimulus can create a completely unexpected result

• It’s a complex dynamical system where you don’t have clear knowledge of the initial conditions or the conditions of the stimulus.

• Big Data can can help you see averages, find the needle in the haystack, and help identify the accurate models for predicting what the market is really going to be doing.


HOW BIG DATA GOT ME HERE


HOW BIG DATA GOT ME HERE

• REACH – Measure of total audience size.• RESONANCE – How much activity

someone creates when he/she publishes.• RELEVANCE – How relevant someone is to

a topic.


CASE STUDY: SUMO FRAUD

• Match-Fixing Scandal in 2011• Discovered through Big Data analysis.• Proven by Text Messages.• $200 tickets and $1 Million Dollar

Champions.


CASE STUDY: PREDICTION MACHINE

• Tool simulates each and every game 50,000 times before making a pick.

• 32 million Americans average yearly spend is $467 or $15 billion in total playing.


CASE STUDY: MORTGAGE FRAUD

LexisNexis Risk Analysis

• Developed HPCC technology - an HPC alternative to Hadoop

• Database has 270 Million Individuals in the US Alone

• They know you’re that John Smith

• Graph Analysis spots Relationships

• Ability to spot mortgage fraud rings that were previously undetectableAnnual Fraud Estimates:

• California, at $864 million• New York at $278 million• Florida at $273 million



CASE STUDY: BIG BROTHER WATCHES BIG BROTHER


WORLD’S CONVERGING:HPC AND BIG DATA

Venus(HPC)

Mars(Big Data)


PAYPAL CASE STUDY: HPC IN THE ENTERPRISE

“Examples of large organizations using HPC include PayPal, which IDC estimates has saved over $700 million by adopting HPC for real-time detection of online consumer fraud.”

- Steve Conway, IDC


PAYPAL CASE STUDY: HPC IN THE ENTERPRISE


HPC - WHAT’S CHANGED?

2013 Tianhe 23,120,000 cores33.86 Petaflops (1015)

1986CRAY X-MP/44 Vector Processors800 Mflops (106)


THE HPC FRONTIER


TRENDS• Rise of Real-Time

Analytic through in-memory technologies

• Enterprises adopt HPC technologies into workflow

• Internet of Things Feeds Big Data Phenomenon and ends up swallowing Big Data as a meme.

•bitly.com/theObserverEffect



SUMMARY

Big Data is about two things:

•Money! Making More and Keeping it

•Degrees of Belief


CALL TO ACTION

• Check out insideBIGDATA.com

• Buy this book:

• Big Data: A Revolution That Will Transform How We Live, Work, and Think by Viktor Mayer-Schonberger and Kenneth Cukier


CALL TO ACTION

Read my SCI-FI Original:

The Observer Effect

http://bit.ly/theobservereffect


POLL: SO HOW DID I DO TONIGHT?


PLEASE LET ME KNOW HOW I DID!“Big Data: What’s It Really About?”

1) WITH YOUR MOBILE DEVICE:In the TCCLive mobile app,

“Agenda” section, then tap “Surveys”

- OR -

2) FILL OUT THE PAPER VERSIONgiven to you at registration

Thank You For Attending!

Technology

Big Data - What is it Really About?