Embed Size (px)
Citation preview
Big Data and the Future of Analytics
Presented by: John-Paul Della Putta
Our Agenda for Today
Evolving Analytics From 1.0 to 3.0
3
The Rise of Big DataWhat it is, how it can benefit you
Big Data TechnologyWhat it is, what you need to know
Using Big Data & Analytics?Becoming analytics driven
Enhancing your AnalyticsIntroducing KPI Pulse
The FutureSome Predictions
Evolving AnalyticsAnalytics 1.0 to 3.0
5Analytics has Changed
6From Analytics 1.0 to 3.0
Analytics 1.0 Good old fashioned reporting & BI
7
Descriptive analytics Generally backward facing and showing
what’s happened and why Often there’s a considerable lag between
event and insight Traditional BI and Reporting – still
relevant today and won’t be going away soon
Analytics 2.0 The Rise of Big Data
8
Looking at much larger, broader data sets, often un-structured data
Emergence of new technologies which deal with large volumes of often un structured data
Rise of the Data Scientist
9
http://au.wiley.com/WileyCDA/WileyTitle/productCd-111866146X.html Video is half way down the page
Analytics 3.0Closing the loop
10
= Traditional Analytics
+ Big Data Technology
+ (possibly Big Data)
+ Prescribed Action
Example – Remote Gas Well MaintenanceWhat action will be taken automatically?
11
Lower Costs 12
Railroad sensor notices that a wheel is too hot and sends a signal to stop the train
A team is sent to perform repairs
Possible derailment is avoided
How operational analytics ‘operate’
It’s not analytics for operations
Descriptive Summarise and describe what’s happened in the past
Predictive Predict what’s likely to happen in the future
Prescriptive Determine actions to take and make the future happen
Recommended for You An example of operational analytics
16
Redshift is Amazon’s Hadoop as a service
17Internet Of ThingBe careful – lots of noise, not much
signal
Mini CrashThe Dark Side of Operational Analytics
18
19Google Flu-trendsOver-states actual flu incidents by 50%
Big DataSome real world examples
21
https://www.youtube.com/watch?v=OliVkzBLey4
22Siri was a pentagon labs experimentUses big data and machine learning etc.
Recommendation Engines 23
Average of many algorithms
Where Big Data is Used 24
Recommendations Risk, Fraud & Security Marketing
http://www.nytimes.com/2012/02/19/magazine/shopping-habits.html?pagewanted=all&_r=3& Target Video
Big Data 101A crash course
Not Your Usual DataBig data’s not just big – it’s different
27
Different Data Big Data is exciting because of all the new information it contains
3+ V’s 28
Volume Velocity Variety
Unstructured DataE.g. Emails
30
The Irony of Big DataThe Questions are Simple
31
Is this person a good credit risk?
Is this movie worth watching?
Is this too much to pay for this property?
Hadoop101
HadoopKey attributes
33
Open source (cost effective)
Stores data in 3 places (no backup)
Not a database, a file system (no loading)
Suitable for large amounts of unstructured data
Scalable – Can be distributed over many
computers (Yahoo has a 42,000 node
implementation)
It’s pretty complex..Sorry, I wish it wasn’t, but it is…
34
Better Decisions 35
Performance and market value. We find that DDD is associated with a 5 – 6% increase in their output and productivity, beyond what can be explained by traditional inputs and IT
5 – 6% Increase
Lowering Credit Risk
37ZestFinanceVideo on Payday lending
https://www.youtube.com/watch?v=FJ7f2-s67-0
How do You as a CFO Use Big Data?Will you be deploying your own Hadoop Cluster?
38
39Renting DataNot ready to build your own Hadoop cluster?
Qlik DataMarket
Qlik DataMarketUsing big data from the cloud
https://www.youtube.com/watch?v=0p04AZipJbA
The Way to a Man’s Heart is Through his StomachThe Way to a CFO’s Heart, is Through Their Budget
42
43
"Information is the oil of the 21st century, and analytics is the combustion engine” (Peter Sondergaard, Senior Vice President, Gartner)
End users want to be able to quickly analyse their own data
CFO’s don’t wait for IT
Qlik User-driven Analytics
47User Driven AnalyticsUsing Qlik Sense
http://www.qlik.com/videodownload?VideoID=74f8abff-5f74-403f-864c-f5e9d2d68f03
48
In-Memory
Instant Insights
Not Big-DataGood old-fashioned human research
Is Yelp paying too little? Are they being too greedy?
I Don’t know – need more data
Back to the real world
53Introducing KPI PulseOr Analytics 2.5
KPI’s on anyone’s mobile phoneNo need to login to the server or have a Qlik license
Click to drill down to the detailsSee key details and reports
PDF / Excel reports
Chat between usersManagers can ask why performance metrics aren’t met
Summary & Recap
What we learnt
So what did you learn? 59
If you were paying attention…
Analytics is changingMoving from descriptive analytics through Predictive to Prescriptive.
Big Data has 3V’sBig Data is different data and
It’s being used everywhere. You might end up renting it.
KPI PulseYou can get real time
analytics pushed out to your users’ mobile phones
Hadoop isn’t a DBIt’s not a database, it’s a filesystem and it’s complex. You can use it without building it
We started with science fiction
https://www.youtube.com/watch?v=zoxevkfSJus
Real life – how to catch a serial killer2011 QlikView is used to help catch a serial killer in Sweeden
