37
1 © Cloudera, Inc. All rights reserved. March 9, 2017 Frank Saffoori | Business Strategist 5 Steps to Analytics Excellence

5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

Embed Size (px)

Citation preview

Page 1: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

1© Cloudera, Inc. All rights reserved.

March 9, 2017

Frank Saffoori | Business Strategist

5 Steps to Analytics Excellence

Page 2: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

2© Cloudera, Inc. All rights reserved.

Expect more from your data

Page 3: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

3© Cloudera, Inc. All rights reserved.

For newborns who can’t communicate discomfort, how can we manage the negative impact of environmental factors in the ICU?

Can we analyze more than three days’ worth of bedside monitor data?

Analyze 20 years of air quality data to prevent asthma attacks.Ingest 50 GBs of sensor and other unstructured data per week.

3© 2015 Cloudera, Inc. All rights reserved.

Page 4: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

4© Cloudera, Inc. All rights reserved.

4

Saving Lives by Detecting Sepsis Early Enough for Successful Treatment

• Has saved 100s of lives already

• Centralizing data from many systems

• 2PB+ in multi-tenant environment supporting 100s of clients

• Secure yet explorable

• Reduces hospital readmissions

HEALTHCARE

» CUSTOMER 360°

» PREDICTIVE ANALYTICS

» IMPROVED SERVICE

DATA-DRIVENPRODUCTS

Page 5: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

5© Cloudera, Inc. All rights reserved.

Patterns & Predictions,

along with DARPA and

University of Dartmouth,

use social media to find

answers to haunting

military problems

Page 6: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

6© Cloudera, Inc. All rights reserved.

Warehouse club understands product movements at a granular, location-specific level, enabling smarter market research and procurement decisions.

Page 7: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

7© Cloudera, Inc. All rights reserved.

The mean number of days to resolve cyber attacks is 46 with a total cost of $973,130 over the 46-day remediation period

Source: Ponemon Reserch 2015 report

Page 8: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

8© Cloudera, Inc. All rights reserved.

A US national security organization identifies potentially suspicious activity across the worldwide web, and supply threat information to 700 commercial and federal organizations.

Page 9: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

9© Cloudera, Inc. All rights reserved.

Source: medGaget, June 6, 2016

• Increased efficiency and

utilization of the parking spots

• Increased local revenue

• Saving $105M & reduced

emissions

Smart Cities: Smart Parking

Milton Keynes

Page 10: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

10© Cloudera, Inc. All rights reserved.

Enabling US Auto Manufacturer to Effectively Capture & Analyze Data from over 30,000 Sensors in Every Car

Challenge:

• Effectively capture and analyze data emitting from 30,000 sensors in every car

Solution:

• Centralized data platform from Cloudera for analytics of all of the sensor data

• Monitor individual component performance and operational metrics

AUTOMOBILE

» CONNECTED CARS

» PREDICTIVE ANALYTICS

» REMOTE MONITORING

Connected Cars

DATA-DRIVENPROCESS

CASE STUDY

Page 11: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

11© Cloudera, Inc. All rights reserved.

Homeland Security Advanced

Research Projects Agency

(HSARPA)

Fighting Fires

Top Cancer Research

Institutions

Working to Cure Cancer

Thorn

Destroying Human Trafficking Networks

Real World ImpactCloudera enables new ways of working with your data

Page 12: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

12© Cloudera, Inc. All rights reserved.

Cloudera: Company Snapshot

Founded 2008, by former employees of

Funding to date Over $1B in cumulative investment

Employees Today 1,600+ Worldwide

Enterprise Grade 1,000+ Enterprise subscription software customers.

Product First commercial distribution of Hadoop CDH - 2.5M open source downloads since 2009

World Class Support 24x7 Global Staff & Operations in 28 CountriesProactive & Predictive Support Programs using our EDH

Mission Critical Production deployments in run-the-business applications worldwide – Financial Services, Retail, Telecom, Media, Health Care, Energy, Government

The Largest Ecosystem 2,600+ Partners

Cloudera University Over 45,000 Trained

Open Source Leaders Cloudera employees are leading developers & contributors to the complete Apache Hadoop ecosystem of projects

Page 13: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

13© Cloudera, Inc. All rights reserved.

The Big Shift…

IT-LedSystem-of-Record Reporting

Business-LedSelf-Service Analytics

FROM TO

Page 14: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

14© Cloudera, Inc. All rights reserved.

Data is Transforming Government

Connected Vehicles

Homeland Security

Transportation

Predictive Maintenance

Smart Ports Smart Healthcare

Student Success Smart Cities

Page 15: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

15© Cloudera, Inc. All rights reserved.

Finance HealthcareRegulatoryIntelligence Defense

Where is the Public Sector data?

• Activity-Based

Data

• Video /

Surveillance

• Online Activity

• Mobile Activity

• Sensors

• Geospatial Data

• Social / Sentiment

• Associative Data

• Inventory / Supply

Chain

• Theater

Operations

• Netflow / Packet

Capture

• Citizen Data

• Demographic /

Census Data

• Social / Sentiment

• Trade Data

• Citizen Data

• Research /

Publications

• Communications

/ Documentation

• Environmental /

Clinical Data

• Policy Data

• Internet of

Things

• Market Data

• Trade Data

• Policy Data

• Demographic /

Census Data

• Communication /

Documentation

• Research /

Publications

• EMRs / EHRs

• Claims /

Insurance Data

• Policy Data

• Citizen Data

• Research /

Publications

• Clinical Studies

• Population

Health

Page 16: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

16© Cloudera, Inc. All rights reserved.

Data is your

most important asset

your data can help achieve

your objectives and mission.

…only if...

Page 17: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

17© Cloudera, Inc. All rights reserved.

Your Data is Officially an Asset… But Status Quo Won't Work Going Forward

• Enormous Amounts of Data (And We're Experiencing Compound Growth)

• Where's The Value? Need a Modern Approach To Realizing Value

• Data (a) Has Quantifiable Value + (b) Is Depreciable

• Think From the Perspective of Your Customers (Data's Beneficiaries)

• Serve Your Data Accordingly � Harness All Your Data to Optimize Impact

• Don't Wait – Be The First

• Even If You're Historically Risk Averse, Balance Taking Innovative Approach

Page 18: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

18© Cloudera, Inc. All rights reserved.

Delivering Real-Time Weather Response with an IoT Platform

CUSTOMER 360

PUBLIC SECTOR

» IOT

» SERVICE IMPROVEMENT

» PREDICTIVE ANALYTICS

Page 19: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

19© Cloudera, Inc. All rights reserved.

CUSTOMER 360Challenge / Opportunity

• Snow & ice expenses = $40-80M

• Control of material usage/costs due to spreader route inefficiencies

• 1,400 trucks

• 2014-15: nearly ran out of salt

• Couldn’t process & analyze 80K records generated per second

• Unable to apply predictive analytics for proactive preparation & management of snow events

Page 20: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

20© Cloudera, Inc. All rights reserved.

CUSTOMER 360

• Optimize snow & ice response

• Real-time information management solution built on Cloudera

• Stream and analyze unlimited, real-time data from sources like…

• WAZE, Twitter, HERE, vehicle locators, weather

data

• Fully monitor route conditions

• Targeted to replace KYTC’s legacy 511 system

Solution

Page 21: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

21© Cloudera, Inc. All rights reserved.

CUSTOMER 360

• Better, faster insights optimize efficiencies of snow & ice removal, reduce traffic, prevent crashes

• Rapid response to federal mandates

• IoT data ingested and available for analysis in 35 seconds (vs. 2 days)

• Aggregate 20M records/day

• Process >1M records/second

• Predictive analytics in 3 hours (vs. 4 days)

• Cost savings = $2-8M per year (payback = 1 season)

• Strategies for road and bridge maintenance (understanding impact of over-salting & plowing)

Results

Page 22: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

22© Cloudera, Inc. All rights reserved.

5 Steps to Analytics Excellence

Page 23: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

23© Cloudera, Inc. All rights reserved.

Big Data Is Different Than Traditional BI

1. Economically feasible to store more data

2. Powered to predictably process large data sets

3. Ability to build your data asset at linear scale

Extreme Performance

& Efficiency

4. Collect data in native format – enables agility

5. Build history of activity by collecting data prior to its use

6. You can have near real-time access to data, plus a view of history

7. Create community data by sharing across your business

8. Out-of-the-box thinking and fail-fast increases innovation

Analytic

Agility

Page 24: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

24© Cloudera, Inc. All rights reserved.

Yet the Journey Requires Organizational Change

50%

50%

Through 2017,

By 2018,

or fewer organizations will have made the

cultural or business model adjustments to

benefit from big data.

of business ethics violations will be from

improper use of big data analytics.

Gartner “Predicts 2015: Big Data Challenges Move From Technology to the Organization” – November 2014

60%Through 2017, of big data projects won’t go beyond pilot or

experimentation and will be abandoned.

Page 25: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

25© Cloudera, Inc. All rights reserved.

5 Steps to Analytics Excellence

• Measure, Analyze, Theorize (Quickly)

• Build Your Foundation

• Build Your Business Case

• Rinse, Lather, Repeat (And Be Agile!)

STEP 1

STEP 2

STEP 3• Quick Win = Creating Raving Fans

• Build Your Roadmap & Your Team

STEP 4

STEP 5

Page 26: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

26© Cloudera, Inc. All rights reserved.

Measure, Analyze, Theorize (Quickly)

• You Can't Improve What You Can't Measure

• Apply DMAIC Principles (even if you don't have a 6S culture)

• Visibility Is Critical

• Current State Analysis (Process, Technology, Skills)

• Future State Analysis (Vision, Strategic Imperatives)

• Gaps & CSFs

• Be Agile (No More Waterfalls, Please!)

STEP 1

Page 27: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

27© Cloudera, Inc. All rights reserved.

Build Your Foundation

• Establish a Base for Success (Plan for People-Process-Technology)

• Leverage Strengths & Core Competencies (Be Results Driven)

• Know Your Weaknesses (for the ambitious – do a full SWOT)

• Partner with Motivated Leaders (And Get an Executive Sponsor)

• Outline Your Business Case

• Orient Your Activity Around a Center of Excellence

STEP 2

Page 28: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

28© Cloudera, Inc. All rights reserved.

Quick Win = Creating Raving Fans

• They Don't Want to Hear It From You (Raving Fans Apply Within)

• Define a “Quick Win" For Your Organization

• Define "Raving Fan" (Customer)

• Prioritize Use Cases on Technical Complexity & Value/Impact

• Operationalize Insights (in weeks, not months)

• Document Results, Lessons Learned, Next Steps (Iteration Is Critical)

• Socialize Across Your Organization (Via Your Raving Fans)

STEP 3(a)

Page 29: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

29© Cloudera, Inc. All rights reserved.

Build Your Roadmap & Your Team

• This Is Not a One-time Exercise � Transformation Is a Journey

• Keep It Centered & Fluid

• Aligned with strategic imperatives & customer demand

• Include The What, How, When, Who, Where

• Acquire and Build Skills & Experience

• Partner with Technology Leaders

• Internal, other agencies, business sector colleagues, vendors

STEP 3(b)

Page 30: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

30© Cloudera, Inc. All rights reserved.

Build Your Business Case

• Start with Illustration of Value

• Current State (Status Quo) + Future State (Vision)

• High Priority Use Cases (Projects)

• Highlight Quick Win (Proof This Works + Value)

• Outline Roadmap

• Cost-Benefit Analysis

• Investment Requirements, Quantitative & Qualitative Benefits, ROI,

Payback, NPV, TCO Comparison

STEP 4

Page 31: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

31© Cloudera, Inc. All rights reserved.

Rinse, Lather, Repeat (And Be Agile!)

• Parallel Work Streams (Use Case Development)

• 2-4 Week Sprints

• Deliver Capabilities & Value Aimed at Creating Raving Fans

• Have a Communication Plan & Build a Brand of Excellence

(Compelling Progress & Value Delivered Frequently)

• Focus on Time to Value (Be Results Driven)

• Build & Evolve Your Analytics Center of Excellence

STEP 5

Page 32: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

32© Cloudera, Inc. All rights reserved.

When you ask bigger questions,you get bigger answersAnd that makes anything possible

Page 33: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

33© Cloudera, Inc. All rights reserved.

Digital Globe – full bleed Can we add more detailed data streams to better model the impact to the

watershed of actual day-to-day activity and occurrences?

Page 34: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

34© Cloudera, Inc. All rights reserved.

What trading patterns should we look out for tomorrow that may indicate

market manipulations?

Page 35: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

35© Cloudera, Inc. All rights reserved.

State of Indiana builds an operational data store to reduce infant mortality below the national average by 2020.

Page 36: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

36© Cloudera, Inc. All rights reserved.

Data helps solve the world's biggest problems

What has your datadone for you lately?

Page 37: 5 Steps to Analytics Excellenceanalyticssummit.harrisburgu.edu/lib/2017/presentation-files/DAS17... · » CUSTOMER 360 ° » PREDICTIVE ... Gartner “Predicts 2015: Big Data Challenges

37© Cloudera, Inc. All rights reserved.