Analytics, Everywhere. Keys to Effective Analytics and Data Discovery

1 © Cloudera, Inc. All rights reserved.

Analy9cs, Everywhere Keys to Effec9ve Analy9cs and Data Discovery


Data is your most important asset

your data can help achieve your objec9ves and mission.

…only if...


Finance Healthcare Regulatory Intelligence Defense

Where is the Public Sector data?

•  Ac9vity-‐Based Data

•  Video / Surveillance

•  Online Ac9vity •  Mobile Ac9vity •  Sensors •  Geospa9al Data •  Social / Sen9ment •  Associa9ve Data

•  Inventory / Supply Chain

•  Theater Opera9ons

•  NeWlow / Packet Capture

•  Ci9zen Data •  Demographic /

Census Data •  Social / Sen9ment

•  Trade Data •  Ci9zen Data •  Research /

Publica9ons •  Communica9ons

/ Documenta9on •  Environmental /

Clinical Data •  Policy Data •  Internet of

Things

•  Market Data •  Trade Data •  Policy Data •  Demographic /

Census Data •  Communica9on /

Documenta9on •  Research /

Publica9ons

•  EMRs / EHRs •  Claims /

Insurance Data •  Policy Data •  Ci9zen Data •  Research /

Publica9ons •  Clinical Studies •  Popula9on

Health


Data silos


Data silos

Limited frameworks


Data silos

Limited frameworks

Fragmented admin & security


An analyst sees an event worth inves9ga9ng.

Ac9ng on data is a clunky process

1



1

2

She wants a broader, more comprehensive picture of the event by correla9ng informa9on from mul9ple silos of data. She makes a data request to IT.



1

2 3

The IT request stalls – it will require custom development that will take 3 months to complete.



2 3

1 4

In the mean9me, she con9nues with her limited data, spends too much 9me manually sieing through other sources, and makes gut decisions.



2 3

1 4

5 She guesses wrong, misallocates her team’s assets and resources, and achieves limited success in her mission.

X


Analy9cs in the 9me of big data


Unified data

Unified security & administra9on

Unified framework

Advocate openness Promote efficiency Con9nue the familiar Extend security Encourage governance

Develop an enterprise data hub


Cloudera Enterprise powered by Apache Hadoop™

A new kind of data plaWorm. • One place for unlimited assets, informa4on, and collabora4on

• Unified, mul4-‐framework data access

Only with Cloudera: •  Leading performance

•  Enterprise system and data management

•  Fundamentally secure • Open source, open standards

Security and Governance

Data and Insights

Process Discover Model Serve

Deployment Flexibility

On-‐Premises Appliances Engineered Systems

Public Cloud Private Cloud Hybrid Cloud


Pervasive analy9cs

Innovate

Extend Empower


Imagine if this could be different

1

An analyst monitors and iden9fies events in near real 9me.



1 2

She has immediate access to unified analy9cal and exploratory views into mul9ple data sources.



1 2 3

She receives recommenda9ons, grounded on historic trends and baselines and the current event environment, on the best tac9cal ac9ons for further inves9ga9on.



1 2 3 4

She incorporates the recommended tac9cs into her inves9ga9on.



1 2 3 4 5

She employs her team’s assets and resources effec9vely and achieves mission success.


Trust enables collabora9on

Security and Governance

Data and Insight

Process Discover Model Serve


Digital Globe – full bleed Can we add more detailed data streams to bener model the impact to the

watershed of actual day-‐to-‐day ac9vity and occurrences?


What trading panerns should we look out for tomorrow that may indicate

market manipula9ons?


Star9ng the journey


1

2

3

4

Collect your exis.ng data

Create new data channels

Explore, enrich, analyze your data

Opera.onalize your insights

Steps to pervasive analy9cs


Iterate to success

Explore, enrich

Analyze, embed

Collect, create

Real-‐9me ingest/serve

New data sources

More complex analysis

Add …

… over 9me


Site clickstream

Unique visitors, enter/exit URLs

CRM transac9ons

Service trends Reports,

email outreach

Phase 1: Single data set analysis

Explore, enrich

Analyze, embed

Collect, create

Explore, enrich

Analyze, embed

Collect, create

Dashboards, page design


Clickstream + CRM

Cross-‐dataset iden9ty matching, path analysis of poten9al issues

Enriched profiles, issue iden9fica9on

Phase 2: Mul9-‐data set analysis

Explore, enrich

Analyze, embed

Collect, create


Preference matching, predic9ve offer crea9on

Enriched profile + inventory

Reports, page design,

email outreach

Phase 3: Predic9ve modeling

Explore, enrich

Analyze, embed

Collect, create


Enriched profile + clickstream

Site personaliza9on, email personaliza9on,

issue aler9ng

Phase 4: Opera9onal analy9cs

Explore, enrich

Analyze, embed

Collect, create

Iden9ty matching, ac9vity and offer correla9on


1 + 1 = 3 Why Cloudera and Informa9ca


Informa9ca Big Data Edi9on

Profile Parse Cleanse ETL Match

Simple visual development environment Prebuilt transforma9ons and reusable business rules Executes na9vely in Hadoop Enables up to 5X developer produc9vity over hand-‐coding scripts


Ingest All Types of Data at Any Latency

Oracle DB2 SQL Server Sybase

Word, Excel PDF StarOffice Email, LDAP

Informix Teradata Netezza ODBC/JDBC

WebSphere MQ JMS MSMQ SAP NetWeaver

Web Services TIBCO webMethods

Flat files HTTP/HTML RPG ANSI

AST FIX SWIFT MVR

Exadata Netezza Pivotal/Greenplum Vertica

Teradata Aster

SAP NetWeaver SAP NetWeaver BI SAS Siebel

JD Edwards Lotus Notes Oracle E-Business PeopleSoft

Salesforce RightNow NetSuite Oracle OnDemand

EDI–X12 EDI-Fact RosettaNet HL7/HIPAA

XML LegalXML IFX cXML

Applications

Messaging

Facebook Twitter LinkedIn Datasift

Databases / Data Warehouses

Data Formats

ebXML HL7 v3.0 ACORD Replicate

Stream

Batch

Archive

Informatica Connectors

Informatica Ingestion


Big Data Meets Data Governance

Informa9ca Big Data Edi9on Tracking the end-‐to-‐end lineage of data before, during, and aeer Hadoop processing with metadata management and lifecycle management

Cloudera Navigator Minimize risk and maintain compliance with the only na9ve end-‐to-‐end data governance solu9on for Apache Hadoop.


A new way forward


Yesterday – Limited structured data storage Today – Unlimited structured and unstructured storage


Yesterday – Scanered, limited processing and analy9cal frameworks Today – Unified, diverse, relevant, familiar frameworks


Yesterday – Segmented management and security Today – Unified data & system security and management


The future of data management: analy9cs, everywhere. What’s your strategy?

Thank you! [email protected] // @wmudge

Learn more about Informa9ca and Cloudera at: hnp://www.cloudera.com/content/cloudera/en/solu9ons/partner/Informa9ca.html

Technology

Analytics, Everywhere. Keys to Effective Analytics and Data Discovery