17
Confidential OPERATIONAL EXCELLENCE FOR BIG DATA APPS

4 Best Practices to Achieve Operational Excellence Across Multiple Big Data Technologies

Embed Size (px)

Citation preview

Confidential

OPERATIONAL EXCELLENCE FOR BIG DATA APPS

Confidential2

TRUSTEDby over 10,000

companies as their big data app platform

BACKEDby top Silicon Valley

investors True Ventures,Rembrandt VP, Bain

Capital

FOUNDEDin 2008, with

headquarters in San Francisco

Confidential

WHY NOW?

3

As Big Data applications become the engine driving innovation and new revenue models, they graduate to 1st class citizens demanding higher standards of quality, reliability, and manageability

Confidential

PERFORMANCE MANAGEMENT FOR BIG DATA APPLICATIONS

your big data apps

MONITORto resolve

issues fasterbig data apps

more effectively

MANAGECOLLABORATE

Confidential5

Heterogeneous Application Environments Cluster Performance Monitoring Application Performance Monitor

Production Hadoop Environments Contain a Variety of Application Technologies

CHALLENGES

Confidential6

Application Performance MonitorCluster Performance MonitoringHeterogeneous Application Environments

Cluster Monitoring Products Do Not Provide Application Insight

CHALLENGES

Confidential7

Cluster Performance Monitoring Application Performance MonitorHeterogeneous Application Environments

Existing Tools Offer Limited Value for Monitoring Application PerformanceLeaving us blind to business context, priority, ownership and performance of our data applications

CHALLENGES

Confidential8

Enterprise Scale Monitoring and Management for Big Data Apps

Business & Operational Context

Data & TechnologyConnecting Business and Data

PERFORMANCE MONITORING & VISIBILITY

Confidential

ACHIEVING OPERATIONAL EXCELLENCE

9

Balancing a fully operational data processing cluster and customer demands is challenging.

Performance monitoring and visibility for big data applications• See everything in one place with a single view of all data applications real-time

performance metrics across the entire enterprise

Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &

downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing

Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering

the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution

Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,

policies, capacity, compliance and utilization.

1

3

2

4

Confidential

ACHIEVING OPERATIONAL EXCELLENCE

10

2

1

3

4

Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics

across your entire environment

Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &

downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing

Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering

the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution

Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,

policies, capacity, compliance and utilization.

Balancing a fully operational data processing cluster and customer demands is challenging.

Confidential

ACHIEVING OPERATIONAL EXCELLENCE

11

3

1

2

4

Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics

across your entire environment

Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &

downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing

Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering

the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution

Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,

policies, capacity, compliance and utilization.

Balancing a fully operational data processing cluster and customer demands is challenging.

Confidential

ACHIEVING OPERATIONAL EXCELLENCE

12

4

3

2

1Performance monitoring and visibility for big data apps• A single integrated view of your data applications and real-time performance metrics

across your entire environment

Instantly understand the business context of a problem• Knowing you have a problem is one thing but understanding the end to end &

downstream dependencies, the quality and service guarantees, who is impacted, theowner(s) and the business criticality of the failure is game changing

Easily collaborate across teams to resolve issues faster• Multi-tenant architectures are inherently chaotic. Accelerate issue resolution by delivering

the right information to the appropriate individuals and teams so everyone is informed and can work together to resolution

Manage the business of big data• Get the operational visibility and controls you need to effectively manage priorities,

policies, capacity, compliance and utilization.

Balancing a fully operational data processing cluster and customer demands is challenging.

Confidential

NURTURE A CULTURE OF OPERATIONAL EXCELLENCE

13

Ensure that business, development, IT operations can collaborate seamlessly when it matters

ConfidentialConfidential

THANK YOU

Confidential

Go to our website: www.driven.io

TO LEARN MORE

ConfidentialConfidential16

APPENDIX

Confidential

End-to-end operational telemetry metadata for big data applicationsAccessible via Web browser, command-line interface (CLI), or simple search queriesEasy integrations through JMX and upcoming Driven SDK

SCALABLE, SEARCHABLE METADATA STORE

17

Telemetry metadata(SSL)

YARN

HADOOP APPS AND INFRASTRUCTURE

APPLICATIONS

Plugin

HADOOP CLUSTERS

WAR

files Web App

Server

Server

Web CLI JMX

Web AppServer

SCALE OUT

SCALE OUT