23
Technology Primer: Hey IT—Your Big Data Infrastructure Can’t Sit in a Silo Anymore Rajaraman Sundaram DevOps: Agile Ops CA Technologies Sr. Principal Product Marketing Manager DO5X142S

Technology Primer: Hey IT—Your Big Data Infrastructure Can’t Sit in a Silo Anymore

Embed Size (px)

Citation preview

Technology Primer: Hey IT—Your Big Data Infrastructure Can’t Sit in a Silo Anymore

Rajaraman Sundaram

DevOps: Agile Ops

CA Technologies

Sr. Principal Product Marketing Manager

DO5X142S

2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of

warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

For Informational Purposes Only

Terms of this Presentation

3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Abstract

The importance of adopting big data management technologies is

unquestionable these days. As a result the business side of organizations is

aggressively investing in big data, at times on their own without involving

central IT teams. Join us in session to learn why IT needs to unify big data

and traditional IT infrastructure to ensure optimal customer experience

and return on investment. We shall also be highlighting how CA Unified

Infrastructure Management (CA UIM) allows you to unify big data and IT

Infrastructure management through a unified view and architecture.

Rajaraman Sundaram

CA Technologies

Sr. Principal Product Marketing Manager

4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Agenda

BIG DATA IN NUMBERS

WHY A SILOED APPROACH WON’T WORK ANYMORE?

CA UIM FOR MONGODB

CA UIM FOR BIG DATA

CA UIM FOR HADOOP

CA UIM FOR CASSANDRA

1

2

3

4

5

6

5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Value of Big Data is Unquestionable

55%of respondents’ have already implemented

Big Data projects

are planning to implement within the

next year

2Xlikely to be in top

quartile of financial performance within

their industries if they use these technologies

29%

http://www.ca.com/us/~/media/Files/IndustryResearch/the-state-of-big-data-infrastructure.pdfhttp://www.bain.com/Images/BAIN_BRIEF_Big_Data_The_organizational_challenge.pdf

6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Big Data Projects Are Sitting In Silo’s

44%integrating individual

projects across functions and departments

organizations’ Big Data projects are not

integrated across departments

21%have a project limited

to a single department or area

29%

7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

But this approach won’t cut it anymore here’s why….

8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

1. Both the growth and velocity of big data projects are increasing

Continued growth of tools and techniques

More siloes and tools would only result in more complexity

Lack of scale and visibility

9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

2. More transactional applications need to leverage Big Data

Big Data not only for “top management” decision making anymore

Examples include product recommendation engines

Need holistic visibility into Big Data & IT Infrastructures

10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

3.Finding skilled staff would become even a bigger challenge

Skills are high in demand

More siloes and tools would only result in more complexity

Lack of scale and visibility

CA UIM for Big Data

12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Solution Overview

StorageSystems Network Database Apps CloudData

center

CA Unified Infrastructure Management

Big Data

13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for Big DataUnify Big Data and traditional infrastructure performance management

Unified visibility. Incorporate monitoring into a central platform that can track all the environments from a business service prospective.

Proactive service management. Leverage intelligent insights and alerts that help your team resolve issues faster and before service levels take a hit.

Reduce cost and complexity. Harness the comprehensive coverage and capabilities that can reduce the costs associated with buying and supporting multiple, disconnected and complex tools.

14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for Big DataComprehensive picture of your entire IT & big data infrastructure

15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Hadoop® 101

Software framework for distributed storage and distributed processing of very large data sets.

Core components include – Hadoop Common – contains libraries and utilities

needed by other Hadoop modules;

– Hadoop Distributed File System (HDFS) – a distributed file-system

– Hadoop YARN – a resource-management platform

– Hadoop MapReduce – a programming model for large scale data processing

16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for Hadoop

Comprehensive monitoring coverage for all elements daemons in Hadoop environments, including clusters HDFS, NameNode, Resource Manager and Hbase.

Out of the box monitoring dashboard and ability to create custom dashboards

Historical Performance trending and analysis

Intelligent and predictive alerts

17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Cassandra® 101

Open source distributed database management system designed to handle large amounts of data across many commodity servers

Providing high availability with no single point of failure.

Cassandra offers robust support for clusters spanning multiple datacenters, with asynchronous masterlessreplication allowing low latency operations for all clients.

18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for Cassandra

Comprehensive monitoring coverage for all elements daemons in Hadoop environments, including Keyspace, JVM, column family, storage volumes and more.

Out of the box monitoring dashboard and ability to create custom dashboards

Historical Performance trending and analysis

Intelligent and predictive alerts

19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

MongoDB® 101

Open source database that uses a document-oriented data model.

Document Database

– Documents (objects) map nicely to programming language data

types.

High Performance

– Embedding makes reads and writes fast.

High Availability

– Replicated servers with automatic master failover.

Easy Scalability

– Automatic sharding distributes collection data across machines.

20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for MongoDB

Monitors the internal performance and resource usage throughout a node in a MongoDB cluster.

Out of the box monitoring dashboard and ability to create custom dashboards

Historical Performance trending and analysis

Intelligent and predictive alerts

21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

CA UIM for Big DataSummary

• I want to monitor availabilityand performance of all the elements within the Big Dataframework and supporting IT infrastructure.

• I want a single pane of glass for my Big Data and traditional IT environment.

• I don’t want to spend time managing multiple monitoring tools.

Customer Pain

• Comprehensive monitoring coverage for Big Dataframework and supporting IT Infrastructure.

• Real-time intelligent and, automated alerts about your Hadoop environment.

• Out of the box andcustomizable reports and dashboards for availability, performance and SLA’s.

Solution Features

• Unified Visibility across Big Data & traditional IT infrastructures.

• Improved services levels with holistic and proactive performance monitoring.

• Reduce cost & complexity of managing Big Data and IT monitoring tools.

Benefits

22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Q & A

23 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For More Information

To learn more, please visit:

http://cainc.to/Nv2VOe

CA World ’15