2
Resolve problems faster and gain end-to-end visibility across your Hadoop® environment Splunk® App for HadoopOps FACT SHEET Enter Splunk The Splunk App for HadoopOps meets this challenge with a single interface to search, monitor and analyze the full Hadoop environment including cluster resources beyond Hadoop itself, such as the network, switch, rack, operating system and database. The Splunk App provides end-to-end visibility and lets you perform rapid troubleshooting and analysis across your Hadoop environment. Search, monitor, alert, troubleshoot and analyze Hadoop nodes, Hadoop distributed file systems (HDFS), MapReduce jobs and more. Features and Benefits The Splunk App for HadoopOps provides a number of specialized features that help you monitor Hadoop: Monitor Nodes on Cluster – Get a complete view of all the servers in the cluster. See the health of the cluster, track hard disk, CPU and RAM utilization from a single view. Cluster visualization display the rack or node where a specific failure might occur Troubleshoot MapReduce Jobs – Gain real-time and historical statistics on the individual and combined Map and Reduce tasks. Troubleshoot MapReduce performance issues by comparing similar jobs and comparing JobIDs to TaskIDs. Correlate between the used core slots and MapReduce tasks and pinpoint the MapReduce attempts that are using them. Monitor Hadoop Services – Expose Hadoop metrics and view the health of the Hadoop file system daemons. Monitor the key load, capacity and resource metrics for enabling hardware and software capacity planning. Manage Services – Enable Hadoop administrators to establish specific views of nodes so they can monitor only the nodes need to see. For example, an administrator can choose to view only the production nodes within a cluster Challenge of Monitoring Hadoop Environments Monitoring Hadoop deployments is a complex and time-consuming function. Existing Hadoop monitoring tools are designed solely to monitor the Hadoop environment—with a lack of visibility into the network, switch, OS and other supporting infrastructure administrators are faced with a significant visibility gap. Without an end-to-end view, critical problems impacting the Hadoop environment will often reoccur and remain unresolved. Real-time operational health and performance monitoring of entire Hadoop environment Integrated alerting to track and respond to activities from MapReduce to the individual node in the cluster A centralized real-time view of Hadoop nodes using an intuitive heat map display HIGHLIGHTS The Splunk App for HadoopOps delivers visibility and analysis across the entire Hadoop ecosystem. Centralized real-time view of Hadoop nodes using intuitive heat map display.

Splunk for hadoop_ops

Embed Size (px)

Citation preview

Resolve problems faster and gain end-to-end visibility across your Hadoop® environment

Splunk® App for HadoopOps

F a c t S h e e t

enter SplunkThe Splunk App for HadoopOps meets this challenge with a single interface to search, monitor and analyze the full Hadoop environment including cluster resources beyond Hadoop itself, such as the network, switch, rack, operating system and database.

The Splunk App provides end-to-end visibility and lets you perform rapid troubleshooting and analysis across your Hadoop environment. Search, monitor, alert, troubleshoot and analyze Hadoop nodes, Hadoop distributed file systems (HDFS), MapReduce jobs and more.

Features and BenefitsThe Splunk App for HadoopOps provides a number of specialized features that help you monitor Hadoop:

Monitor Nodes on Cluster – Get a complete view of all the servers in the cluster. See the health of the cluster, track hard disk, CPU and RAM utilization from a single view. Cluster visualization display the rack or node where a specific failure might occur

Troubleshoot MapReduce Jobs – Gain real-time and historical statistics on the individual and combined Map and Reduce tasks. Troubleshoot MapReduce performance issues by comparing similar jobs and comparing JobIDs to TaskIDs. Correlate between the used core slots and MapReduce tasks and pinpoint the MapReduce attempts that are using them.

Monitor Hadoop Services – Expose Hadoop metrics and view the health of the Hadoop file system daemons. Monitor the key load, capacity and resource metrics for enabling hardware and software capacity planning.

Manage Services – Enable Hadoop administrators to establish specific views of nodes so they can monitor only the nodes need to see. For example, an administrator can choose to view only the production nodes within a cluster

challenge of Monitoring hadoop environmentsMonitoring Hadoop deployments is a complex and time-consuming function. Existing Hadoop monitoring tools are designed solely to monitor the Hadoop environment—with a lack of visibility into the network, switch, OS and other supporting infrastructure administrators are faced with a significant visibility gap. Without an end-to-end view, critical problems impacting the Hadoop environment will often reoccur and remain unresolved.

• Real-time operational health and performance monitoring of entire Hadoop environment

• Integrated alerting to track and respond to activities from MapReduce to the individual node in the cluster

• A centralized real-time view of Hadoop nodes using an intuitive heat map display

h i g h l i g h t S

The Splunk App for HadoopOps delivers visibility and analysis across the entire

Hadoop ecosystem.

Centralized real-time view of Hadoop nodes using intuitive heat map display.

www.splunk.comlisten to your data

250 Brannan St, San Francisco, CA, 94107 [email protected] | [email protected] 866-438-7758 | 415-848-8400 www.splunkbase.com

F a c t s h e e t

Copyright © 2013 Splunk Inc. All rights reserved. Splunk Enterprise is protected by U.S. and international copyright and intellectual property laws. Splunk is a registered trademark or trademark of Splunk Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. Item # FS-splunk-App-HadoopOps-108

View Hadoop Configurations – Discover the configuration of each node and each daemon in the Hadoop cluster. Hadoop is highly dependent on the hardware and network it uses. Monitor for any changes made to the Hadoop configurations to help prevent service disruptions. Drive faster resolution times by using Splunk software to view configurations from HDFS, MapReduce and the entire surrounding environment.

Search Logs – Enhance end-to-end debugging of issues with the power of Splunk search and real-time display of information from all Hadoop, Linux, database and network log files. See at- a-glance health status, cluster visualization, job performance and analysis through a powerful, interactive user interface. The App data model includes hundreds of specialized event types, source types and field definitions to help you build new dashboards and generate reports quickly.

Set Headline and Alert Notifications – Create alerts that are triggered on a single event as well as on a correlated group of events. Per-result alerting provides granular control over the notifications received when a Hadoop node, MapReduce task or HDFS daemon is failing.

Product Requirements

Supported hadoop VersionsCompatible with Apache Hadoop, initially supporting Cloudera CDH and Hortonworks HDP distributions. Refer to the product documentation for the latest list of supported Hadoop distributions.

Splunk RequirementsThe Splunk App for HadoopOps deployment is compatible with Splunk Enterprise version 4.3.2 or later. All universal forwarders in a Splunk App for HadoopOps deployment must run Splunk Enterprise version 4.2.5 or later.

F a c t S h e e t

try Out the app, it’s Free!

Go to http://splunk-base.splunk.com to learn more.

Free DownloadDownload Splunk You’ll get a Splunk Enterprise license for 60 days and you can index up to 500 megabytes of data per day. You can convert to a perpetual Free license or purchase an Enterprise license by contacting [email protected].