Pre-Con Education on APM 9.7

Pre-Con Education on APM 9.7

Haroon Ahmed, Michael Sydor & Andreas Reiss

OCX22E #CAWorld

ca OpsCenter

CA TechnologiesAPM Global SWAT

2 © 2014 CA. ALL RIGHTS RESERVED.

Abstract

In this session, you will learn about what's new with CA APM 9.7.You will learn how the new Smart Instrumentation capability delivers deep diagnostics, how the APM Command Center simplifies installations and remote diagnostics and how the new application environments can be managed.

Haroon Ahmed

Sr. Director Engineering Services

Michael Sydor

Sr. Engineering Services Architect

Andreas Reiss

Sr. Engineering Services Architect

CA TechnologiesAPM SWAT


For Informational Purposes Only

This presentation was based on current information and resource allocations as of August 2014 and is subject to change or withdrawal by CA at any time without notice. Not withstanding anything in this presentation to the contrary, this presentation shall not serve to (i) affect the rights and/or obligations of CA or its licensees under any existing or future written license agreement or services agreement relating to any CA software product; or (ii) amend any product documentation or specifications for any CA software product. The development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion. Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in this presentation, CA will make such release available (i) for sale to new licensees of such product; and (ii) to existing licensees of such product on a when and if-available basis as part of CA maintenance and support, and in the form of a regularly scheduled major product release. Such releases may be made available to current licensees of such product who are current subscribers to CA maintenance and support on a when and if-available basis. In the event of a conflict between the terms of this paragraph and any other information contained in this presentation, the terms of this paragraph shall govern.

Certain information in this presentation may outline CA’s general product direction. All information in this presentation is for your informational purposes only and may not be incorporated into any contract. CA assumes no responsibility for the accuracy or completeness of the information. To the extent permitted by applicable law, CA provides this presentation “as is” without warranty of any kind, including without limitation, any implied warranties or merchantability, fitness for a particular purpose, or non-infringement. In no event will CA be liable for any loss or damage, direct or indirect, from the use of this document, including, without limitation, lost profits, lost investment, business interruption, goodwill, or lost data, even if CA is expressly advised in advance of the possibility of such damages. CA confidential and proprietary. No unauthorized copying or distribution permitted.

Terms of this Presentation

Copyright © 2014 CA. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belongto their respective companies. CA confidential and proprietary. No unauthorized copying or distribution permitted.


APM Pre-Con Education Agenda

9.7 OVERVIEW

APM COMMAND CENTER (ACC)

PHP MONITORING

SMART INSTRUMENTATION

APM IMPROVEMENTS

MOBILE END-TO-END TRANSACTION MONITORING

APM Agent Command Center


APM Command CenterOverview

GOAL: Reduce TCO for APM Agent

Installs, Upgrades, Configuration and Problem Diagnosis

HOW: Simplified via Automation;

User Centric Guided Workflows; Build in Intelligence


APM Command CenterBenefits Summary

ManualSoftware Download

Current: (Hours)

ManualConfiguration

ManualValidation

ManualDistribution

• Simplified via Automation• User Centric Workflow • Built-in Intelligence• 90%+ Time Saving

Au

tom

atic D

ow

nlo

ads

Future: (Minutes)

Up

grade

Wo

rkflow

Intelligen

ce

Au

tom

atic D

istribu

tion


ACC 1.0 GoalReduce Total Cost of Ownership of APM

DiagnosticsView Information about Java Agents running within the environment

Remotely fetch Agent Log Files and other diagnostic information

Package diagnostics for upload to support ticket

Remotely enable Debug mode on single Java Agent


ArchitectureRelease 1.0

APM 9.x

Java Agent

UI (Web Based)

Dis

cove

ry

Exte

nsi

on

Configuration Server

Embedded ActiveMQ Broker

Embedded Jetty REST API

Controller

Discovery

Log Files

Diagnostics

Plugins

Dedicated Server

ApplicationServer

Applicationbeing monitored


Long Term GoalReduce Total Cost of Ownership of APM

Deployment

Cloud based store for

Agent related packages

(PPKs, etc)

Ability to create tailored

packages for

deployment to

production systems

Packages exposed via

API for consumption by

3rd Party deployment

tools

Configuration

Ability to create

configuration groups

Create & enforce

configuration policies

Support for ‘hot’ and

‘cold’ configuration

Audit trail of

configuration changes

Suggest additional

monitoring

opportunities

Health

Review the monitoring

overhead of the agents

Report issues / errors

with the monitoring

Suggest changes to the

monitoring to reduce

overhead


ArchitectureFuture

APM 9.x

Java Agent

UI (Web Based)

Dis

cove

ry

Exte

nsi

on

Configuration Server

Embedded ActiveMQ Broker

Embedded Jetty REST API

Controller

Discovery

Log Files

Diagnostics

Plugins

Dedicated Server

ApplicationServer

Applicationbeing monitored

HostedAPMStore

Configure

Deploy

3rd Party Software

Deployment Tools

Custom


Supported Environments

APM Agent Level– APM Java Agent 9.0.3 and above

Operating Systems – Configuration Server– Windows , RedHat Linux, SUSE Linux

– JDK 1.7+

Operating Systems – Controller– Windows, RedHat Linux , SUSE Linux , AIX 7.1

– JDK 1.7+

Application Servers– All application servers supported by the Java Agent will be supported


ACC Installation

Install Configuration Server – “configserver-package-<version>.xxx” & “hibernate-libs-<version>.xxx”

Install Controller Agent on Monitored Server– “acc-agent-runtime-<version>.xxx”

Install Agent Extension on Monitored Application– Copy AccRegistration.jar to the Agents “/core/ext” directory

– Update IntroscopeAgent.profile (introscope.agent.acc.enable=true, introscope.agent.acc.port=51914)

– Restart Application


ACC WebUIhttp://<hostname>:8088/


Demo

APM Agent – Smart Instrumentation


Why are some users less happy than others?

What is happening to some users while my alerts are green?

What are they doing different?

What is my application doing different?


Let’s take a closer look…

With the goal to identify what one request is doing different than all the others.


Smart Instrumentation Overview

Goal: Identify critical components to be monitored and Isolate problem components, without requiring comprehensive knowledge of an application environment or manual instrumentation.


Smart Instrumentation Nomenclature

“Smart Instrumentation”, “Intelligent Instrumentation”, “Deep Instrumentation” and "Deep Tracing" are synonymous terms for this feature

“Deep Inheritance (an existing feature of the Introscope Agent) should not be confused with the new Deep (Smart) Instrumentation feature in 9.6. These are two distinct features


Smart Instrumentation Introduction

Aim to auto instrument interesting methods

No PBD requirements

Methods will appear in Transaction traces and are referred to as ‘deep components’


Smart Instrumentation Probing

3

1

Method is not covered by any PBD file.

Bytecode is tokenized and parsed

2

Parsing

Tokenize

ScoreMethod Size

Loops

Calling other

packageVisibility

…

Scoring on method complexity

4

Compare with preconfigured Scoring level

5Instrument Method

Public void main(){System.out.println(“asd”;}

Instrument - Pre

Instrument - Post


Stalls Errors

Introscope 9.7

Hot Levels

Traces

Error Snapshots

Scoring

Complexity

Introscope 9.6

The evolution of deep components

Transaction

Traces

Gap Assessment

The Future Of APM

Usage

PerformanceThresholds

Anomalies

Runtime Analysis


Smart Instrumentation 9.7 Features – Deep Stall Snapshots

Stall Snapshot with Deep Trace Components

PBD Instrumented components with standard information


Smart Instrumentation 9.7 Features – Hot Instrumentation Level Triggering

Hot triggering of instrumentation level

Choose between low, medium, high instrumentation


Smart Instrumentation 9.7 Features – New trigger tracer

New Tracer for response time based triggering: ComponentTimeAutoTraceTriggerTracer Defining a tracer

with a threshold

Apply the tracer

to a class and

method


Demo

APM 9.7 Improvements


Agenda

WEBVIEW UPDATES

AGENT UPDATES

RICH EMAIL NOTIFICATION

1

2

3

HIGH PERFORMANCE TIM

REAL-TIME TRANSACTION METRICS

4

5


Dashboard Widgets– Shapes & Connectors

– XML Type Views

– Console Lens

Chart Updates– Min/Max

– CSV Export

WebView Updates

EOL Worksatation


Demo


JDK 8 Support

Metaspace Memory Pool – GCMonitor now reports PermGen (if java version is <= 1.7) or

Metaspace (if java version is >= 1.8)

Agent Updates

JAVA 8


Agent Updates

NEW *MATCHING* DIRECTIVE

SkipMatchingClassesForFlag: <class-pattern> <Tracer-group>– Example:

SkipMatchingClassesForFlag: *Bean* TracingGroup01

SkipMatchingMethodsForFlag: <method-pattern> <Tracer-group>– Example:

SkipMatchingMethodsForFlag: *set* TracingGroup02

TraceMatchingMethodsIfFlagged: <Tracer-group> <method-pattern> <Tracer-name> <Resource-Metric>– Example:

TraceMatchingMethodsIfFlagged: TracingGroup03 *get* BlamePointTracer "Traced|Metrics|{classname}|{method}"


Demo


Agent Updates

Enables users to:– Understand the context and urgency of a problem

– 1-click away to link into the alert and/or metric triggering the problem

Rich Email Notification


Demo


High Performance TIM SummaryA Few Words to Review

Key topics

9.7 TIM Performance is improved, compared with 9.6 TIM

Findings

Multiple Cores are leveraged by the TIM

Experiences


Prior version did not exploit multiple cores

Prior version has poor scalability– 100Mbit capacity

– Degraded quickly with excessive “Dropped Packets”

Need a strategy to run well, even if packets are being dropped

High Performance TIMWhy Increase TIM Performance


High Performance TIMTestBed

Desktop and TESS

Load Generator(s)

(replay PCAP files)

CA

Net

wo

rk


High Performance TIMFactors Affecting Performance Business Definitions of Transactions

– If we use complex business definitions then theoretically we can say 9.7 TIM can perform much better than 9.6 TIM as we are using multiple timworkers where we can leverage the true power the multiple CPU/core architecture.

Apmpacket bottleneck – As our results show that apmpacket can handle load up to a limit and if starts dropping

packets then we cannot pump more traffic even if timworkers are not sweating.

Napatech Card – Napatech card can improve performance significantly as it has a good amount of buffer

which holds incoming network packets, so in a way apmpacket can handle more traffic.


High Performance TIMPerformance Results

0

1

2

3

4

5

6

7

0

20000000

40000000

60000000

80000000

100000000

120000000

100mbps

200mbps

300mbps

350mbps

400mbps

Log(

pac

kets

dro

pp

ed

)

96 TIM

Packets Captured

Packets dropped

0

500

1000

0

5

10

100mbps

300mbps

500mbps

700mbps

800mbps

900mbps

Log(

Pac

kets

Cap

ture

d)

97 TIM non-tmpfs

Packets Captured

Packets dropped

0

50

100

150

0

2

4

6

8

10

1 2 3 4 5 6 7 8

Log(

Pac

kets

Cap

ture

d

97 TIM with tmpfs

Series1

Series2


High Performance TIMTmpfs or not?

0

100

200

300

400

500

600

700

800

900

100 mbps 300 mbps 500 mbps 700 mbps 800 mbps 900 mbps

Packets Dropped

non-tmpfs

tmpfs

“… if you can afford some dropped packets then using a tmpfs configuration

will allow you to keep going…”

[email protected]


Real Time Transaction MetricsBasic Capabilities

User Configurable– RTTM – enable/disable

– Per-TIM reporting clamp for transactionID/UserGroup combinations

– Parameters

Business Transaction Definition ID

Usergroup

– UI

Configurable, Individual CEM Application Node


Real Time Transaction MetricsEnable/Disable RTTM Monitors


Real Time Transaction MetricsUser Group Matching – New Match Page


User Group Match – Update Page


RTTM Global Configuration


Real Time Transaction MetricsGroup Info Under Business Transaction (Investigator)

Mobile Integration


Agenda

WHAT IS END USER END POINT MONITORING?

WHAT IS CA MOBILE APPLICATION ANALYTICS?

END USER ENDPOINT INTEGRATION WITH MAA

1

2

3


Feature to externally pass a common Business Transaction model and meta-data into APM– Represents data as part of APM Business Segments, traces and

AppMap

– Uses an HTTP request header

– Documentation includes examples for leveraging this feature in JMeter synthetic scripts

– Mobile and Cloud Monitor will be the first out of the box CA products to support this feature.

What is End User Endpoint Monitoring?

OVERVIEW


What is End User Endpoint Monitoring?


What is CA Mobile Application Analytics

Deep Visibility:

Complete end-to-end view into native apps running on mobile devices

Rapid Analysis:

From mobile infrastructure to mobile device

Actionable Analytics:

By app, region, carrier, device or users


What is CA Mobile Application Analytics?


End User Endpoint Integration with MAA

Customers need to identify how their applications are handling request

from Mobile Applications

Establishing a way to pass a common Business transaction model and

meta data into APM

– Represents data as part of APM Business Segments, traces and AppMap

Compare/Monitor how “Applications” are handling Mobile App Business Transaction requests from end user device to the backend DB or mainframe.


End User Endpoint Integration with MAA

MAA SDK used to enable APM endpoint integration

APM integration – used to inject transactions details to an HTTP header which includes Business Service, Business Transaction, Device type/version etc.

MAA SDK


AppMap Flows Showing Mobile ApplicationsFull integration to backend processes and resources (Mobile Mainframe)


Additional Optional HTTP Header Details


Mobile Meta-Data in traces

Transaction Trace decoration & filtering based on Mobile specific data


Mobile Transaction Breakdown by Provider

Mobile Business Transaction listed in Business Segment per Agent

Response Per Interval break down by service provider


Agent Properties and Sustainability Metrics


Supported Platforms

APM 9.7

Agent 9.7 for the MAA - APM Integration

Pre Agent 9.7 supported via field pack (no AppMap Support)


Futures

Transaction Status from MDO to APM and in-context URLs– Build a service between APM server and MAA SaaS server where information

can be requested on stored events for deeper analysis

MDO integration with Transaction Trace– Have MAA trigger transaction trace sessions and collect specific trace events

with the Mobile Business Transaction context


Demo

APM Agent – PHP Agent


A new star has arrived…


PHP AgentFeatures

Similar concept to our Java and .NET Agent

Method level visibility

Automatic Frontend detection and monitoring

Deep Transaction Trace visibility

Custom instrumentation• Custom FrontendMarker, BlamePointTracer and BackendMarker

Our first « Multi-Process Agent »• Lightweight probes solely dedicated to raw data collection

• Computing logic is processed outside of the monitored application to reduce overhead

• Controller Agent is in charge of configuration, data collection and processing

Platform support: PHP 5.3 and 5.4, Apache 2.2, RedHat/Centos 5.5+ and 6.5+ (64 bits)


PHP AgentArchitecture

Local Socket

Enterprise Manager

PHP Process Collector Agent

WebView

Pro

bes


PHP AgentConfiguration steps

• First Step …• Second Step …• Third Step…


For More Information

To learn more about DevOps, please visit:

http://bit.ly/1wbjjqX

Insert appropriate screenshot and text overlayfrom following “More Info Graphics” slide here;

ensure it links to correct pageDevOps






For Informational Purposes Only

© 2014 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

This presentation provided at CA World 2014 is intended for information purposes only and does not form any type of warranty. Content provided in this presentation has not been reviewed for accuracy and is based on information provided by CA Partners and Customers.

Terms of this Presentation

Technology

Pre-Con Education on APM 9.7