Is your Web Application Performance Doomed?

Imad Mouline - Compuware CTO, APM Solutions

Jean-Pierre Garbani - VP, Principal Analyst, Forrester Research

How issues with browsers, cloud services, third-party providers, the Internet, and your

data center can impact your performance and what you can do about it

Agenda

Complexities of todays application deliver and the impact on IT and business

Evolution of APM and limitations of todays APM tools

Best practices for unifying your APM strategy

2010 Forrester Research, Inc. Reproduction Prohibited3 2009 Forrester Research, Inc. Reproduction Prohibited

Jean-Pierre Garbani, Vice President, Principal Analyst

2010 Forrester Research, Inc. Reproduction Prohibited4

Controlling complexity is a

major IT issue . . .

2010 Forrester Research, Inc. Reproduction Prohibited5

IT and the enterprise

Application performance is key to enterprise productivity and

business success.

Transactional applications and business services based on aggregates of

these applications are the business visible component of IT.

Performances are critical for the overall productivity of the enterprise.

IT operation must deliver performances are in line with business expectations.

The current economic conditions favor short-term returns on

investments.

IT organizations tend to favor tactical over strategic initiatives.

In light of the poor economic situation, reducing costs tops business goals.

There's increasing pressure to prove business benefits of any IT spending.

2010 Forrester Research, Inc. Reproduction Prohibited6

Complexity example: web based business service

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and

devices Users

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Zone of customer expectation

Virtual or Real Data Center

2010 Forrester Research, Inc. Reproduction Prohibited7

Productivity equals application performance

The key to productivity in interactive applications is

response time:

.1 second is instantaneous.

1 second is when a response time is perceived.

10 seconds is when users lose focus on the interaction.

Basic rules

Simple and frequent tasks: 1 second or less

Common tasks: 2 to 4 seconds

Complex tasks: 8 to 12 seconds

2010 Forrester Research, Inc. Reproduction Prohibited8

But can IT organizations deliver?

2010 Forrester Research, Inc. Reproduction Prohibited9

Complexity management issue

IT complexityBusiness

integration

Manual ability

Time

IT management

gap

Saturation

point

2010 Forrester Research, Inc. Reproduction Prohibited10

Technology

innovation

Business

service

demand

Cost/value

ratio

$

R&D

Exponential

growth

Things will not improve with time

IT is an autocatalytic process

2010 Forrester Research, Inc. Reproduction Prohibited11Source: October 29, 2008, Talking To Your CFO About Cloud Computing Forrester report

Cloud-based services are on the horizon

2010 Forrester Research, Inc. Reproduction Prohibited12

What will be naturally in the cloud in 2015?

Standardized business logic

Horizontal business applications

Multitenant business process platforms

Simple, standardized infrastructure services (IaaS) like storage and

compute power

What will remain on-premise?

Most custom-build applications

Application implementing customers intellectual property relevant and competitive business logic

How will we manage complex hybrid applications?

2010 Forrester Research, Inc. Reproduction Prohibited13

Management tools evolve with application complexity

System

management

Application

network monitoring

End user experience

monitoring

Java EE and

.NET

management

Database

performance

management

Messaging, Web

services, and SOA

monitoring

Business

transaction

management

Future integration

with business

processes

Analytics and event

processing

One and two

tier applications

Browser-based

applications

N-tier composite

applications

Highly integrated

business services

2010 Forrester Research, Inc. Reproduction Prohibited14

The application performance management concept

Java EE and .NET are at the application core.

Java EE applications servers seen as the critical technology

Number of entrants in the monitoring of these applications, closely followed by

an interest in .NET

Acquired by larger IT management vendors

BSM and application mapping

But the granularity of dependency mapping at the application level isn't

sufficient to be a template for transaction performance management

APM evolved into a broader monitoring solution.

Complex applications, using Web services, SOA, and multitier aggregation

Problems can now come from a number of directions .

APM started to include other forms of monitoring, such as end user experience,

infrastructure, and database to complement the Java EE and .NET monitoring.

2010 Forrester Research, Inc. Reproduction Prohibited15

The business transaction monitoring concept

Applications are really seen through business transactions.

Performances are perceived at the transaction level.

Transactions are not created equal.

Global monitoring is not sufficient to debug transaction performance

issues.

Business transaction monitoring, with the possibility to map in real time at

the individual transaction level, appears alongside APM solutions.

Business transaction monitoring solutions provide transaction visibility and

problem identification but not the monitoring depth of APM.

Is the ideal solution an APM-BTM convergence?

2010 Forrester Research, Inc. Reproduction Prohibited16

The Forrester APM Reference Model

MajorISP

Internet

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Collect transaction response time

Inside Outside

Zone of customer expectationMap the transaction componentsZone of customer expectationMonitor the transaction components

2010 Forrester Research, Inc. Reproduction Prohibited17

The Forrester APM Reference Model

Collect response times by transaction, and determine the first level-

alerting criterion.

Understand and map all the components of the transaction.

Monitor applications themselves. This includes all types of applications.

Monitor performance of the database(s).

Monitor the physical and virtual components of the infrastructure.

Combine all these parameters.

Provide all this information on a single-pane-of-glass dashboard.

2010 Forrester Research, Inc. Reproduction Prohibited18

End user experience monitoring

Database monitoring

Application monitoring

Infrastructure monitoring

Role-oriented,real-time

dashboard

Combined analytics

Transactionmapping

Real user performance monitoring

Synthetic user record playback

Java EE and .NET monitoring

Messaging monitoring

Portal and Web server monitoring

Packaged application monitoring

Databaseperformance analytics

Database performance monitoring

Mainframe performance connector

Network and server monitoring

Virtual world monitoring

Custom application monitoring

CMDB connector

The Forrester APM Reference Model

2010 Forrester Research, Inc. Reproduction Prohibited19

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

2010 Forrester Research, Inc. Reproduction Prohibited20

Recommendations

Understand the complexity level of your business services. This should be

assessed in a business dimension and in an IT operation dimension but with an eye

to whats coming down the pike.

Inventory the monitoring products installed in your operation. Conduct a

thorough assessment of the value and potential for integration of each of these

products, sorting what should be replaced and what should be kept.

Conduct an analysis of the solutions available on the market. Create a gap

analysis between installed solutions versus a comprehensive performance

management solution using the Forrester reference model.

Conduct an economic analysis. This analysis should take into consideration the

efficiency of the end result. For example, how many brownouts and downtimes

could have been avoided with the right solution, and privilege these long-term

benefits over short-term savings in license costs.

2009 Forrester Research, Inc. Reproduction Prohibited

Thank you

JP Garbani

+1 239.352.0129

jgarbani@forrester.com

www.forrester.com

Imad Mouline - Compuware CTO, APM Solutions

Examples and Recommendations based on JPs Conclusions

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including virtualization and cloud

Integrates all events and data on a single pane of glass for proactive analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

The Browser Is Becoming THE Integration Platform

8.87

By The Numbers

Number of hosts accessed directly by the browser, per user transaction, averaged across 3,000 companies

Measurementcity

Number of hosts per user transaction

Hong Kong 6.82

Beijing 8.87

London 7.95

New York 9.82

Frankfurt 8.71

Paris 10.12

Stockholm 10.48

Helsinki 12.71

Amazon EC2 Region Percentage

EC2 Asia Pacific - Singapore 0.151

EC2 EU - Ireland 1.578

EC2 US West - Northern California 2.066

EC2 US East - Northern Virginia 24.144

TOTAL 27.938

Enterprises ARE Adopting Cloud Computing

Percentage of web app transactions that include at least one object hosted on Amazon EC2

Amazon EC2 Region Percentage

EC2 Asia Pacific - Singapore 0.151

EC2 EU - Ireland 1.578

EC2 US West - Northern California 2.066

EC2 US East - Northern Virginia 24.144

TOTAL 27.938

The Web Application Delivery Chain

The Challenge of Delivering Web Applications

Systems management

tools: OK

user is NOT happy

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Traditional zone of control

2010 Forrester Research, Inc. Reproduction Prohibited9

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

The Web Application Delivery Chain

The Challenge of Delivering Web Applications

Systems management

tools: OK

user is NOT happy

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Traditional zone of control

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

The Web Application Delivery Chain

Network peering problems

Outages

Inconsistent geo performance Bad performance under load Blocking content delivery Incorrect geo-targeted content

Configuration issues Oversubscribed POP Poor routing optimization Low cache hit rate

Network peering problems

Bandwidth throttling

Inconsistent connectivity Configuration

errors Application

design issues Code defects Insufficient

infrastructure

Poorly performing JavaScript

Browser/device incompatibility

Page size too big

Too many objects

Low cache hit rate

Network resource shortage

Faulty content transcoding

SMS routing / latency issues

The Challenge of Ensuring Quality Web Experiences

Zone of customer expectationZone of customer expectation

Systems management

tools: OK

user is NOT happy

Zone of customer expectationZone of customer expectationTraditional zone of controlTraditional zone

of control

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Pinpointing Problems and Optimizing Performance

The Web Application Delivery Chain

Is it my data

center?

Is it anISP or the Internet?

Is it a 3rd party

provider?

Is it a browser or

device?

Is it my datacenter, the Internet, my vendor or a browser/device issue?

Focus on the most critical business issuesQuick identification of root cause

2010 Forrester Research, Inc. Reproduction Prohibited10

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

Is it my datacenter, the Internet, my vendor or a browser/device issue?

Focus on the most critical business issuesQuick identification of root cause

Single Pane of Glass requires unifying monitoring approaches

Internet

Web Servers

Load Balancers

AppServers

Data base

Users

Synthetic Tests

Gomez Backbone

Agents

Real User Traffic

RUM metrics Active monitoring metrics

Business impact prioritizationRapid root cause isolationRapid time-to-value

Gomez SaaS Platform

GomezFirst Mile appliance

Use Case Scenarios

Scenario #1: Problem inside data center

Scenario #2: Problem with third party

MajorISP

Local ISP

Mobile Carrier

Internet

Content DeliveryNetworks

3rd Party/Cloud Services

Browsers and devices UsersUsers

Storage

Web Servers

App Servers

DB Servers

Mainframe

Load Balancers

Mobile Components

Network

Scenario 1 Scenario 2

Data Center Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Focus on the most critical business issuesNew operations Dashboard organized by alert severity

Shopping Cart Transaction: Severe alert with a response time over 9 seconds

Root Cause Indicators instantly highlight an issue in the data center

2010 Forrester Research, Inc. Reproduction Prohibited11

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

Data Center Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Focus on the most critical business issuesNew operations Dashboard organized by alert severity

Shopping Cart Transaction: Severe alert with a response time over 9 seconds

Root Cause Indicators instantly highlight an issue in the data center

Data Center Problem: QuantificationHow many users are impacted by poor performance?

Drill into details of shopping cart transaction

Further drill into trends over time

Problem is with the Cart page specifically and is impacting 26% of 3,235 Users

Problem is with the Cart page specifically and is impacting 26% of 3,235 Users

2010 Forrester Research, Inc. Reproduction Prohibited12

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

Data Center Problem: QuantificationHow many users are impacted by poor performance?

Drill into details of shopping cart transaction

Further drill into trends over time

Problem is with the Cart page specifically and is impacting 26% of 3,235 Users

Problem is with the Cart page specifically and is impacting 26% of 3,235 Users

Data Center Problem: ResolutionWhere is the problem in my infrastructure?

Is my load balancer balancing properly?Do I have a problem with a specific web server?

Web Server 3Specific issue with Web Server creating response time degradation

2010 Forrester Research, Inc. Reproduction Prohibited13

Conclusion

An application performance management solution:

Understands the infrastructure supporting the transaction

Collects data and events from all transaction components, including

virtualization and cloud

Integrates all events and data on a single pane of glass for proactive

analysis

Guide IT operations in identifying the component at fault

Determine transaction criticality

Allows deep dive on component (of all nature) at fault

Data Center Problem: ResolutionWhere is the problem in my infrastructure?

Is my load balancer balancing properly?Do I have a problem with a specific web server?

Web Server 3Specific issue with Web Server creating response time degradation

Third Party Problem: IdentificationIs it my datacenter, the Internet, my vendor or a client issue?

Identify third party issues immediatelyEasily drill into third party

Product Search shows a severe alert with a response time over 3 seconds

Root Cause Indicators highlight a third party issue

Drill into third party contributors

Third Party Problem: Historical AnalysisTrend Third Party Performance over time

Ad Vendor shows marked degradation of performance

Chart shows third party trending over time

Data Center n-Tier Deep-Dive

Gomez First Mile One ChartBusiness and User ImpactOutside In Response TimeData Center Response TimeWeb Server Infrastructure

Vantage Multi-tier ReportMulti-tier analysis (Web, App, DB)Response Time at each TierTransaction analysis

Java / .NET Method Analysis In Context with Gomez Alert

1 2

Summary

At a Glance status of business critical transaction Identify alerting

transactions Immediate fault domain

isolation

Transaction detail drill down View transaction level

performance details and trends

View business impact

Fault domain drill down Isolate problem root cause

Q&A

Imad Mouline - Compuware CTO, APM Solutions

Jean-Pierre Garbani - VP, Principal Analyst, Forrester Research