Upload
appdynamics
View
365
Download
3
Embed Size (px)
Citation preview
Achieving stability and End to End Monitoring Stace Baal, eHarmony Inc.Director of Engineering
The Problem
The Mess or Miss of Data
What we’re working on
The Rollout
The Business Transaction
The Drill Down
Copyright © 2015 AppDynamics. All rights reserved. 2
Dashboards
Health Rules
Proactive
That shouldn’t happen?!
Out of the datacenter – EUM
What’s next?
THE PROBLEM
The Problem
The Problem
Mature, large brand in the midst of changing architecture• Instability from Monolithic legacy application• Reactive not proactive with production issues• Little visibility into how new services interacted with legacy apps• Lack of data on customer experience
The Problem
THE MESS OR MISS OF DATA
The mess of data
We needed one source to truth to quickly diagnose issues• Fragmentation of monitoring systems• Lots of holes, lack of time for maintenance as services evolve• Ineffective alerting, noise• User facing outages
The mess of data
Copyright © 2015 AppDynamics. All rights reserved. 10
Why APM?
Challenges that caused us to choose AppDynamics• Stability• Time to Market: Needed a turnkey solution• Minimal internal resources• Engineering driven solution• Ability to track and trend baselines• Single pane of glass
THE ROLLOUT
How do we roll this out?
Challenges that caused us to choose AppDynamics• Deploy• Define• Diagnose• Notify• Discovery
Tiers
Business Transactions
Dashboards
Health Rules
Snapshots
Rolling out AppDynamics
Decide what to cover and how to divide it up• Create applications• Define and organize tiers• Deploy
– Start Front to Back– Chef Integration– Staging – Production, rolling deploy
• Wow, that went fast… – Time to market vs. homgrown solutions
Example call graph
Rolling out AppDynamics
Copyright © 2015 AppDynamics. All rights reserved. 16
• 4 Applications– User Front– User Back– Batch– Staging
• 38 Tiers (and counting)• EUM, Web & Mobile
THE BUSINESS TRANSACTION
Defining Business Transactions
Copyright © 2015 AppDynamics. All rights reserved. 18
Defining Business Transactions
BT: Business transaction correlated across service tiers• Visibility into what is most important• Start simple, broad transactions key to the business• Add granularity over time• May take some time, but it’s worth it
Defining Business Transactions
Copyright © 2015 AppDynamics. All rights reserved. 20
One Transaction
Several URLs
Defining Business Transactions
Copyright © 2015 AppDynamics. All rights reserved. 21
One Transaction
Correlated Tiers
Defining Business Transactions
BT is the foundation for all diagnostic tools• Correlation• Trends and dynamic baselines• Health rules• Drilldown and discovery
Defining Business Transactions
Copyright © 2015 AppDynamics. All rights reserved. 23
THE DRILLDOWN
Drilling down into Transaction Snapshots
Your diagnostic window into a transaction• Single pane view across tiers• Deep code-level visibility• Database and exit calls• Custom diagnostic data• Server health and utilization
Drilling down into Transaction Snapshots
Copyright © 2015 AppDynamics. All rights reserved. 26
Drilling down into Transaction Snapshots
Copyright © 2015 AppDynamics. All rights reserved. 27
DASHBOARDS
Dashboards
Dashboards
Your tool to bring everything together• At a glance diagnostic and status• Comprehensive tier and node monitoring• Connecting the dots between systems• Trending over time• Easily surface data between teams
Dashboards
Copyright © 2015 AppDynamics. All rights reserved. 31
Traffic
Performance
Dashboards
Copyright © 2015 AppDynamics. All rights reserved. 32
WEB
API
Service
Dashboards
Copyright © 2015 AppDynamics. All rights reserved. 33
PROACTIVE
So now what?
• Data and tools drive a cultural shift• Alert and surface issues before than can become outages• Health Rules are able to be predictive• Socialize the system beyond on-call • Empower teams and increase visibility• Encourage engineers to drilldown and optimize
THAT SHOULDN’T HAPPEN?!
That shouldn’t happen?!
That shouldn’t happen?!
That Random Spike
Copyright © 2015 AppDynamics. All rights reserved. 38
That shouldn’t happen?!
After the release
Copyright © 2015 AppDynamics. All rights reserved. 39
OUT OF THE DATACENTER - EUM
End user Monitoring
Extending visibility to the end user experience• Web: Pages & Ajax Requests• Mobile: Network Requests• Mobile: Crash Reporting• Custom Events & Timers• User snapshots correlated with BT snapshots• Justify and prioritize infrastructure and application enhancements• Correlate performance to business metrics • CDN and 3rd party monitoring
Stability & End to End Monitoring
Copyright © 2015 AppDynamics. All rights reserved. 42
WHAT’S NEXT?
Thank You