Monitoring VMware vFabric with Hyperic and Spring Insight

Steve Millidge

vFabric tcServer

Why vFabric tcServer?

• Pre-configured Templates• Many instances from a single binary install• High Performance JDBC connection pool• Improved Diagnostics• JMX management enabled by default• Unix & Windows Service Scripts• Server Management Tools• Latest security patches as binaries• Integration with vFabric components

Features over Tomcat• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management

Diagnostics• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management

Diagnostics Template

./tcruntime-instance.sh create <instance> -t diagnostics

SlowQueryReportJmx

• Reports on SLOW and FAILED Queries• Subscribe for JMX Notifications

ThreadDiagnosticsValve

$CATALINA_BASE/logs/catalina.YYYY-MM-DD.log

+ Extended Logging

JMX Notifications

• Reports on “slow”, “stuck” and “failed” requests• Subscribe for JMX notifications or view log files

EM4J• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management

Traditional Best Practice for Virtualised JVM’s

• Reserve 100% of the required VM memory• Tune JVM Heap to occupy minimum• Avoid GC Thrashing “Both ballooning and swapping should be

prevented for Java application”

• No benefit from Virtualisation memory sharing• All resources must be provisioned upfront

ESXi 5.0 Memory Reclamation

• Transparent Page Sharing• Memory Compression• VMware Tools Balloon OR EM4J Balloon• Swap

EM4J Balloon Driver

Guest OS

JVM Heap JVM Heap

Guest OS

JVM Heap JVM Heap

Hypervisor

Elastic Memory for Java EM4J

• Requires ESXi 5.0• Redhat / Centos v5 (x32 or x64)• Hotspot JDK 1.6• Heap > 512Mb• Recommend no more than 4 JVMs per VM• JVMs should account for the majority of the

VM memory usage

Switch EM4J On

• Enable EM4J in the VM– sched.mem.pshare.guestHintsSyncEnable=true– sched.mem.maxmemctl=-1 (max balloon size)

• Create EM4J instance– ./tcruntime-instance.sh create instanceName -t elastic-

memory

Troubleshooting your App

• How many database calls does that page generate?• What was the SQL executed?• How long did the query take?• Why does this page take a long time to load?• Which part was slow?• What happened then?!

Spring Insight to the Rescue

What does it provide?• Information on all database queries • Information on all web request and response information• Lists component calls and parameters

Where can I use it?• Agile Development• QA• Load Testing• Production Monitoring

Under the Covers

How does it work?• Agent instruments application code using AspectJ• Reports to “dashboard” (insight.war) component

responsible for rendering statistics

Increased Memory Requirements• Increased memory –Xmx• Increased permgen –XX:MaxPermSize

Applications Summary

Application View

End Point View

Response Time Histogram

Request & Response Summary

JDBC Query

Recent Activity

vFabric Hyperic Integration

More later!

vFabric Hyperic

Overview

• Monitoring & Management Solution• Out-of-box monitors over 75 technologies• Automatic discovery of resources• Metric Collection• Event Tracking• Resource Control• Alerting & Notifications• Access to Live Information

Architecture

Resource Hierarchy

• Platform – Win2008, linux etc

• Platform Services– CPU– File System Mount– Network Interfaces

• Server– tcServer instance– RabbitMQ Server

• Service– tcServer Session Manager– RabbitMQ Queue

Hyperic User Interface

Resource View

Resource Alerts

• Metric Alerting• Event Alerting

– Log file tracking– Config file tracking

tcServer Application Management

vSphere Monitoring

• Server side HQU Extension• Remote agent accesses vSphere vCenter

vCenter Resource Hierarchy

Agent installed on VM• Platform

– Win2008, linux etc

• Platform Services– CPU– File System Mount– Network Interfaces

• Server– tcServer instance– RabbitMQ Server

• Service– tcServer Session Manager– RabbitMQ Queue

Agent monitoring vCenter• vCenter – Software• ESX Host – Platform• VM – PlatformFeatures• Auto disovery of ESX

Hosts and VM’s• Auto detection of new

ESX Hosts and VM’s• Auto detection of

architecture changes e.g. vMotion

ESX Host & VM Metics

Monitoring VMware vFabric with Hyperic and Spring Insight

Documents

High Performance Data with VMware vFabric GemFire · PDF fileVMware vCloud® Architecture Toolkit High Performance Data with VMware vFabric™ GemFire® Best Practices Guide October

Getting Started with vFabric Suite - Guardian Network Solutions · 2014-10-31 · Getting Started with vFabric Suite VMware vFabric Suite 5.3 This document supports the version of

© 2011 VMware Inc. All rights reserved vFabric Cloud Application Platform Spring, tcServer and Hyperic - Build, Run & Manage J2EE web apps Pronam Chatterjee

VMWARE PRODUCT GUIDE8.2 VMware vFabric Postgres 9.1 61 8.3 VMware vFabric Postgres 9.2 and 9.3 61-62 8.4 Pivotal tc Server and Web Server 62 8.5 VMware vFabric Hyperic 62 8.6 VMware

Migrating Java Applications to vFabric · Presentation – AJAX, CSS, JQuery Spring tc App Server Apache Web Server Hyperic Frameworks & Tools Platform Services Portals/Widgets –

Using VMware vFabric Postgres for Data Director - vFabric ... · By default, vFabric Postgres performs dynamic tuning of checkpoint parameters so that rapid changes in available I/O

Vblock™ Solution for Application Lifecycle Platform · 2012-10-12 · tc server and Hyperic server and agent This project incorporates the VMware vFabric components: tc server,

VMware vFabric Hyperic Overview · Integrate vFabric Hyperic with OpenNMS .....54. 5 About vFabric Hyperic Overview vFabric Hyperic Overview is an introduction to VMware® vFabric™Hyperic

© 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

vFabric GemFire User's Guide - pubs.vmware.compubs.vmware.com/vfabric52/topic/com.vmware.ICbase/PDF/vfabric-g… · 21/03/2013 · vFabric GemFire User's Guide VMware vFabric GemFire

High Performance Data with VMware vFabric …...data fabric in production, and GemFire on vSphere best practice considerations. vFabric GemFire Monitoring and Troubleshooting Primer

VMware vFabric - Webinar with CIO Magazine

VMWARE PRODUCT GUIDE · VMware vFabric Postgres 9.1 Per Virtual Machine CLOUD APPLICATION PLATFORM VMware vFabric Postgres 9.2 and 9.3 Per Virtual Machine CLOUD APPLICATION PLATFORM

CAP1714-Next Generation Messaging VMware vFabric RabbitMQ_Final_US.pdf

VMware vFabric Postgres Standard Edition User Guide

VMware vFabric Data Director for DB as a Service

Introducing vFabric, the VMware Cloud Application Platform

Using VMware vFabric Postgres - vFabric Postgres 9.3 · PDF fileUsing VMware vFabric Postgres vFabric Postgres 9.3.5 This document supports the version of each product listed and supports

vFabric Hyperic Resource Configuration and Metrics...2008/06/05 · SpringSource tc Runtime 7.0 server 378 17 vFabric Web Server 388 vFabric Web Server Plugin Overview 388 Configuration

Distributed Data Management with VMware vFabric GemFire