Consumer Cloud Monitoring Beta Kick-Off

© 2012 IBM Corporation

Cloud Consumer Monitoring

Consumer Cloud MonitoringBeta Kick-Off

Mac Holloway – Release Manager

08/24/2012

© 2012 IBM Corporation2


IBM Confidential

Reminders

– Please keep your phone on mute when not speaking (*6 toggles mute on phone conference facility if your phone does not have Mute button)

–We are recording this web conference so that:• People not able to attend can review

• You can share with colleagues who have an interest (keep in mind

Confidential, though, please don’t share outside your company)

• IBM Dev team can review if needed to make sure we capture feedback

correctly.



IBM Confidential

IBM Confidential Information & DisclaimerCloud Consumer Monitoring has not yet been announced, so this web conference and other early information is considered IBM Confidential. Please use care in sharing this information with others, and treat it as you would your own Confidential information.

THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY.WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED.IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION.NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, OR SHALL HAVE THE EFFECT OF:

• CREATING ANY WARRANTY OR REPRESENTATION FROM IBM (OR ITS AFFILIATES OR ITS OR THEIR

• SUPPLIERS AND/OR LICENSORS); OR• ALTERING THE TERMS AND CONDITIONS OF THE APPLICABLE LICENSE AGREEMENT

GOVERNING THE USE OF IBM SOFTWARE.

IBM's statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM's sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential futureproducts may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.



IBM Confidential

Agenda

GeneralInteractionsMarketing (short)Technical OverviewUI FlowsSchedule detailsDemoWrap Up



IBM Confidential

General information

What we want to accomplish: We want to work with you to develop an offering both you and IBM will derive success from. This needs to be Win-Win collaboration.

We will provide code drops every 3 weeks. This will be per a published schedule.

The schedule will change per input from you.

We want recommendations.On capabilitiesOn look-and-feelOn organizationOn Time To Value issuesOn collateral and support

On September 14 we will shift to an Open Beta model and we will be expanding the participation to accommodate more of the customers that have shown interest.



IBM Confidential

Interactions

Forum – this is a general discussion forum for all items of general interest. Please try it out.

Wiki – a place for making documentation and other deliverables generally available. If you have thoughts or needs for material or information or other collateral this is where we would make it available. Presentations and recordings will be available here.

Advocate - for each of the business partners on this call we will assign you an advocate from the Tivoli team to insure that we are aware of your needs and progress.

Weekly calls - These meetings will be for:• Issues – technical, procedural, informational• Requirements discussions• Previews of upcoming capabilities if there is interest

Special projects - We will also have separate support for other work like creating an agent, running a beta with a customer/end user, etc.



IBM Confidential

Why Cloud Consumer Monitoring ?



IBM Confidential

Cloud Consumer Scope & Landscape

Cloud Consumer Users

Cloud Provider Users

PrivatePublicHybrid

PrivatePublicHybrid

CloudCloud Cloud Service Request & Delivery Platform

Cloud Service Request & Delivery Platform

Cloud Monitoring Tools(Cloud Provider)

Cloud Monitoring Tools(Cloud Provider)

Cloud InfrastructureCloud Infrastructure

Cloud Services Provider Personnel (Cloud Broker)Cloud Services Provider Personnel (Cloud Broker)

Cloud AdministratorCloud OperatorSMEs

Cloud AdministratorCloud OperatorSMEs

Create imagesCreate images

Request cloud services (execute, control, etc)Request cloud services (execute, control, etc)

Manages and fulfill cloud requestsQoSManages and fulfill cloud requestsQoS

WorkloadWorkloadVMVM

Provision resourcesDeploy workloadProvision resourcesDeploy workload

Monitor workloadsMonitor workloads

Manages the Cloud Services Delivery PlatformManages the Cloud Services Delivery Platform

Manages the Cloud InfrastructureManages the Cloud InfrastructureOperationsDev OpsLine of business

OperationsDev OpsLine of business HypervisorHypervisor

VMVM VMVM VMVM

OSOS OSOS OSOS

ApplAppl ApplAppl ApplAppl

Cloud Consumer workloadCloud Consumer workload



IBM Confidential

RequirementsLow Time To Value

• Infrastructure install by cloud provider must be on the order of minutes or 10s of minutes

• CVM instantiation/monitoring/debug by cloud consumermust be on the order of a couple of minutes

Light weightAdaptive to highly dynamic environment – VMs come and go all the timeExtensibility - easy to add more monitoring coverageIntegration

• Events can be fed to any enterprise event management system

• Historical data can be sent to a data warehouse

• Any data can be pulled into other toolingBroad platform coverage

• EC2, VMware, SCP, …



IBM Confidential

InsightfulApplication-level metrics. The monitoring infrastructure collects data

from within the application, bringing into focus application-level data that the hypervisor can’t see.

Intuitive interface. Attractive web-based UI presents application-level data in an intuitive way that supports actionable insights at the application level.

Integration with cloud service provider platforms. The monitoring infrastructure integrates with cloud provisioning systems to create a highly dynamic and automated ecosystem that aligns with customer business processes.

LightweightQuick time-to-value. Newly provisioned virtual machines are

automatically discovered, and are displaying performance metrics in the UI in under a minute.

Self-configuring. Monitoring is established and maintained automatically, as the VM image is deployed.

Self-optimizing. The monitoring infrastructure dynamically scales itself to the workload, monitoring only what is needed using an appropriate amount of resource.

SecureMulti-tenant. Multiple tenants may share the monitoring infrastructure

within a safe and secure environment in which each can only access his/her own data.

Cloud service providers, and their tenants, need a multi-tenant, lightweight, elastically scalable solution for monitoring virtual machines and the applications running on them, without having to wrestle with a complex monitoring infrastructure.



IBM Confidential

Technical overview and sample panel flow



IBM Confidential

Small, Extensible, Integrated and EASY

CloudPlatform

support

MgmtFabricNode

EnterpriseIntegration

Extend

ible

UI

Extend

ible

Data

Provid

ers

Mul

tiple

Age

ntA

rch.

HighlyDistributed

Data

Events

Scalability

Smar

t Clou

d Pro

vision

ing

Amaz

on E

C2

Smar

t Clou

d Pro

vision

ing

Amaz

on E

C2

ITM

Da

ta W

are

ho

use

Om

nib

us

ITM

User Provided Custom

Default Appl. Support

Local Short Term Store

Forwarding

ForwardingITM Agents

Agent Less

Local / Remote

OSLC e

xpos

ed

No

Ce

ntr

aliz

ed

Da

ta



IBM Confidential

ITM

Ominbus

Customer VM

Agent

Customer VM

Agent

Customer VM

Agent

Customer VM

Agent

SQLAdapter

Base Fabric Node

SQL

DataWarehouse

UI AMZ …SCP

CloudPlatformCloud

PlatformCloudPlatform

High Level Architecture



IBM Confidential

CCM Panels – Overall Flow

Event Console

Situation Config

Group Setup

Health Check / Troubleshoot.

User Management

CCM Component Config

Eclipse Help (Context Sensitive)

Group Details (one tab on the page for each agent type in group. BP/Customer may contribute tabs.)

Cloud Dashboard (initial page)

drill down

Event Details (drill into {Group, EventSeverity} choice.)

drill down



IBM Confidential

Cloud Dashboard

Credit Services

2 1 1 4 6 1

VM Group VM Count Offline

WebSphere 4 2 2 8 0

vm27.ibm.com

1 1 4 1 0

2 1 1 4 6 1DB2

Cloud Dashboard

test1.ibm.com 1 0

test2.ibm.com 1 0

test3ibm.com 1 0



IBM Confidential

Group Details – Sample Agent Tab (Linux VMs)



IBM Confidential

credit8.raleigh.ibm.com:LNXOverview Properties CPU Disk Memory Network Process

credit8.raleigh.ibm.com:LNX

50 100

bash

notifier

LocMapper

chrome

ksh

CPU Utilization (Top 5)

50 100

HADR2

TEST

HADR1

SAMPLE

SAMPLE2

Disk Utilization % (Top 5)

Home Linux VMs Credit Services

Severity Status EventsEvent

DescriptionGroup Impacted Time

Display Item

Critical

OpenLinux_Process_High_CPU

The percentage..

Credit ServicesProtection

8/14/2012 3:27PM

LocMapper

Search1

1-6 of 6 items 5 | 10 | 25 | 50 | 100 | All < << 1 > >>

Overview



IBM Confidential

Schedule



IBM Confidential

Beta Drop scheduleDate Drop 1 Drop 2 Drop 3 Drop 4 Drop 5 Drop 6

Sprint 8/24 9/14 10/05 10/26 11/16 12/14

Beta drop 8/24 9/19 10/10 10/31 11/21 12/19

For each drop we will have defined content.For each drop there will be a set of capabilities that we want customers to exercise.For each drop there will be value that we are trying to deliver.For each drop we want customer input on the value and how to improve it.

Additionally we want to continually review the schedule and (to the extent it is possible) adjust it per the general customer input on priorities.

There is a schedule but this is a beta. We need to keep working on the product until it is ready to ship. We will look to the customers to work with us on determining when this has been achieved.

Two caveats – this is software development so content for any givne drop may change for various reasons. Change in content based on customer input may have other effects on content.



IBM Confidential

Drop 1Basic capabilities running in Amazon/EC2 or SCP. We will provide installables for the fabric node and Customer VM(s) (Linux instance(s)). The customer will be able to:Install the fabric node code.Install the ITM agents (Linux OS, X, and ITM Agent Builder MySQL SAMPLE) Instantiate a fabric node.Instantiate VMs with Linux OS agent already installedGroup panel showing VMs in a group (all VMs in the cluster at this point)

Customer experience:The customer gets to experience the ease or difficulty of the fabric node creation. The customer gets to experience/validate the deployment TTV seeing monitoring within seconds or minutes of instantiating a VM in their environment.The customer gets an initial insight into what groups/workloads could be.The customer sees both performance data for a VM running Linux OS.The customer gets to see that ANY ITM agent can be used albeit in a default table view.The customer gets to see the events and associated status for all of the ITM agents.The customer gets to see a SAMPLE ITM agent builder agent in operation.

IBM is looking for:Impressions on the install. Is this easy enough ? What would make it easier ? What other cloud platforms are important ?Impressions on the UI look and feel. Is this “sexy” enough ? Is the flow logical ? Is the arrangement intuitive ? What should change ?Is this the right data to monitor/show ? What should change ?How should status be aggregated ?Is the sample useful ?Validation of the order of value delivery – the plan.



IBM Confidential

Drop 2Add grouping, event panel, event forwarding, VMware/Vcenter support, and full Gaian on the customer VM (with non-ITM data source and no event or status support)

In basic terms this is what is new:Ability to group data sources and list and render groupsWindows OS panel showing Windows performance metrics and event based statusEvent based statusEvent list panel Discovery plug-in for VMware/Vcenter – allows Vcenter based private clouds i.e. VCELL.The user uses the configuration manager UI to have events forwarded to OMNIbus (or other event consumer)Ability to add non-ITM data sources (no event support, table display only, no contribution to group status)More configuration

Customer experience:The customer can now create groups. This is the key workload concept.The customer can now run on VMware.The customer can leverage event driven status for single VMs.The customer can play with more of the configuration through the UI. The customer can create a non-ITM agent data source using the distributed db interface

What IBM wants:Does the grouping capability make sense ? How would they change it ?Does the status aggregation for groups makes sense ? Is the aggregation algorithm sufficient for a first release ? If we were going to make modifications, what would they recommend ?What types of data sources are they interested ? What kind of samples do they need ? What kind of custom display options are they interested in ?



IBM Confidential

Drop 3

Add status aggregation, self-healing, WAS monitoring, and historical data

In basic terms this is what is new:Status for aggregates - groupsFirst pass of components restarting on failureWAS monitoringHistorical data

Customer experience:The customer can play with killing components and watching the recovery.The customer can now monitor WAS and include it in groups.The customer can use historical data to debug a problem.The customer can see aggregated status for groups – user defined, data source type, all VMs

IBM is looking for:Testing help on the self-healing.Help in whether the WAS metrics are what they need.Is the WAS page(s) layout effective ?Help in whether the default set of event sis appropriate.Validation of group status aggregation.



IBM Confidential

Drop 4Add fabric delivery, DB2 monitoring, remote monitoring (will need to work with public cloud providers and private cloud users on this)

In basic terms this is what is new:DB2 monitoringAdvanced extensibilityRemote monitoring (aka agent-less monitoring) for OSes

Customer experience:The customer can now use an appliance based fabric node rather than having to build one.The customer can now create a custom page(s) for an ITM agent builder agent and insert it into the product. This is the other half of the extensibility capability. She/he can now use the samples as a basis to create a custom agent with customer display of the data.The customer can now monitor DB2 and include these data sources in groups.The customer can now do OS monitoring without having an OS agent on each VM.

IBM is looking for:Validation of the usefulness of an appliance approach.Is the sample sufficient? what other doc do they need ?Are the DB2 metrics the ones they need ?Is the DB2 page(s) layout effective ?Are the DB2 defaults events appropriate ?Is the remote monitoring sufficient ? enough data ? enough agents ?



IBM Confidential

Drop 5Drop 5 Add custom pages for other agents, more config, more self healing

In basic terms what is new:

The user wants to consider data sources other than ITM agent builder agent

• The user selects an image with on it and adds both the application(s) and a non-ITM data collectors feeding the distributed db interface

• The user provides page definitions to a panel in the CCM UI which dowloads them and inserts them into the nav structure.

• The user starts an instance of the VM

• The user navigates to the grouping page

• The user adds the data source to a group

• The user can now navigate to the provided custom pages from the group that the data source is part of

Customer experience:

The user can create non-ITM data sources (and associated displays).

IBM is looking for:

Is the situation editor “good enough” ? sufficient function ? sufficient usability ?

Are the samples for the non-ITM data source sufficient ? is the doc sufficient ?

Is the integration with ITM easy enough ? What is missing ?



IBM Confidential

Drop 6Drop 6 Add basic situation editing, ITM 6.3 dependencies – WPA and DP (including OSLC registration)

In basic terms what is new:The user can send data to her ITM infrastructure.

• The user uses the configuration manager UI to have historical data sent to an ITM Data Warehouse.

• The user points an application at the OSLC api and pulls data from the fabric node.The user can change the basic values for a given situation

• She opens the situation editor• Specifics in early design

Customer experience:The user can edit situations for the ITM agents.The customer can integrate this with an ITM installation – events, historical data.

IBM is looking for:Is the situation editor “good enough” ? sufficient function ? sufficient usability ?Is the integration with ITM easy enough ? What is missing ?



IBM Confidential

Demo

Fabric node creation - SCP

Customer node creation – SCP

Simple debug example - SCP

MySQL

EC2



IBM Confidential

Wrap up



IBM Confidential

RequirementsLow Time To Value

• Infrastructure install by cloud provider must be on the order of minutes or 10s of minutes

• CVM instantiation/monitoring/debug by cloud consumermust be on the order of a couple of minutes

Light weightAdaptive to highly dynamic environment – VMs come and go all the timeExtensibility - easy to add more monitoring coverageIntegration

• Events can be fed to any enterprise event management system

• Historical data can be sent to a data warehouse

• Any data can be pulled into other toolingBroad platform coverage

• EC2, VMware, SCP, …



IBM Confidential

Materials

Link to Forum:

http://www.ibm.com/developerworks/forums/forum.jspa?forumID=2897

Link to Wiki:

https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Cloud%20Consumer%20Monitoring/page/Welcome

Link to downloads (still cleaning up install automation – targetting 8/29 availability):

https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Cloud%20Consumer%20Monitoring/page/Downloads%20-%20Drop%201/attachments

Link to install instructions:

https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Cloud%20Consumer%20Monitoring/page/Installation%20instructions%20-%20Drop%201



IBM Confidential

Nest steps

Advocate assignment

Todos from customer input

Input from customers on scheduling cadence calls

Misc.



IBM Confidential

www.ibm.com

Documents

Consumer Cloud Monitoring Beta Kick-Off