Cloud Control Overview - Amazon S3Control+Ov… · Cloud Control Everything you Need or Want to Know about All of your Servers and Workstations 5/16/2019 Ken Latimer - Proprietary

Cloud Control Overview

Ken Latimer

5/16/2019 Ken Latimer - Proprietary and Confidential 1

Cloud Control

Manage Your Entire Computer Environment

- Servers and Workstations

- Windows and Unix

- Physical, Virtual and Cloud

With One Common Management System

For Only $1 per Computer per Month


Cloud Control

Everything you Need or Want to Know about

All of your Servers and Workstations


Hardware Inventory and Configurations

Operating System and Application Inventory

Internal Operating System Misbehavior

Current Performance Problems

Subsystem Performance

Actual Resource Consumers

Excess Capacity Available for Use

Future Capacity Requirements

Summary Dashboards for All Computers, Each Organization/Group and Each Computer

Unusual Load Changes

Current Resource Utilization

Historical Resource Utilization

Hardware Modifications

Software Additions and Deletions

Software Version Changes

Service Stability and State

Overall Up Time

The Problems With Traditional Management Applications

• Different applications for different environments – Physical computers: Based on operating system (Windows, Unix)

– Virtual computers: Based on hypervisor (Hyper-V, VMware, OpenStack)

– Cloud computers: Based on provider (Amazon, Microsoft, Google)

• Limited scaleability – Real time data: Impractical to collect in large environments

– Very large database: Questionable response times

• Missing key analysis data – No visibility inside the operating system: memory swapping, consuming processes,

configuration changes, application state, effects of virtualization

• No common or consolidated view of the total environment

Cloud Control was Specifically Designed to Solve These Problems


The Cloud Control Difference

• Comprehensive computer analysis and control – performance, stability, reliability, capacity, efficiency and availability

• Complete access to all operating system data – configurations, resource utilization, performance, applications and services

• For all computers – physical, virtual and cloud

• Unlimited scaleability – from 1 to 1,000,000

• Simple and intuitive – installs in minutes, guides the user, explains the results

• Easily organized – manages multiple customers and/or departments

• Proactive – identifies areas needing attention and recommends specific changes

• Integrates easily into existing systems – API uses SQL queries/commands over a Rest connection

Computer Management for the Entire Environment


Fully Distributed Architecture

• All data collection, analysis, recording and reporting is done on each individual computer – Automatically installed (and updated) operating system service

– Minimized processor (1%), memory (4%) and storage (700MB) requirements

• Complete access to everything inside the operating system – Configurations, usage data, applications, processes

• No scaling limit – Workload equally distributed across the entire environment

• No single point of failure or massive database to backup

• Consolidated views of all computers regardless of computer type – Data automatically retrieved from individual computers as required


Three Dimensional Configuration


• Computers can be logically organized regardless of where the computer is physically located, the type of computer (virtual, physical, cloud …) or the type of operating system

• Computers can be then be grouped based on criticality, organization, purpose …

• Management data can be summarized by organization and/or group

Organization A Organization B Organization C

Overall Management

Group 1

Group 2

Group 1

Group 2

Group 1

Group 2

Minimal Computer Requirements

Windows Computers – Windows XP/Server 2003 or later

– File sharing enabled and ports 139 and 445 accessible

– Domain admin credentials (or local admin credentials with required registry entry)

– Standard WMI used for configuration and data collection

Unix Computers – Red Hat, OpenSUSE, Ubuntu, CentOS …

– Secure Shell (SSH) enabled and port 22 accessible

– SUDO credentials

– Standard files and commands used for configuration and data collection

Automatically adjusts for differences in operating system versions


Extensive Computer Evaluation

• Performance – Processor, memory, swapping, storage, and latency

– Impact of other virtualized computers on the same host

• Stability – Abnormal resource utilization when compared to historical data

• Reliability – Changes in the configuration and availability of resources as well as overall uptime

• Capacity – Availability of sufficient resources to support predicted future utilization

• Efficiency – Excess resources not required to support current or future utilization

• Availability – Status of and changes to installed software and services


Complete Situational Awareness

• Organizations or Groups with Issues

• Performance Problems and Causes

• Unusual Changes in Behavior

• Overall Stability of the Environment

• Future Resource Requirements

• Resources Not Being Utilized

• Overall Hardware Inventory

• Hardware Additions, Deletions or Changes

• Overall Software Inventory

• Software Additions, Deletions or Changes

• Management Efficiency over Time


Self Explanatory System


• Easily navigable with a very intuitive design

• Basic guide to help user get started

• Simply select the desired view then select the desired organization, group or computer

Details Readily Available


• View Info provides additional details about each specific view

Simplified Computer Configuration

• Computers can be automatically discovered from a specified subnet or can be individually added

• Organization and group names are assigned during discovery or individual computer addition


Dashboards

• Summarize the current status for the entire environment, a specific organization, a specific group, or a specific computer

• Provide a top level overall status as well as the specific status for each of the analysis areas – performance, stability, reliability, capacity, efficiency and availability

• Highlight the overall management rating (0%-100%) as well as the management rating for each analysis areas

• Identify the current computer configuration(s), resource utilization, configuration changes, computer up time(s), and software/service changes

• Emphasize specific organizations/groups/computers that require attention in specific analysis areas

• Display the historic and predicted resource utilization as well as the historic changes that have occurred

Immediate Assessment of the Environment

with

Specific Action Recommendations


Dashboards - Overall Environment or Organization

• Summary statistics about the entire environment or a specific organization

• Groups with issues listed in order of severity

• Click on highlighted groups (if any) for further information


Dashboards - Overall Specific Group

• Summary statistics about the specified group

• Computers with issues listed in order of severity

• Click on highlighted computers (if any) for further information


Dashboards - Overall Specific Computer

• Overall statistics about the specified computer

• Specific issues identified


Dashboards - Performance

• Highlights organizations/groups or computers with specific performance issues

• Average metrics for all selected computers if no issues

• Historical metrics for the past 24 hours

• Click on highlighted issues (if any) for further information


Dashboards - Stability

• Highlights organizations/groups or computers with specific stability issues

• Historical metrics for the past 30 days



Dashboards - Reliability

• Highlights organizations/groups or computers with specific reliability issues

• Identifies specific restarts and configuration changes



Dashboards - Capacity

• Highlights organizations/groups or computers with specific capacity issues


• Predicted trends for the next 90 days (less if less than 90 days data collected)



Dashboards - Efficiency

• Highlights organizations/groups or computers with specific efficiency issues


• Predicted trends for the next 90 days (less if less than 90 days data collected)



Dashboards - Availability

• Highlights organizations/groups or computers with specific availability issues

• Identifies specific software or service changes



Computers - Configured

• Discover, add, modify, or delete the computers to be monitored

• Structure the computers into appropriate organizations and groups

• Check the current status of the computers


Computers - Subnets

• Automatically discover all of the computers in selected subnets

• Structure the computers into appropriate organizations and groups

• Update the configuration as computers are added or deleted


Configurations - Computers

• Shows the current hardware configuration of each computer

• Manufacturer, model and operating system

• Processor, memory and storage


Configurations - Storages

• Shows the current storage configuration for each computer

• Drive and name

• Total and available storage on each drive


Configurations - Networks

• Shows the current network configuration for each computer

• Connection and name

• Current status


Ratings

• An assessment of the effective utilization of the entire environment, organization/group or specific computer

• Overall rating as well as ratings for each analysis area - performance, stability, reliability, capacity, efficiency and availability

• The rating percentage (0 – 100) reflects the relative amount of weighted time each computer operated without any issues

• Overall analysis areas are weighted based on their relative impact on the computer

• Alerts are weighted based on their impact on the specific analysis area

• Condition alerts (excessive memory swapping …) are weighted for total time the condition exists

• Event alerts (software upgrade …) are weighted for a time of one minute

• Specific weightings of each analysis area and each issue are identified in the appropriate Ratings View Info


Ratings - Historical

• Shows the overall historical rating and well as the rating for each analysis area

• Any desired time period may be viewed

• Ratings are averaged when viewing the environment, an organization or a group


Alerts

• Preconfigured alerts for each of the analysis areas – performance, stability, reliability, capacity, efficiency and availability

• Two types of alerts – condition (excessive memory swapping …) and event (software upgrades …)

• Alerts are evaluated every minute

• Email notifications are sent (if email recipients have been set) whenever an alert is triggered or when a condition alert is cleared

• Alerts for the past 24 hours are displayed and a complete alert history maintained

• Alerts may be disabled (or re-enabled) for a specific computer, organization/group or the entire environment

• Specific contact lost instances of the reliability alerts may be excluded (or re-included if previously excluded) for a specific computer, organization/group or the entire environment

• Specific software or service instances of the availability alerts may be excluded (or re-included if previously excluded) for a specific computer, organization/group or the entire environment

• The specific conditions under which an alert will be generated (or cleared) are identified in the appropriate Alerts View Info


Performance Alerts

Virtualization Processor, Virtualization Memory, Processor Overload, Memory Overload and Excessive Latency

• Virtualization Processor - Generated whenever the minimum number of processes waiting meets or exceeds 4 and the processor utilization is less than 80% during the past 5 minute(s)

• Virtualization Memory - Generated whenever the unavailable memory meets or exceeds 10% and the sum of unavailable memory and memory utilization meets or exceeds 90% during the past 5 minute(s)

• Processor Overload - Generated whenever the average utilization meets or exceeds 94% and the peak utilization meets or exceeds 97% during the past 5 minute(s)

• Memory Overload - Generated whenever the average utilization meets or exceeds 92% and the peak utilization meets or exceeds 96%, and/or, the average swapping meets or exceeds 1% of total memory and the peak swapping meets or exceeds 2% of total memory, during the past 5 minute(s)

• Excessive Latency - Generated whenever the average latency meets or exceeds 30 milliseconds and the peak latency meets or exceeds 40 milliseconds during the past 5 minute(s)

• The alerts will clear when the performance condition no longer exists


Stability Alerts

Abnormal Processor Utilization, Abnormal Memory Utilization, Abnormal Storage Utilization and Abnormal Throughput Rate

• Stability alerts compare the past 4 hour(s) with the same period during the previous day, week and month

• Alert generated if resource utilization is significantly greater or less than the average utilization for all of the preceding periods

• Resource utilization must be a minimum of 20% and at least 20% greater or less than the preceding periods

• The alert will clear when the abnormal condition no longer exists

• At least 32 days of data collection is required in order to most accurately evaluate stability


Reliability Alerts

Computer Restarted, Processor Change, Memory Change, Storage Change and Network Change

• Computer Restarted - Generated whenever the computer or Cloud Control service restarts

• Contact Lost – Generated whenever a monitored computer stops responding

• Processor Change - Generated whenever the processor speed, number of cores or number of logical cores changes

• Memory Change - Generated whenever the physical memory size changes

• Storage Change - Generated whenever a storage is added, deleted or the storage allocation changes

• Network Change - Generated whenever an adapter is added, deleted or the adapter connection status changes


Capacity Alerts

Insufficient Processor Resources, Insufficient Memory Resources, Insufficient Storage Resources and Insufficient Storage Performance

• The historical trend data is used to predict the resource requirement for the next 90 days (if at least 90 days of historical data has been collected)

• The predicted resource requirement includes a safety buffer of approximately 20% for unexpected utilization growth

• Alert generated if capacity is not sufficient for predicted requirement

• The alert will clear when historical trending indicates that the resources are sufficient

• At least 32 days of data collection is required in order to most accurately evaluate capacity


Efficiency Alerts

Excessive Processor, Excessive Memory and Excessive Storage

• The historical trend data is used to predict the resource requirement for the next 90 days (if at least 90 days of historical data has been collected)

• The predicted resource requirement includes a safety buffer of approximately 20% for unexpected utilization growth

• Alert generated if capacity is greater than the predicted requirement

• The alert will clear when historical trending indicates that the resources are not excessive

• At least 32 days of data collection is required in order to most accurately evaluate efficiency


Availability Alerts

Software Installed, Software Modified, Software Removed, Service Installed, Service Modified, Service Removed and Service Not Running

• A software alert is generated whenever a software application is installed, modified or removed

• A service alert is generated whenever a software service is installed, modified, removed or stops running

• Specific software applications or services may be excluded from the alerts


Alert Email Notifications

• Sent whenever a conditional or event alert is triggered or when a conditional alert is cleared


Alerts - Active

• All currently active alerts

• Availability alerts may have specific instances excluded


Alerts - Recent

• All condition and event alerts for the past 24 hours

• Availability alerts may have specific instances excluded


Alerts - Configured

• Alerts may be disabled (or enabled if previously disabled) for a specific computer, organization/group or the entire environment

• Email recipients for each alert may be set (or modified) for a specific computer, organization/group or the entire environment


Alerts - Excluded Instances

• Specific software or service instances of the availability alerts may be excluded (or re-included if previously excluded) for a specific computer, organization/group or the entire environment


Retained Metrics

• 28 overall system metrics, 7 disk metrics for each disk drive, and 9 network adapter metrics for each network adapter are captured each minute

• Trend information is calculated for 12 system metrics, 3 disk drive metrics and 4 network adapter metrics

• 6 metrics are captured each minute for each running process

• Metrics for each minute are retained for 7 days

• Minute metrics are appropriately combined into hourly metrics

• Metrics for each hour are retained for 90 days

• Hourly metrics are appropriately combined into daily metrics

• Daily metrics are retained forever


Processor Metrics

• Allocation – Total number of processor cycles per second (cores x speed)

• Utilization – Percent utilization of the total processor cycles

• Peak Utilization – Maximum processor utilization percent (for one minute)

• Utilization Trend – Processor utilization percent expected based on the previous history

• Processes Waiting – Number of processes waiting to run

• Peak Processes Waiting – Maximum number of waiting processes (for one minute)

• Processes Waiting Trend – Number of waiting processes expected based on previous history

• Process Utilization – Percent processor utilization for each running process


Processor - Utilization

• Shows the overall historical processor utilization percent and trend



Processor - Waiting Processes

• Shows the overall historical number of processes waiting and trend



Processor Top Consumers

• Shows the overall historical utilization percent by the processes when running

• Top five processes shown individually, all others combined



Memory Metrics

• Allocation – Amount of memory available to the operating system

• Utilization – Percent utilization of the total physical memory

• Peak Utilization – Maximum memory utilization percent (for one minute)

• Utilization Trend – Memory utilization percent expected based on the previous history

• Swapping – Rate at which memory is being swapped in and out

• Peak Swapping – Maximum swapping rate (for one minute)

• Swapping Trend – Swapping rate expected based on the previous history

• Unavailable Memory – Percent of physical memory reserved for use by drivers, …

• Peak Unavailable – Maximum percent of memory reserved (for one minute)

• Unavailable Trend – Unavailable memory percent expected based on previous history

• Process Utilization – Percent memory utilization for each running process


Memory - Utilization

• Shows the overall historical memory utilization percent and trend



Memory - Swapping

• Shows the overall historical memory swapping rate and trend



Memory - Unavailable

• Shows the overall historical unavailable memory percent and trend

• Unavailable memory is used by drivers, hypervisors …



Memory Top Consumers

• Shows the overall historical utilization percent by the processes when running




Storage Metrics – Overall

• Allocation – Overall total storage available from all drives

• Utilization – Percent utilization of the total storage

• Peak Utilization – Maximum storage utilization percent (for one minute)

• Utilization Trend – Storage utilization percent expected based on the previous history

• Throughput – Rate at which storage is being written or read

• Peak Throughput – Maximum throughput rate (for one minute)

• Throughput Trend – Throughput rate expected based on the previous history

• Latency – Average time required to process the storage read and write requests

• Peak Latency – Maximum average latency time (for one minute)

• Latency Trend – Average latency time expected based on previous history

• Process Throughput – Overall I/O throughput rate for each running process


Storage Metrics – Each Drive

• Allocation – Overall total storage available on the drive

• Utilization – Percent utilization of the total drive

• Peak Utilization – Maximum drive utilization percent (for one minute)

• Utilization Trend – Drive utilization percent expected based on the previous history

• Throughput – Rate at which the drive is being written or read

• Peak Throughput – Maximum throughput rate (for one minute)

• Throughput Trend – Throughput rate expected based on the previous history

• Latency – Average time required to process the drive read and write requests

• Peak Latency – Maximum average latency time (for one minute)

• Latency Trend – Average latency time expected based on previous history


Storage - Utilization

• Shows the overall historical storage/drive utilization percent and trend



Storage - Throughput

• Shows the overall historical storage/drive throughput rate and trend



Storage - Latency

• Shows the overall historical storage/drive average latency time and trend



Storage - Top Consumers

• Shows the overall historical I/O throughput rate for running processes




Network Metrics – Overall

• Bandwidth – Overall network bandwidth for all adapters

• Received – Overall network receive rate for all adapters

• Peak Received – Maximum network receive rate (for one minute)

• Received Trend – Network receive rate expected based on the previous history

• Transmitted – Overall network transmit rate for all adapters

• Peak Transmitted – Maximum network transmit rate (for one minute)

• Transmitted Trend – Network transmit rate expected based on the previous history

• Discards – Overall network discards count for all adapters

• Peak Discards – Maximum network discards count (for one minute)

• Discards Trend – Network discards count expected based on the previous history

• Errors – Overall network errors count for all adapters

• Peak Errors – Maximum network errors count (for one minute)

• Errors Trend – Network errors count expected based on the previous history


Network Metrics – Each Adapter

• Bandwidth – Current network bandwidth for this adapter

• Received – Overall network receive rate for this adapter

• Peak Received – Maximum network receive rate (for one minute)

• Received Trend – Network receive rate expected based on the previous history

• Transmitted – Overall network transmit rate for this adapter

• Peak Transmitted – Maximum network transmit rate (for one minute)

• Transmitted Trend – Network transmit rate expected based on the previous history

• Discards – Overall network discards count for this adapter

• Peak Discards – Maximum network discards count (for one minute)

• Discards Trend – Network discards count expected based on the previous history

• Errors – Overall network errors count for this adapter

• Peak Errors – Maximum network errors count (for one minute)

• Errors Trend – Network errors count expected based on the previous history


Network - Received

• Shows the overall historical received rate and trend



Network - Transmitted

• Shows the overall historical transmitted rate and trend



Software - Applications

• Shows all installed (or previously installed) software

• Includes last update date and removal date (if previously removed)

• Aids compliance validation and tracking


Software - Services

• Shows all installed services

• Includes start up mode and current state


Processes - Processor

• Shows the overall historical process processor utilization percent (while running)

• Processes are ordered based on the amount of processor consumed

• Any desired process may be selected



Processes - Memory

• Shows the overall historical process memory utilization percent (while running)

• Processes are ordered based on the amount of memory consumed




Processes - I/O

• Shows the overall historical process I/O rate (while running)

• Processes are ordered based on the amount of I/O consumed




Inventory - Computers

• Shows the total number of each computer type


Inventory - Operating Systems

• Shows the total number of each operating system type


Inventory - Applications

• Shows the total number of each application type


Common Capabilities

• All views can be printed or emailed in PDF format

• All views except for the dashboards can be printed or emailed in CSV format

• The following general settings are available

– Default language

– Paper size for printing

– Default recipients for alerts and scheduled emails

– User interface access theme (blue, gray, slate or access)

– Row count for table views

• Active Directory can be used for administrator and user access control

• Local users (non Active Directory) can be added, edited or deleted by an administrator

• Local users without administrator privileges can change their own passwords

• The overview presentation is can be downloaded at any time from the Cloud Control application

• Details of the current version and the current license can be viewed

• Improvement suggestions and problem reports can be automatically sent

• Computer logs for a specific computer and overall environment errors can be downloaded


Reports - Scheduled

• Shows the reports scheduled to be run

• Scheduled reports are emailed to the specified recipients

• Both CSV and PDF reports may be scheduled


Rest API Access

• getDatabaseTables – Returns all database table names, column names and data types

• executeDatabaseQuery – Reads specific tables and returns desired rows/columns

• executeDatabaseCommand – Executes database commands insert, update, delete, …

• Traditional SQL queries and commands


Internationalization

• All text automatically converted using Google Translate

• Translations can be ‘fine tuned’ to ensure proper nuance

• Contact [email protected] for a specific language version of the software


mailto:[email protected]?Subject=Internationalization

Future Capabilities

Near Term – Upgrade to the current release level (1.1) • Windows taskbar application

– Monitor specified organizations, groups or computers – Indicate when there are issues that require attention – Launch the Cloud Control application to display the details of the issue

Medium Term – Next release level (2.0) • Application response time monitoring and alerting

– Measure time from request to response for each registered TCP/IP application – Regularly record response times for each application – Alert on significant changes in response time – Display historical response times for each application

• Automatic Remediation of Problems and Issues – Customer supplied script (batch or shell) executed upon detection of alert – Computer address, alert category, alert type and error values provided as parameters to script – Script can be run on problem computer or separate management computer – Script execution can be configured for one, many or all computers

Longer Term • General use improvements suggested by customers • Other major features important to computer management


Getting Started

1. Download the Cloud Control Application from CldCtl.Com – CloudControlWindows.exe if installing on a Windows computer

– CloudControlUnix.bsx if installing on a Unix computer

2. Run the Application Installation File – Automatically extracts, installs and initializes

3. Go to ‘ServerIP:4040’ in your browser and Log In – Default Credentials are ‘cldctl cldctl’

4. Go to the Computers Tab and Add Additional Computers to be Managed – Discover all computers in a subnet or add individual computers

Takes Less Than 5 Minutes


http://www.cldctl.com/

Documents

Cloud Control Overview - Amazon S3Control+Ov… · Cloud Control Everything you Need or Want to Know about All of your Servers and Workstations 5/16/2019 Ken Latimer - Proprietary