ITSM VendorEvaluationKit Checklist

  • Upload
    krijal

  • View
    22

  • Download
    0

Embed Size (px)

DESCRIPTION

ITSM VendorEvaluationKit Checklist

Citation preview

uptime

1GeneralDetailsup.timeVendor 2Notes1.1Multiplatform supportDoes it support Windows, Linux, Solaris, AIX, HP/UX, Novell, etc.?1.2Virtualization SupportWhat Virtualization stacks does the software monitor?

1.3Database SupportWhat production databases does the software monitor?

1.4API SupportDoes the product support an open API (RESTful)?1.5DashboardsDoes up.time have flexible and customizable dashboards?1.6SearchDoes the tool have integrated search capabilities?1.7Data ArchivingIntegrated data archival and purge1.8Scalability - # of ServersCan it scale easily to cover 1,000s of servers, applications, and services?1.9Scalability Multi-Data Center SupportWill it support monitoring across multiple data centers? Can it provide consolidated views through one dashboard?1.1Open AccessDoes it support ODBC, JDBC, and Pluggable Components1.11Depth of StatisticsAt what level does the product gather statistics (i.e. app, server, system, resource and platforms levels)? Does the depth match requirements?1.12Agents and PerformanceHow lightweight are the agents? Will they impact server performance?1.13Agentless monitoringWhat agentless monitoring options exist?

1.14Cross Platform MonitoringDo the agents normalize statistics across all hardware platforms for apple to apple comparison across systems?1.15Self HealingCan it perform automated and proactive actions to help cut down on incidents before they happen?1.16Client AccessCan the tool be accessed from a browser? Are there separate clients for reporting, normal UI access, and/or administration?1.17Other2Ease of UseDetailsup.timeVendor 2Notes2.1Install TimeHow difficult is the product to get installed? Does it require training or other assistance?2.2Configuration TimeHow difficult is the product to configure. Are the agents difficult to configure?2.3Auto DiscoveryDoes the product have auto discovery?2.4User InterfaceHow intuitive is the User Interface? Is key functionality easy to find and use?2.5User ManagementCan you have multiple users with arbitrary role definitions? Can the dashboards be role-based?2.6Group ManagementDoes it have the ability to define groups, or groups of groups2.7Role ManagementCan it assign roles to users?2.8Access ControlCan it control access levels based on functionality at the group and user level?2.9ExtensibilityCan custom components and scripts be created?2.101Ease of ExtensionHow difficult is it to extend the functionality?2.11Other3Pricing and LicensingDetailsup.timeVendor 2Notes3.1Pricing for physical serversWhat is the pricing structure? Is it cost effective? Is it per element? 3.2Pricing for virtualized serversHow are virtualized servers priced and what is the cost for each?3.3Pricing for network devicesWhat is the pricing structure? Is it per socket or per device? Is it cost effective?3.4Admin consolesWhat is the cost for an admin console and how many are required?3.5Add-OnsIs there any additional charge for monitoring WebSphere, Exchange, Oracle, etc. and what are the costs?3.6Management PacksWhat are the requirements for additional management packs and the cost for each?3.7Implementation CostsDoes the product require professional services to implement? What is the typical add-on cost as a % of licenses? 3.8Training CostsWhat is the cost for the required training?3.9Other4Server Monitoringup.time4.1Server DashboardWhen users call with problems, can the product instantly show, on a dashboard, what is affecting the servers?4.2Resource trending and analysisCan the product show trends in utilization across all resources over time?4.3Server Workload AnalysisCan the product clearly show the server workloads and the trends over time?4.4Root Cause AnalysisWhat tools, statistics, metrics, etc., does the product provide to help you determine the root cause of a failure. Is it deep enough to meet your needs?4.5Multiplatform MonitoringWhat server platforms does the product provide detailed monitoring on?Server Virtualization Analysis and RecommendationsDoes the product have the capability to automatically identify the best server candidates for virtualization ? 4.6Capacity Data Collection Does the product collect capacity and resource utilization data across a multiple platforms? 4.7Detailed Capacity ReportingDoes the product provide enterprise CPU utilization reporting?4.8User-level access monitoringCan the product monitor activity at a user level?4.9Other5Network MonitoringDetailsup.timeVendor 2Notes5.1Resource trending and analysis?Can the product show trends in network utilization across all devices over time?5.2Network Device Workload AnalyticsCan the product clearly show network device bottlenecks and workload trends over time? 5.3Support for thousands of devicesCan the product add your full array of network devices across different vendors?5.4Customizable SNMP metricsCan the product collect, graph, and alert on any SNMP value?5.5Customizable MIB libraryCan the product upload vendor or device MIBs to add support for custom devices and metrics?5.6Netflow Traffic AnalyticsCan the product perform deep dive NetFlow and Jflow traffic analysis? 5.7Network DashboardWhen users call with problems, can the product instantly show, on a dashboard, what is affecting the network?5.8Automation and AlertingCan the product trigger automation or alerts based on the state of the network devices, network ports or custom SNMP values?6Application MonitoringDetailsup.timeVendor 2Notes6.1Application Event CorrelationCan the product correlate individual data points back to application status?6.2Application Impact VisibilityCan the product distinguish between performance-impacting or availability-impacting events as they relate to users? 6.3Application DashboardWhen users call with problems, can the product instantly show, on a dashboard, what is affecting the user applications?6.4Automation and AlertingCan the product trigger automation or alerts based on the state of the application as an aggregate as opposed to the state of individual statistics?7SLA Monitoring and ReportingDetailsup.timeVendor 2Notes7.1Service Level ObjectivesCan you define service level objectives to track and graph desired vs. actual performance of SLOs?7.2SLA ConfigurationHow difficult is it to configure and set up SLAs? Does it take minutes or days?7.3SLA Visibility DashboardDoes the product provide visibility of real-time SLA performance over a given compliance period?7.4uptime ReportingCan the product show uptime reports for services, devices, services and applications?7.5Automation and AlertingCan the product trigger auto-fixes or alerts based on current SLA performance or get proactive warnings when an SLA is trending to miss a target?7.6Other8ReportingDetailsup.timeVendor 2Notes8.1Ad-Hoc ReportsHow easily can custom reports be generated? Does it take seconds or hours?8.2Capacity ReportingDoes the product provide deep capacity reporting across platforms (virtual, physical, and cloud), all from one interface?8.3Proactive "Hot Spot" ReportingDoes the product produce reports that can show the hot spots in an IT environment, across services, devices, applications and services?8.4Scheduled ReportsCan reports be saved and scheduled for delivery? 8.5Easy Reports PublishingDoes the solution have a publishing mechanism? How difficult is it to publish reports?8.6Output FormatsWhat report output formats are supported (i.e. XML, HTML, PDF, Email, etc.)?8.7Customizable ReportsDoes the toolset offer easy customization of reports with parameters for date, infrastructure and any other relevant field in the report?8.8Other9CustomizationDetailsup.timeVendor 2Notes9.1Easy to adoptIs the customization framework easy to understand and implement?9..2DashboardsCan dashboards be customized? 9.3Data consistencyDoes the system allow you to use custom data with all standard functions?9.4Reusable customizationsCan customizations be re-used ?9.4Flexibility and choiceDoes your tool allow for execution of any kind of script or executable?9.5Other10Proactive IT ManagementDetailsup.timeVendor 2Notes10.1Fine grained visibilityDoes the system distinguish between availability outages and performance impacting events? 10.2Alerts/NotificationDoes the tool support alerts or notification of failures, problem conditions, and proactively alert on potential problems that havent even occurred yet? 10.3Automatically adding and removing resourcesCan the tool automatically add or remove resources to avoid issues?10.4Dynamic reconfiguring or restarting resourcesCan the tool interact with system level utilities to dynamically reconfigure or restart resources to avoid failure?10.5Problem Infrastructure IdentificationDoes the tool provide ways to identify problem infrastructure and/or applications? Can it tell you where to prioritize time with regards to fixing server and applications issues?10.6Trending over timeDoes the tool give administrators a clear view of how resources are being utilized over time to identify potential upcoming problems?10.7Proactive IT Management Success ReportsDoes the tool have reports that can show ITs success rate of solving incidents over time?10.8Other11Virtualized Server MonitoringDetailsup.timeVendor 2Notes11.1Auto-Discovery of Entire Virtual EnvironmentCan the tool auto-discover 1,000s of VMs, ESX hosts, clusters, resource pools, and vCenters in seconds and automatically update your dashboards? 11.2Auto-detection of New VMsCan the tool auto-detect new VMs and put them in the dashboard. Can it alert you if they might be rogue or over-allocated VMs?11.3Auto-Monitoring and AlertingCan the tool automatically apply monitoring and alerting any new VMs spun up in your environment and ensure you have zero virtual environment blind spots?11.4Deep Virtualization MetricsDoes the solution allow you to gain deep insight into hypervisor health, storage I/O bottlenecks, and instance contention?11.5Sprawl PreventionDoes the solution have the metrics, alerts and reports to proactively and reactively find and stop sprawl.11.6VMware Power Awareness IntelligenceCan the tool understand all the normal power state changes in VMware and only alert on the real problems?11.7Miss-configuration DetectionDoes the tool automatically check things like resource provision and license validation to make sure the new VM meets Corp standards? Can the tool automatically re-provision resources to preset standards when VMs are spun up to ensure resources arent wasted?11.8Instance Motion VisibilityDoes the tool aggregate metrics while keeping an eye to the fact that virtual instances can move from physical frame to physical frame?11.9Appropriate Data CollectionDoes the tool collect statistics via APIs to the virtual infrastructure or does it scrape consoles or rely on agent level metrics collected from inside of the virtual instances?11.1Virtual Platform Event DetectionCan the tool detect when changes to the virtualization platform and instance configuration change?11.11Other12Heterogeneous Environment MonitoringDetailsup.timeVendor 2Notes12.1DashboardDoes the solution allow you to view servers, services and applications that span the physical, virtual and cloud domain from a single dashboard? Are the dashboards customizable?12.2AutomationCan the tool trigger actions in the context of the physical and virtual resources that allow you to dynamically re-configure the data center if/when needed?12.3Other13Vendor SupportDetailsup.timeVendor 2Notes13.1Company stabilityHow long has the vendor been in business? Are they profitable? How reliant are they on external funding?13.2Install baseHow many companies have deployed the software? Does the company have references for environments similar to yours?13.3UpdatesDoes the company release regular updates? Does the product have an upgrade path?13.4SupportWhat does the support contract cover (i.e. does it include customizations or upgrades)? 13.5Other