Upload
doankhanh
View
220
Download
0
Embed Size (px)
Citation preview
VMware Vrealize operations ManageMent pack For
PostgreSQL
User Guide
2 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it.
You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.
The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].
1. Purpose...................................................................................................................................................................... 32. Introduction to the Management Pack....................................................................................... 3
2.1 How the Management Pack Collects Data............................................................. 32.2 Data the Management Pack Collects........................................................................... 32.3 Inventory Tree (Traversal Spec)........................................................................................... 3
3. Dashboards............................................................................................................................................................ 43.1 PostgreSQL Overview.................................................................................................................. 43.2 PostgreSQL on OS.......................................................................................................................... 53.3 PostgreSQL on VM......................................................................................................................... 63.4 PostgreSQL IOPS............................................................................................................................. 73.5 PostgreSQL Top-N Queries.................................................................................................... 8
4. Views............................................................................................................................................................................. 95. Reports....................................................................................................................................................................106. Alerts..........................................................................................................................................................................117. Troubleshooting the Management Pack................................................................................12
7.1 Troubleshooting an Adapter Instance.......................................................................127.2 Testing Connection Failures................................................................................................127.3 Viewing System Log Files.....................................................................................................13
8. Appendix I: Metrics.....................................................................................................................................149. Appendix II: Alerts........................................................................................................................................20
taBle oF contents
3 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
1. purposeThe Blue Medora VMware vRealize Operations (vROps) Management Pack for PostgreSQL User Guide describes the primary features of the Management Pack for PostgreSQL, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of PostgreSQL resources from within vRealize Operations.
2. introduction to the Management packThe Management Pack for PostgreSQL is an embedded adapter for vRealize Operations (vROps) that monitors PostgreSQL database systems remotely by creating a JBDC connection to retrieve performance data regarding PostgreSQL resources.
This section includes the following topics:
• How the Management Pack Collects Data• Data the Management Pack Collects
2.1 How the Management Pack Collects Data
During each data collection cycle, the Management Pack opens a JDBC connection to the specified PostgreSQL database instance and queries it to retrieve resource metrics.
The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes.
2.2 Data the Management Pack Collects
The Management Pack can collect performance data, relationships (associations), and events for the following PostgreSQL resources:
1. PostgreSQL Adapter Instance 2. PostgreSQL Instance 3. PostgreSQL Database 4. PostgreSQL Table • Indexes (if disabled, index and trigger instance metric groups will not be returned)
5. PostgreSQL Function (requires ‘pg_stat_user_functions’ to be enabled)
6. PostgreSQL Query (requires ‘pg_stat_statments’ to be enabled)
2.3 Inventory Tree (Traversal Spec)
The Inventory Tree (Traversal Spec) feature within vROps allows you to easily navigate your PostgreSQL environment. The hierarchical structure implicitly shows relationships among resource kinds and enables quick drill-downs to root-cause issues.
Figure 1: PostgreSQL Architecture
Figure 2: Example Traversal Spec
4 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
3. DashboardsDashboards are the primary user interface that allow users to monitor PostgreSQL resources from within vRealize Operations.
The following dashboards are available in the Management Pack:
• PostgreSQL Overview• PostgreSQL on OS• PostgreSQL on VM• PostgreSQL IOPS• PostgreSQL Top-N Queries
3.1 PostgreSQL Overview
The PostgreSQL Overview dashboard displays heat maps depicting the overall health of PostgreSQL databases. Figure 3: PostgreSQL Overview Dashboard
5 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
3.2 PostgreSQL on OS
The PostgreSQL on OS dashboard allows you to select a PostgreSQL database and related operating system in order to view key performance metrics (KPIs) for each. Figure 4: PostgreSQL on OS Dashboard
6 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
3.3 PostgreSQL on VM
The PostgreSQL on VM dashboard allows the user to select a PostgreSQL database and related virtual machine to view key performance indicators (KPIs) for each.
Figure 5: PostgreSQL on VM Dashboard
7 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
3.4 PostgreSQL IOPS
The IOPS dashboard allows the user to select a PostgreSQL database to view IO stats for the related database, virtual machine, and datastore.
Figure 6: PostgreSQL IOPS Dashboard
8 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
3.5 PostgreSQL Top-N Queries
The Top-N Queries dashboard allows the user to select a PostgreSQL database to view a ranking of the Top 10 slowest queries. The dashboard also allows you to select individual queries from the heat map to view performance metrics for the selected query.
Figure 7: PostgreSQL Top-N Queries Dashboard
9 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
4. ViewsThe vROps Management Pack for PostgreSQL contains custom views, which allow the user to view statistics of metrics for PostgreSQL resources. Views provide a “big picture” look at resources, as opposed to a more in depth view.
Table 1: PostgreSQL Views
VIEw TyPE DESCrIPTION
PostgreSQL Database Overview List Provides a overview of database performance metrics.
PostgreSQL Instance Overview List Provides an overview of instance performance metrics.
PostgreSQL Slowest Queries List Provides a list of slowest queries metrics.
PostgreSQL Throughput List Provides a list of throughput metrics.
To access the Management Pack views, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below.
For the full list of views for the Management Pack, go to Home > Content > Views.
Figure 8: Accessing PostgreSQL Views
10 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
5. reportsThe vROps Management Pack for PostgreSQL contains the following custom reports. The reports can be exported and easily shared with key stakeholders in either .pdf or .csv formats.
Table 2: PostgreSQL Reports
rEPOrT DESCrIPTION
PostgreSQL Databases Report Corresponds to the view of the same name in section 4, Views.
PostgreSQL Instance Report Corresponds to the view of the same name in section 4, Views.
PostgreSQL Slowest Queries Report Corresponds to the view of the same name in section 4, Views.
PostgreSQL Throughput Report Corresponds to the view of the same name in section 4, Views.
To access the Management Packs reports, go to Environment > PostgreSQL and click the desired Object (resource kind). Select the Reports tab, then Report Templates.
To run the selected report, click the Run Template icon ( ).
Figure 9: Accessing PostgreSQL Reports
11 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
6. alertsThe vROps Management Pack for PostgreSQL pulls PostgreSQL database health indicators and displays them in vRealize Operations as alerts. The critical levels of each alert are closely mapped from PostgreSQL to vROps.
Refer to Appendix II for the full list of alerts, symptoms, and recommendations provided by this Management Pack.
Figure 10: Alert Example
12 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
7. troubleshooting the Management packKnown troubleshooting information can help you diagnose and correct common problems with the Management Pack for PostgreSQL.
This section includes the following topics:
• Troubleshooting an Adapter Instance• Testing Connection Failures• Viewing System Log Files
7.1 Troubleshooting an Adapter Instance
Perform these general troubleshooting steps to diagnose and correct problems with an adapter instance:
• Edit the adapter instance and click Test Connection to verify the connection to vROps. Refer to section 7.2, Testing Connection Failures.
• View the collection status and collection state for the adapter instance resource on the Environment Overview page in vROps.
• Check the adapter and collector logs for errors. Refer to section 7.3, Viewing System Log Files, for details.
7.2 Testing Connection Failures
When clicking Test Connection in the Manage Solution window when adding an adapter instance, the following connection errors are possible.
7.2.1 wrong Credentials
Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Reason: User ID or Password invalid.
Action: Ensure the correct PostgreSQL and vRealize Operations User Name and Password was entered when adding your adapter instance.
7.2.2 wrong Host
Error: Unable to establish a valid connection to target system. Required property is unknown host.
Action: Ensure the correct hostname or IP address of the PostgreSQL instance was entered when adding your adapter instance.
7.2.3 wrong Port
Error: Unable to establish a valid connection to target system. Connection authorization failure occurred. Error opening socket server <name> on port with message: Connection refused.
Action: Check your PostgreSQL database system and ensure the connection port number matches the port number entered (if other than default of 5432) when adding your adapter instance.
7.2.4 wrong Database
Error: Connection authorization failure occurred. The application server rejected establishment of the connection. An attempt was made to access a database, <name>, which was either not found or does not support transactions.
Action: Ensure the database name(s) provided match the PostgreSQL system. Multiple databases should be separated by commas in the Manage Solution window.
13 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
7.2.5 SSL Not Enabled
Error: SSL connection is not enabled.
Action: Under Advanced Settings, set SSL mode to be enabled (required).
7.2.6 Server Does Not Support SSL
Error: The server does not support SSL connections.
Action: Under Advanced Settings, set SSL mode setting to Disabled.
7.3 Viewing System Log Files
You can view PostgreSQL adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vROps user interface or in an external log viewer.
The adapter log files are in the $ALIVE_BASE/user/log/adapters/PostgreSQLAdapter/ folder. The collector log files are in the $ALIVE_BASE/user/log/ folder.
The logging level is set to ERROR by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG.
You can set the base log level for the collector via Administrator -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level.
NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time.
For complete information about viewing log files and modifying log levels, refer to the vROps online help.
14 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
8. appendix i: MetricsThe Management Pack for PostgreSQL collects the following metrics by PostgreSQL Resource Kinds.
Table 3: Management Pack Metrics
rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE
PostgreSQL Instance Tablespaces|General Tablespace Size double
PostgreSQL Instance Tablespaces|Configuration Tablespace Name string
PostgreSQL Instance Tablespaces|Configuration Tablespace Location string
PostgreSQL Instance Tablespaces|Configuration Tablespace Location string
PostgreSQL Instance Tablespaces|Configuration Tablespace Owner string
PostgreSQL Instance Tablespaces|Configuration Privileges string
PostgreSQL Instance Tablespaces|Configuration User Name string
PostgreSQL Instance Tablespaces|Configuration IP Address string
PostgreSQL Instance Tablespaces|Configuration Port integer
PostgreSQL Instance Tablespaces|Configuration Instance Name string
PostgreSQL Instance Buffers Buffers Allocated double
PostgreSQL Instance Buffers Times Backend Executed Own fsync
double
PostgreSQL Instance Buffers Times Background Writer Stopped Due to too Many Buffers
double
PostgreSQL Instance Buffers Buffers Written by Backend double
PostgreSQL Instance Buffers Buffers Written by Background Writer
double
PostgreSQL Instance Buffers Buffers Written During Checkpoint double
PostgreSQL Instance Configuration Name string
PostgreSQL Instance Configuration Server IP string
PostgreSQL Instance Configuration Server Port integer
PostgreSQL Instance Configuration Last Time Stats Reset string
PostgreSQL Instance Configuration Version string
PostgreSQL Instance Checkpoints Scheduled Checkpoints Performed double
PostgreSQL Instance Checkpoints Time Synchronizing Checkpoint Files to Disk
double
PostgreSQL Instance Checkpoints Requested Checkpoints Performed double
PostgreSQL Instance Checkpoints Time Writing Checkpoint Files to Disk
double
PostgreSQL Database Sessions Number of Active Connections integer
PostgreSQL Database Sessions Total Sessions integer
PostgreSQL Database Sessions Active Sessions integer
PostgreSQL Database Sessions Idle Sessions integer
PostgreSQL Database Sessions Idle Sessions in Transaction integer
PostgreSQL Database Sessions Idle Sessions in Transaction (Aborted)
integer
15 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE
PostgreSQL Database Sessions Sessions Executing Fastpath Function Call
integer
PostgreSQL Database Sessions Sessions with Unknown State (Track Activities is Disabled)
integer
PostgreSQL Database General Canceled Queries Due to Conflicts integer
PostgreSQL Database General Deadlock Count integer
PostgreSQL Database General Database Size integer
PostgreSQL Database General Last Timestamp Stats Reset string
PostgreSQL Database Activity Rows Deleted double
PostgreSQL Database Activity Rows Returned double
PostgreSQL Database Activity Rows Updated double
PostgreSQL Database Activity Rows Fetched double
PostgreSQL Database Activity Rows Inserted double
PostgreSQL Database Configuration Tablespace Name string
PostgreSQL Database Configuration Database Name string
PostgreSQL Database Configuration Database ID integer
PostgreSQL Database Configuration IP Address string
PostgreSQL Database Configuration Port integer
PostgreSQL Database Conflicts Queries Canceled Due to Deadlocks
double
PostgreSQL Database Conflicts Queries Canceled Due to Old Snapshot
double
PostgreSQL Database Conflicts Queries Canceled Due to Lock Timeouts
double
PostgreSQL Database Conflicts Queries Canceled Due to Dropped Tablespaces
double
PostgreSQL Database Conflicts Queries Canceled Due to Pinned Buffers
double
PostgreSQL Database Transactions Transaction Rollbacks double
PostgreSQL Database Transactions Transaction Commits double
PostgreSQL Database Disk IO Temporary Bytes Written double
PostgreSQL Database Disk IO Temporary Files Created double
PostgreSQL Database Disk IO Buffer Hit Ratios double
PostgreSQL Database Disk IO Block Reads/Buffer Misses double
PostgreSQL Database Disk IO Time Spent Writing Data double
PostgreSQL Database Disk IO Buffer Hits double
PostgreSQL Database Disk IO Time Spent Reading Data double
PostgreSQL Database Disk IO Blocks Read by Sequences integer
PostgreSQL Database Disk IO Blocks Hit by Sequences integer
PostgreSQL Table Triggers|Configuration Trigger Enabled Status string
PostgreSQL Table Triggers|Configuration Trigger ID double
PostgreSQL Table Triggers|Configuration Trigger Name string
16 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE
PostgreSQL Table Triggers|Configuration Type of Trigger Fire integer
PostgreSQL Table Triggers|Configuration Arguments Passed to Trigger string
PostgreSQL Table Triggers|Configuration Table ID integer
PostgreSQL Table Triggers|Configuration Table Name string
PostgreSQL Table Triggers|Configuration Function Name string
PostgreSQL Table Triggers|Configuration Function ID integer
PostgreSQL Table Triggers|Configuration IP Address string
PostgreSQL Table Triggers|Configuration Port integer
PostgreSQL Table Indexes|Activity Number of Block Reads integer
PostgreSQL Table Indexes|Activity Number of Table Rows Fetched by Scan
integer
PostgreSQL Table Indexes|Activity Number of Buffer Hits integer
PostgreSQL Table Indexes|Activity Number of Index Entries Returned integer
PostgreSQL Table Indexes|Activity Number of Scans integer
PostgreSQL Table Indexes|Configuration Index ID string
PostgreSQL Table Indexes|Configuration Index Name string
PostgreSQL Table Indexes|Configuration Table Name string
PostgreSQL Table Indexes|Configuration Schema Name string
PostgreSQL Table Indexes|Configuration Table ID integer
PostgreSQL Table Indexes|Configuration IP Address string
PostgreSQL Table Indexes|Configuration Port integer
PostgreSQL Table General Table Size integer
PostgreSQL Table Activity Number of Rows Updated double
PostgreSQL Table Activity Number of Sequential Scans double
PostgreSQL Table Activity Last Time Table Analyzed by Auto Daemon
string
PostgreSQL Table Activity Number of Dead Rows double
PostgreSQL Table Activity Last Time Table Vacuumed by Auto Daemon
string
PostgreSQL Table Activity Number of Rows Deleted double
PostgreSQL Table Activity Last Time Table Manually Analyzed string
PostgreSQL Table Activity Number of Index Scans double
PostgreSQL Table Activity Number of Rows Inserted double
PostgreSQL Table Activity Number of Times Table Manually Vacuumed
double
PostgreSQL Table Activity Number of Times Table Vacuumed By Auto Daemon
double
PostgreSQL Table Activity Last Time Table Manually Vacuumed
string
PostgreSQL Table Activity Number of Rows Fetched by Index Scans
double
PostgreSQL Table Activity Number of Times Table Manually Analyzed
double
17 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE
PostgreSQL Table Activity Number of Rows Modified Since Last Analyzed
integer
PostgreSQL Table Activity Number of Times Table Analyzed by Auto Daemon
double
PostgreSQL Table Activity Rows fetched by Sequential Scans double
PostgreSQL Table Activity Number of Live Rows double
PostgreSQL Table Activity Number of Rows Hot Updated (No separate index update requried)
double
PostgreSQL Table Configuration Table ID integer
PostgreSQL Table Configuration Tablespace Name string
PostgreSQL Table Configuration Database Name string
PostgreSQL Table Configuration Table Name string
PostgreSQL Table Configuration Table Schema string
PostgreSQL Table Configuration IP Address string
PostgreSQL Table Configuration Port integer
PostgreSQL Table Disk IO Number of Block Reads from Indexes
double
PostgreSQL Table Disk IO Number of Block Reads double
PostgreSQL Table Disk IO Number of Buffer Reads double
PostgreSQL Table Disk IO Number of Block Reads from TOAST Table Indexes
double
PostgreSQL Table Disk IO Number of Buffer Hits from TOAST Table
double
PostgreSQL Table Disk IO Number of Buffer Hits from Indexes double
PostgreSQL Table Disk IO Number of Buffer Hits from TOAST Table Indexes
double
PostgreSQL Table Disk IO Number of Block Reads from TOAST Table
double
PostgreSQL Function Activity Total Time Spent Calling This and All Called Functions
double
PostgreSQL Function Activity Average Total Call Time double
PostgreSQL Function Activity Times Called double
PostgreSQL Function Activity Time Spent on This Function Alone (not referenced functions)
double
PostgreSQL Function Configuration Schema Name string
PostgreSQL Function Configuration Function Name string
PostgreSQL Function Configuration Function ID integer
PostgreSQL Function Configuration IP Address string
PostgreSQL Function Configuration Port integer
PostgreSQL Function Configuration Database Name string
PostgreSQL Function Configuration Rank integer
PostgreSQL Query Activity Query Text string
PostgreSQL Query Activity Total Time double
18 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
rESOUrCE KIND rESOUrCE GrOUP rESOUrCE ATTrIBUTE ATTrIBUTE TyPE
PostgreSQL Query Activity Average Time Spent Per Call double
PostgreSQL Query Activity Number of Calls double
PostgreSQL Query Activity Rows Returned integer
PostgreSQL Query Configuration User Name string
PostgreSQL Query Configuration Database Name string
PostgreSQL Query Configuration IP Address string
PostgreSQL Query Configuration Port integer
PostgreSQL Query Configuration Rank integer
PostgreSQL Query Disk IO Local Block Cache Hits integer
PostgreSQL Query Disk IO Shared Block Reads integer
PostgreSQL Query Disk IO Shared Blocks Written integer
PostgreSQL Query Disk IO Total Time Spent Writing Blocks integer
PostgreSQL Query Disk IO Shared Blocks Dirty Read integer
PostgreSQL Query Disk IO Local Block Reads integer
PostgreSQL Query Disk IO Shared Block Cache Hits integer
PostgreSQL Query Disk IO Local Blocks Dirty Read integer
PostgreSQL Query Disk IO Total Time Spent Reading Blocks integer
PostgreSQL Query Disk IO Local Blocks Written integer
19 Blue Medora VMware vRealize Operations Management Pack for PostgreSQL User Guide
9. appendix ii: alertsThe vROps Management Pack for PostgreSQL creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert.
Table 4: Management Pack Alerts
NAME DESCrIPTION rECOMMENDATION
Max Written Clean (Per Second) is Higher than Normal
The number of times the background writer has overwritten the maximum number of buffers (when a checkpoint is performed) is much higher than normal.
Consider increasing the value of “bgwriter_lru_maxpages” in postgresql.conf to increase performance.
Tablespace Size is Higher than Normal
The size of your Database is much higher than normal
Consider running a VACUUM to recover disk space.
Database Size is Higher than Normal The size of your Database is much higher than normal
Consider running a VACUUM to recover disk space.
Table Size is Higher than Normal The size of your Table is much higher than normal
Consider running a VACUUM to recover disk space.
Temp Files Created is Higher than Normal
The number of temporary files created is higher than normal. This can cause slower performance and I/O contention.
Consider increasing the “work_mem” in the postgresql.conf file.
Dead Rows is Higher than Normal The dead rows for this table are higher than normal.
To clear the dead rows, consider running “VACUUM FULL” or “CLUSTER” during a maintenance window.
Queries Cancelled are Higher than Normal
The number of queries that are being cancelled is higher than normal.
Consider enabling “hot_standby_feedback” in the postgresql.conf file to avoid cancelled queries. warning: This could create bloat in the primary database.
Copyright © 2015 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions.
The PostgreSQL name and logo are trademarks or registered trademarks of The PostgreSQL Global Development Group in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.
Blue Medora
3225 N Evergreen Dr. NE Suite 103
Grand Rapids, MI 49525
www.bluemedora.com
You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.
The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].