27
© 2016 EDB. All rights reserved. 1 How to get a good night’s sleep: Managing your EDB Postgres Workload To listen to the recording presentation please visit EnterpriseDB.com > Resources> Webcast recordings. If you have questions please contact [email protected]

Managing Your EDB Postgres Workload

Embed Size (px)

Citation preview

Page 1: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 1

How to get a good night’s sleep: Managing your EDB Postgres Workload

To listen to the recording presentation please visit EnterpriseDB.com > Resources> Webcast recordings.

If you have questions please contact [email protected]

Page 2: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 2

•  Introduction to EnterpriseDB •  The EDB Postgres Platform •  Protecting your data

•  High availability and failover •  Managing your environment •  Summary

Agenda

Page 3: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 3

POSTGRES innovation

ENTERPRISE reliability

24/7 support

Services & training

Enterprise-class features, tools &

compatibility

Indemnification

Product road-map

Control

Thousands of developers

Fast development

cycles

Low cost

No vendor lock-in

Advanced features

Enabling commercial adoption of Postgres

Page 4: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 4

EDB Postgres Platform

Page 5: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 5

EDB Postgres Tool Suites Management, Integration, Migration

EDB Postgres Replication Server Single/multi-master solutions for performance, read-scalability, and write availability.

EDB Postgres Enterprise Manager Monitoring, managing and tuning large scale Postgres installations.

EDB Postgres Failover Manager Failover database clusters for high availability.

EDB Postgres Backup and Recovery Centralized backup and recovery for large Postgres installations including point-in-time recovery.

EDB Postgres Migration Toolkit Migration of data and objects out of Oracle, MS-SQL, MySQL to Postgres.

Page 6: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 6

•  EDB Postgres Backup and Recovery •  EDB Postgres Failover Manager •  EDB Postgres Postgres Enterprise Management

EDB Postgres Management Suite

Page 7: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 7

•  Simplifies and reduces errors with a system-wide catalog and command line tool that allows online backup and recovery across local and remote PostgreSQL and EDB Postgres Advanced servers.

Backup and Recovery

Backup and Recovery

Page 8: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 8

•  Local and remote online physical backups •  Backup catalog to manage multiple PostgreSQL and

Advanced Server databases

•  Auto-compression and MD5 checksum verification •  Verification guards against corrupt files •  Continuous WAL archiving and point-in-time recovery

(PITR) •  Table space restoration on different paths •  Retention policies

Backup and Recovery Feature Highlights

Page 9: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 9

•  Backup and Recovery software •  Configuration file •  Backup catalog

•  Backup locations •  Archived WAL locations

Backup and Recovery Components

Page 10: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 10

Backup and Recovery SHOW & VERIFY Commands [edb@rhel6x64 bin]$ ./bart SHOW -s pg93_local -i all

Server Name Backup ID Backup Time Backup Size pg93_local 1404887038189 2014-07-09 11:24:00 4.23185 MB pg93_local 1404885620373 2014-07-09 11:00:20 35.9585 MB pg93_local 1404886175037 2014-07-09 11:09:35 35.5676 MB pg93_local 1404808794468 2014-07-08 13:39:55 35.9395 MB pg93_local 1404888020037 2014-07-09 11:40:21 2.37839 MB pg93_local 1404810368031 2014-07-08 14:06:08 35.9585 MB

[edb@rhel6x64 bin]$ ./bart VERIFY-CHKSUM -s ppas93_local -i all

Server Name Backup ID Verify ppas93_local 1404904369050 OK ppas93_local 1404904443884 OK ppas93_local 1404903395963 Cannot Verify ppas93_local 1404903852783 OK ppas93_local 1404903728598 Cannot Verify ppas93_local 1404903992052 OK ppas93_local 1404903608103 OK

For a given server, the list of backups taken, their ID, Time and Size

For a given server, the list of backups taken and their checksum verification. Note: No md5 generated for uncompressed backups, hence cannot Verify message.

Page 11: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 11

Backup and Recovery Configuration # tail -n 30 /usr/edb-bart-1.1/etc/bart.cfg [BART] bart-host= [email protected] backup_path = /data/backups pg_basebackup_path = /opt/PostgreSQL/9.4/bin/pg_basebackup xlog-method = stream logfile = /var/log/bart.log [EFMMSTR] host = 172.16.6.12 port = 5432 user = postgres retention_policy = 3 BACKUPS xlog-method=fetch description = "Postgres database on efmmstr demo kit” [TBOX2] host = 172.16.6.16 port = 5444 user = enterprisedb xlog-method=fetch description = "PPAS database on tbox1"

Page 12: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 12

Backup and Recovery Integration with NetBackup Example

Page 13: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 13

•  Creation of highly available configurations of Postgres

•  Monitoring the health of a Postgres HA configuration

•  Automating the failover process in the event of a failure

•  Used in conjunction with streaming replication

EDB Postgres Failover Manager

Create fault tolerant database clusters to minimize downtime

Page 14: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 14

EDB Postgres Failover Manager Based on Streaming Replication

•  Streaming Replication −  Feature of Postgres −  Gives redundancy

Page 15: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 15

•  Agents −  Run on the master and

standby nodes −  Monitors the health of those

databases −  Communicates with each

other and witness to determine cluster health

−  Notifies user if an issue is detected

−  Initiates failover if needed

•  Witness node −  Confirms assertions of either

master or standbys −  Breaks tie in the event of

conflicting assertions

EDB Postgres Failover Manager Architecture and Components

Example Failover Manager cluster that employs a virtual IP address. You can use a load balancer in place of a virtual IP address if you provide your own fencing script to re-configure the load balancer in the event of a failure.

Page 16: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 16

•  Single management console allows easy visual control

•  Works with both PostgreSQL and EDB Postgres Advanced Server

•  Start/stop, configure, define and manage storage, security and database objects via single graphical console

MONITOR MANAGE TUNE

Only solution available that combines all three tasks into one tool

EDB Postgres Enterprise Manager

Page 17: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 17

Mission critical OS and database statistics collection

Predefined (225+) and custom alerts via SMTP or SNMP

Predefined & custom at-a-glance global dashboards

Replication monitoring

MONITOR TUNE MANAGE

CRUD operations on all database objects

Bulk operations across multiple servers

Capacity Manager for planning & forecasting

Customizable GUI charts, tables & graphs

SQL Profiler to speed up large workloads

Index Advisor to suggest and create indexes

Postgres Expert for best practice enforcement

Tuning Wizard for machine utilization and load profiles

EDB Postgres Enterprise Manager Core Features

Page 18: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 18

•  Enterprise Manager Agent •  Installed on each managed machine; collects data on

OS and databases

•  Enterprise Manager Server •  Centralized storage for agent collected data and client

dashboards

•  Enterprise Manager Clients •  User GUI console with global at-a-glance monitoring

dashboards and used to carry out centralized database administration and tuning

•  Fat client and web client

EDB Postgres Enterprise ManagerComponents

Page 19: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 19

EDB Postgres Enterprise ManagerDistributed Architecture

Monitoring Data

Monitoring Data

Enterprise Management Connections

Database Management Connection

Database Management Connection

PEM Clients Unmanaged Hosts

PEM Server

Managed Hosts (PEM Agents)

Page 20: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 20

EDB Postgres Enterprise Manager Alerts

•  Email •  Traps •  Scripts

Page 21: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 21

EDB Postgres Enterprise Manager Capacity Manager

90 GB

Page 22: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 22

•  Detailed Query Analysis

EDB Postgres Enterprise Managerfor Developers

1001101001 0101110100 1011010101

Page 23: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 23

•  Debugger for stored procedures, triggers and functions

EDB Postgres Enterprise Managerfor Developers

1001101001 0101110100 1011010101

Page 24: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 24

•  Improved visualization Custom dashboards, sharable data and an operations dashboard

•  Integration with other tools and functionalities Manage EFM and streaming replication

•  Nagios integration Work with customer technologies already in place

•  Audit Log alerts to monitor the health of databases

•  Streaming replication wizard and EFM monitoring to simplify replication and cluster management

New in Postgres Enterprise Manager 6

Page 25: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 25

EDB Postgres Platform

Page 26: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 26

More information EDB Postgres Enterprise Manager EDB Postres Failover Manager

EDB Postgres Backup and Recovery Downloads

EDB Postgres Enterprise Manager EDB Postgres Failover Manager EDB Postgres Backup and Recovery

Resources

Page 27: Managing Your EDB Postgres Workload

© 2016 EDB. All rights reserved. 27

27