Embed Size (px)
DESCRIPTION
Postgres has long been a database that easily scales vertically. It has also supported durable and reliable binary replication.In the last two years, work on HA, clustering and extensions to our MVCC system has produced clustering features that help Postgres efficiently scale across many smaller systems.This talk will start with a demo of the latest Postgres replication features. Then, we'll walk through open source and commercially-supported stacks that supporting the most demanding applications backed by Postgres.In version 9.1, Postgres added streaming and synchronous replication that can be configured in about 5 steps. In 9.2 (to be released in 2012), we're adding cascaded replication and optimizations for common developer requests.These features set the stage for a fast, efficient and distributed SQL cluster -- one that has configurable durability, is easy to administer and supported by "cloud" and virtualization vendors.
Citation preview
Some Conference
SCALE 10x
LCA 2012
Scaling Data: Postgres, The Stack and the
Future of ReplicationSelena Deckelmann
[email protected]@selenamarie
Some Conference
OSCO
N 2011
LCA 2012
Some Conference
OSCO
N 2011
LCA 2012
Postgres disrupts the rest of the
commercial relational database industry.
Some Conference
OSCO
N 2011
LCA 2012
Licensing
“Enterprise” Web development
Proprietary DBA Career Path
Disruptive forces
Some Conference
OSCO
N 2011
LCA 2012
Licensing
Drop-in replacement for custom application development on proprietary DBs.
Cheap Data Warehousing
Ecosystem!
Some Conference
OSCO
N 2011
LCA 2012
“Enterprise”Web development
Postgres is a “Developers database” - Extension is encouraged
Database of choice for Django
Oracle wants PHP developers
Some Conference
OSCO
N 2011
LCA 2012
“Visit the Ruby and Python Topicfor more information pertainingto Ruby/RoR, Python and other
non-PHP scripting languages.”
Some Conference
OSCO
N 2011
LCA 2012
DBA Career path
Companies can’t hire Postgres DBAs fast enough.
Postgres is close enough to Oracle, that Oracle DBAs can jump in.
What we do better: Data loading, automation, TUI and GUI admin tools
Some Conference
OSCO
N 2011
LCA 2012
And... Stability
Support major releases for at least 5 years.
Commits to HEAD are stable.
Bugs reported are fixed in <48 hrs.
Some Conference
SCALE 10x
LCA 2012
Demo!
• Demo here!https://github.com/selenamarie/pg_replication_demo
Some Conference
SCALE 10x
LCA 2012
Old problems
• Replication is hard
• Sharding is hard
• Slow in “the cloud”
Some Conference
SCALE 10x
LCA 2012
Solutions
• Streaming, cascaded replication
• Sharding is still hard
• Index-only scans
new!
new!
Some Conference
SCALE 10x
LCA 2012
The Good
• Community starting to really address Ops/performance concerns:
• AVOIDING REINDEXING ON ALTER TYPE OF INDEXED COLUMN
• NOT VALID CHECKS
• pg_basebackup
Some Conference
SCALE 10x
LCA 2012
The Bad
• Installation of Postgres harder than SQLite
• psql is powerful, not very friendly
• HA Ops support could be way better
Some Conference
SCALE 10x
LCA 2012
What’s happening now
• Heroku -> postgres.heroku.com 400 million write-transactions/day
• VMWare -> for managing lots of instances
• More interest in PaaS (like what MySQL support has been for a long time)
Some Conference
SCALE 10x
LCA 2012
Next in HA?
• Continued usability improvements
• Cascaded Failover
• Multi-master with synchronous rep
