Some Conference
SCALE 10x
LCA 2012
Scaling Data: Postgres, The Stack and the
Future of ReplicationSelena Deckelmann
[email protected]@selenamarie
Some Conference
OSCO
N 2011
LCA 2012
Some Conference
OSCO
N 2011
LCA 2012
Postgres disrupts the rest of the
commercial relational database industry.
Some Conference
OSCO
N 2011
LCA 2012
Licensing
“Enterprise” Web development
Proprietary DBA Career Path
Disruptive forces
Some Conference
OSCO
N 2011
LCA 2012
Licensing
Drop-in replacement for custom application development on proprietary DBs.
Cheap Data Warehousing
Ecosystem!
Some Conference
OSCO
N 2011
LCA 2012
“Enterprise”Web development
Postgres is a “Developers database” - Extension is encouraged
Database of choice for Django
Oracle wants PHP developers
Some Conference
OSCO
N 2011
LCA 2012
“Visit the Ruby and Python Topicfor more information pertainingto Ruby/RoR, Python and other
non-PHP scripting languages.”
Some Conference
OSCO
N 2011
LCA 2012
DBA Career path
Companies can’t hire Postgres DBAs fast enough.
Postgres is close enough to Oracle, that Oracle DBAs can jump in.
What we do better: Data loading, automation, TUI and GUI admin tools
Some Conference
OSCO
N 2011
LCA 2012
And... Stability
Support major releases for at least 5 years.
Commits to HEAD are stable.
Bugs reported are fixed in <48 hrs.
Some Conference
SCALE 10x
LCA 2012
Demo!
• Demo here!https://github.com/selenamarie/pg_replication_demo
Some Conference
SCALE 10x
LCA 2012
Old problems
• Replication is hard
• Sharding is hard
• Slow in “the cloud”
Some Conference
SCALE 10x
LCA 2012
Solutions
• Streaming, cascaded replication
• Sharding is still hard
• Index-only scans
new!
new!
Some Conference
SCALE 10x
LCA 2012
The Good
• Community starting to really address Ops/performance concerns:
• AVOIDING REINDEXING ON ALTER TYPE OF INDEXED COLUMN
• NOT VALID CHECKS
• pg_basebackup
Some Conference
SCALE 10x
LCA 2012
The Bad
• Installation of Postgres harder than SQLite
• psql is powerful, not very friendly
• HA Ops support could be way better
Some Conference
SCALE 10x
LCA 2012
What’s happening now
• Heroku -> postgres.heroku.com 400 million write-transactions/day
• VMWare -> for managing lots of instances
• More interest in PaaS (like what MySQL support has been for a long time)
Some Conference
SCALE 10x
LCA 2012
Next in HA?
• Continued usability improvements
• Cascaded Failover
• Multi-master with synchronous rep
Recommended
