66
Introduction to Sharding

Webinar: Sharding

  • Upload
    mongodb

  • View
    3.165

  • Download
    0

Embed Size (px)

DESCRIPTION

Sharding allows you to distribute load across multiple servers and keep your data balanced across those servers. This session will review MongoDB’s sharding support, including an architectural overview, design principles, and automation.

Citation preview

Page 1: Webinar: Sharding

Introduction to Sharding

Page 2: Webinar: Sharding

Agenda

• Scaling Data

• MongoDB's Approach

• Architecture

• Configuration

• Mechanics

Page 3: Webinar: Sharding

Scaling Data

Page 4: Webinar: Sharding

Examining Growth

• User Growth– 1995: 0.4% of the world’s population– Today: 30% of the world is online (~2.2B)– Emerging Markets & Mobile

• Data Set Growth– Facebook’s data set is around 100 petabytes– 4 billion photos taken in the last year (4x a decade

ago)

Page 5: Webinar: Sharding

Read/Write Throughput Exceeds I/O

Page 6: Webinar: Sharding

Working Set Exceeds Physical Memory

Page 7: Webinar: Sharding

Vertical Scalability (Scale Up)

Page 8: Webinar: Sharding

Horizontal Scalability (Scale Out)

Page 9: Webinar: Sharding

Data Store Scalability

• Custom Hardware– Oracle

• Custom Software– Facebook + MySQL– Google

Page 10: Webinar: Sharding

Data Store Scalability Today

• MongoDB Auto-Sharding

• A data store that is– Free– Publicly available– Open Source

(https://github.com/mongodb/mongo)– Horizontally scalable– Application independent

Page 11: Webinar: Sharding

MongoDB's Approach to Sharding

Page 12: Webinar: Sharding

Partitioning

• User defines shard key

• Shard key defines range of data

• Key space is like points on a line

• Range is a segment of that line

Page 13: Webinar: Sharding

Data Distribution

• Initially 1 chunk

• Default max chunk size: 64mb

• MongoDB automatically splits & migrates chunks when max reached

Page 14: Webinar: Sharding

Routing and Balancing

• Queries routed to specific shards

• MongoDB balances cluster

• MongoDB migrates data to new nodes

Page 15: Webinar: Sharding

MongoDB Auto-Sharding

• Minimal effort required– Same interface as single mongod

• Two steps– Enable Sharding for a database– Shard collection within database

Page 16: Webinar: Sharding

Architecture

Page 17: Webinar: Sharding

What is a Shard?

• Shard is a node of the cluster

• Shard can be a single mongod or a replica set

Page 18: Webinar: Sharding

• Config Server– Stores cluster chunk ranges and locations– Can have only 1 or 3 (production must have

3)– Not a replica set

Meta Data Storage

Page 19: Webinar: Sharding

Routing and Managing Data

• Mongos– Acts as a router / balancer– No local data (persists to config database)– Can have 1 or many

Page 20: Webinar: Sharding

Sharding infrastructure

Page 21: Webinar: Sharding

Configuration

Page 22: Webinar: Sharding

Example Cluster

• Don’t use this setup in production!- Only one Config server (No Fault Tolerance)- Shard not in a replica set (Low Availability)- Only one mongos and shard (No Performance Improvement)- Useful for development or demonstrating configuration

mechanics

Page 23: Webinar: Sharding

Starting the Configuration Server

• mongod --configsvr• Starts a configuration server on the default port

(27019)

Page 24: Webinar: Sharding

Start the mongos Router

• mongos --configdb <hostname>:27019• For 3 configuration servers:

mongos --configdb <host1>:<port1>,<host2>:<port2>,<host3>:<port3>

• This is always how to start a new mongos, even if the cluster is already running

Page 25: Webinar: Sharding

Start the shard database

• mongod --shardsvr• Starts a mongod with the default shard port (27018)• Shard is not yet connected to the rest of the cluster• Shard may have already been running in production

Page 26: Webinar: Sharding

Add the Shard

• On mongos: - sh.addShard(‘<host>:27018’)

• Adding a replica set: - sh.addShard(‘<rsname>/<seedlist>’)

Page 27: Webinar: Sharding

Verify that the shard was added

• db.runCommand({ listshards:1 }) { "shards" : [{"_id”: "shard0000”,"host”: ”<hostname>:27018” } ],

"ok" : 1 }

Page 28: Webinar: Sharding

Enabling Sharding

• Enable sharding on a database

sh.enableSharding(“<dbname>”)

• Shard a collection with the given key

sh.shardCollection(“<dbname>.people”,{“country”:1})

• Use a compound shard key to prevent duplicates

sh.shardCollection(“<dbname>.cars”,{“year”:1, ”uniqueid”:1})

Page 29: Webinar: Sharding

Tag Aware Sharding

• Tag aware sharding allows you to control the distribution of your data

• Tag a range of shard keys– sh.addTagRange(<collection>,<min>,<max>,<t

ag>)

• Tag a shard– sh.addShardTag(<shard>,<tag>)

Page 30: Webinar: Sharding

Mechanics

Page 31: Webinar: Sharding

Partitioning

• Remember it's based on ranges

Page 32: Webinar: Sharding

Chunk is a section of the entire range

Page 33: Webinar: Sharding

Chunk splitting

• A chunk is split once it exceeds the maximum size• There is no split point if all documents have the same

shard key• Chunk split is a logical operation (no data is moved)

Page 34: Webinar: Sharding

Balancing

• Balancer is running on mongos• Once the difference in chunks between the most

dense shard and the least dense shard is above the migration threshold, a balancing round starts

Page 35: Webinar: Sharding

Acquiring the Balancer Lock

• The balancer on mongos takes out a “balancer lock”• To see the status of these locks:

use configdb.locks.find({ _id: “balancer” })

Page 36: Webinar: Sharding

Moving the chunk

• The mongos sends a moveChunk command to source shard

• The source shard then notifies destination shard• Destination shard starts pulling documents from

source shard

Page 37: Webinar: Sharding

Committing Migration

• When complete, destination shard updates config server- Provides new locations of the chunks

Page 38: Webinar: Sharding

Cleanup

• Source shard deletes moved data- Must wait for open cursors to either close or time out- NoTimeout cursors may prevent the release of the lock

• The mongos releases the balancer lock after old chunks are deleted

Page 39: Webinar: Sharding

Routing Requests

Page 40: Webinar: Sharding

Cluster Request Routing

• Targeted Queries

• Scatter Gather Queries

• Scatter Gather Queries with Sort

Page 41: Webinar: Sharding

Cluster Request Routing: Targeted Query

Page 42: Webinar: Sharding

Routable request received

Page 43: Webinar: Sharding

Request routed to appropriate shard

Page 44: Webinar: Sharding

Shard returns results

Page 45: Webinar: Sharding

Mongos returns results to client

Page 46: Webinar: Sharding

Cluster Request Routing: Non-Targeted Query

Page 47: Webinar: Sharding

Non-Targeted Request Received

Page 48: Webinar: Sharding

Request sent to all shards

Page 49: Webinar: Sharding

Shards return results to mongos

Page 50: Webinar: Sharding

Mongos returns results to client

Page 51: Webinar: Sharding

Cluster Request Routing: Non-Targeted Query with Sort

Page 52: Webinar: Sharding

Non-Targeted request with sort received

Page 53: Webinar: Sharding

Request sent to all shards

Page 54: Webinar: Sharding

Query and sort performed locally

Page 55: Webinar: Sharding

Shards return results to mongos

Page 56: Webinar: Sharding

Mongos merges sorted results

Page 57: Webinar: Sharding

Mongos returns results to client

Page 58: Webinar: Sharding

Shard Key

Page 59: Webinar: Sharding

Shard Key

• Shard key is immutable

• Shard key values are immutable

• Shard key must be indexed

• Shard key limited to 512 bytes in size

• Shard key used to route queries– Choose a field commonly used in queries

• Only shard key can be unique across shards– `_id` field is only unique within individual shard

Page 60: Webinar: Sharding

Shard Key Considerations

• Cardinality

• Write Distribution

• Query Isolation

• Reliability

• Index Locality

Page 61: Webinar: Sharding

Conclusion

Page 62: Webinar: Sharding

Read/Write Throughput Exceeds I/O

Page 63: Webinar: Sharding

Working Set Exceeds Physical Memory

Page 64: Webinar: Sharding

Sharding Enables Scale

• MongoDB’s Auto-Sharding– Easy to Configure– Consistent Interface– Free and Open Source

Page 65: Webinar: Sharding

• What’s next?– [ Insert Related Talks ]– [ Insert Upcoming Webinars ]– MongoDB User Group

• Resourceshttps://education.10gen.com/http://www.10gen.com/presentations

Page 66: Webinar: Sharding

Software Engineer, 10gen

Speaker Name

#hashtag

Thank You