16
Document Schema Design & Data Consistency A.K.A. awesome-scale data Kiril Savino CTO, Founder GameChanger Media

Document Schema Design & Consistency Management

  • View
    312

  • Download
    0

Embed Size (px)

DESCRIPTION

Using Mongo for high-throughput dynamic content.

Citation preview

Page 1: Document Schema Design & Consistency Management

Document Schema Design & Data Consistency

A.K.A. awesome-scale data

Kiril Savino CTO, Founder

GameChanger Media

Page 2: Document Schema Design & Consistency Management

GameChanger

Page 3: Document Schema Design & Consistency Management

Abundance & Urgency

• 15,000 games, or 5,000,000 events per DAY

• 1,100,000 games scored to date

• 320 million events and counting

• Impatient consumers

Page 4: Document Schema Design & Consistency Management
Page 5: Document Schema Design & Consistency Management
Page 6: Document Schema Design & Consistency Management

Solving Problems

• Many small objects

• Rapid interleaved writing

• Immediate availability

• Complex representation

Page 7: Document Schema Design & Consistency Management

The Single Query Rule

Page 8: Document Schema Design & Consistency Management

The Single Document Rule

Page 9: Document Schema Design & Consistency Management

Multiple Access Patterns

• Write patterns

• Edit patterns

• Read patterns

• Multiple representations

Page 10: Document Schema Design & Consistency Management
Page 11: Document Schema Design & Consistency Management

Consistent, Eventually

• Canonical location

• Write contract

• Completeness guarantee

Page 12: Document Schema Design & Consistency Management

Canonical Location

Page 13: Document Schema Design & Consistency Management

Write Contract

Page 14: Document Schema Design & Consistency Management

Completeness Rule

Page 15: Document Schema Design & Consistency Management

The Machine

Page 16: Document Schema Design & Consistency Management

Thanks!gc.io/about @kirilnyc