14
PRESENTATION TITLE ON ONE LINE AND ON TWO LINES First and last name Position, company How to Optimize Inter-DC communication Solution Architect, ScyllaDB Eyal Gutkind

Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

Embed Size (px)

Citation preview

Page 1: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

How to Optimize Inter-DC communication

Solution Architect, ScyllaDB

Eyal Gutkind

Page 2: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Eyal Gutkind

2

Head of Solution Architects team at ScyllaDB. Previously, held Product Management roles at Mirantis and DataStax. Prior to DataStax I spent 12 years with Mellanox Technologies in various engineering management and Product Marketing roles. I have a BSc. degree in Electrical and Computer Engineering from Ben Gurion University and an MBA from Fuqua School of Business at Duke University

Page 3: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

What’s Inter-Datacenter Communication?

3

USA Data Center Asia Data Center

Page 4: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

What Do You Pay for?

4

Page 5: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

What Do You Pay for?

5

Page 6: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

6

- Simple vs NetworkTopology Strategies

EC2MultiRegionSnitch - for AWS based deployments,

GossipingPropertyFileSnitch - for all other deployments

Page 7: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

- Simple vs NetworkTopology StrategiesCREATE KEYSPACE myks WITH replication = {'class': 'SimpleStrategy', 'replication_factor': '7'}

7

USA Data Center Asia Data Center

Page 8: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

- Simple vs NetworkTopology StrategiesCREATE KEYSPACE myks WITH replication = {'class': 'NetworkToplogyStrategy', 'usa’: '3', ‘asia’: ‘3’}

8

USA Data Center Asia Data Center

Page 9: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

- Simple vs NetworkTopology Strategies

- Be Local! - Set Load balancing correctly in your clients

9

load_balancing_policy= TokenAwarePolicy(DCAwareRoundRobinPolicy(local_dc='asia'))

Page 10: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

- Simple vs NetworkTopology Strategies

- Be Local! - Set Load balancing correctly in your clients- Set Consistency levels in your queries!

10

insert_query = SimpleStatement( "INSERT INTO myks.mytable (user_id, name, address, zip_code) VALUES (%s, %s, %s, %s)", consistency_level=ConsistencyLevel.LOCAL_QUORUM)…)

Page 11: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Snitch, Keyspace and Client Drivers Settings

- Simple vs NetworkTopology Strategies

- Be Local! - Set Load balancing correctly in your clients- Set Consistency levels in your queries!

11

Page 12: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Inter-Node Compression!

Default : None

Use: DC

In your Scylla.yaml file uncomment and set

internode_compression: dc

12

Page 13: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

Summary

- As expected, you always pay :)

- Create keyspaces and tables in the regions you need them- Enable conversations between ops and dev for best use cases

- Review client geo locations and data access patterns- Who is writing? (Cheap)- Who is reading? (Expensive)

- Enable compression!

13

Page 14: Scylla Summit 2017: How to Optimize and Reduce Inter-DC Network Traffic and Stop Paying too Much!

PRESENTATION TITLE ON ONE LINE AND ON TWO LINES

First and last namePosition, company

THANK YOU

[email protected]

@gutkinde

Please stay in touch

Any questions?