Performance Isolation in Multi-Tenant

Cloud Data Services

1 7/15/2013 MSR Faculty Summit 2013

Microsoft Research

2 7/15/2013 MSR Faculty Summit 2013

shared

Machine in cluster

Database server process

Tenant1

database

Tenant2

database

3 7/15/2013 MSR Faculty Summit 2013

job tasks

Task level

Job level

Slave Node 1

Task1 Task1 Task2

Slave Node 2

Task3 Task3 Task2

Master Node

4 7/15/2013 MSR Faculty Summit 2013

5 7/15/2013 MSR Faculty Summit 2013

unaffected other

Static resource allocation

Service provider accountable

6 7/15/2013 MSR Faculty Summit 2013

WHERE State = ‘Vermont’ WHERE State = ‘Vermont’ ‘California’

7 7/15/2013 MSR Faculty Summit 2013

Tenant is promised reservation of DBMS resources

“VM inside SQL process”

CPU utilization, IOPS, Memory, …

Resource governance Fine-grained resource sharing

Novel mechanisms

Metering (auditing) Monitor actual and promised metrics for tenant

Determine violations

8 7/15/2013 MSR Faculty Summit 2013

Database server process

(25% CPU utilization,

4GB RAM)

Tenant1

database

100 IOPS

100 IOPS 50 IOPS

Capacity:

200 IOPS

9 7/15/2013 MSR Faculty Summit 2013

Machine in cluster

Database server process

Tenant1

database

Tenant2

database

Promised: 100 IOPS

Achieved: 80 IOPS

Burst of

200 I/Os arrive

50 I/Os 100 I/Os 50 I/Os

10 7/15/2013 MSR Faculty Summit 2013

1 sec

Reservation of 100 IOPS

Violations (IOPS)

Penalty Violations (IOPS)

Penalty

11 7/15/2013 MSR Faculty Summit 2013

12 7/15/2013 MSR Faculty Summit 2013

150 IOPS 100 IOPS

Capacity:

200 IOPS

Machine in cluster

Database server process

Tenant1

database

Tenant2

database

CPU utilization

VLDB 2014

Hit Ratio

13 7/15/2013 MSR Faculty Summit 2013

15 7/15/2013 MSR Faculty Summit 2013

16 7/15/2013 MSR Faculty Summit 2013

Eight

Tenant 1

Red

18 7/15/2013 MSR Faculty Summit 2013

Th

rou

gh

pu

t (q

ps)

Other tenant

workloads

start

Tenant of

interest

Th

rou

gh

pu

t (q

ps)

Other tenant

workloads

start

Tenant of

interest

19 7/15/2013 MSR Faculty Summit 2013

CP

U U

tiliza

tio

n (

%)

Dis

k r

ead

s /

sec

(IO

PS)

20 7/15/2013 MSR Faculty Summit 2013

CP

U U

tiliza

tio

n (

%)

Dis

k r

ead

s /

sec

(IO

PS)

Amazon RDS

21 7/15/2013 MSR Faculty Summit 2013

Microsoft SQL Azure

Oracle 12c

Multi-tenant Oracle DBMS as a service

Google Cloud SQL