Building AWS Compatible Cloud Services

Copyright © 2013 NTT Communications Corporation. All right reserved.

Copyright © NTT Communica3ons Corpora3on. All right reserved.

Building AWS-‐‑‒Compatible Public Cloud Service

Shinichiro KashiwagiCloud Services DivisionNTT Communications

1


Cloudn introduction

•  Who I am–  Lead developer of a public cloud service in NTT Communications

–  Working in UK branch now for a VMware-‐‑‒based private cloud service

•  Cloudn -‐‑‒ NTTComʼ’s public cloud service–  Starting from 6.9 EUR/VM–  AWS-‐‑‒compatible services and APIs

2


Service Concepts

•  Comprehensive low-‐‑‒cost IaaS services– We are a follower–  Support standard services, not only Compute

•  AWS Compatible as much as possible•  Free Network traffic

–  Benefit from our Tier-‐‑‒1 Global IP Backbone and global DC coverage

•  Multi-‐‑‒region, multi-‐‑‒zone–  Available in United States and Japan–  Planning to expand to other regions

3


Product Line-‐‑‒up

•  Offering most popular AWS compatible services including EC2, S3, ELB..–  Over CloudStack!

4


Feature Comparison

5

CloudStack is a IaaS pla?orm while AWS is a comprehensive service


Challenges

6

Feature AWS CloudStack

Compute ✔ (EC2) ✔

Load Balancing ✔ (ELB) ✔ (beIer with NetScaler)

Autoscaling ✔ (Autoscaling)

Dynamic DNS ✔ (Route53)

Monitoring ✔ (CloudWatch)

Provisioning ✔ (EC2)

Object Storage ✔ (S3)

Databases ✔ (RDS)

Content Delivery ✔ (CloudFront)

Portal ✔ (console)

ApplicaBon services ✔ (SQS, SNS..)

Service Providers have to prepare


Region

Architecture

7

Portal

CloudStack (Compute)

Addi3onal Services

Compute Nodes

Monitoring Opera3on and Support

L7 Proxy

Billing

Zone

Compute Nodes

Zone


Compute

•  Cloudstack AWSAPI module–  Supporting important EC2 APIs–  Limitations

•  CloudStack 3.0.6~∼•  Basic networking mode only

•  Mapping AWS concepts to CloudStack world•  Regions, Zones•  Compute Offering names

•  Differences in compute model–  IP address persistency–  Lack of local disk (Instance Store in AWS)–  Difficult to share templates

8


Compute GUI

9

Compute GUI for CloudStack 2.x zones

Compute GUI for CloudStack 3.x zones


Load Balancing

•  Evaluated CloudStack native load balancers–  VR (haproxy), NetScaler–  No AWS API!

•  Newly implemented–  Load Balancing “Advanced”–  AWS ELB compatible features

•  Multi-‐‑‒zone•  SSL termination•  AWS ELB compatible API

10


Load Balancing Advanced -‐‑‒ GUI

11


Dynamic DNS

•  CloudStack VR DNS: dnsmasq–  DHCP server–  Static configuration–  No external API

•  Newly implemented–  AWS Route53 compatible API

•  Except some features such ash latency based round robin

–  No synchronisation with CloudStack DNS

12


Monitoring

•  CloudStack native HA mechanism–  Slow to detect failure–  Not sure about DB integrity during convergence–  No external interface

•  Newly implemented–  AWS CloudWatch compatible API

•  Challenges–  KVM handler

•  virsh operations should be serialised•  Security group bug in CloudPlatform 3.x

13


Autoscaling•  Available in CloudStack 4.1

–  Needs NetScaler–  Coordination with Monitoring and Load Balancing

•  CloudStack Autoscaling uses SNMP for monitoring and controls CloudStack load balancing

•  Not pluggable, not extensitble yet

–  No AWS API•  Newly implemented

–  Works without NetScaler

14


Provisioning

•  CloudStack has no bulk VM provisioning feature

•  Newly implemented

15


Object Storage

•  CloudStack did not have integrated object storage service

•  Adpoted Cloudian–  Offering AWS S3 compatible API–  Emulate the similar domain hierarchy as CloudStack

16


Relational Database•  Anything to do with CloudStack?•  We implemented anyway

–  offering MySQL clusters–  with AWS RDS compatible API

17


PaaS

•  Anything to do with CloudStack?•  We are offering CloudFoundry on top of CloudStack IaaS

18


Various products

Portal + Authen3ca3on Servers

Account Management

Authentication

Product Management

Billing Calculation

Portal GUI （SSO to Product GUI）

Order Management

Customer Management

Billing Management

Payment Management

Customer Support

Customer Management

Common function Reseller specific function

Reseller-Portal API

•  Create Customer

•  Delete Customer

•  Suspend Customer

•  Resume Customer

•  Get Billing Info

•  SSO

Portal-Product API

•  Add Account

• Delete Account

• Suspend Account

• Resume account

• Update API Keys

• Get Usage

Reseller A

Reseller B

…..

Portal


Lessons learned

•  Built a subset of AWS service using CloudStack–  Using Ruby on Rails (and Java)–  AWSAPI module is good–  Users can benefit from AWS ecosystem, including various tools and techniques

•  Key design points–  Compute – difference in model and semantics–  API versions and authentication (signature versions)–  Behavior compatibility

•  Error messages•  Abnormal cases

20


“Will CloudStack be following AWS?”

•  AWS API is only available for Compute– What about other services?– Will such related services be included in CloudStack?

•  NetScaler-‐‑‒dependence

21


Thank you

http://www.ntt.com/cloudn_̲e/

[email protected]@skash88

22

Technology

Building AWS Compatible Cloud Services