Patterns for Cloud Computing

Patterns for Cloud Computing

Solution Architect Briefingzoli.herczeg.ro

Taken from Simon Guests’ work at TechEd Berlin 2009

This is Jim


Jim’s Boss (the CIO) has asked him to “move their company to the cloud!”


He’s seen many great things on cloud computing/Windows Azure


…but he’s still a little confused


He still doesn’t quite understand what types of applications make sense in the

cloud


He also wonders how other organizations are using the cloud


What patterns have other people learned – and can Jim re-use for his applications?


Session Objectives

Session Objectives

Validate what you may have heard and seen so far

Provide you with 5 patterns for cloud-based applications

Show you how to implement these patterns using Windows

Azure

Where does my application live?

Application runs on-premises

Application runs at a hoster

Application runs using cloud

platform

Build

vs.

Buy

Build

Buy

“Packaged”Application

An application that I buy “off the shelf” and

run myself

“Home Built”Application

An application that I develop and run myself

Hosted “Home Built”

An application that I develop

myself, but run at a hoster

Hosted “Packaged”

An application that I buy “off the shelf” and then run at a

hosterCloud

Platform

An application that I develop

myself, that I run in the cloud

“Software as a Service”

A hosted application that I

buy from a vendor

Platform Services

Software Services

Application Services

Infrastructure Services

Microsoft Cloud ServicesCategories of Services

Pricing

Compute• $0.12 / CPU hour

Storage• $0.15 / GB / month• $0.01 / 10k txn /

month Bandwidth

• $0.10 in / GB• $0.15 out / GB

Web Edition (1GB)• $9.99 / month

Business Edition (10GB)• $99.99 / month

Bandwidth• $0.10 in / GB• $0.15 out / GB

Service Bus• $0.15 / 100k

messages Access Control

• $0.15 / 100k tokens Bandwidth

• $0.10 in / GB• $0.15 out / GB

SUBSCRIPTIONCONSUMPTION VOLUME LICENSING“Pay as you go and

grow”Available at launch

• Low barrier to entry and flexibility• Optimized for cloud elasticity

• Discounts for commitment• Plans for payment

predictability

“Coordinated purchasing”

Planned for FY11• Unified purchasing through EA• Introduction to volume

discounts

“Value for a commitment“

Select offers Announced

Offers & PromotionsDevelopment Accelerator Designed to accelerate cloud app development. Flexible (on/off) consumption for scaling. Predictable payment and discounted price.

•6 month subscription (38%-45% discount) •Offered as a unit (can order multiple units)•Cancel first 30 days; anytime after first 6 months•Overage at Standard Consumption rates

CORE ($59.95/month)Amount Included in BaseCompute 750 hrs/mo Storage 10 GB/mo Storage Transactions 1M/mo NET - Messages 1M/moData Transfers 7 GB In / 14 GB Out

EXTENDED ($109.95/month)Amount Included in BaseSame as Core except also includes 1 SQL Azure Business Edition DB (10 GB)

Introductory Free Offer No-cost developer starter offer. Provides no-cost allocation to run a cloud service.

•Available to all partner/customers•Limit of one per customer•Overage at Standard Consumption rates

NO-COSTWindows AzureCompute 25 Hrs/monthStorage 0.5 GB/monthBandwidth 0.5 GB/monthStorage Transactions 10K/month

SQL Azure1 Web Edition DB (1GB DB) 90 day trial

Service Bus and Access Control Service Messages 100K/mo

MSDN Premium Mobilize committed .NET developer base. Enable them to build, deploy, manage multiple cloud projects w/in MSDN subscription.

• Available to MSDN Premium subscribers with limit of one per subscription (one per Windows Live ID)• 12-month term• Overage at partner Consumption rates• Limited time to sign up (thru 6/30/10)• After 6/30/10 quantities may be reduced

NO-COSTWindows AzureCompute 750 hrs Storage 10 GBStorage Transaction 1M

SQL Azure - 3 Web DB (1 GB)

Service Bus and Access Control Service Messages 1 Million

Data Transfer 7GB In/14GB Out

Private(On-Premise)

Infrastructure

(as a Service)

Platform(as a

Service)

Types of Clouds

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications


Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications


You

man

age M

anaged by vendor

Managed by vendor

You

man

age

You

man

age


#1 - Using the Cloud for Scale

“Isn’t the cloud good for applications that need to scale dynamically?”


For example, tax applications


“How does this work?”


Let’s do some white boarding for Jim…


…and when I say white boarding, I really mean it


Web TierBrowserRequest

B/L Tier DatabaseResponse

“Wow! What a great site!”


Web Tier B/L Tier Database

Browser

Browser

Browser

Browser

Browser

“Server Busy”


Web Tier B/L Tier Database

Browser

“Timeout”

Browser

Browser

Browser

Browser

How would Jim do this today on premises?


Web Tier B/L Tier Databa

seBrowser

Browser

Browser

Browser

Browser

Web Tier

Web Tier

N L B



Database

Browser

Browser

Browser

Browser

Browser

Web Tier B/L Tier

B/L Tier

B/L Tier

N L B



Database

Browser

Browser

Browser

Browser

Browser

B/L Tier

B/L Tier

B/L Tier

N L B

Web Tier

Web Tier

Web Tier

N L B



Browser

Browser

Browser

Browser

Browser

B/L Tier

B/L Tier

B/L Tier

N L B

Database

p1 p2 p3

Web Tier

Web Tier

Web Tier

N L B


Not without consequences...


Browser

Browser

Browser

Browser

Browser

B/L Tier

B/L Tier

B/L Tier

N L B

Database

p1 p2 p3

Web Tier

Web Tier

Web Tier

N L B

“That took a lot of work - and money!”



Browser B/L Tier

B/L Tier

B/L Tier

N L B

Database

p1 p2 p3

Web Tier

Web Tier

Web Tier

N L B

“Not so great now…”

“Hmmm... Most of this stuff is sitting idle...”

“That took a lot of work - and money!”



Usage

Jan Apr Jul Oct

Datacenter peak load

Idle time

How can Windows Azure help?


Web RoleBrowserRequest Worker

RoleAzure Storag

eResponse

“Wow! What a great site!”


Web Role Worker Role

AzureStorag

eBrowser

“Server Busy”

Browser

Browser

Browser

Browser


Web Role

Worker Role

AzureStorag

eBrowser

Browser

Browser

Browser

Browser

Web Role

Web Role

N L B

You don’t see this bit


Web Role

AzureStorag

eBrowser

Browser

Browser

Browser

Browser

Web Role

Web Role

N L B

Worker Role

Worker Role

Worker Role

N L B

OK, so changing config is easy...

…but what else do I need to know?


Web RoleBrowser

Browser

Browser

Browser

Browser

Web Role

Web Role

N L B

N L B

AzureStorag

eWorker

Role

Worker Role

Worker Role


Web RoleBrowser

Browser

Browser

Browser

Browser

Web Role

Web Role

N L B

N L B

AzureStorag

eWorker

Role

Worker Role

Worker Role

Tight coupling between web and worker role is an anti-

pattern



Queue

Req1. Place on queue 3. Pickup from queue

4. Process

2. Respond to UI



Queue

Req

4. Process

Table

5. Add result to table

6. Query table on refresh

How many web and worker roles do you need?



Web Role

Worker Role

AzureStorag

eBrowser

Browser

Browser

Browser

Browser

Web Role

Web Role

N L B

Worker RoleLog

WMI_Win32_PerfFormattedData_ASPNET_ASPNETApplications/RequestsPerSecond

Management APIor Email



Web Role

Queue

Req

Web Role

Web Role

Req

Req

Monitor queuelength against

user’s expectations

Web Role

Web Role

Web Role

Worker Role


Web Role

Queue

Req

Web Role

Web Role

Req

Req

Monitor queuelength against

user’s expectations

Web Role

Web Role

Web Role

Worker Role

Worker Role

Worker Role

Worker Role

Worker Role

Worker Role

Patterns for Cloud ComputingTakeaways

Understand how to communicate between Web and Worker roleStrategy on when to scale up/down roles in production

Using configuration, Azure makes it easy to scale roles

Patterns for Moving to the Cloud

#2 - Using the Cloud for Multi Tenancy

“I like the idea of scaling Web roles…”


“…but need to serve multiple customers”


“Without creating separate codebases!”



Web TierBrowser B/L Tier Database

Customer #1




Customer #2


Customer #1


Customer #3


Gets expensive pretty quickly



Browser

Browser

Customer #1

Customer #2

Customer #3

Schema Customizations

UI Customizations


UI Customizations

3 options for data in multi tenant environment



Browser

Browser

Customer #1

Customer #2

Customer #3

Option 1: Everyone Uses the Same Database/Schema

Fixed Schema

Pros: Simplest approach, easy to maintain/upgrade.Cons: No customizations. Restoring of tenant data.


Web TierBrowser B/L Tier

DatabaseBrowser

Browser

Customer #1

Customer #2

Customer #3 Option 2: Give Each Customer Their Own

Database/Schema

Customer #1Database

Database

Customer #2

Customer #3

Pros: Flexible. Tenant restore is easier. High Isolation.Cons: Can be costly. Difficult to upgrade db schemas.



Browser

Browser

Customer #1

Customer #2

Customer #3

Option 3: Fixed Database/Schema, with customizations

Fixed Schemawith

Customizations

Pros: Customers can add their own custom fieldsCons: Non standard way of customizing the schema. Tenant restore is difficult.


TenantIDTenant

int

TenantNamenvarchar

EmployeeIdEmployee

int

FirstName nvarchar

LastName nvarchar

CustomizationID

Customizationint

Value nvarchar

TypeIDType

int

Name nvarchar

CLRType nvarchar

1

*

*1

*1

*

*


TenantIDTenant

1

TenantNameUK Branch

EmployeeIdEmployee

1

FirstName Gordon

LastName Brown

CustomizationID

Customization1

Value SW1A 2AA

TypeIDType

1

Name PostalCode

CLRType string

1

*

*1

*1

*

*


TenantIDTenant

2

TenantNameUS Branch

EmployeeIdEmployee

2

FirstName Barack

LastName Obama

CustomizationID

Customization2

Value 20500

TypeIDType

2

Name ZipCode

CLRType string

1

*

*1

*1

*

*


TenantIDTenant

2

TenantNameUS Branch

EmployeeIdEmployee

2

FirstName Barack

LastName Obama

CustomizationID

Customization2

Value 20500

TypeIDType

2

Name ZipCode

CLRType string

1

*

*1

*1

*

*

Fixed SchemaApplies to All

Tenants

CustomizableTenant by

Tenant Basis

Could be both


UI Customizations



Browser

Browser

Customer #1

Customer #2

Customer #3

URL Handling

Can ASP.NET MVC Help?



Browser

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk

http://hr.fabrikam.com

http://employeedata.cloudapp.net



Browser

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)




Browser

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)

Use custom routing in ASP.NET MVC



Design considerations must include both data and UI

Many other considerations, such as identity – p&p guidance

Always consider Multi Tenancy first, even if only one customer


#3 - Using the Cloud for Compute

Jim has seen how Azure enables multiple nodes


“Can I use all of these nodes in parallel?”


“I’ve got this complex calculation I would like to share across these multiple nodes…”



MasterClient

Data

Worker

Worker

Worker

Data

Data

Data


MasterClientResul

t

Worker

Worker

Worker

Result

Result

Result

Popularized by the term “MapReduce”*

* 2004 OSDI paper by Jeff Dean and Sanjay Ghemawat (Google)


MasterClient

Data

Worker

Worker

Worker

“Map”

M<k,v>

M<k,v>

M<k.v>

M<“the quick brown”.”e”>M<“fox jumps over”.”e”>M<“the lazy dog”.”e”>

How many ”e”’s in“The quick brown fox jumps over the

lazy dog”?


MasterClientResul

t

Worker

Worker

Worker

“Reduce”

L<k,v>

L<k,v>

L<k,v>

L<”e”,”1”>L<”e”,”1”>L<”e”,”1”>

3 x ”e”s found

And it’s definitely popular...


Google20pb of data analyzed every day using

MapReduce

Yahoo!10k+ cores, 4pb of data using MapReduce

Facebook2500+ cores, 1pb of data using MapReduce

Frameworks


Apache HadoopOpen Source Java “Inspired by MapReduce”

(Core, HDFS, many more)

ClouderaConsulting, training, distribution of Hadoop

Amazon Elastic MapReduceHadoop implementation on EC2



MasterClient

Data

Worker

Worker

Worker

Data

Data

DataClient ApplicationJob/Task Scheduler

Remote Service

Sockets


How about implementing this on Windows Azure?


Web RoleClient

Data

Worker

Worker

Worker

Data

Data

DataClient ApplicationJob/Task Scheduler

Remote Service

Queue

Req

Table


Learn about existing frameworks, especially Apache HadoopRead up on Dryad (DryadLINQ) for future direction

MapReduce very visible, although can be difficult to initially grasp


#4 - Using the Cloud for Storage

“The cloud lets me store infinite data, right?”


Lots of headaches with data management today


“It sounds too good to be true…”


How does Jim do this today on premises?


File ServerClientRPC/NFSFile

Store



DB ServerClient RDBMS

TDS (Tabular Data Stream)Data



Web ServerBrowser Datab

ase

HTTP POSTData



Server Data

Affinity between your data and physical hardware that serves it

I love you!

I love you too!


Server Data

I love you!

I love you too!

Symptoms:Which RAID number was that again?

Tedious to backup exponentially growing dataCrap! I’m at 95% capacity - got to move to a bigger

disk

How does the cloud help?

Breaks the affinity between your data and hardware

Blobs, Tables, Relational



Client Azure Blob Storage

REST API

PutBlob PUT http://account.blob.core.windows./net/containername/blobname

Blob Container

http://account.blob.core.windows.net/containername/blobname

PutBlob = 64Mb MAXMetaData = 8Kb per Blob



REST API

GetBlob GET http://account.blob.core.windows./net/containername/blobname

Blob Container




REST API

GetBlob GET http://account.blob.core.windows./net/containername/blobnameRange: bytes=329300 - 730000

Blob Container




REST API

PutBlock(blobname, blockid, data)PutBlockList(blobname, blockid1, …, blockidN)

Blob Container


PutBlock = 4Mb MAX to a maximum of 50GbBlockId = 64 bytes



Worker Role

AzureTable

Storage

Each Table:

PartitionKey (e.g. DocumentName) to ensure scalabilityRowKey (e.g. version number)[fields] for data

http://account.table.core.windows.net

REST: GET http://account.table.core.windows.net/Customer?$filter=%20PartitionKey%20eq%20value LINQ:var customers = from o in context.CreateQuery<customer>(“Customer”) where o.PartitionKey == value select o;


Codename Sitka (early 2008)

SQL Server Data Services (MIX08)



TDSData

This is what I’m doing on premises...



TDSData

So, this is what I would like to do in the cloud...

SQL Data Services (MIX09)

SQL Azure (July 2009)


SQL AzureClient RDBMS

TDSData

So, this is what I would like to do...


SQL AzureBrowser RDBMS

TDSWeb Role

HTTP



TDSWeb Role

HTTP Worker Role

Queue

Migration!


Browser RDBMSWeb Tier

HTTPBus. Logic

“The Data Center”

SQL Server

TDS



TDSWeb Role

HTTP Worker Role

Queue

“The Cloud”


Understand the pricing model for storage on-premises vs. cloudSQL Azure as a factor for migration/move from on premises

Storage in the cloud may look the same, but breaks the affinity issue


#5 - Using the Cloud for Communications

Jim’s organization needs to communicate with other organizations


“This has always been a very tricky and expensive process to get working”


“Does the cloud offer anything to help?”


How would Jim have done this before?


Client Server

Company 1 Company 2Telco provided WAN

FTPClient

FTPServer


Client Server


FTPClient

FTPServer

Internet


Client Server


Browser

Internet

ExtranetSite

DMZ

What does the cloud provide?


ClientREST

Azure Queue

http://app.queue.core.windows.net/


Client

RESTAzure Queue


Client

Company 1

Company 2


Client

RESTAzure Queue


Client

Company 1

Company 2 x


Client

RESTAzure Queue


Client

Company 1

Company 2

Primary Access Key

Primary Access Key


Client

RESTAzure Queue


Client

Company 1

Company 2Web Role


Client

RESTAzure Queue


Client

Company 1

Company 2Web Role

Firewall

Firewall

Proxy?


Client

RESTAzure Queue


Client

Company 1

Company 2Web Role

Firewall

Firewall

NAT?

65.55.33.204

192.168.14.100


Client

RESTAzure Queue


Client

Company 1

Company 2Web Role

Firewall

Firewall

65.55.33.204

192.168.14.100OK, so I’ll do a

HTTP poll every minute


Client

RESTAzure Queue


Client

Company 1

Company 2Web Role

Firewall

Firewall

65.55.33.204

192.168.14.100…and how about other

protocols other than HTTP?

How does the Service Bus help?


Client

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Two modes: TCP Relay and Message Buffer



Client

Outbound bi-directional socketKept alive in background

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall


Client


Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

FirewallOutbound one-way socket

Message routedaccordingly


My Laptop


Service Bus

sb://.../myqueue

Home PC

This Conference

My Home

Firewall

FirewallOutbound one-way socket

Message routedaccordingly

192.168.14.193

SQL Express

Port 1433

Localhost:1000

Application



Client

Consumer defines and createsa Message Buffer

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST


Client

Producer sends messages tothe Message Buffer

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST

Firewall


Client

Consumer picks up these messages(retrieve, peek, lock)

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST

Firewall


Firewalls/NATs can add additional trouble (especially non-HTTP)Learn how Service Bus traverses in these scenarios

Be careful consuming Azure queues directly via REST


Putting the Patterns Together

We’ve covered 5 patterns, but Jim has one last question…


Are there cases where these patterns work together?



PHP

Let’s build an application in

PHP that scales to many nodes…

Windows Azure

http://primephp.cloudapp.net/


PHP

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Windows AzureUse the principles of

multi tenancy to create a version

of the application across multiple

vendors

(10 nodes)

(5 nodes using ELB)

http://primegae.appspot.com/

http://default-484648132.us-east-1.elb.amazonaws.com/

http://primephp.cloudapp.net/


PHP

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Job

Job

Job

Client

Windows Azure

Compute results with a

MapReduce-like way of

distributing work across all of

these applications


PHP

SQL Azure

Database

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Job

Job

Job

Client

Windows AzureStore the

results in a SQL Azure database


PHP

SQL Azure

Database

.NET Service Bus

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Job

Job

Job

Client

Windows Azure

Coordinate communicatio

n through the .NET

Service Bus


PHP

SQL Azure

Database

.NET Service Bus

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Job

Job

Job

Client

Windows Azure

Next Steps

Obviously, our friend Jim, is fake…

Next Steps

Next Steps

Build on the sessions that you’ve learned

Explore the 5 usage patterns for your scenarios today

Think about the next steps for implementation

Documents

Patterns for Cloud Computing