Patterns for Cloud Computing

Solution Architect Briefingzoli.herczeg.ro

Taken from Simon Guests’ work at TechEd Berlin 2009

This is Jim

Jim’s Boss (the CIO) has asked him to “move their company to the cloud!”

He’s seen many great things on cloud computing/Windows Azure

…but he’s still a little confused

He still doesn’t quite understand what types of applications make sense in the

He also wonders how other organizations are using the cloud

What patterns have other people learned – and can Jim re-use for his applications?

Session Objectives

Validate what you may have heard and seen so far

Provide you with 5 patterns for cloud-based applications

Show you how to implement these patterns using Windows

Where does my application live?

Application runs on-premises

Application runs at a hoster

Application runs using cloud

platform

“Packaged”Application

An application that I buy “off the shelf” and

run myself

“Home Built”Application

An application that I develop and run myself

Hosted “Home Built”

An application that I develop

myself, but run at a hoster

Hosted “Packaged”

An application that I buy “off the shelf” and then run at a

hosterCloud

Platform

An application that I develop

myself, that I run in the cloud

“Software as a Service”

A hosted application that I

buy from a vendor

Platform Services

Software Services

Application Services

Infrastructure Services

Microsoft Cloud ServicesCategories of Services

Pricing

Compute• $0.12 / CPU hour

Storage• $0.15 / GB / month• $0.01 / 10k txn /

month Bandwidth

• $0.10 in / GB• $0.15 out / GB

Web Edition (1GB)• $9.99 / month

Business Edition (10GB)• $99.99 / month

Bandwidth• $0.10 in / GB• $0.15 out / GB

Service Bus• $0.15 / 100k

messages Access Control

• $0.15 / 100k tokens Bandwidth

• $0.10 in / GB• $0.15 out / GB

SUBSCRIPTIONCONSUMPTION VOLUME LICENSING“Pay as you go and

grow”Available at launch

• Low barrier to entry and flexibility• Optimized for cloud elasticity

• Discounts for commitment• Plans for payment

predictability

“Coordinated purchasing”

Planned for FY11• Unified purchasing through EA• Introduction to volume

discounts

“Value for a commitment“

Select offers Announced

Offers & PromotionsDevelopment Accelerator Designed to accelerate cloud app development. Flexible (on/off) consumption for scaling. Predictable payment and discounted price.

•6 month subscription (38%-45% discount) •Offered as a unit (can order multiple units)•Cancel first 30 days; anytime after first 6 months•Overage at Standard Consumption rates

CORE ($59.95/month)Amount Included in BaseCompute 750 hrs/mo Storage 10 GB/mo Storage Transactions 1M/mo NET - Messages 1M/moData Transfers 7 GB In / 14 GB Out

EXTENDED ($109.95/month)Amount Included in BaseSame as Core except also includes 1 SQL Azure Business Edition DB (10 GB)

Introductory Free Offer No-cost developer starter offer. Provides no-cost allocation to run a cloud service.

•Available to all partner/customers•Limit of one per customer•Overage at Standard Consumption rates

NO-COSTWindows AzureCompute 25 Hrs/monthStorage 0.5 GB/monthBandwidth 0.5 GB/monthStorage Transactions 10K/month

SQL Azure1 Web Edition DB (1GB DB) 90 day trial

Service Bus and Access Control Service Messages 100K/mo

MSDN Premium Mobilize committed .NET developer base. Enable them to build, deploy, manage multiple cloud projects w/in MSDN subscription.

• Available to MSDN Premium subscribers with limit of one per subscription (one per Windows Live ID)• 12-month term• Overage at partner Consumption rates• Limited time to sign up (thru 6/30/10)• After 6/30/10 quantities may be reduced

NO-COSTWindows AzureCompute 750 hrs Storage 10 GBStorage Transaction 1M

SQL Azure - 3 Web DB (1 GB)

Service Bus and Access Control Service Messages 1 Million

Data Transfer 7GB In/14GB Out

Private(On-Premise)

Infrastructure

(as a Service)

Platform(as a

Service)

Types of Clouds

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Security & Integration

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

Storage

Server HW

Networking

Servers

Databases

Virtualization

Runtimes

Applications

anaged by vendor

Managed by vendor

#1 - Using the Cloud for Scale

“Isn’t the cloud good for applications that need to scale dynamically?”

For example, tax applications

“How does this work?”

Let’s do some white boarding for Jim…

…and when I say white boarding, I really mean it

Web TierBrowserRequest

B/L Tier DatabaseResponse

“Wow! What a great site!”

Web Tier B/L Tier Database

Browser

“Server Busy”

Web Tier B/L Tier Database

Browser

“Timeout”

Browser

How would Jim do this today on premises?

Web Tier B/L Tier Databa

seBrowser

Browser

Web Tier

Database

Browser

Web Tier B/L Tier

B/L Tier

Database

Browser

B/L Tier

Web Tier

Browser

B/L Tier

Database

p1 p2 p3

Web Tier

Not without consequences...

Browser

B/L Tier

Database

p1 p2 p3

Web Tier

“That took a lot of work - and money!”

Browser B/L Tier

B/L Tier

Database

p1 p2 p3

Web Tier

“Not so great now…”

“Hmmm... Most of this stuff is sitting idle...”

“That took a lot of work - and money!”

Jan Apr Jul Oct

Datacenter peak load

Idle time

How can Windows Azure help?

Web RoleBrowserRequest Worker

RoleAzure Storag

eResponse

“Wow! What a great site!”

Web Role Worker Role

AzureStorag

eBrowser

“Server Busy”

Browser

Web Role

Worker Role

AzureStorag

eBrowser

Browser

Web Role

You don’t see this bit

Web Role

AzureStorag

eBrowser

Browser

Web Role

Worker Role

OK, so changing config is easy...

…but what else do I need to know?

Web RoleBrowser

Browser

Web Role

AzureStorag

eWorker

Worker Role

Web RoleBrowser

Browser

Web Role

AzureStorag

eWorker

Worker Role

Tight coupling between web and worker role is an anti-

pattern

Req1. Place on queue 3. Pickup from queue

4. Process

2. Respond to UI

4. Process

5. Add result to table

6. Query table on refresh

How many web and worker roles do you need?

Web Role

Worker Role

AzureStorag

eBrowser

Browser

Web Role

Worker RoleLog

WMI_Win32_PerfFormattedData_ASPNET_ASPNETApplications/RequestsPerSecond

Management APIor Email

How many web and worker roles do you need?

Web Role

Monitor queuelength against

user’s expectations

Web Role

Worker Role

Web Role

Monitor queuelength against

user’s expectations

Web Role

Worker Role

Patterns for Cloud ComputingTakeaways

Understand how to communicate between Web and Worker roleStrategy on when to scale up/down roles in production

Using configuration, Azure makes it easy to scale roles

Patterns for Moving to the Cloud

#2 - Using the Cloud for Multi Tenancy

“I like the idea of scaling Web roles…”

“…but need to serve multiple customers”

“Without creating separate codebases!”

Web TierBrowser B/L Tier Database

Customer #1

Customer #2

Customer #1

Customer #3

Gets expensive pretty quickly

Browser

Customer #1

Customer #2

Customer #3

Schema Customizations

UI Customizations

3 options for data in multi tenant environment

Browser

Customer #1

Customer #2

Customer #3

Option 1: Everyone Uses the Same Database/Schema

Fixed Schema

Pros: Simplest approach, easy to maintain/upgrade.Cons: No customizations. Restoring of tenant data.

Web TierBrowser B/L Tier

DatabaseBrowser

Browser

Customer #1

Customer #2

Customer #3 Option 2: Give Each Customer Their Own

Database/Schema

Customer #1Database

Database

Customer #2

Customer #3

Pros: Flexible. Tenant restore is easier. High Isolation.Cons: Can be costly. Difficult to upgrade db schemas.

Browser

Customer #1

Customer #2

Customer #3

Option 3: Fixed Database/Schema, with customizations

Fixed Schemawith

Customizations

Pros: Customers can add their own custom fieldsCons: Non standard way of customizing the schema. Tenant restore is difficult.

TenantIDTenant

TenantNamenvarchar

EmployeeIdEmployee

FirstName nvarchar

LastName nvarchar

CustomizationID

Customizationint

Value nvarchar

TypeIDType

Name nvarchar

CLRType nvarchar

TenantIDTenant

TenantNameUK Branch

EmployeeIdEmployee

FirstName Gordon

LastName Brown

CustomizationID

Customization1

Value SW1A 2AA

TypeIDType

Name PostalCode

CLRType string

TenantIDTenant

TenantNameUS Branch

EmployeeIdEmployee

FirstName Barack

LastName Obama

CustomizationID

Customization2

Value 20500

TypeIDType

Name ZipCode

CLRType string

TenantIDTenant

TenantNameUS Branch

EmployeeIdEmployee

FirstName Barack

LastName Obama

CustomizationID

Customization2

Value 20500

TypeIDType

Name ZipCode

CLRType string

Fixed SchemaApplies to All

Tenants

CustomizableTenant by

Tenant Basis

Could be both

UI Customizations

Browser

Customer #1

Customer #2

Customer #3

URL Handling

Can ASP.NET MVC Help?

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk

http://hr.fabrikam.com

http://employeedata.cloudapp.net

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)

Browser

Customer #1

Customer #2

Customer #3

http://hr.contoso.co.uk -> CNAME (employeedata.cloudapp.net)

http://hr.fabrikam.com -> CNAME (employeedata.cloudapp.net)

Use custom routing in ASP.NET MVC

Design considerations must include both data and UI

Many other considerations, such as identity – p&p guidance

Always consider Multi Tenancy first, even if only one customer

#3 - Using the Cloud for Compute

Jim has seen how Azure enables multiple nodes

“Can I use all of these nodes in parallel?”

“I’ve got this complex calculation I would like to share across these multiple nodes…”

MasterClient

Worker

MasterClientResul

Worker

Result

Popularized by the term “MapReduce”*

* 2004 OSDI paper by Jeff Dean and Sanjay Ghemawat (Google)

MasterClient

Worker

“Map”

M<k,v>

M<k.v>

M<“the quick brown”.”e”>M<“fox jumps over”.”e”>M<“the lazy dog”.”e”>

How many ”e”’s in“The quick brown fox jumps over the

lazy dog”?

MasterClientResul

Worker

“Reduce”

L<k,v>

L<”e”,”1”>L<”e”,”1”>L<”e”,”1”>

3 x ”e”s found

And it’s definitely popular...

Google20pb of data analyzed every day using

MapReduce

Yahoo!10k+ cores, 4pb of data using MapReduce

Facebook2500+ cores, 1pb of data using MapReduce

Frameworks

Apache HadoopOpen Source Java “Inspired by MapReduce”

(Core, HDFS, many more)

ClouderaConsulting, training, distribution of Hadoop

Amazon Elastic MapReduceHadoop implementation on EC2

MasterClient

Worker

DataClient ApplicationJob/Task Scheduler

Remote Service

Sockets

How about implementing this on Windows Azure?

Web RoleClient

Worker

DataClient ApplicationJob/Task Scheduler

Remote Service

Learn about existing frameworks, especially Apache HadoopRead up on Dryad (DryadLINQ) for future direction

MapReduce very visible, although can be difficult to initially grasp

#4 - Using the Cloud for Storage

“The cloud lets me store infinite data, right?”

Lots of headaches with data management today

“It sounds too good to be true…”

How does Jim do this today on premises?

File ServerClientRPC/NFSFile

DB ServerClient RDBMS

TDS (Tabular Data Stream)Data

Web ServerBrowser Datab

HTTP POSTData

Server Data

Affinity between your data and physical hardware that serves it

I love you!

I love you too!

Server Data

I love you!

I love you too!

Symptoms:Which RAID number was that again?

Tedious to backup exponentially growing dataCrap! I’m at 95% capacity - got to move to a bigger

How does the cloud help?

Breaks the affinity between your data and hardware

Blobs, Tables, Relational

Client Azure Blob Storage

REST API

PutBlob PUT http://account.blob.core.windows./net/containername/blobname

Blob Container

http://account.blob.core.windows.net/containername/blobname

PutBlob = 64Mb MAXMetaData = 8Kb per Blob

REST API

GetBlob GET http://account.blob.core.windows./net/containername/blobname

Blob Container

REST API

GetBlob GET http://account.blob.core.windows./net/containername/blobnameRange: bytes=329300 - 730000

Blob Container

REST API

PutBlock(blobname, blockid, data)PutBlockList(blobname, blockid1, …, blockidN)

Blob Container

PutBlock = 4Mb MAX to a maximum of 50GbBlockId = 64 bytes

Worker Role

AzureTable

Storage

Each Table:

PartitionKey (e.g. DocumentName) to ensure scalabilityRowKey (e.g. version number)[fields] for data

http://account.table.core.windows.net

REST: GET http://account.table.core.windows.net/Customer?$filter=%20PartitionKey%20eq%20value LINQ:var customers = from o in context.CreateQuery<customer>(“Customer”) where o.PartitionKey == value select o;

Codename Sitka (early 2008)

SQL Server Data Services (MIX08)

TDSData

This is what I’m doing on premises...

TDSData

So, this is what I would like to do in the cloud...

SQL Data Services (MIX09)

SQL Azure (July 2009)

SQL AzureClient RDBMS

TDSData

So, this is what I would like to do...

SQL AzureBrowser RDBMS

TDSWeb Role

HTTP Worker Role

Migration!

Browser RDBMSWeb Tier

HTTPBus. Logic

“The Data Center”

SQL Server

TDSWeb Role

HTTP Worker Role

“The Cloud”

Understand the pricing model for storage on-premises vs. cloudSQL Azure as a factor for migration/move from on premises

Storage in the cloud may look the same, but breaks the affinity issue

#5 - Using the Cloud for Communications

Jim’s organization needs to communicate with other organizations

“This has always been a very tricky and expensive process to get working”

“Does the cloud offer anything to help?”

How would Jim have done this before?

Client Server

Company 1 Company 2Telco provided WAN

FTPClient

FTPServer

Client Server

FTPClient

FTPServer

Internet

Client Server

Browser

Internet

ExtranetSite

What does the cloud provide?

ClientREST

Azure Queue

http://app.queue.core.windows.net/

Client

RESTAzure Queue

Client

Company 1

Company 2

Client

RESTAzure Queue

Client

Company 1

Company 2 x

Client

RESTAzure Queue

Client

Company 1

Company 2

Primary Access Key

Client

RESTAzure Queue

Client

Company 1

Company 2Web Role

Client

RESTAzure Queue

Client

Company 1

Company 2Web Role

Firewall

Proxy?

Client

RESTAzure Queue

Client

Company 1

Company 2Web Role

Firewall

65.55.33.204

192.168.14.100

Client

RESTAzure Queue

Client

Company 1

Company 2Web Role

Firewall

65.55.33.204

192.168.14.100OK, so I’ll do a

HTTP poll every minute

Client

RESTAzure Queue

Client

Company 1

Company 2Web Role

Firewall

65.55.33.204

192.168.14.100…and how about other

protocols other than HTTP?

How does the Service Bus help?

Client

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Two modes: TCP Relay and Message Buffer

Client

Outbound bi-directional socketKept alive in background

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

Client

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

FirewallOutbound one-way socket

Message routedaccordingly

My Laptop

Service Bus

sb://.../myqueue

Home PC

This Conference

My Home

Firewall

FirewallOutbound one-way socket

Message routedaccordingly

192.168.14.193

SQL Express

Port 1433

Localhost:1000

Application

Two modes: TCP Relay and Message Buffer

Client

Consumer defines and createsa Message Buffer

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST

Client

Producer sends messages tothe Message Buffer

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST

Firewall

Client

Consumer picks up these messages(retrieve, peek, lock)

Service Bus

sb://.../myqueue

Client

Company 1

Company 2

Firewall

ATOMPub via REST

Firewall

Firewalls/NATs can add additional trouble (especially non-HTTP)Learn how Service Bus traverses in these scenarios

Be careful consuming Azure queues directly via REST

Putting the Patterns Together

We’ve covered 5 patterns, but Jim has one last question…

Are there cases where these patterns work together?

Let’s build an application in

PHP that scales to many nodes…

Windows Azure

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Windows AzureUse the principles of

multi tenancy to create a version

of the application across multiple

vendors

(10 nodes)

(5 nodes using ELB)

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Client

Windows Azure

Compute results with a

MapReduce-like way of

distributing work across all of

these applications

SQL Azure

Database

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Client

Windows AzureStore the

results in a SQL Azure database

SQL Azure

Database

.NET Service Bus

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Client

Windows Azure

Coordinate communicatio

n through the .NET

Service Bus

SQL Azure

Database

.NET Service Bus

Java Servlet

Google AppEngine

ASP.NETAmazon EC2

Client

Windows Azure

Next Steps

Obviously, our friend Jim, is fake…

Next Steps

Build on the sessions that you’ve learned

Explore the 5 usage patterns for your scenarios today

Think about the next steps for implementation

Patterns for Cloud Computing

Documents

Cloud computing 2016, Panel on CLOUD/SERVICES IoT & Cloud Computing … · 2016. 12. 25. · Cloud computing 2016, Panel on CLOUD/SERVICES IoT & Cloud Computing Standardization Challenges

VA Enterprise Design Patterns: Cloud Computing … Enterprise Design Patterns: Cloud Computing Microservices Office of Technology Strategies (TS) Architecture, Strategy, and Design

Cloud Computing Expositor: Andrius Morganti. Cloud Computing Cloud Computing Nube, Internet Abstracción de detalles Uso de TI Cloud computing = Computar

Cloud Computing Cloud Computing Overview of Distributed Computing

ARC206: Patterns for Cloud Computing

Cloud Computing Patterns @ OOP · PDF fileCloud Computing Patterns @ OOP 2017 ... -> Procurement processes have to reflect that a backend is not a car ... suppliers using a cloud for

INTRODUCTION TO CLOUD COMPUTING ggg UNDERSTANDING CLOUD COMPUTING UNDERSTANDING CLOUD COMPUTING DEFINITION CLOUD COMPUTING

Cloud Computing (depa) Cloud Computing (Cloud Computing Lab … · 2021. 2. 4. · Cloud Computing (depa) Cloud Computing (Cloud Computing Lab Test for Industry 4.0) (Lab Test) ånu

CLOUD COMPUTING. What is cloud computing ? History Virtualization Cloud Computing hardware Cloud Computing services Cloud Architecture Advantages & Disadvantages

Cloud computing patterns

Patterns For Cloud Computing David Gristwood Application Architect Microsoft @ScroffTheBad

Cloud Computing indigoo.com CLOUD COMPUTINGindigoo.com/dox/wsmw/1_Middleware/Cloud-Computing.pdf · Cloud Computing indigoo.com Cloud Cloud IaaS, PaaS, SaaS Cloud Cloud. Cloud Computing

· Cloud Computing Private Cloud Public Cloud (1) Cloud Computing Cloud Computing" Cloud Computing (1) Private Cloud (2) Public Cloud (Critical IT Outsourcing) (1) (2) 30 (2) Cloud

VA Enterprise Design Patterns: Cloud Computing Architecture · VA Enterprise Design Patterns: 6. Cloud ... An enterprise cloud computing architecture has the ... while continuing

Patterns para Windows Azure e Cloud Computing

Two patterns for cloud computing: Secure Virtual … · Two patterns for cloud computing: Secure Virtual Machine Image ... —Secure Virtual Machine Image Repository: Avoid the poisoning

Cloud Computing - ppgi.ci.ufpb.brppgi.ci.ufpb.br/wp-content/uploads/palestra-cloud-computing.pdf · Cloud computing is ... the user-friendly version of grid computing. _ Cloud computing

Patterns for Cloud Computing - IBM · PDF filePatterns for Cloud Computing 1 ... Patterns of expertise can be created from scratch, used as is, or personalized to fit your business

Cloud Computing Essentials · Cloud Computing Essentials ... gk3210

CLOUD COMPUTING. Contents Introduction to cloud computing. Three levels of cloud computing: Implementation of cloud computing Private cloud Public cloud