Getting Your Nerd on with Microsoft’s Cloud data servicesScott KleinTechnical EvangelistMicrosoft Corporation

Get in touch

www.scottLklein.com

scottkl@microsoft.com@sqlscott

SaaSPhysical Virtual

A Continuous Offering From Private To

Public Cloud

IaaS PaaS

Agenda• Windows Azure SQL Database

• Architecture• Application Connectivity• Scalability

• Windows Azure Table Storage• Architecture• Querying

• Best Practices and Considerations• Cost• Transactions

Windows Azure SQL Database

How It WorksArchitectureClient Layer - Used by application to communicate directly with SQL Database.Services Layer – Gateway between Client layer and Platform layer.Platform Layer – Includes physical servicers and services that support the Services layer.Infrastructure Layer – IT administration of the physical HW and OS.

Infrastructure Layer

PHP WCF Data Services

SQL ServerApplications

and Tools

ODBC ADO.NETTabular Data Stream (TDS)

Client Layer

Services Layer

Provisioning

Billing and Metering

Connection Routing

Provisioning

Billing and Metering

Connection Routing

Provisioning

Billing and Metering

Connection Routing

…

…

…

TDS+SSL

Platform Layer

SQL Server

SQL Database

FabricManagemen

t Services

SQL Server

SQL Database

FabricManagemen

t Services

SQL Server

SQL Database

FabricManagemen

t Services

…

…

…

Application ConnectivityConsiderations And Best Practices1. login: [login]@[server]2. Idle connections3. Long running transactions4. DoS guard5. Failover events6. Throttling7. Connection pooling and Retry logic8. Latency introduced for updates9. No cross-database dependencies

Scalability Model For The CloudCloud ApplicationsRequire Scale Beyond Scale-UpDemand the Best Economics

Best Price/PerformanceElasticity + Pay-as-you-go

ChallengesDefining the TenantEstablishing Tenant’s surrogate keyEstablish Sharding Strategy (Range / Point)Elastic Scalability (Splits/Merges/Tenant Moving)Application Lifecycle Management (Dev; Test; Deploy; Upgrades)Overcoming limitations of existing tools & available featuresTransient nature of connectivity

SQL Database

Demo Time!

Windows Azure Tables

Azure Storage Architecture

Table Storage ConceptsEntityTableAccount

contoso

Name =…Email = …

Name =…EMailAdd=

customers

Photo ID =…Date =…

photos

Photo ID =…Date =…

Table Details

InsertUpdate Merge – Partial updateReplace – Update entire entityUpsertDeleteQueryEntity Group TransactionsMultiple CUD Operations in a single atomic transaction

Create, Query, DeleteTables can have metadata

Not an RDBMS! Table

Entities

No Fixed Schema

FIRST LAST BIRTHDATE

Wade Wegner 2/2/1981

Nathan Totten 3/15/1965

Nick Harris May 1, 1976

FAV SPORT

Canoeing

Querying

FIRST LAST BIRTHDATE

Wade Wegner 2/2/1981

Nathan Totten 3/15/1965

Nick Harris May 1, 1976

?$filter=Last eq ‘Wegner’

Purpose of the PartitionKeyEntity LocalityEntities in the same partition will be stored togetherEfficient querying and cache localityEndeavour to include partition key in all queries

Entity Group TransactionsAtomic multiple Insert/Update/Delete in same partition in a single transaction

Table ScalabilityTarget throughput – 20,000 tps/partition, several thousand tps/accountWindows Azure monitors the usage patterns of partitionsAutomatically load balance partitionsEach partition can be served by a different storage nodeScale to meet the traffic needs of your table

PARTITIONKEY(CATEGORY)

ROWKEY(TITLE) TIMESTAMP MODELYEAR

Bikes Super Duper Cycle … 2009

Bikes Quick Cycle 200 Deluxe … 2007

… … … …Canoes Whitewater … 2009Canoes Flatwater … 2006PARTITIONKEY(CATEGORY)

ROWKEY(TITLE) TIMESTAMP MODELYEAR

Rafts 14ft Super Tourer … 1999

… … … …

Skis Fabrikam Back Trackers … 2009

… … … …Tents Super Palace … 2008

PARTITIONKEY(CATEGORY)

ROWKEY(TITLE) TIMESTAMP MODELYEAR

Bikes Super Duper Cycle … 2009

Bikes Quick Cycle 200 Deluxe … 2007

… … … …Canoes Whitewater … 2009Canoes Flatwater … 2006Rafts 14ft Super Tourer … 1999… … … …

Skis Fabrikam Back Trackers … 2009

… … … …Tents Super Palace … 2008

Partitions and Partition Ranges

Server ATable = Products

Server BTable = Products

[Canoes - MaxKey)

Server ATable = Products

[MinKey - Canoes)

Windows Azure Tables

Demo Time!

Cool StuffAzure Office Hours (benkotips.com/OfficeHrs)

Live Call-in Radio Show for Developers

Thank You

© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.