Cloud Computing: SQL Data Services

Christophe Codourey Consultant BI

Urs MeierPrincipal Consultant

Technology competence Oracle, Microsoft, IBM, Open Source

BusinessIntelligence

Business

Communication

App

licat

ion

Dev

elop

men

tManagedServices

Existing IT customer

infrastructure

Training

Trivadis Facts & FiguresCurrently 13 locations with over 540 employees

Baden, Basel, Bern, Brugg, Lausanne, Zurich Düsseldorf, Frankfurt, Freiburg, Hamburg, Munich, Stuttgart Vienna

Since January 2008, the Trivadis Group has a qualified majority of shares in MIK AG, based in Brugg

Financially independent and sustainably profitable

Key figures in 2008Consolidated incomeCHF 108 million / EUR 68 millionServices for more than 650 clients in over 1‘600 projectsOver 150 Service Level AgreementsMore than 5'000 training participants per year Research budget: CHF 6.0 million / EUR 3.6 million

Agenda

Azure Overview

SQL Data Services (SDS)

SQL Server ↔ SDS Compatibility

SDS Client Applications

Visual Studio & .NET

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

• Designed to be: “File System in the cloud” • lowest cost efficient solution for simple

data storage and retrieval in the cloud • can store

• Queues• Blobs• ISAM style, simple Tables

(non-relational)

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

Database Data Sync Reference Data

ETL Data Mining Reporting

SDS for the past year

Storage

SQL, Tablesand Rows

T/SQL via TDS

Authority, Container,

Entity

SOAP/REST

Simple Tables, Blobs,

Queues

SOAP/RESTMassive

ArchitecuralChange Key-Value DB

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

The New SQL Data Services

Familiar SQL Server relational modelUses existing APIs & toolsBuilt for the Cloud with availability and scaleAccessible to all from PHP, Ruby, and Java

Clear Feedback: “I want a database in the Cloud”

Your Apps

Tabular Data Stream(TDS)

SQL Data Services

TDS Endpoint

ADO.NET

Entity Framework

SQL Server Drivers

Authority, Container,

Entity

SOAP/REST

From CTP 1 to now

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

SOAP/REST

Data Services

T/SQL via TDS T/SQL via TDS

Database Choices

Low-cost and zero friction addresses web/dept workloads

Target is 3 to 10 GB Databases

High compatibility with existing SQL Server offering

Reso

urc

es

Dedicated

Shared

Low High“Friction”/Control

SDS (RDBMS)

Value Props:

Auto HA, Fault-ToleranceFriction-free scaleSelf-provisioningHigh compatibility

Virtual DB server Logical user database

(LDB) Resource governance @

LDB Security @ LDB

Value Props:

XSPs, Server OpsSQL CLR100% compatibility

Roll-your-own HA/DR/scale

Hosted Hosted SQL Server or

other Resource governance @

VM Security @ DB Server/OS

On-premise SQL Server or other s/w on-

premise Resource governance @ machine Security @ DB Server/OS

Value Props:Full h/w control –

size/scale100% compatibilityRoll-your-own

HA/DR/scale

Database

Server

Service Provisioning ModelEach account has

a billing relationship with Microsoftowns one or more virtual servers

Each server has one or more databases including virtual mastereach database limited in size one or more logins

Each database has one or more SQL users

Account

Server

DatabaseServer=server1.data.database.windows.netDatabase=testDBLogin=JeanDupont[@server1] (maps to

testuser)

SQL Server vs. SQL Data Services • Master

• AdventureWorks• Northwind• Pubs

• Master

• Pubs• Northwind

• Adventureworks

SQL Server(on premises)

• Master• AdventureWorks• Northwind• Pubs

SQL Data Services

Instances and Databases

One SQL Server instance per physical machineMultiple databases per instance

Randomly distributed by infrastructureRessource sharing

Scalable HA technologyAutomatic replication and failover

Provisioning, metering and billing infrastructure

Machine 5

SQL Instance

SQL DBs

DB5 DB1 DB3 DB2

Provisioning (databases, accounts, roles…), Metering, and Billing

Machine 6

SQL Instance

SQL DBs

DB1 DB6 DB2 DB3

Machine 4

SQL Instance

SQL DBs

DB3 DB4

Machine 7

SQL Instance

SQL DB

DB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load Balancing

Reading DataSelect * from Customer

Primary(for Customer)

New Primary(for Customer)

Writing DataUpdate CustomerSet Priority = 1

Primary(for Customer)

TDS GatewayFront-end Node

Protocol Parser

Gateway Logic

TDSSession

1

Front-end NodeProtocol Parser

Gateway LogicTDS

Session 2

Architecture

Master Cluster

Master Node

Data Node Components

Partition Manager

Master Node

Data Node Components

Partition Manager

1

2

4

5

6

7

8

Utility Layer

Account Database

Billing/Usage

Database

Service Platform

Monitoring

Load Balancing

NodeProvisionin

g

Roles

3

Machine 5

SQL Instance

SQL DB

DB5 DB1 DB3 DB2

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Machine 6

SQL Instance

SQL DB

DB1 DB6 DB2 DB3

Machine 4

SQL Instance

SQL DB

DB3 DB4

Machine 7

SQL Instance

SQL DB

DB4 DB5

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

Authority, Container,

Entity

SOAP/REST

SDS from now on

Storage

SQL, Tablesand Rows

SQL, Tablesand Rows

Simple Tables, Blobs,

Queues

SOAP/REST

• Existing KnowHow and Applications

• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon

T/SQL via TDS T/SQL via TDSidentical

?

Example of SQL CompatibilityIn Scope for v1 (likely)

Tables, indexes and viewsStored ProceduresTriggersConstraintsTable variables, session temp tables (#t)…

Out of Scope for v1 (likely)

Distributed Trans/QueryCLRService BrokerSpatialPhysical server or catalog DDL and viewsGlobal tables(##t)?Traditional Backup / Restore

Management Tools

API for provisioningWeb

SQL Server Management Studio (SSMS)

Basically available, but will have obviously some restrictions

e.g. no sp_configure

Standard Query Tools

Security Model

Uses regular SQL security modelAuthenticate logins, map to users and rolesAuthorize users and roles to SQL objects

Limited to standard SQL Auth loginsUsername + password

EncryptionTDS supports SSLNo database encryption at all in V1

TDE Encryption Functions

How Scalable is SDS?

Scalability comes at cost of consistency

ACID (Atomicity, Consistency, Isolation, Durability)

Write n nodes on Commit, read from max. n nodes

BASE (Basically available, soft state, eventually consistent)

Write n nodes on Commit synchronize more nodes laterRead on more than n nodes

SDS V1 Implements (a very) ACID model

Write 3 nodesRead 1 node

Scalability

Scale PerformanceLeader election

SDS fabric can switch the primary node for a database to a less busy node

SDS may throttle your session if it takes too much resourcesBYOP (bring your own partitioning)

Scale Size of DatabaseCurrent offering is targeted at departmental databasesBYOP (bring your own partitioning)

SDS Client Applications

Clients connect directly to a databaseCannot hop across DBs

Any database client library for SQL Server can be also used for SDS

ODBC, OLE DB, ADO.NET Provider for SQL Server

ADO.NET Entity FrameworkADO.NET Data Services (Astoria)

LINQ to SQL

PHP native SQL Client…

Cloud

SDS Client Apps

SDS Database

TDS + TSQL Model

Windows Azure ComputeREST

(Astoria)ADO.Net* +

EF

Browser

HT

TP

Application

SQL Client*TD

S

* Client access enabled using TDS for ODBC, ADO.Net, OLEDB, PHP-SQL, Ruby, …

Data

Cen

ter Web Srv

SQL Client*

HT

TP

+R

ES

T

Application

REST Client*

Web App

SQL Client*

HT

TP

+S

OA

P

Application

SOAP Client*

Tabular Data Stream (TDS)

“Code far” scenarioTDS is not designed for high latency networks

Recommendation Batch SQL statements Use Functions/Stored Procedures

Table valuein parametersare very handy

Microsoft Cloud Services

Azure™ Services Platform

Compute

Storage

Management

Database Data Sync Reference Data

ETL Data Mining Reporting

Extending SQL Data Platform to Cloud

SQL Data Services (SDS)Database-as-a-Service

Data SyncReference Data

Reporting

Business Intelligenc

e

Symmetric Programming Model Data Hub Aggregation

Initial services – core RDBMS capabilities as a service (SDS), Data Sync and Data HubFuture Offerings

Additional data platform capabilities as a service: BI/DSS, DWNew services: Reference Data, Secure Data Hub

Data Hub / Sync Services

On Premises Assets and Data

Mobile Users

SQL Services (Opportunities and Futures)

ScalabilityPartitioned databasesGeo-location and geo-redundancy

FlexibilityDistributed querySupport for multiple levels of hardware and software isolation

SecurityFuture AD FederationWLID, etc as alternate authentication protocolsEncryption

Release Plan

Invitation CTP – On-board invitation-only customers + some current

Public CTP – On-board all early adopters

Commercial Availability with Windows Azure in 2009

MIX ‘09

TechEd

InvitationCTP

Public CTP

Commercial Availability

Migration

Mar 09

May 09 Jul 09 Nov 09

Sep 09

Apr 09

Jun 09 Aug 09

Oct 09

PDC

InternalAdoption

Quick Wins with SDSHigh Availability

Including Data Hub ScenarioFast and easy Deployment

Ideally “Code near” scenario with Web apps

Well known programming modelLow learning curve

ReliabilityConfidence that data will not be lostReplication, back-up

Defined SLA, at which Cost (?)

Want to Know More?

Team Bloghttp://blogs.msdn.com/ssds

MSDN Development Centerhttp://msdn.microsoft.com/en-us/sqlserver/dataservices

Register @ the Azure start portalhttp://www.azure.com

Visitez notre stand et

participez au concours

Prix

Save the date for tech·days next year!

14 – 15 avril 2010, CICG

Classic Sponsoring Partners

Premium Sponsoring Partners