SQL Server and SQL Azure Hand-in-Hand: When and How to Extend Your Database to the Cloud?

SQL Server and SQL Azure Hand-in-Hand:When and How to Extend Your Database to the Cloud?

Tara Seppa, CEE Application Platform Product Manager, Microsoft

Luka Debeljak, CEE Windows Azure Product Manager, Microsoft

• Microsoft‘s Journey to the Cloud• SQL Server 2008 R2: What is it all about?• SQL Azure: Database in the Cloud• Key Scenarios For Extending Your Database to the Cloud

– Extending SQL Server to the cloud:• SQL Data Synch, Moving your data to the Cloud• Virtual Network Functionality and Integration• Global availability and backup of your data

– Business Inteligence Integration• SQL Reporting On Premise and in the Cloud• What is PowerPivot all about?

– Scaling Up vs Scaling Out: SQL Server vs SQL Azure• Summary

Agenda

Challenges Facing Today‘s IT

• Too much focus on the basic management tasks

• IT acts as a bottleneck: unable to respond to business requests in a timely manner

• „Shadow IT“ increases IT management costs and puts the companies at risk

Cloud Impact

REDUCED MANAGEMENT

NEW ECONOMICS

INCREASED OPPORTUNITIES

Pay for what you useLower and predictable costsShift from capex and opexAccelerate speed to value

No patching, maintenanceFaster deploymentRobust multi-layered securityReliability and fault-tolerance

Latest software for usersInternet collaboration Anywhere accessInstant self-provisioning

IT as a ServiceINFRASTRUCTURE

A S A S E R V I C E

PLATFORMA S A S E R V I C E

SOFTWAREA S A S E R V I C E

CUSTOMER &PARTNER APPS

Run Your Business, Not Your Infrastructure

On Premises

Cloud

PC, Phone, Browser

Infrastructure

Database

Middle Tier

Applications

NetworkingVirtualization

Identity & AccessSecurity

Reporting& AnalysisData

WarehousingTransaction Processing

WorkflowApplication

ServerEnterprise Integration

WebCustom

Packaged Composite

Apps

MANAGEMENT TOOLS

ALM and TOOLS

Your business applications

Running on the Microsoft Application Platform

Accessed by any client

On premises or in the cloud

Managed by the same tools

One developer experience

The Microsoft Application Platform

On Premises

PC, Phone, Browser

On Premises

Cloud

PC, Phone, Browser

In The Cloud

Managed Self-Service BI

Multi-Server Management

Virtualization & Live Migration

Scalable relational database platform

Consistent, familiar model & tools

Self-managed, highly available cloud services

The Data Platform





Agenda

What’s New in SQL Server 2008 R2

• Business Intelligence:– Managed Self-Service Business Intelligence– PowerPivot for SharePoint (Project Gemini)

• VertiPack• VertiScan

– Data Visualizations in Reporting Services• Other Feature Areas:– Master Data Services– Stream Insight– Multi-server Management

Analyzing Massive Data Volumes in ExcelWith a few mouse clicks, a user can create and publish intuitive and interactive self-service

analysis solutions.

PowerPivot for Excel PowerPivot for SharePoint

Managed Self-Service BI with PowerPivot

Master Data Management

VERSIONING

WORKFLOW APPROVAL

ROLE SECURITY

HIERARCHY MGMT

CRM

HR DocERP Asset Mgmt

Purchasing DB

MSFT CEP Engine

APPLICATION

Input Adapters

EVENT SOURCES

Devices, Sensors

Web servers

Event stores & Databases

Stock tickers & News feeds

Output Adapters

EVENT TARGETS

Event stores & Databases

Pagers & Monitoring

devices

KPI Dashboards, SharePoint UI

Trading stations

StreamInsight

Platform from Microsoft for continuous and incremental processing of event streams from multiple sources based on declarative query and pattern specifications with low latency

Agenda





ComputeVMRole, Admin

Access

Storage Management Relational data ConnectivityCaching

Access controlCDN

Introducing the Windows Azure PlatformThe Windows Azure platform is an internet-scale cloud services platform, hosted in Microsoft data centers around the world, that provides a simple, reliable, and powerful platform for creating web applications and services.

Data Sync

Developer ExperienceUse existing skills and tools.

Reporting

Data and Storage Options in Azure

Relational Database

Structured Storage

Unstructured Storage

NTFS Drive

Asynchronous Service Communication

SQL Azure

Windows Azure Tables

Windows Azure Blobs

Windows Azure Queues

Windows Azure Drive

Elastic Scale Developer Agility

Self-managed

Easy provisioning and deployment

Auto High availability and fault tolerant

Self-managing and self-healing

Database as a utility with pay as you grow scaling

Rely on Business-ready SLAs

Enable multi-tenant solutions

Manage multiple servers

Build cloud-based database solutions on a familiar relational model

Build on existing developer skills and familiar Transact-SQL syntax

Explore new data application patterns

Microsoft SQL Azure Benefits

Extending SQL Server to the Cloud

Symmetry with Traditional RDBMSFamiliar T-SQL relational model

Support existing code libraries and protocolsEcosystem of familiar development and management tools

Distributed “scale-out” database serviceAbstracts OS and hardware managementLow-friction provisioning, multi-tenantAutomatic high-availability and data replicationPay-as-you-go and commitment offers

Enterprise-class “scale-up” data platformMultiple hardware platforms and deployment optionsDeploy as dedicated server in customer datacenter, VM or 3rd partyTypically licensed per-server or per processor

Provisioning Model

Account

Server

Database

Each account has zero or more servers

Establishes a billing instrument

Each server has one or more databases

Logical concept equal to a master DBUnit of authentication, geo-location, billing, reportingGenerated DNS-based name

Each database has standard SQL objects

Users, Tables, Views, Indices, etcUnit of consistency

Architecture• SQL Server 2008 as core DB engine• Shared infrastructure at SQL database and below

– Request routing, security and isolation• Scalable HA technology provides the glue

– Automatic replication and failover• Provisioning, metering and billing infrastructure

Provisioning (databases, accounts, roles, …), Metering, and Billing

Machine 5SQL Instance

SQL DBUserDB1

UserDB2

UserDB3

UserDB4


SQL DBUserDB1

UserDB2

UserDB3

UserDB4


SQL DBUserDB1

UserDB2

UserDB3

UserDB4

Scalability and Availability: Fabric, Failover, Replication, and Load balancing

DEMOWindows Azure Portal & Solution





Agenda

SQL Azure

Cloud Hub Data

Collaboration

Business Inteligence

Software as a Service

Departmental Applications

Scale-out Enterprise

Applications

SQL Azure Scenarios

Cloud Hub – Data Collaboration

Extending Reach of data assets to facilitate greater collaboration between partners, branch officers, remote workers and mobile

devices. Challenges Today• Extending data trapped within firewalls to partners and branch offices• Extending reach of data to new devices and applications• Organizational silos resulting in multiple copies of data • Consolidating and streamlining data for multi-party collaboration

SQL Azure Benefits• Secure and easy extension or consolidation of data into

cloud• Ability to expose data from SQL Azure with existing

frameworks• Data Sync keeps on-premises and cloud database

synchronizedScenario Cases• B2B Supply/Value chain collaboration

using information hub• Easy data sharing to public and

partners• Mobile applications and remote workers

accessing data that is extended to the cloud

“Today, an end-to-end special order takes 15 seconds instead of 15 minutes, thanks to Windows Azure, SQL Azure, and the Virtual Inventory Cloud from GCommerce.”

Steven SmithPresident and Chief Executive OfficerGCommerce

GCommerce

SQL Azure

Scale-out Enterprise Applications

Applications which use relational database in the cloud to benefit from easy provisioning and management, scale and reduced TCO

Challenges Today• Efficiently utilizing resources for predictable

business patterns• Difficult to roll out extra capacity quickly• Enable new solutions at scale without additional

investmentSQL Azure Benefits• Fully managed, highly scalable, cloud-

based relational database as a service with pay as you go model

• Built-in high availability, fault tolerance and automated management (no VMs)

• Ability to handle spikes in demand and scale up or scale down on demand

Scenarios• Enterprise building scalable web

application in cloud to benefit from greater flexibility.

• Enterprise uses cloud database to handle unpredictable variations in demand

Kelly Blue BookUsing Windows Azure …. we will see $100,000 in savings each year—a number that will increase because we would normally continue to add servers to that data center as we grow. Andy LapinDirector of Enterprise Architecture, Kelley Blue Book

Departmental ApplicationsStreamline resources by consolidating existing departmental databases in

the cloud and/or quickly provision databases in the cloud to meet departmental needs

Challenges Today• Data loss or compliance concerns due to data scattered across organization• Lack of agility in provisioning databases for departmental needs

SQL Azure Benefits• Self –managing, highly scalable relational database as a service built on

SQL Server technology• Easy web-based provisioning and fully automated relational database as

a service• Ability to connect from existing Access front-end applications to data

stored in SQL Azure• Familiar programming model and tools to build, migrate and manage

databases.Scenario Cases• Migration/consolidation of data into a more

managed cloud environment.• Allowing central IT to “upsize” data into

more managed scalable cloud databases.• Departmental applications created to be

quickly and efficiently provisioned.

KRAFT

Kraft Foods evaluated options for flexible spend management of 350 departmental application portfolio based on usage.

Software-as-a-Service (SaaS applications)

Expand business opportunities and reach new markets by building SaaS applications quickly and efficiently

Challenges Today• Geo-expansion and reaching new markets faster• Monetizing IP more effectively and expanding reach• Reliably and efficiently scaling to meet customer and business needs• Flexibility to pay as you grow without large upfront hardware investments

SQL Azure Benefits• Create multi-tenant service with easy scale up and scale down• Self-managed, highly available and fault tolerant service with a pay-as-you-go model• Familiar programming model and tools

Scenario Cases• Enhancing traditional on-premises

deployments.• Building multi-tenant offering to scale and

compete with more options to customers.• Enabling solutions to provide more options

to customers and partners for different needs and deployment.

ESRI

“By freeing customers from having to make large hardware, software, and staffing investments up front, we’re helping lower the cost of GIS entry and increase the return on investment.” Arthur HaddadDevelopment Lead and Architect, ESRI

Business IntelligenceDeveloping solutions providing new insight into business performance and

processes through integration with existing data and/or 3rd party private and public data with familiar tools

Customer Challenges• Quickly building solutions that enable analysis of internal and

external information.• Integrate 3rd party data to provider deeper and richer

analysis in a seamless manner.

SQL Azure Benefits• Native data connectivity from SQL Azure to Office.• Ability to combine data in SQL Azure with third party

Scenario Cases• An enterprise using data in SQL Azure and

integrating with on-premises tools.• Multi-party solution provides opportunity

for end-to-end visibility and analysis.• Enterprise leveraging SQL Azure BI to

create reports and perform analysis over their data

GCommerce“SQL Azure is a perfect solution for housing inventory data, in contrast with a traditional data warehouse model. We can post data to a common repository that has huge scalability and redundancy.” Jason PopillionChief Technology OfficerGCommerce

Database Migration to the Cloud

• SQL Azure Data Sync Tool for SQL Server• SQL Server Migration Assistant

– Moving any database to SQL Azure– SQL Server 200x, MySQL, Oracle, Access

• SQL Server 2008 R2– Management Studio: Generate Script Wizard– Integration Services

• Data-Tier Application Component (DAC) Packages– „MSI for you database“– SQL Azure supports deployment of DACs– Supported in Visual Studio 2010

• SQL Server Migration Wizard – Available on CodePlex Portal

• …. Other 3rd party tools i.e. DBbest

DEMODatabase Migration Tools

CREATE DATABASE efg.prod2clone AS COPY OF xyz.prod2 CREATE DATABASE abc.prod2clone AS COPY OF xyz.prod2 CREATE DATABASE xyz.prod2clone AS COPY OF xyz.prod2

South Central US

abc.database.windows.net Dev1Maste

r

xyz.database.windows.net

prod1Master

prod2cloneprod2copy

prod2cloneprod2copy

North Europe

efg.database.windows.net

DR1 Master

prod2cloneprod2copy

Database Copy

Prod2

SQL Azure Data Sync

• Features:– Synchronization of data spanning

on-premises with cloud and mobile scenarios

– Manageability of data movement providing fine grained scheduling of data exchange

– Data sub-setting allowing control of tables to be synchronized

• Core scenarios:– Sync SQL Azure instances– Sync SQL Server to SQL Azure– Sync offline apps to SQL Azure– Enable geo-replication of data

On-Premis

es

Cloud Offline Clients

SQL Azure Data Sync – V1 Overview

On-Premises (Headquarters)

Sync

Sync

Remote OfficesData Sync Service For SQL AzureRetail

Stores

Sync Sync

Sync

SQL Azure

Database

Sync Sync CTP1

CTP2

DEMOSQL Azure Data Sync

Windows Azure Connect

• Secure network connectivity between on-premises and cloud– Supports standard IP protocols

• Enables hybrid apps access to on-premises servers

• Allows remote administration of Windows Azure apps

• Simple setup and management– Integrated with WA Service Model– Web, Worker and VM Roles

supported Enterprise

Windows Azure





Agenda

Business Intelligence as a ServiceEnabling intelligence from on-premise to the cloud

• Coming soon• Reporting Services (CTP

2010) • Future

• Analysis Services• Integration Services• Data cleansing service

SQL Server Integration Services

(SSIS)SQL Server Reporting Services (SSRS)

SQL Server Analysis Services

(SSAS)

• Native data connectivity from SQL Azure to Office

• Ability to combine data in SQL Azure with third party

DEMOSQL Azure and PowerPivotProject „Crescent“





Agenda

Enterprise-level security, scalability

High-scale, complex event processing

Data consistency across heterogeneous systems

MPP support for 10s-100s TB DW

Highly scalable appliancesSeamless BI Integration

Scalable relational database platformConsistent, familiar model & tools

Self-managed, highly available cloud service

TRUSTED, SCALABLE PLATFORM

IT & DEVELOPER EFFICIENCY

MANAGED SELF-SERVICE BI

Multi-server managementVirtualization & Live Migration

Accelerated development& deployment

Self-service analyticsSelf-service reporting

Streamlined collaboration& management

COMPREHENSIVE PLATFORM FOR IT VALUE

SQL Server 2008 R2

Documents

SQL Server and SQL Azure Hand-in-Hand: When and How to Extend Your Database to the Cloud?