Fast Track & Project MadisonOverview

Doug LanmanData Warehousing SSPNorth Central, Midwest and Heartland DistrictsSQL Server Data Warehousing

Microsoft Confidential

Agenda

Fast Track OverviewThe Bridge to Madison – Hub & SpokeMadison OverviewMTP & TAP programsQuick StartSummary

The Appliance Model for Data Warehousing• Building a traditional

DW• Time consuming• Expensive• Performance varies• Scalability issues

Potential bottlenecks in standard DW architecture

• The DW appliance model• Pre-built & tuned h/w + s/w• Views entire stack holistically• Known performance &

scalability• Encapsulates best practices• Leverages Sequential I/O

Lower TCOFaster

deployment

Better performanc

e

Minimised DBA time

Benefits

A new offering to help Customers and Partners accelerate their Data Warehouse deployments.

What is SQL Server Fast TrackData Warehouse?

Seven new SMP Reference Architectures

Fast Track Data Warehouse Components

6<Session Name> Microsoft NDA-only

Software:• SQL Server 2008

Enterprise• Windows Server 2008

Hardware:• Tight specifications for

servers, storage and networking

• ‘Per core’ building block

Configuration guidelines:• Physical table

structures• Indexes• Compression• SQL Server settings• Windows Server

settings• Loading

SQL Server Fast Track Data Warehouse for HP

2 Processor ConfigurationServer: HP ProLiant DL385 G5p with 2 Quad-core AMD Opteron processorsStorage server: EMC or MSA StorageScalability: 4 – 8 TB

4 Processor ConfigurationServer: HP ProLiant DL 585 G5 with 4 Quad-core AMD Opteron processorsStorage server: EMC or MSA StorageScalability: 4 – 16 TB

8 Processor ConfigurationServer: HP ProLiant DL 785 G5 with 8 Quad-core AMD

Opteron processorsStorage server: EMC or MSA StorageScalability: 16 – 32 TB

• Note - Compression assumes 2.5:1

SQL Server Fast Track Data Warehouse for DELL

2 Processor ConfigurationServer: Dell Power Edge 2950 MLK with 2 Quad-core Intel Xeon processorsStorage server: EMC CX4-240Scalability: 4 – 8 TB

4 Processor ConfigurationServer: Dell Power Edge R900 with 4 6-core Intel Xeon processorsStorage server: EMC CX4-240Scalability: 12 – 24 TB

• Note - Compression assumes 2.5:1 - Fully loaded only adds drives to minimum HW required - Data space can be increased by using 450GB drives

Fast Track Benefits Summary

9<Session Name> Microsoft NDA-only

Appliance-like time to valueReduces DBA effort; fewer indexes, much higher level of sequential I/O

Choice of HW PlatformsDell, HP, Bull – more in future

Low TCO ThroughCommodity Hardware and value

pricing; Lower storage costs.

High ScaleNew reference architectures scale

up to 32 TB (assuming 2.5x compression)

Reduced RiskTested by Microsoft; better choice of hardware; application of Best

Practice

The Bridge to Project "Madison"

Fast Track offers appliance-like ease of deployment, scalability and performance for SMPMadison to offer massively parallel (MPP) scale and performanceMadison hub-and-spoke architecture includes support for SMP spokes

Madison Hub and Spoke Architecture –

Centralized Vs Decentralized Centralized EDW Model Is Challenged• Too Expensive & Inflexible• Complex ETL• Overwhelmed By Mixed Workload

Siloed Data Marts• Outgrow their platforms• No Centralized Management

Madison Enables Best Of Both Worlds , Hub and Spoke

Data Source

DM1 DM2 DM3 DM4

Data Source

Data SourceData

Source

Data Sourc

e

Data Sourc

e

EnterpriseData Warehouse

Madison and Fast Track Hub and Spoke

12<Session Name> Microsoft NDA-only

Central EDW Hub

Regional Reporting

Departmental Reporting

ETL Tools

High Performance HQ

Reporting

Microsoft Confidential

Benefits of Hub-And-Spoke

All systems connect via a dedicated high speed networkParallel database copy – speeds of up to 500 GB per minSimplify data mart ETL / ELT processes with publishing modelSeparate management and user workloadsIntegrate SMP SS08 and MPP systemsIndependently expand any systemAdd spokes without impacting other usersDeploy development and test environments that leverage parallel connectivity

MPP (Madison) Overview

INDUSTRY STANDARDNETWORKING

INDUSTRY STANDARDSERVERS

Reference Hardware Platforms

ProjectMadison

INDUSTRY STANDARDSTORAGE

Madison Node

Database Server Storage Server

Madison ArchitectureDatabase Servers

Du

al

Infi

nib

an

d

Control Nodes

Active / Passive

Landing Zone

Backup Node

Storage Servers

Spare Database Server

Du

al

Fib

er

Ch

an

nel

The DemoQuery

No cheating (cache flushed)Inner joins

Results625K rows returned in 11 seconds from 1 trillion row table Final product will be even faster!

ReportRetailer: day-part analysis(Sales+Time+Date+Prod type)

Madison Beta Programs

Two ProgramsMTP – Madison Technology Preview

20 – 30 participantsDuration of 4 to 6 weeks

TAP – Beta production implementation6 – 8 customersFirst iteration 9 to 12 weeks

RequirementsFocus on EDW and large data martsMigration projects, not green fieldOpen to customers & prospects30+ TB of data…at least 4 100+ TB

Microsoft Commitment

MTPHigh touch SupportMS or partner will provide HW and will host the MTPCustomer may have opportunity to engage with TAPMS will work with customer to define scope and success criteriaMS will perform the bulk of MTP work (2 -3 resources)

TAPCustomer must procure the Madison reference architecture and conduct the TAP in their own data centerPremier support will be providedServices will be provided (2 -3 resources)Training / mentoring will be providedMS will work with customer to define scope and success criteria

Customer Commitment

MTPCustomer to provide data, queries, concurrency model, existing data model, etc.Customer to provide SME and DBA to answer questions of MTP teamCustomer to provide existing benchmarksCustomer to define priorities for testing and areas of interestCustomer to attend 2-3 day MTP interactive session and review

TAPCustomer to provide data, queries, concurrency model, existing data model, etc.Customer to provide SME, DBA and other resources to work with MS TAP teamFor onsite – customer to provide building access, internet access, etc Customer to provide existing benchmarks

Summary

Fast Track data warehouse reference architectures are available todayScale up today with SMP, scale out tomorrow with MPPHub-and-Spoke will integrate SMP reference architectures with MadisonMadison will scale SQL Server to 1PBMadison will set a new bar in appliance pricing and performanceMTP and TAP for Madison are this year!

Dell EDW Systems Architecture

“Hubs” – 400TB Total• 1 primary, 1 DR System• Mirrored DR via ETL• Mirror not shown

• “Spokes” – 350TB Total• 3 DA v3 Appliances• 1 SSE 2008 “SMP” Spoke

• Dedicated IB Network− “Grid” enabled appliance

network− SQL “Copy” between

appliances− Up to 500GB/min transfer

• Teradata Migration− Direct migration of historical

data− Automated Extract & Load

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions,

it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.