Mark KromerMicrosoft Data Platform Technology Specialist

What’s New in SQL Server 2012 for Philly Code Camp 2012.1

For developers, architects, IT pros & DBAs

MSSQLDUDE

Twitter: @mssqldudehttp://mssqldude.wordpress.com

SQL Server Magazine BI Bloghttp://www.sqlmag.com/blog/sql-server-bi-blog-17

mkromer@microsoft.com

New SQL Server Architectures

Business Intelligence

SQL 2012 Developer

Experience

To the Cloud!

A Brief History of SQL Server

QUESTION #1

SQL Server 2000 falls out of support …

20122013NeverAlready out of support

AlwaysOn, ColumnStores, GeoClustering

Mission Critical Architectures

Mission Critical Confidence

ORGANIZATIONAL COMPLIANCE & PEACE

OF MIND

REQUIRED 9s & DATA PROTECTION

BLAZING-FAST PERFORMANCE

Greater flexibility and availability with SQL Server AlwaysOn

Maximized hardware resources

Support for Windows Server Core to reduce planned downtime

AA A

Column-based query accelerator for dramatic performance gains

Faster performance for FILESTREAM, spatial & FTS

User-defined server roles for better separation of duties & Audit support across editions

SharePoint & Active Directory integration for secure BI data

Simplified application testing with Distributed Replay and streamlined troubleshooting with Extended Events

GREATER UPTIME WITH HIGH AVAILABILITYKey technologies to deliver required 9s

ALWAYSON WINDOWS SERVER CORE SUPPORT

ONLINE OPERATIONS ENHANCEMENTS

Availability Groups provide database level protection

Multiple Secondaries

Failover Cluster Instances provide instance level

protection

Reduce OS patching by as much as with new support for

1

by reducing OS patching

Maintain uptime during maintenance

operations using enhanced online operations

Reindexing of large object data types

Adding non-null columns

Add column with default

1The percentage reduction in patching varies & can be less based on the server roles that are enabled & the type of patches that are applied .

SQL SERVER 2012 HA & DR SOLUTIONS

1Multi-site Failover Cluster Instance (FCI) for HA & DR

• Shared Storage solution• Instance Level HA • Instance Level DR• Doesn’t require database to be in FULL recovery

model

2 Availability Group for HA & DR

• Non-Shared Storage solution• (Group of) Database Level HA• (Group of) Database Level DR• DR replica can be Active Secondary• Requires database to be in FULL recovery model

3Failover Cluster Instance for local HA & Availability Group for DR

• Combined Shared Storage and Non-Shared Storage• Instance Level HA • (Group of) Database Level DR• DR replica can be Active Secondary• Requires database to be in FULL recovery model

AlwaysOnHelping enable global HA, through greater uptime and manageability

Synchronous data

movement

Asynch

ronou

s dat

a

mov

emen

t

AG

AG

AG

AG_Listener

HIGHER PRODUCTIVITYSingle solution to manage; Availability Groups for Clustering, Mirroring, Log Shipping, and Diagnostics

Wizards for easy set up; dashboards for visibility

GREATER UPTIME & H/W USEMultiple, active secondaries

Multi-database failover

Faster connections and page repair

Offload & distribute workloads to secondaries

ADDITIONAL BENEFITS

Scale on demand; distribute workloads across readables

Performance gains by shifting workloads off primary to secondaries, including backups

Unified HA Solution

Blazing-Fast Performance

¹Source: Microsoft customer evidence, Choice Hotels International²Source: Microsoft customer evidence, KAS Bank³Source: Microsoft customer testing; common data warehousing queries

ColumnStore IndexNew

transactions per day²

100,000,000

10xNow, up to Faster³

transactions per second¹

57,000“400 percent improvement in performance.”

First American Title Insurance Company

Columnstore Indexes:Fetch Only Needed Columns

SELECT ProductKey, SUM (SalesAmount) FROM SalesTable WHERE OrderDateKey < 20101108

StoreKey

01

04

04

03

05

02

StoreKey

02

03

01

04

04

01

RegionKey

1

2

2

2

3

1

RegionKey

1

2

1

2

2

1

Quantity

6

1

2

1

4

5

Quantity

1

5

1

4

5

1

OrderDateKey

20101107

20101107

20101107

20101107

20101107

20101108

OrderDateKey

20101108

20101108

20101108

20101109

20101109

20101109

ProductKey

106

103

109

103

106

106

ProductKey

102

106

109

106

106

103

SalesAmount

30.00

17.00

20.00

17.00

20.00

25.00

SalesAmount

14.00

25.00

10.00

20.00

25.00

17.00

Columnstore Indexes:Processing Data

Columnstore vs. RowstoreNew Batch Processing in EngineColumnstore index scan can produce batches or rows

Batch-enabled operators get batchesNon-batch operators get rows

Query optimizer decides

List

of

qualif

yin

g

row

s

Column vectors

Batch object

13

DBA Productivity Enhancement

Point in Time Recovery Using New Timeline

SQL Server Capabilities Standard

Business Intelligence

Enterprise

SQL Server 2012 Editions

*Enterprise legacy servers licensed under Server/CAL licensing are subject to a 20-core per server limit.** Basic include 2 node Failover Clustering

SQL Server 2012 SKUs & LicensingAligned with how businesses consume DB and business intelligence software

Principal Editions Licensing OptionsServer+CAL Core-based

EnterpriseHigh-end datacenter

w/ BI Server capabilities

Business IntelligenceEnterprise BI projects, user-

based licensing

StandardDepartmental, limited scale

16

QUESTION #2

SQL Server AlwaysOn Allows for how many secondary replicas?

0123

QUESTION #3

Which editions of SQL Server has been EOL’d?

Data CenterWeb EditionSQL Server 11gStandard Edition

SQL Server Data Tools Visual Studio 2010

Developer Experience

Build in a Productive Development EnvironmentSQL Server Data Tools (SSDT)

Database

Projects

SQL SERVER DATA TOOLS

Declarative not scripted

Model-based design & validation

Same tools when connected or offline

Schema & app under team source code control

Integrated development environment

Target on-premises or in the cloud

Unified across server, BI & cloud

Simplify complex programming tasks with T-

SQL enhancements

Ease database migrations with improved

support for ANSI SQL standards

Schema differencing for‒ Incremental import & deployment ‒ Drift detection & reconciliation

Test locally, deploy to all versions SQL Server or SQL Azure

Extended Events Enhancements• Flexible event selection, logging, and filtering with Extended Events

• Simplified diagnosis of functional and performance troubleshooting with new user interface for Extended Events

MISSION CRITICAL CONFIDENCE

Distributed Replay• Simplified application testing and upgrade

• Minimize errors in upgrades and proactively conduct capacity testing to simulate production environment and protect performance

PEACE OF MINDStreamlined management

Programmability T-SQL Enhancements

Date/Time Constructors• Construct date/time values without messy string

manipulation• DATEFROMPARTS, TIMEFROMPARTS• DATETIMEFROMPARTS, SMALLDATETIMEFROMPARTS• DATETIME2FROMPARTS, DATETIMEOFFSETFROMPARTS

Programmability T-SQL Enhancements

OFFSET / FETCH• Works like MySQL’s LIMIT, but ANSI standard• No performance gain, just syntactic sugar

SEQUENCE• Central IDENTITY mechanism (like Oracle)• Performs better than IDENTITY• Same transaction limitations

Programmability T-SQL EnhancementsWindowing Enhancements

• Moving average and other aggregates based on preceding/following rows• LAG/LEAD, DATEDIFF, FIRST_VALUE/LAST_VALUE

• Distribution / Median• CUME_DIST(), PERCENT_RANK(), PERCENTILE_CONT()• Can also use WITHIN GROUP

IIF(), CHOOSE(), CONCAT(), EOMONTH()FORMAT()

• .NET parity, with exceptions

PARSE(), TRY_CONVERT(), TRY_PARSE()FORCESEEK enhancements• Can now specify index/columns

New FORCESCAN hint• For large bulk continuous read scenarios where you want a scan

QUESTION #4

Which of these is NOT a new T-SQL construct?

SequenceOffsetTry-CatchThrowNone of the above

Power View, DQS, Tabular Models, SharePoint Integration

Business Intelligence

Rapid Data Exploration and Visualization

Stunning, interactivedata visualizations,

Power View

Familiar tools built on Excel &

SharePoint

Mashup data, PowerPivot

“Only 28% of

potential users are using

the standard BI platform

of choice in

organizations¹”

¹ Gartner, “The Consumerization of BI Drives Greater Adoption,” James Richardson, June 3, 2011

Managed Self-Service BI

Gaininsight

& oversight

End usercreated,

IT managed

Single administration

from SharePoint28

“We can balance our employees’ need for rich

information and collaboration with IT’s

need to manage the safety & confidentiality

of information.”

CareGroup Healthcare System

And Big Data Analytics & Data Warehousing

“Parallel Data Warehouse runs

complex queries about 160 times

faster, providing a data load over

1 Tb/Hour and fully integrates into

a complete BI Solution”

StructuredUNSTRUCTURED,

& real-timeMassive Scale,

Low Cost

>24TBANALYTICAL SOLUTIONS¹

>600TBDATA WAREHOUSES W/ TRUE MPP²

¹Source: Microsoft customer evidence, Yahoo ²Source: Microsoft testing

CompleteBI SOLUTION

—DirectEdge, US Stock Exchange

Credible, Consistent Data

% of master data complete & accurate

Hrs spent per employee each week searching for info

Top 20% Performers 1.2hrs

Middle 50% Performers 2.8hrs

91%

68%

Under 50%Bottom 30% Performers 6hrs

Companies with accurate data perform better¹

Single BI Semantic

Model

Data Quality Services

¹Source: “Turning Pain into Productivity with Master Data Management,” Aberdeen Group, Feb 2011

MasterDataServices

CREDIBLE, CONSISTENT DATAAccessible data cleansing tools

Data Quality Services

• Profile, cleanse, and match data• Build a knowledge base • Improve data quality using organizational knowledge and

3rd party data providers including providers in Windows Azure Marketplace

• Accessible by data stewards

BREAKTHROUGH INSIGHT

CREDIBLE, CONSISTENT DATAEfficient and familiar data managementMaster Data Services Enhancements

BREAKTHROUGH INSIGHT

• MDS Add-in for Excel• Improves access to master data• Lowers the barriers to getting started

• Overhauled user experience for Explorer and Integration Management capabilities• Add/deleted more quickly• More easily move members in a

hierarchy• Entity-based staging for easier data

loading

Master DataServices

Two Hadoop connectors for SQL Server and Parallel Data Warehouse now available included with SQL Server

Hadoop based distribution on Windows Server and Windows Azure currently in CTP

Big Data, Unlocked for Deep InsightsBusiness Insights to all users from structured or unstructured data

Data

Velocity

Variety Variability

Volume

Microsoft partnering with Hortonworks for an Apache Hadoop™ based distribution for Windows Server and Windows Azure

• Broader access of Hadoop to end users, IT professionals and Developers

• Enterprise-ready Hadoop distribution with greater security, performance and ease of management

• Breakthrough insights with the use of familiar tools such as PowerPivot for Excel, SSAS and SSRS

SQL SERVER DELIVERS

Big Data is defined by

• Volume: Cheaper storage & new sources

• Variety: 80% non-relational

• Velocity: Real-time analytics needed

• Variability: Challenging to analyze

MICROSOFT ROADMAP & STRATEGY

QUESTION #5

What is HDFS?Open Source Framework for Distributed AppsHadoop Distributed File SystemOpen Source Distributed File System for WindowsAll of the above

To The Cloud!

Windows Azure

Cloud On Your Terms

OPTIMIZED PRODUCTIVITY

SCALE ON DEMAND & FAST TIME

TO SOLUTION

EXTEND DATA ANYWHERE

DAC parity across Denali and SQL Azure to seamless extend new applications

FileTable for increased data storage flexibility

Greater interoperability and support for web applications

Single database application development experience with Microsoft Project “Juneau”

Streamline virtualization management with System Center Virtual Machine Manager

Roadmaps for SQL Server appliances and reference architectures

Common architecture across server, appliances and cloud

WHY SQL SERVER 2012 FOR HYBRID IT Common > • Active Directory® • Common Development Tools

• Common Management Tools

FLEXIBILITY & CHOICE SCALE ON DEMAND ANY DATA, ANY SIZE

Cloud on your terms

FLEXIBILITY & CHOICE SCALE ON DEMAND ANY DATA, ANY SIZE

• Build and extend applications quickly

• Move apps seamlessly on-premise to cloud

• License mobility

• AlwaysOn & SLA-driven availability

• Scale up on-premises

• Scale out quickly with self-built private clouds, appliances and SQL Azure

• Any type of data - unstructured | structured | complex

• Integrate 3rd party data and activate new data

• Monetize your data

Hybrid IT

TraditionalNON-VIRTUALIZED

PrivateCLOUD

PublicCLOUD

SQL Azure Federations

• Provides Data Partitioning/Sharding at the Data Platform• Enables applications to build elastic scale-out applications• Provides non-blocking SPLIT/DROP for shards (MERGE to come later)• Auto-connect to right shard based on sharding keyvalue• Repartitioning operations without downtime• Examples: Web scale DB, Multi-tenant SaaS, Workloads with spikes,

burst, peaks, NoSQL apps, Big Data apps.

Single tenant per databaseMultiple-tenants per database Multiple databases per tenant

SQL Azure Federation Concepts

40

Federation “Orders_Fed”

ShardedApplication

Azure DB with Federation Root

Federation Directories, Federation Users, Federation Distributions, …

Federation- Represents the data being sharded

Federation Root- Database that logically houses federations, contains

federation meta data Federation Key

- Value that determines the routing of a piece of data (defines a Federation Distribution)

Federation Member (aka Shard)- A physical container for a set of federated tables for a

specific key range and reference tables Federated Table

- Table that contains only atomic units for the member’s key range

Reference Table (DDR)- Non-sharded table

Atomic Unit- All rows with the same federation

key value: always together!

Member: PK [min, 100)

Member: PK [100, 488)

Member: PK [488, max)

(Federation Key: CustomerID)

AUPK=5

AUPK=25

AUPK=35

AUPK=105

AUPK=235

AUPK=365

AUPK=555

AUPK=2545

AUPK=3565

Con

nectio

n

Gate

way

Cloud-Ready Information Platform

On Premises & Private cloud Public Cloud

OData

Common Tools

Data Sync

Extend any data

Extend anywhere

End user analytics

Common Architecture

QUESTION #6

What SQL Services are NOT YET Available in Azure?

Reporting ServicesFederationsAnalysis ServicesFan Out QueriesNone of the above

QUESTION #7

Which area of SQL Server 2012 was most interesting to you?

High AvailabilityDeveloper ToolsBig DataAzure

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.