Upload
raymond-cochrane
View
600
Download
4
Tags:
Embed Size (px)
DESCRIPTION
Tech Talk SQL Server 2012 Business Intelligence
Citation preview
Microsoft Business IntelligenceUpdate on SQL Server 2012
Preliminary Information Subject to Change
Agenda
Microsoft and Enterprise Information Management
Update on Microsoft Business Intelligence Capabilities
Preliminary Information Subject to Change
Evolution of BI
Self-Service BITraditional BI
IT Pro
End Users
Existing Data
LOB Applications FilesData Marts
ETL/Data Quality
Analysis Reports Dashboards & Scorecards
Provision
Analysis Cubes
Data Warehouse
Data Staging
Spreadsheets
Specialized Tools
?
Preliminary Information Subject to Change
Microsoft Business Intelligence
Analysis Services
Reporting Services
Integration Services
Master Data Services
SharePointScorecards
Excel Workbooks
PowerPivot Application
s
SharePointSearch &
Dashboards
Most widely deployed EIM &
BI Platform
Most Broadly adopted
Productivity & Collaboration
Tools
OdataFeeds
LOB Apps
Preliminary Information Subject to Change
Phases of Enterprise Information Management
Market-leading ETL and data
integration tool
Knowledge-based Data Cleansing &
Matching
Discover Origins & Relationships between artifacts
Project Barcelona* Integration Services
Master Data Services Data Quality Services
Easy-start solution for master and reference data management
* Will be shipped separately from SQL Server 2012 and is subject to change
Preliminary Information Subject to Change
Integrated Data Management Scenario
Data Sources Temp Table
MDS Reference
Store
Cleanse, matchDQS
CurateMDS
Match, de-duplicate
DQS
AcquireSSIS
Consumer
PublishSSIS
View
s
DiscoverBarcelona
Project BarcelonaMetadata Discovery
http://projectbarcelona.cloudapp.net/
demo
Project Barcelona Platform Architecture
Metadata Graph Query, Augmentation, and Annotation API
SQL ISSharePoint
Excel 3rd Party Crawler
3rd Party / Vertical
Application
AdminUI
Information Worker
Experience
DBA/IT ProExperience
Crawler Harvested Data API
Barcelona Index Server
Other Microsoft
Project Barcelona Key Features
Minimal Investment
• No up front planning, modeling, ongoing maintenance
• Out of the box, just starts working
Incremental Investment
• As more of the enterprise is crawled, more and more dependencies are uncovered
Open & Extensible
• New crawlers, UIs added over time
• In-house customized solutions
• Opportunity for partners
• Crawlers shipped out of band
Preliminary Information Subject to Change
Why is Data Quality Important?
Data quality problems cost U.S. businesses more than $600 billion a year.
Data Warehousing Institute (TDWI)
Costs associated with bad data include: • Excess inventory
• Higher supply chain costs
• higher direct marketing costs
• Billing
• And more…
Preliminary Information Subject to Change
Common Data Quality Issues
Data Quality Issue Sample Data Problem
Format Do values follow consistent formatting standards ?
Telephone number formats:xxxxxxxxxx, (xxx) xxx-xxxx 1.xxx.xxx.xxxx, etc.
Standard Are data elements consistently defined and understood ? ‘Gender code’ = M, F, U
‘Gender code’ = 0, 1, 2
Consistent Do values represent the same meaning ? How is revenue presented ?Dollars, Euro, Both?
Complete Is all necessary data present ? 20% of customers’ last name is blank, 50% of zip-codes are 99999
Accurate Does the data accurately represent reality or a verifiable source?
A Supplier is listed as ‘Active’ but went out of business six years ago
Valid Do data values fall within acceptable ranges? Salary values should be between 60,000-120,000
Duplicates Data appears several times Both John Ryan and Jack Ryan appear in the system – are they the same person?
Preliminary Information Subject to Change
How to Manage Data Quality?
Data quality management entails the establishment and deployment of:
RolesResponsibilitiesPoliciesProceduresTechnology
Preliminary Information Subject to Change
Make Data Quality Approachable to Everyone
Improve your data quality with DQSCleanse the data and keep it clean Build confidence in your enterprise dataShare the responsibility for data quality
Remove Barriers for Data QualityDesigned for ease of useEmpowering the business usersSee data quality results in minutes rather than months
Preliminary Information Subject to Change
DQS Solution Concepts
Knowledge-DrivenBased on a Data Quality Knowledge Base (DQKB) that is reusable for a variety of data quality improvements
Knowledge Discovery
Acquire additional knowledge through data samples and user feedback
SemanticsData is mapped into Data Domains, which capture its Semantics
Open and Extendible
Support use of user-generated knowledge and IP by 3rd party reference data
providers
Easy to Use
Compelling user experience designed for increased productivity
Preliminary Information Subject to Change
DQS Architecture Overview
DQS Clients
Knowledge Discovery and Management
DQS Cloud Services
DataMarket - Categorized Reference DataDQS Client
DQS Server
Reference Data API(Browse, Set, Validate…)
Reference Data API(Browse, Get, Update…)
Common Knowledge Store
DQS Engine
Knowledge Discovery
Data Profiling Exploration Matching
Cleansing
Reference Data
Reference Data
Services
DQS Store - KB, Domains
Interactive DQ Projects
Administration
Future Clients: Excel, SharePoint,MDS…
DQ Active Projects
Published KBs
SSIS DQS Cleansing Component
DQ Projects Store
Other DQS Clients
3rd Party Reference Data
Preliminary Information Subject to Change
dqs demo flow
Create DQKB
Knowledge Discovery to
create a domain
Manage Domains
Create DQS Project
Preliminary Information Subject to Change
What is Master Data?
Objects that are the focus of organizational activity
Exists in different forms at each level of the organizationThe requirements of a product model can vary between org levelsDifferent object types are more specific to certain org levels
CharacteristicsRelatively slowly changingObjects of the transactions rather than transactional data Shared among contributors and consumers
Preliminary Information Subject to Change
Main Scenarios
Data Solutions
Provides storage and management of the objects and metadata used as the application knowledge
• Object mappings
• Reference Data / managed object lists
• Metadata management / data dictionary
Data Warehouse / Data Marts Mgmt
Operational Data Management
Enables business users to manage the dimensions and hierarchies of DW / Data Marts
• BI scenarios
Central data records mgmt and consumption sourced by other operational systems
MDS focusPartners Value Add
A company has adopted 6 “best of breed” systems from different vendors. They need to be able to propagate the correct customer information to each system in a consistent way.MDS provides a platform for central schema, integration points and validation for SI/ISV/Internal IT to develop a custom solution1
Preliminary Information Subject to Change
Versioning
ValidationAuthoring business rules to ensure
data correctness Modeling
Entities, Attributes, Hierarchies
Enabling Integration & Sharing
MDS Capabilities
MDSRole-based Security and Transaction Annotation Master Data
Stewardship
External (CRM, ..)Excel DWH
Loading batched data through Staging Tables
Consuming data through Views
Registering to changes through APIs
Excel Add-In Web UI Data Matching
Workflow / Notifications
Focus on Foundational PlatformV1 product
Empowering IWs through Excel Add-in and improved Web UIEnhanced performance and scalabilityImproved quality (usability, robustness, security)
SQL Server 2012 Focus for MDS
Preliminary Information Subject to Change
Empowering IW: MDS Excel Add-in
Load filtered set of data from your MDS database, update leveraging the full power of Excel and publish the data back to the database
Create new entities and attributes
Define attribute constrains, validate and correct entries
Create relations between entities with domain based attributes
Create shortcut of the MDS connection and share it easily with others for easy collaboration
Preliminary Information Subject to Change
mds demo flow
Create MDS Model
Create Entity's in XLS
Publish data updates in XLS
Explore/Update data
Create subscription
views
Preliminary Information Subject to Change
Whats new in SQL Server 2012
Analysis Services and PowerPivot
Reporting Services and Power View
Master Data Services and Data Quality Services
Preliminary Information Subject to Change
Analysis Services: Tomorrow
Build on the strengths and success of Analysis Services and expand its reach to a much broader user base
Embrace the relational data model – well understood by developers and IT Pros
Bring together the relational and multidimensional models under a single unified BI platform – best of both worlds!
Provide flexibility in the platform to suit the diverse needs of BI applications
Analysis Services VisionBI Semantic
Model
Preliminary Information Subject to Change
BI Semantic Model
Data model
Business logic and queries
Data access ROLAP MOLAP VertiPaqDirectQuery
MDX DAX
Multi-dimensional
Tabular
Third-partyapplications
Reporting Services & Power
ViewExcel PowerPivot
Databases LOB Applications Files OData Feeds Cloud Services
SharePointInsights
BI Semantic Model: Architecture
Preliminary Information Subject to Change
Depends on the application needs for each layerData modelBusiness logicData access & storage
Two Visual Studio (BIDS) project types in SQL Server 2012
Multidimensional project – with MDX and MOLAP/ROLAPTabular project – with DAX and VertiPaq/DirectQuery
How Should I Build my Model?
Preliminary Information Subject to Change
SSAS: Multidimensional Model Improvements
Multidimensional projects received over 300 improvements across the board for performance, supportability, reliability and functionality
Almost 100 were reported directly by customers
Major new features include:Visual Studio 2010 designersRemoval of 4GB string store limit for attributesNew events for monitoring lock usage and contentionsNew messages for tracking resources used per commandNew PowerShell support
Preliminary Information Subject to Change
What’s New in PowerPivot for Excel Add-in
Includes the same designer and the same features available to the IT Pro in the Tabular Project in BIDS, except:
Table partitionsSecurity rolesConfiguring Direct Query mode
Note it is possible to restore a PowerPivot workbook on a tabular instance of Analysis Services and then create and manage table partitions
Preliminary Information Subject to Change
What’s New in PowerPivot for Excel Add-in
Perspectives and the reporting properties are hidden by default, otherwise they are available on the PowerPivot Window’s Advanced ribbon tab
The specialized functionality on the Advanced ribbon tab (which is hidden by default) includes:
PerspectivesSummarize ByReporting properties
Preliminary Information Subject to Change
What’s New in PowerPivot for Excel Add-in
Excel’s PowerPivot ribbon tab includes the ability to create, edit and delete KPIs
The PowerPivot Field List has been updated to:Allow perspective selectionDisplay hierarchies and KPIsCreate a KPI based on a measure
The Measure Settings window, used to create and edit measures, supports the configuration of formatting options
Preliminary Information Subject to Change
What’s New in PowerPivot for Excel Add-in
SharePoint Server 2010 SP1 is a prerequisite
The add-in has update to include:New administrative capabilitiesNew setup experiencePower View authoring from the PowerPivot Galley
Preliminary Information Subject to Change
Whats new in Reporting Services
New SSRS SharePoint Integration Benefits
SSRS SharePoint 2010 Shared ServiceHosted in SharePoint Shared Service App poolSSRS catalog DBs are SharePoint Service App DBsWCF and Claims based communicationCentral Admin UI for all RS administrationULS Logging integrationBuilt-in scale-out and load balancer
Report Performance ImprovementsParity with SQL Server 2012 Native mode performance• Top SharePoint mode pain point• Small reports used to be 2-3 times slower: Fixed
Faster than 2008 R2 SharePoint mode ~ 30-60%
SQL Setup option for SSRS SharePoint service
Preliminary Information Subject to Change
Data Alert Workflow
Create Alert
Emai
l D
eliv
ery
Alert Management
Office Open XML Rendering Extensions
Support for new file formats introduced in Office 2007
Word rendering to *.docx formatExcel rendering to *.xlsx format
Feature parity with existing Word and Excel renderers
ZIP-compressed files
Larger worksheets in Excel65k -> 1M rows256 -> 16k columns
More colors in Excel56-color palette -> 24-bit color (16M colors)
What is Power View
Power View is an interactive data exploration and visual presentation experience.
Preliminary Information Subject to Change
Highly Visual Design Experience
Presentation-ready at all times
Rich metadata-driven interactivity
SQL Server 2012 Power View
• Interactive Presentation turns pervasive information into persuasive information
• Deliver and collaborate through SharePoint• Full screen presentation mode for interactive boardroom session
• Fully integrated with PowerPivot• Drive greater insight through smart and powerful querying• Zero configuration highlighting and filtering• Animated trending and comparisons
• Interactive, web-based authoring and sharing of information• Familiar Microsoft Office design patterns• Powerful data layout with banding, callout and small multiples
visualizations
Preliminary Information Subject to Change
Power View Architecture
RS Shared Service
SharePoint Farm
Power View client
App Server
Data sources
Analysis Services SP Integrated
PowerPivotSystem Service
AS ServerTabula
r
Web Front End
SSRS Addin for SharePoin
t
PowerPivotWeb Service
Excel PowerPivot Model
SQL Server BIDSBISM Model
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after
the date of this presentation.MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not
be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.