Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Eric Bortei-Doku
SQL Server 2019 – Linux and Containers
Optimize your hybrid data estate
SQL
Optimize your hybrid data estate
The evolution of SQL Server
SQL Server 2008
SQL Server 2008 R2
SQL Server 2012
SQL Server 2014
SQL Server 2016 & 2017*
Transparent DB encryption
PowerPivot ● SharePoint integration ● Master Data Services
AlwaysOn ● In-Memory ColumnStore ● Data quality services ● Power View ● Cloud
In-memory across workloads ● Performance & scale ● Hybrid cloud optimized ● HDInsight ● Cloud BI
Industry-leading performance ● End-to-end mobile BI ● AI built-in ● Choice of language & platform ● Easy migration to the cloud
SQL Server 2019
Intelligence over all data ● Big data clusters with Spark and HDFS ● R and Python built-in ● Data classification & compliance tracking ● Azure Data Studio
*Support for Linux and Docker first available in SQL Server 2017
SQL
Optimize your hybrid data estate
Security and
compliance
Developer and
DBA tools
Choice across OS
and containers
Intelligence over
all data
SQL Server 2019What’s new?
Mission-critical
performance
SQL Server 2019
Mission-critical
performance
#1 OLTP performance
#1 DW performance on 1TB, 10TB, and 30TB
#1 OLTP price/performance
#1 DW price/performance on 1TB, 10TB, and 30TB
Industry-leading, mission-critical performanceNow with higher concurrency and scale through
HW innovations including persistent memory
support NEW
Persistent memory can offer a query performance
boost of up to 30% for I/O intensive workloads
(Hybrid Buffer Pool)
Combine in-memory technologies for analytics on
your operational data using HTAP
Mission-critical performance
The Intelligent Database
Accelerate parallel queries and improve scaling of
frequent queries with enhanced Intelligent Query
Processing NEW
Gain performance insights anytime and anywhere
with Lightweight Query Profiling NEW
Table Variable Deferred Compilation provides
50%+ faster query execution through improved
query plans NEW
Workloads based on Tempdb will run faster
on SQL Server 2019 with no application
changes PLANNED
Bold indicates new and improved features in SQL Server 2019
The Intelligent Query Processing feature family
Intelligent QP
Adaptive Joins
Batch Mode
Interleaved
Execution
Memory Grant
Feedback
Row ModeBatch Mode
Approximate
Count Distinct
Mission-critical performance
Adaptive QP
Table Variable
Deferred
Compilation
Approximate
QP
Batch Mode
for Row Store
Scalar UDF in-
lining
SQL Server 2019
Mission-critical
performance
SQL Server 2019
Security and
compliance
Always Encrypted with secure enclaves
(protects sensitive data) In-place encryption: enables
cryptographic operations on sensitive
data without moving the data outside
the database NEW
Rich computations: pattern matching
and range comparisons are supported
inside the secure enclave, enabling a
broad range of applications NEW
Always Encrypted with secure enclaves is
enabled by Windows Server 2019
plaintext ciphertext
Enhanced
client driver
Enclave
plaintext
SQL
Security and compliance
Data classification and assessments
Classification tool allows you to tag
columns stored in a SQL Server
database with pre-defined set of GDPR-
related labels
Data Classification and auditing built-
in to the engine NEW
Get visibility into your security state and
meet compliance standards with SQL
Server Vulnerability Assessment
Security and compliance
SQL Server 2019
Security and
compliance
SQL Server 2019
Developer and
DBA tools
Modern editor experience (Independent of OS and data sources)
Azure Data Studio (formerly SQL
Operations Studio) is a lightweight, open
source, cross-platform graphical
management tool and code editor NEW
Support across Windows, Linux and
MacOS for SQL Server, Azure SQL Database,
Azure SQL Data Warehouse, and SQL Server
2019 big data
Use SQL Server Management Studio 18.0 to
access, configure, manage, and administer all
SQL Server components NEW
Developer and DBA tools
Enhancing the developer experience
Build new types of apps through
extended Java language supportNEW
Enhanced graph support enables
new query types including edge
constraints and merge DMLNEW
Leverage native support for UTF-8
character encodingNEW
Launch pad
SQL
Developer and DBA tools
SQL Server 2019
Developer and
DBA tools
SQL Server 2019
Choice across OS
and containers
More deployment choices than ever before
Support for Red Hat Enterprise Linux,
SUSE Linux Enterprise Server, Ubuntu,
and Windows
Linux and Windows Docker containers
SQL Server in Red Hat containers NEW
Linux-native installation: Yum Install, Apt-
Get
Application and database compatibility
Replication, DTC, and Machine Learning in
SQL Server 2019 NEW
Choice across OS and containers
SQL Platform Abstraction Layer
(SQLPAL)
RDBMS IS AS RS
Windows Linux
Windows Host Ext.Linux Host Extension
SQL Platform Abstraction Layer(SQLPAL)
Host extension mapping to OS system calls(IO, Memory, CPU scheduling)
Win32-like APIsSQL OS API
SQL OS v2
All other systemsSystem resource &
latency sensitive code paths
Platform abstraction layer - SQL Server on Linux
Choice across OS and containers
Shared storage HA in Kubernetes on SQL 2017
Persistent Volume Storage
User
Node
Pod
SQL Server
Node
Load Balancer Service
Node
Pod
SQL Server
Pod
SQL Server
Choice across OS and containers
Mission critical availability
Use Availability groups on
Kubernetes to implement a
full AG system integrated into
SQL Server NEW
Accelerated Data Recovery
performs versioning to ensure
recovery and availability of
data PLANNED
Objects outside the database
can now automatically
failover, avoiding the need for
custom data replications PLANNED
AG
Pod
Operator
Pod
SQL
Server
primary
AG agent
Load
balancer
Pod
SQL
Server
secondary
AG agent
Pod
SQL Server
secondary
AG agent
SQL
Server
primary
SQL
Server
secondary
Load
balancer
SQL Server 2019
Choice across OS
and containers
SQL Server 2019
Intelligence over
all data
SQL Server 2019 enables intelligence over all your data
Build intelligent apps and
AI with all your data
AI over all data
Easily and securely manage
data big and small
Managing all data
Simplified management and analysis through a unified deployment, governance, and tooling
Unified access to all your data with
unparalleled performance
Integrating all data
Intelligence over all data
SQL Server 2019 big data, analytics, and AI
Managed data lake with
SQL Server and Spark
SQL Server
Data virtualization
T-SQLAnalytics Apps
Open
database
connectivit
y
NoSQL Relational
databases
HDFS
Complete AI platform
SQL Server External Tables
Compute pools and data pools
Spark
Scalable, shared storage (HDFS)
External
data
sources
Admin portal and management services
Integrated AD-based security
SQL Server
ML Services
Spark &
Spark ML
HDFS
REST API
containers for
models
Managing all dataIntegrating all data AI over all data
Store high volume data in a data lake and
access it easily using either SQL or Spark
Management services, admin portal, and
integrated security make it all easy to manage
Combine data from many sources without
moving or replicating it
Scale out compute and caching to boost
performance
Easily feed integrated data from many sources
to your model training
Ingest and prep data and then train, store, and
operationalize your models all in one system
Intelligence over all data
Data virtualization easily combines data
from many sources and eliminates data
silos
Intelligence over all data
SQL Server
T-SQLAnalytics Apps
ODBC NoSQL Relational databases Big data
PolyBase external tables
SQL Server is the hub for integrating data
Easily combine across relational and
non-relational data stores
Intelligence over all data
Data virtualization creates solutions
CostsLower storage costs
Less dev time spent on integration
Rapid iterations and prototypes
Timely data
Smaller attack surface area
Consistent security model
Fresh and accurate data
Easier data governance
Speed
Security
Quality
Compliance
Data virtualization integrates data from disparate
sources, locations and formats, without replicating or
moving the data, to create a single "virtual" data fabric
Intelligence over all data
SQL Server simplifies big data
deployment, operation, and integration
Intelligence over all data
Deploy and manage a SQL Server + big data cluster
Easily deploy and manage a big data cluster using
Microsoft’s Kubernetes-based big data solution
built-in to SQL Server
Hadoop Distributed File System (HDFS) storage,
SQL Server relational engine, and Spark analytics
are deployed as containers on Kubernetes in one
easy-to-manage package
Intelligence over all data
SQL Server
master instance
Persistent storage
Custom apps AnalyticsBI
SQL
Serv
er
HDFS Data
Node
Spar
k
Kubernetes pod
SQL
Serv
er
HDFS Data
Node
Spar
k
SQL
Serv
er
HDFS Data
Node
Spar
k
Node Node Node
Scale out big data compute and storage
SQL Server 2019 includes Spark and HDFS,
enabling you to read and write directly in
HDFS using SQL Server or Spark NEW
Elastically scale compute and storage on
demand using the Kubernetes architecture NEW
Apps, BI, and analytics access all your
relational and big data through the SQL
Server master instance using T-SQL NEW
Scale-out data marts combine and cache data
from relational and non-relational data
sources for fast querying NEW
SQL
Intelligence over all data
Increase analytics and apps performance
Compute pool
SQL Compute
Node
SQL Compute
Node
SQL Compute
Node…
Compute pool
SQL
Compute
Node
IoT data
Directly
read from
HDFS
Persistent storage
…
Storage pool
SQL
Serv
er
Spar
k
HDFS Data
Node
SQL
Serv
er
Spar
k
HDFS Data
Node
SQL
Serv
er
Spar
k
HDFS Data
Node
Kubernetes
pod
AnalyticsCustom
apps B
I
SQL Server
master instance
Node Node Node Node Node Node Node
SQL
Data pool
SQL Data
Node
SQL Data
Node
Compute pool
SQL
Compute
Node
Storage Storage
Intelligence over all data
Resources
Intelligence over all data
What’s New in SQL Server 2019TPC OrganizationKubernetesRed Hat Containers
THANK YOU!