Introduction to MS-CPREST

Max Wang

SQL OIPI – Test Development

Agenda

• Background

• Overview

• Details

• Protocol Example

• Resources

• Q&A

Background

Background

• What is Control Plane(CP)

Control Plane

Employee

Security

Entrance

PropertyManagement

Equipment

Security

Room, Corridor

PropertyManagement

Employee

Cleaning

Room, Corridor

PropertyManagement

Manager

Management

Office

PropertyManagement

Control Plane

• Kubernetes Concepts

Background

• What is SQL Server Big Data Cluster Control Plane?

Kubernetes Concepts

Kubernetes Concepts

Kubernetes Concepts

Kubernetes Concepts

Control Plane – SQL Server BDC

Control Plane - Kubernetes

Universal Control Plane - Docker

Control Plane - Summary

SQL Server BDC CPKubernetes CPDocker UCP

New Product CP

Background

• What is SQL Server Big Data Cluster Control Plane?

• Kubernetes Concepts

• Kubernetes Control Plane

• Docker Control Plane

• Where is SQL Server Big Data Cluster Control Plane?

Where is SQL Server BDC CP?

Overview

Overview

• What can we do with the protocol?

What can we do with the protocol?

What can we do with the protocol?

Overview

• What can we do with the protocol?

• Communication Flow

Overview

• What can we do with the protocol?

• Communication Flow

• Protocol Preconditions

Protocol Preconditions

Controller Controller Database

Overview

• What can we do with the protocol?

• Communication Flow

• Protocol Preconditions

• How to have my own SQL Server BDC?

How to have my own SQL Server BDC?

Tools Python 3

kubectl

azdata

Azure Data Studio

SQL Server 2019 extension

How to have my own SQL Server BDC?

Azure KubernetesService (AKS)

aks-dev-test

aks-dev-test-ha

Kubernetes Cluster

DeploymentProfiles

kubeadm-dev-test minikube-dev-testkubeadm-prod

azdata bdc config list

How to have my own SQL Server BDC?

How to have my own SQL Server BDC?

How to have my own SQL Server BDC?

Details

Details

• Protocol Messages

Protocol Messages

HTTP Methods GET

POST

PATCH

DELETE

Details

• Protocol messages

• URI Parameters

URI Parameters

URI Parameters

URI Parameters

Details

• Protocol messages

• URI Parameters

• JSON Elements

JSON Elements

metadata

docker

storagespark

hadoop.yarn

kind

name

endpointtype

replicas

nameServiceType

port

driverMemory

driverCoresexecutorInstances

executorMemoryexecutorCores

classNameaccessMode

size

registry

repository

imageTag

imagePullPolicy

nodeManager

scheduleMax

capacitySchedulermemoryvcoresmemory

maxAmPercent

Details

• Protocol messages

• URI Parameters

• JSON Elements

• Abstract Data Model

Abstract Data Model

Abstract Data Model

Abstract Data Model

Abstract Data Model

Abstract Data Model

Abstract Data Model

Details

• Protocol messages

• URI Parameters

• JSON Elements

• Abstract Data Model

• Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Methods

Protocol Message Example

Protocol Message Example

Resources

Resources• SSBDC work shops:

https://github.com/microsoft/sqlworkshops/tree/master/sqlserver2019bigdataclusters/SQL2019BDC

• SSBDC docs: https://docs.microsoft.com/en-us/sql/big-data-cluster/deploy-on-aks?view=sql-server-ver15

• SSBDC deployment samples: https://github.com/microsoft/sql-server-samples/tree/master/samples/features/sql-big-data-cluster/deployment

• SSBDC deployment docs: https://docs.microsoft.com/en-us/sql/big-data-cluster/view-cluster-status?view=sql-server-ver15

• azdata Commands: https://docs.microsoft.com/en-us/sql/big-data-cluster/reference-azdata-bdc?view=sql-server-ver15