43
Building Clouds with Windows Azure Pack and System Center Michael Rüefli– Cloud Architect www.miru.ch Thomas Maurer – Cloud Architect & Microsoft MVP www.thomasmaurer.ch

E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Embed Size (px)

DESCRIPTION

A brief guide how to build private clouds using System Center, Hyper-V, Storage Spaces, JBODs, Windows Azure Pack, Service Management Automation

Citation preview

Page 1: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Building Clouds with Windows Azure Pack and System Center Michael Rüefli– Cloud Architectwww.miru.chThomas Maurer – Cloud Architect & Microsoft MVPwww.thomasmaurer.ch

Page 2: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Session Objectives

o Get overview of Microsoft Cloud OS stack

o Understand the different components involved and see them in action

o Hear deployment experiences from the Field

o Have a lot of fun ….and get questions answered

Page 3: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

The Cloud OSModern platform for the world’s apps

DEVELOPMENT MANAGEMENT IDENTITY VIRTUALIZATIONDATA

CUSTOMER

SERVICE PROVIDER

WINDOWS AZURE

Transforms the datacenter

Unlocks insightson any data

Empowers people-centric IT

Enables modern apps

1CONSISTENTPLATFORM

Page 4: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Cloud – Demystified

• Pool of compute, storage and networking

• Allocable on demand to your customers • Automate everything• Metered• Self-service

Page 5: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Architecture

Page 6: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Cloud OS Experience (Microsoft Cloud v2)

R2 w/ Service Provider Foundation

Future Services

Service Bus

SQLVMsWebSites

Service Management API

ServicePlansUsers Provider

PortalConsumer

Self-ServicePortal

Web SitesAppsDatabaseVMs

Service ProviderCustomer

Self Service Portal Moves On-

Premises

Common Mgt. Experience

Workloads

Cloud-Enabled Services Move On-

Premises

Consistent Dev.

Experience

Other Service

sCDN.

Media,, etc.

Caching

Service Bus

SQLVMsWebSites

WorkerRole

Service Management API

Web SitesAppsDatabaseVMs

Subscriber Self-

ServicePortal

Windows Azure

R2

Page 7: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

VM Cloud Architecture

Virtual Machine Manager

NetworkStorageComputeServices

VMs Apps

Service Provider Foundation

Windows Azure Pack

RD GWWSUSWDSSQLAD

IPAM

Service Management Automation

Page 8: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Virtual Machine Manager

Storage

iSCSI, Fiber Channel, SMB, Storage Spaces

Network

Logical Networks, VLAN based, NVGRE

Compute

Hyper-V(ESX, XenServer)

Clouds (Resources Pools)

Tenants (Service Customers)

VMs and Services

System Center Virtual Machine

Manager

DeploymentManagementAutomationMonitoring

Page 9: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Storage

Page 10: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

The Performance vs. Cost Dilemma 80% of costs for 20% of I/O critical workloads

(peaks)

Page 11: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Microsoft Software defined StorageStorage Spaces / Scale out File Server

• Cost effective and performant• Ease of Management• Scalable• Auto Tiering (SSD / HDD)• Write Back Cache

Page 12: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Scale the Storage Stack

Clustered Storage Spaces (CSV)

Hyper-V Compute Cluster

High Speed Storage Network10-40 GbE / 56 Gb Infiniband

SMB Namespace

60-bay Shared SAS JBOD Arrays

400 TB / Mirrored(2.2 TB SSD Tier)

Scale Out File Server with RDMA (40GbE/RoCe)

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

SMBDirect

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

SMBDirect

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

SMBDirect

Page 13: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

File Client

SMB ClientSMBBuffer

File Server

Application

NIC Driver

Transport Protocol Driver

With RDMA

Improved network performance through SMB Direct (RDMA*)

Without RDMA

Application

NIC Driver

SMB ServerSMB Client

Transport Protocol Driver

NIC Driver

TransportProtocol Driver

AppBuffer

SMBBuffer

OSBuffer

Driver

Buffer

SMBBuffer

OSBuffer

Driver

Buffer

SMB Server

NIC Driver

TransportProtocol Driver

AppBuffer

SMBBuffer

rNIC* rNIC* NIC AdapterBuffer NICAdapter

BufferAdapterBuffer

AdapterBuffer

RoCe

InfiniBand

• Higher performance through offloading of network I/O processing onto network adapter

• High throughput with low latency and ability to take advantage of high-speed networks (such as InfiniBand and iWARP)

• Remote storage at the speed of direct storage

• Transfer rate of around 40 Gbps on a single NIC port

• Compatible with SMB Multichannel for load balancing and failover *Remote Direct Memory Access *e.g. Mellanox Connect X3®™ Adapter Family

Page 14: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Manage the Storage Stack

SAN3rd Party

NAS Devices

Scaleout Fileserver (SOFS)

Node Node

JBOD

SAS SAS

FC/iSCSI

SMB3 SMB3

SCVMM Storage Management

Page 15: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

3rd party storage management

Page 16: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

DEMOStorage Management

Page 17: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Network

Page 18: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Microsoft Networking

Cloud Providers are required to…

… isolate Tenants from each other… isolate Tenants from Provider Infrastructure… be flexible for changes on physical

Infrastructure… offer Self Service Capabilities to tenants

Page 19: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Why Network Management is Important

Page 20: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 Networking

Logical NetworksPhysical Network Infrastructure

Network SitesNetwork Sites / VLANs

IP PoolsIP Address Pools for deployment

Page 21: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 R2 Networking

Logical NetworksPhysical Network Infrastructure / Sites / IP Pools

VM NetworksVirtual Networks for VMs

Port ProfilesNew Features from Windows Server 2012 Hyper-V

Logical SwitchLogical Network Switch which combines all features

Page 22: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

How network virtualization works• Overlays multiple virtual networks

on shared physical network

• Uses industry standard General Routing Encapsulation (NVGRE) protocol

Problems solved• Creates VM mobility across

datacenter, hoster cloud or Azure without network constraints

• Provides ability to import customer IP addresses and network topology

• Helps remove VLAN constraints

• Helps eliminate hierarchical IP address assignment for virtual machines

Hyper-V Network Virtualization

Physical server Physical network

VIRTUALIZATION

Blue virtual machine

Yellow virtual machine Blue network Yellow network

Page 23: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 Networking

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

Page 24: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

Page 25: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

VM Network

Logical NW

Virtual Machine

VM Network

Virtual Machine

Page 26: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

VM Network

Logical NW

Virtual Machine

Logical Switch

Software Defined Networking

Hyper-V Network VirtualizationExtensible Virtual Switch

Network Policy/Offloads

SR-IOVDHCP GuardIPSec Task OffloadBandwidth ControlTrunk Mode

Page 27: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Multi-Tenant HNV Gateway

• Virtual Machine running Server 2012 R2 with RRAS Role

• On "dedicated" Hyper-V Host• 50 S2S VPNs / 200 virtual Subnets per single

GW • Service Template for Scale Out / Redundancy• Support for Site-to-Site VPN with 3rd Party

Products from Cisco, Juniper, Citrix

Page 28: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

IPAM – VMM Integration

AD DC / NPS / DNS

DNS

DHCP

IPAM Management

Server

SCVMM

Manage virtual IP spaces like a Boss !

Page 29: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

DEMOSoftware defined Networking

Page 30: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Hypervisor

Page 31: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Microsoft Hyper-V 2012 R2

• Gen2 VMs• Enhanced Session Mode• vRSS / dVMQ• Online VHDX resizing• Hyper-V Replica Cycles• …etc

Page 32: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Hypervisor Management

Page 33: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

DEMOHypervisor

Page 34: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Coffee BreakWe'll be back….in 10 minutes….sharp!

Page 35: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Admin Portal

Page 36: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Tenant Portal

Page 37: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Automation

Page 38: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Automation….

… is a key component in every cloud… must leverage standard APIs and

interfaces… must support multiple tenants… must support linear scaling

Page 39: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Architecture• REST oData API / Web Service• Portal integrated with Azure Pack• SQL Database• Runbook Workers

Windows Azure Pack Admin Portal

Page 40: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

DEMOService Management Automation

Page 41: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

So which one to go for?SC Orchestrator

SMA

Better together

Page 42: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

Thomas MaurerCloud Architect / MVPwww.thomasmaurer.ch@ThomasMaurer

Michael RueefliCloud Architectwww.miru.ch@drmiru

In case of any questions…

Page 43: E2EVC 2014 building clouds with Microsoft Cloud OS and System Center

THANKS!