Félix CuadradoNetwork Support for Cloud Applications

International Workshop in Trends in Future CommunicationsCPqD, Campinas, Brazil25th February 2014

• 18,000 students in London• Member of Russell Group

• School of EECS• 70 academic staff• £37M research grant portfolio• Networks research group

• Wireless and systems networking• 16 academic staff• 50+ PhDs and Postdocs

Queen Mary University of London

2

• Distributed services management in the datacenter

• Monitoring of events• Objectives-based management

• Automated diagnosis• Self-configuration• Self-healing

Datacenter Services Management

3

Node N1

Container static_web

Node N6 Node N10

Node N3 Node N5

Node N4

Container esb1 Container esb1

Container prc2

Container esb2Container esb1

Container prc1

Container dyn_web2

Container bsn_logic1 Container ora_db

Container ora_db

CoRs

PrRc

PrCg

PrMg

ClMg

AcMg

AcDA

CPDA

ClDA

OpAc

ClPo

ClPS

ClDS

CrPD

AcDS

CPDA

Container bsn_logic2

Container bsn_logic2 C

Node N1

Container static_web

Node N6 Node N10

Node N3

Node N5 Node N4

Container esb1 Container esb1

Container prc2

Container esb2Container esb1

Container prc1

Container dyn_web2

Container bsn_logic1 Container ora_db

Container ora_db

CoRs

PrRc

PrCg

PrMg

ClMg

AcM

g

AcD

A

CPDA

ClDA

OpA

c

ClPo

ClPS

ClDS

CrPD

AcD

S

CPDA

Container bsn_logic2

Container bsn_logic2

Container bsn_rule1

PrRR

OA

cPPrRP

Migrate

Compute, MessagingUpdate Graph

Decide Migrations

BSP SYNC BARRIER

BSP SYNC BARRIER

Distributed Graph Processing

The Cloud 1.0

4

User Latency

Reliability

Geo-distributed Cloud Applications

5

User Latency

Reliability

Dynamism

• Spans over a multi tenant infrastructure• Datacenters, CDN: computing resources• Internet Service Providers, IXPs

• Distributed Application Overlay• Nodes (computing), and links (connectivity)

• Requirements on links to end users and intra-application links

• Elasticity: dynamically adapt to user workload

Anatomy of a Cross Cloud Application

6

• Applications know what they need (QoS, requirements)

• Latency, bandwidth are often the performance bottlenecks

• But only control cloud resources• Where to deploy?• Hack network at application layer

(proxies, load balancer, middleboxes)

• Compensate/adjust on transport protocols

Applications and Networks don’t talk

7

• Network views aggregated packet information

• Internal information hidden for other stakeholders

• Static network configuration

• Programmatic control plane for the network• Control forwarding behaviour• Break into the protocol stack• Network virtualization resources can be dynamically allocated

Enter SDN

8

Logically Centralised Control Plane, on a Internet Scale, multi-tenant infrastructure?

• Applications are managed based on measured server metrics. • CPU, memory, requests/second, service time

• We also need network information monitoring!• Static information (topology)• Dynamic information (network status) … “real time”

Network analytics

9

Scalable Fine-grained Network Monitoring

Network plus Server App Analytics

Application-aware network management

• Applications management plane has to orchestrate both compute and network infrastructure

• Use SDN to help with transient states, migration• … and automatically handle application high availability

Dynamic Cloud App management with SDN

10

Infrastructure ecosystem

Act at the right timescale

Decide where and how much

Manage transitional states

• Cloud applications require some services• Security, load balancing, forwarding…

• Geo-distributed applications need similar support!

• How to extend to a network-wide scale?• Co-location of application nodes- support services

• Efficient support of dynamic overlays• Configure with changing network-wide policies

Network-wide services for applications

11

Load Balan

cer

Proxy

Transcoder FW

IDSCache

…

As challenging to manage as the applications themselves

• Cloud applications are a strong use case for SDN• Support latency requirements• Link to end user, intra application communications

• We need to talk!• Application management needs to become aware of the

networking side• Orchestration of the network and computing

infrastructure must be addressed• How do we support autonomic dynamic application

management, in a scalable way?

Conclusions

12

Obrigado!felix.cuadrado@qmul.ac.uk

International Workshop in Trends in Future CommunicationsCPqD, Campinas, Brazil25th February 2014