April 18, 20231

Our team: Undergrad Thomas de Ruiter, Anand Sawant, Ruben Verboon, … Grad Siqi Shen, Guo Yong, Nezih Yigitbasi Staff Henk Sips, Dick Epema, Alexandru Iosup, Otto Visser Collaborators Ion Stoica and the Mesos team (UC Berkeley), Thomas Fahringer, Radu Prodan, Vlad Nae (U. Innsbruck), Nicolae Tapus, Mihaela Balint, Vlad Posea (UPB), Derrick Kondo, Emmanuel Jeannot (INRIA), Assaf Schuster, Mark Silberstein, Orna Ben-Yehuda (Technion), ...

Introduction toCloud Computing

Alexandru Iosup

Parallel and Distributed Systems GroupDelft University of TechnologyThe Netherlands

SPEC RG Cloud Meeting

April 18, 20232

April 18, 20233

What is Cloud Computing?3. A Useful IT Service“Use only when you want! Pay only for what you

use!”

April 18, 20234

Q: What do you use?

Q: Why not this level?

Q: Why not this level?

April 18, 20235

Agenda

1. What is Cloud Computing?2. IaaS Clouds, the Core Idea3. The IaaS Owner Perspective4. The IaaS User Perspective5. Reality Check6. Conclusion

IaaS Cloud Computing

VENI – @larGe: Massivizing Online Games using Cloud Computing

Joe Has an Idea ($$$)

(Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

MusicWave

• Big up-front commitment

• Load variability: NOT supported

Solution #1Buy or Rent

…

10%

(Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

Solution #2Deploy on IaaS Cloud

(Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: V. Nae, 2008.)

Q: So are we just shifting the problem to somebody else, that is, the IaaS cloud

owner?

• NO big up-front commitment

• Load variability: supported

Inside an IaaS Cloud Data Center

(Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: A. Iosup, 2011.)

Time and Cost Sharing Among Users

User C

User B

MusicWave

(Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

Main Characteristics of IaaS Clouds

1. On-Demand Pay-per-Use

2. Elasticity (cloud concept of Scalability)

3. Resource Pooling

4. Fully automated IT services

5. Quality of Service

April 18, 202312

April 18, 202313

Agenda

1. What is Cloud Computing?2. IaaS Clouds, the Core Idea3. The IaaS Owner Perspective:

How to Deploy a Cloud?4. The IaaS User Perspective5. Reality Check6. Conclusion

IaaS Cloud Deployment ModelsPrivateOn-premises

PublicOff-premises

Hybrid

(Source: A. Antoniou, MSc Defense, TU Delft, 2012. Original idea: Mell and Grance, NIST Spec.Pub. 800-145, Sep 2011.)

Resource Sharing Models

MusicWave

April 18, 202315

MusicWave OtherApp

Space-Sharing Time-SharingIaaS Clouds

MusicWave OtherApp

Q: Which one is better?

Grids

Host OS Host OS

OtherApp

Virtualization

April 18, 202316

Virtualization

Host OS

MusicWave OtherApp OtherApp

Q: What to do now?

Guest OS

Virtual Resources

VM Instance

Applications

Guest OS

Virtual Resources

VM Instance

Applications

Q: What is the problem?

April 18, 2023

Virtualization and The Full IaaS Stack

17

Guest OS

Virtual Resources

VM Instance

Applications

Physical Infrastructure

Virtual Infrastructure Manager

Virtual Machine Manager

Guest OS

Virtual Resources

VM Instance

Applications

Virtual Machine Manager

Guest OS

Virtual Resources

VM Instance

Applications

The Virtual Machine Lifecycle

April 18, 202318

(Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

Q: Is this fair?

Use Case: Amazon Elastic Compute Cloud (EC2)• Prominent IaaS provider

• Datacenters all over the world

• Many VM instance types

• Per-hour charging

April 18, 202319

Instance Capacity US$/hour

m1.small 0.10

m1.large 0.38

c1.xlarge 0.76

April 18, 202320

Agenda

1. What is Cloud Computing?2. IaaS Clouds, the Core Idea3. The IaaS Owner Perspective4. The IaaS User Perspective:

How to Use Clouds? How to Choose Clouds?5. Reality Check6. Conclusion

Workload

April 18, 202321

MusicWave OtherApp

Time

MusicWave

OtherApp

OtherApp

OtherApp

Load = 4

RunTime= 6

Use Case: Workloads of Zynga(Massively Social

Gaming)

April 18, 202322

Sources: CNN, Zynga.

Source: InsideSocialGames.com

“Zynga made more than $600M in 2010 from selling in-game virtual goods.”S. Greengard, CACM, Apr 2011

Selling in-game virtual goods:

“Zynga made est. $270M in 2009 from.”http://techcrunch.com/2010/05/03/zynga-revenue/

Use Case: Workloads of Zynga(Massively Social

Gaming)

• Load can grow very quickly

April 18, 202323

Load

Provisioning and Allocation of Resources

April 18, 202324

Load

Time

Provisioning Allocation

Provisioning and Allocation of Resources

April 18, 202325

Load

Time

Provisioning Allocation

Q: What is the interplay between provisioning and allocation?

Provisioning and Allocation Policies

April 18, 202326

Where?When?How many?

Time

Load

Provisioning Allocation

From where?Which type? etc.

When?etc.

Q: How many policies exist? Q: How to select a policy?

(Source: A. Antoniou, MSc Defense, TU Delft, 2012.)

Use Case:Two Provisioning Policies, Compared

April 18, 202327

Startup

OnDemand

Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and

Allocation Policies for Infrastructure-as-a-Service Clouds,

(submitted). PDS Tech.Rep.2011-009

Use Case:Two Provisioning Policies, ComparedMetrics for comparison• Job Slowdown (JSD ): Ratio of actual runtime in

the cloud and the runtime in a dedicated non-virtualized environment

• Charged Cost (Cc )

• Utility (U )

April 18, 202328

Q: Charged cost vs Total RunTime?

Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and

Allocation Policies for Infrastructure-as-a-Service Clouds,

(submitted). PDS Tech.Rep.2011-009

Use Case:Two Provisioning Policies, ComparedWorkloads

April 18, 202329

Uniform Increasing Bursty

Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and

Allocation Policies for Infrastructure-as-a-Service Clouds,

(submitted). PDS Tech.Rep.2011-009

System Hardware VIM Hypervisor

Max VMs

DAS4/Delft 20 Dual quad-core 2.4 GHz24 GB RAM

2x1 TB storage

64

FIU 7 Pentium 4 3.0 GHz

5 GB RAM340 GB Storage

7

Amazon EC2 unkown/various

- 20

Use Case:Two Provisioning Policies, ComparedEnvironments

April 18, 202330

Villegas, Antoniou, Sadjadi, Iosup. An Analysis of Provisioning and

Allocation Policies for Infrastructure-as-a-Service Clouds,

(submitted). PDS Tech.Rep.2011-009

Use Case:Many Provisioning Policies, ComparedJob Slowdown (JSD)

April 18, 202331

Q: Why is OnDemand worse than Startup?A: waiting for machines to boot

Use Case:Many Provisioning Policies, ComparedCharged Cost (Cc )

April 18, 202332

Q: Why is OnDemand worse than Startup?A: VM thrashing

Q: Why no OnDemand on Amazon EC2?

Use Case:Many Provisioning Policies, ComparedUtility (U )

33

April 18, 202334

Agenda

1. What is Cloud Computing?2. IaaS Clouds, the Core Idea3. The IaaS Owner Perspective4. The IaaS User Perspective5. Reality Check:

Who Uses Public Commercial Clouds? 6. Conclusion

April 18, 20233535

The Real IaaS Cloud

• “The path to abundance”• On-demand capacity• Cheap for short-term tasks• Great for web apps (EIP, web

crawl, DB ops, I/O)

• “The killer cyclone”• Not so great performance

for scientific applications (compute- or data-intensive)

http://www.flickr.com/photos/dimitrisotiropoulos/4204766418/ Tropical Cyclone Nargis (NASA, ISSS, 04/29/08)

VS

April 18, 2023

April 18, 202336

(Source: http://www.cca08.org/files/slides/w_vogel.pdf)

Zynga zCloud: Hybrid Self-Hosted/EC2• After Zynga had large scale

• More efficient self-hosted servers• Run at high utilization

• Use EC2 for unexpected demand

April 18, 202337(Sources: http://seekingalpha.com/article/609141-how-amazon-s-aws-can-attract-ugly-economics and

http://www.undertheradarblog.com/blog/3-reasons-zynga-is-moving-to-a-private-cloud/)

Other Cloud Customers

• 218 virtual CPUs• 9TB/2TB block/S3 storage• 6.5TB/2TB I/O per month

April 18, 202338

(Source: http://markbuhagiar.com/technical/businessinthecloud/)

April 18, 202339

Agenda

1. What is Cloud Computing?2. IaaS Clouds, the Core Idea3. The IaaS Owner Perspective4. The IaaS User Perspective5. Reality Check6. Conclusion

April 18, 202340

Conclusion Take-Home MessageConclusion Take-Home Message

• Cloud Computing = IaaS + PaaS + SaaS• Core idea = lease vs self-own

• On-Demand, Pay-per-Use, Elastic, Pooled, Automated, QoS

• The Owner Perspective• Time-Sharing• Virtualization

• The User Perspective• Variable workloads• Provisioning and Allocation policies

• Reality Check: 100s of usershttp://www.flickr.com/photos/dimitrisotiropoulos/4204766418/

April 18, 202341

Thank you for your attention! Questions? Suggestions? Observations?

Alexandru Iosup

A.Iosup@tudelft.nlhttp://www.pds.ewi.tudelft.nl/~iosup/ (or google “iosup”)Parallel and Distributed Systems GroupDelft University of Technology

- http://www.st.ewi.tudelft.nl/~iosup/research.html

- http://www.st.ewi.tudelft.nl/~iosup/research_cloud.html

- http://www.pds.ewi.tudelft.nl/

More Info:

Do not hesitate to contact me…