42
1 Aula 01 - Enabling Technologies and Distributed System Models

Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Embed Size (px)

Citation preview

Page 1: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

1

Aula 01 - Enabling Technologies and Distributed System Models

Page 2: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

2

Livro texto

Page 3: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 3

Data Deluge Enabling New Challenges

(Courtesy of Judy Qiu, Indiana University, 2011)

Page 4: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

4

From Desktop/HPC/Grids to Internet Clouds in 30 Years

HPC moving from centralized supercomputers

to geographically distributed desktops, desksides,

clusters, and grids to clouds over last 30 years

R/D efforts on HPC, clusters, Grids, P2P, and virtual

machines has laid the foundation of cloud computing

that has been greatly advocated since 2007

Location of computing infrastructure in areas with

lower costs in hardware, software, datasets,

space, and power requirements – moving from

desktop computing to datacenter-based clouds

Page 5: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 5

Interactions among 4 technical challenges :

Data Deluge, Cloud Technology, eScience,

and Multicore/Pareallel Computing

(Courtesy of Judy Qiu, Indiana University, 2011)

Page 6: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 6

Clouds and Internet of Things

HPC: High-

Performance

Computing

HTC: High-

Throughput

Computing

P2P:

Peer to Peer

MPP:

Massively Parallel

Processors Source: K. Hwang, G. Fox, and J. Dongarra,

Distributed and Cloud Computing, Morgan Kaufmann, 2012.

Page 7: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

7

Technology Convergence toward HPC for

Science and HTC for Business

(Courtesy of Raj Buyya, University of Melbourne, 2011)

Copyright © 2012, Elsevier Inc. All rights reserved.

Page 8: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

8

2011 Gartner “IT Hype Cycle” for Emerging Technologies

2007

2008

2009

2010

2011

Copyright © 2012, Elsevier Inc. All rights reserved.

Page 9: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 9

Page 10: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 10

Page 11: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 11

Page 12: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 12

Page 13: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 13

Architecture of A Many-Core

Multiprocessor GPU interacting

with a CPU Processor

Page 14: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 14

Page 15: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 15

Page 16: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 16

Datacenter and Server Cost Distribution

Page 17: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

17

Virtual Machine Architecture

Copyright © 2012, Elsevier Inc. All rights reserved.

(Courtesy of VMWare, 2010)

Page 18: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 18

Primitive Operations in Virtual Machines:

Page 19: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

19

Concept of Virtual Clusters

(Source: W. Emeneker, et et al, “Dynamic Virtual Clustering with Xen and Moab,

ISPA 2006, Springer-Verlag LNCS 4331, 2006, pp. 440-451)

Copyright © 2012, Elsevier Inc. All rights reserved.

Page 20: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 20

Page 21: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 21

A Typical Cluster Architecture

Page 22: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 22

Page 23: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 23

A Typical Computational Grid

Page 24: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 24

Page 25: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 25

Page 26: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

26

The Cloud Historical roots in today’s

Internet apps • Search, email, social networks

• File storage (Live Mesh, Mobile Me, Flicker, …)

A cloud infrastructure provides a framework to manage scalable, reliable, on-demand access to applications

A cloud is the “invisible” backend to many of our mobile applications

A model of computation and data storage based on “pay as you go” access to “unlimited” remote data center capabilities

Copyright © 2012, Elsevier Inc. All rights reserved.

Page 27: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 27

Basic Concept of Internet Clouds

Page 28: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

28

The Next Revolution in IT Cloud Computing

Classical Computing

• Buy & Own

• Hardware, System Software,

Applications often to meet peak

needs.

• Install, Configure, Test, Verify,

Evaluate

• Manage

• ..

• Finally, use it

• $$$$....$(High CapEx)

Cloud Computing • Subscribe

• Use

• $ - pay for what you use, based on QoS

Every 1

8 m

on

ths?

Copyright © 2012, Elsevier Inc. All rights reserved.

(Courtesy of Raj Buyya, 2012)

Page 29: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 29

Page 30: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 30

Cloud Computing Challenges: Dealing with too many issues (Courtesy of R. Buyya)

Billing

Utility & Risk

Management

Scalability

Reliability

Software Eng.

Complexity

Programming Env.

& Application Dev.

Page 31: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 31

The Internet of Things (IoT)

Internet of

Things

Smart Earth

Smart

Earth:

An

IBM

Dream

Page 32: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 32

Opportunities of IoT in 3 Dimensions

(courtesy of Wikipedia, 2010)

Page 33: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 33

System Scalability vs. OS Multiplicity

Page 34: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 34

System Availability vs. Configuration Size :

Page 35: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 35

Page 36: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

36

Transparent Cloud Computing Environment

Page 37: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 37

Parallel and Distributed Programming

Page 38: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 38

Grid Standards and Middleware :

Page 39: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 39

Page 40: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 40

Energy Efficiency :

Page 41: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 41

System Attacks and Network Threads

Page 42: Aula 01 - Moodle USP: e-Disciplinas · Aula 01 - Enabling Technologies ... that has been greatly advocated since 2007 ... on-demand access to applications

Copyright © 2012, Elsevier Inc. All rights reserved. 1 - 42

Four Reference Books:

1. K. Hwang, G. Fox, and J. Dongarra, Distributed and Cloud

Computing: from Parallel Processing to the Internet of Things

Morgan Kauffmann Publishers, 2011

2. R. Buyya, J. Broberg, and A. Goscinski (eds), Cloud Computing:

Principles and Paradigms, ISBN-13: 978-0470887998, Wiley Press,

USA, February 2011.

3. T. Chou, Introduction to Cloud Computing: Business and

Technology, Lecture Notes at Stanford University and at Tsinghua

University, Active Book Press, 2010.

4. T. Hey, Tansley and Tolle (Editors), The Fourth Paradigm : Data-

Intensive Scientific Discovery, Microsoft Research, 2009.