62
ACTA UNIVERSITATIS UPSALIENSIS UPPSALA 2021 Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 2074 Networked Latency Sensitive Applications - Performance Issues between Cloud and Edge LORENZO CORNEO ISSN 1651-6214 ISBN 978-91-513-1295-8 URN urn:nbn:se:uu:diva-452971

NetworkedLatency Sensitive Applications-PerformanceIssues

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: NetworkedLatency Sensitive Applications-PerformanceIssues

ACTA UNIVERSITATIS

UPSALIENSIS UPPSALA

2021

Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 2074

Networked Latency Sensitive Applications - Performance Issues between Cloud and Edge

LORENZO CORNEO

ISSN 1651-6214 ISBN 978-91-513-1295-8 URN urn:nbn:se:uu:diva-452971

Page 2: NetworkedLatency Sensitive Applications-PerformanceIssues

Dissertation presented at Uppsala University to be publicly examined in Room 2446, ITC, Lägerhyddsvägen 2, Uppsala, Thursday, 4 November 2021 at 13:15 for the degree of Doctor of Philosophy. The examination will be conducted in English. Faculty examiner: Professor Anna Brunström (Karlstads Universitet).

Abstract Corneo, L. 2021. Networked Latency Sensitive Applications - Performance Issues between Cloud and Edge. Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 2074. 62 pp. Uppsala: Acta Universitatis Upsaliensis. ISBN 978-91-513-1295-8.

The increasing demand for industrial automation has motivated the development of applications with strict latency requirements, namely, latency-sensitive applications. Such latency requirements can be satisfied by offloading computationally intensive tasks to powerful computing devices over a network at the cost of additional communication latency. Two major computing paradigms are considered for this: (i) cloud computing and (ii) edge computing. Cloud computing provides computation at remote datacenters, at the cost of longer communication latency. Edge computing aims at reducing communication latency by bringing computation closer to the users. This doctoral dissertation mainly investigates relevant issues regarding communication latency trade-offs between the aforementioned paradigms in the context of latency-sensitive applications.

This work advances the state of the art with three major contributions. First, we design a suite of scheduling algorithms which are performed on an edge device interposed between a co-located sensor network and remote applications running in cloud datacenters. These algorithms guarantee the fulfillment of latency-sensitive applications' requirements while maximizing the battery life of sensing devices. Second, we estimate under what conditions latency-sensitive applications can be executed in cloud environments. From a broader perspective, we quantify round-trip times needed to access cloud datacenters all around the world. From a narrower perspective, we collect latency measurements to cloud datacenters in metropolitan areas where over 70% of the world's population lives. This Internet-wide large-scale measurements campaign allows us to draw statistically relevant conclusions concerning the readiness of the cloud environments to host latency-sensitive applications. Finally, we devise a method to quantify latency improvements that hypothetical edge server deployments could bring to users within a network. This is achieved with a thorough analysis of round-trip times and paths characterization resulting in the design of novel edge server placement algorithms. We show trade-offs between number of edge servers deployed and latency improvements experienced by users.

This dissertation contributes to the understanding of the communication latency in terms of temporal and spacial distributions, its sources and implications on latency-sensitive applications.

Keywords: Latency Sensitive Applications, Cloud Computing, Edge Computing, Internet Measurements, Age of Information

Lorenzo Corneo, Department of Information Technology, Computer Systems, Box 337, Uppsala University, SE-75105 Uppsala, Sweden.

© Lorenzo Corneo 2021

ISSN 1651-6214 ISBN 978-91-513-1295-8 URN urn:nbn:se:uu:diva-452971 (http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-452971)

Page 3: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 4: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 5: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 6: NetworkedLatency Sensitive Applications-PerformanceIssues

∗ ∗

Page 7: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 8: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 9: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 10: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 11: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 12: NetworkedLatency Sensitive Applications-PerformanceIssues

5th

Page 13: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 14: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 15: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 16: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 17: NetworkedLatency Sensitive Applications-PerformanceIssues

Q3Q1 Q2 Q1

Sensor network

Edgeserver

Internet Cloud Application

Q1 Q3

Q1 Q2

Q3

Page 18: NetworkedLatency Sensitive Applications-PerformanceIssues

Q1

Q2

Q3

Page 19: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 20: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 21: NetworkedLatency Sensitive Applications-PerformanceIssues

Δ(t) = t − U(t)

t U(t)

Δ(t) τΔ

Δ(t) ≤ τΔ

T

� T

Δ̄(t) =1

Δ(t)dt T 0

Page 22: NetworkedLatency Sensitive Applications-PerformanceIssues

Δ(t) ui τΔ

τΔ

Page 23: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 24: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 25: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 26: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 27: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 28: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 29: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 30: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 31: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 32: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 33: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 34: NetworkedLatency Sensitive Applications-PerformanceIssues

∼ ∼

Page 35: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 36: NetworkedLatency Sensitive Applications-PerformanceIssues

<$100Bn $100-300Bn $300-700Bn >$700BnIV III Weather Farming

Monitoring

Smart home Streaming Human

Bandwidth FZ

Wea

ther

Farm

<$1

00B

n $1

00-3

00B

n $3

00-7

00B

n >

$700

Bn

Requ

ired

Late

ncy

10m

s 50

ms

100m

s 10

min

1h

r

Req

uire

d La

tenc

y10

ms

50m

s 10

0ms

10m

in

1hr

Smart city Reaction Time

Remote Perceivable Camera/ Surgery

StreamingSmart home

MTP

PL

HRTSmart city

Remote Camera/ SurgeryTra cLatency D2D Tra cD2D

Wea

rabl

es

Monitoring

Wea

rabl

es

Monitoring

Gaming Gaming Autonomous

Vehicles Latency FZ Edge FZ360o video

AR/VRI II 360o videoMotion-to-Photon

AR/VR AV

10MB 100MB 10GB 100GB >1TB 10MB 100MB 1GB 10GB 100GB >1TB Data generated/entity Data generated/entity

Page 37: NetworkedLatency Sensitive Applications-PerformanceIssues

≤ ≤

Page 38: NetworkedLatency Sensitive Applications-PerformanceIssues

AU:Can

berra

AU:M

elbou

rne

AU:Sy

dney

BE:B

russel

s

BR:Sa

o Pau

lo

CA:M

ontre

al

CA:Q

uebe

c

CA:T

oronto

CH:G

eneva

CH:Zu

rich

CN:B

eijing

CN:Che

ngdu

CN:H

angzho

u

CN:H

ong K

ong

CN:Sh

angh

ai

DE:Berl

in

DE:Fran

kfurt

ES:M

adrid

FI:Hels

inki

FR:Pari

s

GB:Lo

ndon

ID:Ja

karta

IE:Dub

lin

IN:B

enga

luru

IN:Che

nnai

IN:H

ydera

bad

IN:M

umba

i

IT:M

ilan

JP:O

saka

JP:T

okyo

MY:Ku

ala Lu

mpur

NL:Amste

rdam

NO:Oslo

NO:Stavan

ger

PL:W

arsaw

SE:St

ockh

olm

Singa

pore

South

Kore

a

Taiwan

US:A

tlanta

US:D

allas

US:La

s Veg

as

US:N

ew Y

ork

US:Sa

lt La

ke C

i

US:Sa

n Anto

nio

US:Sa

n Fran

cisc

US:Sa

n Jose

US:Se

attle

US:W

ashing

ton

ZA:Cap

e Tow

n

ZA:Jo

hann

esburg

0

25

50

75

100

RT

T [m

s]

Page 39: NetworkedLatency Sensitive Applications-PerformanceIssues

Page 40: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 41: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 42: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 43: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 44: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 45: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 46: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

Page 47: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 48: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 49: NetworkedLatency Sensitive Applications-PerformanceIssues

Q1

Q2

Q3

Page 50: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 51: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 52: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 53: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

. . .

. .

? =

Page 54: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

. .

. .

. .

. . .

Page 55: NetworkedLatency Sensitive Applications-PerformanceIssues

. . .

. . .

Page 56: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 57: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

.

. . .

. . .

. .

. .

.

.

. .

. .

Page 58: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

. .

Page 59: NetworkedLatency Sensitive Applications-PerformanceIssues

.

. .

Page 60: NetworkedLatency Sensitive Applications-PerformanceIssues

. .

. .

Page 61: NetworkedLatency Sensitive Applications-PerformanceIssues
Page 62: NetworkedLatency Sensitive Applications-PerformanceIssues

Acta Universitatis Upsaliensis Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology 2074

Editor: The Dean of the Faculty of Science and Technology

A doctoral dissertation from the Faculty of Science and Technology, Uppsala University, is usually a summary of a number of papers. A few copies of the complete dissertation are kept at major Swedish research libraries, while the summary alone is distributed internationally through the series Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology. (Prior to January, 2005, the series was published under the title “Comprehensive Summaries of Uppsala Dissertations from the Faculty of Science and Technology”.)

ACTA UNIVERSITATIS

UPSALIENSIS UPPSALA

2021 Distribution: publications.uu.se

urn:nbn:se:uu:diva-452971