15
www.kom.tu-darmstadt.de Dipl.-Math. Dipl.-Inform. Kalman Graffi KOM - Multimedia Communications Lab Dept. of Electrical Engineering and Information Technology, Dept. of Computer Science TUD – Technische Universität Darmstadt Merckstr. 25, D-64283 Darmstadt, Germany, [email protected] Tel.+49 6151 164959, Fax. +49 6151 166152 26.06.22 1 © author(s) of these slides 2007 including research results of the research network KOM otherwise as specified at the respective slide Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows Kalman Graffi , Konstantin Pussep, Sebastian Kaune, Aleksandra Kovacevic, Nicolas Liebau, and Ralf Steinmetz

IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

Embed Size (px)

DESCRIPTION

Peer-to-peer and mobile networks gained significant attention of both research community and industry. Applying the peer-to-peer paradigm in mobile networks lead to several problems regarding the bandwidth demand of peer-to-peer networks. Time-critical messages are delayed and delivered unacceptably slow. In addition to this, scarce bandwidth is wasted on messages of less priority. Therefore, the focus of this paper is on bandwidth management issues at the overlay layer and how they can be solved. We present HiPNOS.KOM, a priority based scheduling and active queue management system. It guarantees better QoS for higher prioritized messages in upper network layers of peer-to-peer systems. Evaluation using the peer-to-peer simulator PeerfactSim.KOM shows that HiPNOS.KOM brings significant improvement in Kademlia in comparison to FIFO and Drop-Tail, strategies that are used nowadays on each peer. User initiated lookups have in Kademlia 24% smaller operation duration when using HiPNOS.KOM.

Citation preview

Page 1: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

ww

w.k

om

.tu

-da

rmst

ad

t.d

e

Dipl.-Math. Dipl.-Inform. Kalman Graffi

KOM - Multimedia Communications LabDept. of Electrical Engineering and Information Technology, Dept. of Computer ScienceTUD – Technische Universität Darmstadt Merckstr. 25, D-64283 Darmstadt, Germany, [email protected] Tel.+49 6151 164959, Fax. +49 6151 166152

10.04.23

1

© a

utho

r(s)

of

thes

e sl

ides

200

7 in

clud

ing

rese

arch

res

ults

of

the

rese

arch

net

wor

k K

OM

ot

herw

ise

as s

peci

fied

at t

he r

espe

ctiv

e sl

ide

Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

Kalman Graffi, Konstantin Pussep, Sebastian Kaune, Aleksandra Kovacevic, Nicolas Liebau, and Ralf Steinmetz

Page 2: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

2

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Example: Bandwidth Usage in Unst. P2P Overlay

Queries

I cannot hear youHelp!

Emergency!

Unimportant

Bandwidth usage :

• Irrelevant search queries starve relevant queries• Overlay flow specific QoS demands unconsidered

Page 3: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

3

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Outline

Motivation and Scope

Background: Scheduling and Active Queue Management

Contribution:• Characteristics of Overlay Flows• Requirements and Related Work• Overlay Bandwidth Management Layer• HiPNOS.KOM - Our Solution

Evaluation

Future Work and Conclusion

Page 4: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

4

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Motivation for Bandwidth Management

Emerging commercial P2P applications require• Quality of Service• Crucial for long-term success of P2P paradigm

Most critical resource in P2P systems: bandwidth• In most cases the bottleneck in the system• Required for maintenance and service provisioning

P2P specific bandwidth management needed• Control the bandwidth, provide QoS• Overlay independent solution

Page 5: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

5

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Which Flows are in Focus?

Types of flows in P2P systems

• Layer 4 traffic flows: • Underlay perspective• Out of scope

• Direct P2P communication: • File transfer, application traffic, …• Few, but large data streams (elephants)• (Often) with low priority for the system

• Overlay flows• Multi-hop: maintenance, user queries…• Many, small messages (mice)• Varying relevance for system

Provide QoS to overlay flow according to its relevance

Page 6: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

6

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Learn from network layer

• Scheduling• Reorder tasks/messages in queue• Reference: First-in-First-Out

• Active Queue Management • Drop msg. upon congestion of queue• Reference: Drop Tail

Research challenge: how to apply on overlay layer?

Scheduling and Active Queue Management

Message

1. Message SchedulingBefore:

After:

2. Queue ManagementBefore:

After:Queue Limit

Sched.+AQM

Page 7: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

7

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Overlay Bandwidth Management

Generally applicable overlay bandwidth management• New layer Network Wrapper: API between overlay and underlay

Research challenge: Which requirements are defined• by overlay flow characteristics• for the SCHED + AQM used

In-from overlay

Insert msg in buffer

Apply AQM mech.

Timeout

Pick next msg (SCHED)

Out to underlay

Bandwidth available?

Receive message

yesno

Buffer management

Page 8: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

8

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Observation• Huge number of contacts with few messages each• Overlay “flows” and traditional flows differ significantly

Conclusion • Stateless scheduler needed• Quality of service information are stored in messages

Analyzing Overlay Flows in Kademlia

Simulation of KademliaSetup:

• PeerfactSim.KOM• 10,000 peers, all join,

random store/lookupMetrics:

• # of contacts per peer• # of msg per contact

Results:

Page 9: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

9

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Requirements and Related Work

Requirements:• QoS attributes per message (defined by higher layer):

• Introduce delay priority (ϵ PD) and loss priority (ϵ PL)• Quality req.:

Related Work see paper/Technical Reports of author• SCHED and AQM proposed for routing layer (L3)

Expect long-term flows, not existing in overlays• Overlay bandwidth management in overlays

• Mobile P2P (on UMTS/GSM), P2P multimedia streams Focus on underlay/multimedia

characteristics• GIA [Chawathe, 2003], controls incoming traffic

Sched. and AQM mechanism for overlay flows needed

Page 10: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

10

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

HiPNOS.KOM: Highest Priority First, No Starvation• Introduce (independent) message priorities

• For loss – criticality (1 byte)• For delay – criticality (1 byte)

Active Queue Management solution:• If buffer size exceeded:

• Drop message with lowest loss-prio.

Scheduling solution• If bandwidth available:

• Pick message with highest latency-prio.

Avoid starvation• Periodically increase delay-prio. of queued messages

Our Solution: Sched. and AQM of Overlay Flows

In-from overlay

Insert msg in buffer

Apply AQM mech.

Timeout

Pick next msg (SCHED)

Out to underlay

Bandwidth available?

Receive message

yesno

Page 11: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

11

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Evaluation Setup

Compare HiPNOS.KOM with reference solution• First In, First Out: reference scheduling solution• Drop Tail: reference active queue management mech.

Simulation Setup:• Simulated: Kademlia on PeerfactSim.KOM• Scenario:

• 10000 peers join, heterogeneous bandwidths• Peers perform random store/lookup operations• Msgs with random delay/loss priorities: -128 to 127

• Varying: HiPNOS.KOM and FIFO/Drop Tail• 20 simulation runs per setup• Metrics: Delay of msgs and number of dropped msgs

Page 12: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

12

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Evaluation Results of HiPNOS.KOM

Results:

Quality of service increases with priority • Delay antiproportional to priority• Loss decreases with increasing priority

QoS requirements of overlay flows can be fulfilled

Page 13: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

13

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Future Work

Observation:• QoS requirements fulfilled: higher prio., better QoS• Even minimal mechanisms are sufficient

Conclusion:• Shift of research focus:

• Not how to provide QoS for overlay flows (solved)• But how set QoS priorities of overlay messages

Next steps:• Emergency Call Handling (ECH) over P2P Overlays

• Globase.KOM used to find closest Emergency Station• ECH messages have highest priority in overlay• Fulfills legal and technical requirements for ECH

• Security issues• Evaluate with more overlay types (unstructured…)

Page 14: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

14

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

ConclusionProblem: QoS for overlays currently not supported

• Overlays cannot be used for critical applications• Heterogeneity of message relevance not supported

Contribution:• Overlay flow characteristics identified: only mice flows• Introduce message priorities for loss and delay• HiPNOS.KOM enables P2P overlays to support QoS

demands

Evaluation:• Good/expected results show effectiveness of solution

Impact:• Increase of stability, scalability, robustness …

• of overlay and application• for low (no?) costs

• Enables QoS-based applications

Page 15: IEEE LCN 2007: Kalman Graffi - Overlay Bandwidth Management: Scheduling and Active Queue Management of Overlay Flows

10.04.23

15

ww

w.k

om

.tu

-da

rmst

ad

t.d

eK

. G

raff

i et

al.

Ove

rlay

Ba

nd

wid

th M

an

ag

em

en

t

Questions?

Kalman Graffi

Peer-to-Peer Research Group

Dept. of Electrical Engineering and Information TechnologyMultimedia Communications Lab · KOM

Merckstr. 25 · 64283 Darmstadt · GermanyPhone (+49) 6151 – 16 49 59Fax (+49) 6151 – 16 61 [email protected]

Further information: http://www.KOM.tu-darmstadt.de/

Publications: http://www.KOM.tu-darmstadt.de/Research/Publications/publications.html