88
Course Matters

Course Matters

  • Upload
    jetta

  • View
    32

  • Download
    2

Embed Size (px)

DESCRIPTION

Course Matters. Recent Papers. from journals. Good Posters Bad Posters. Improving I/O Performance of Intermediate Multimedia Storage Node. Pal Halvorsen Thomas Plagemann Vera Goebel Multimedia Systems 03. Problem. Improve the performance of I/O in integrated multimedia storage node - PowerPoint PPT Presentation

Citation preview

Page 1: Course Matters

Course Matters

Page 2: Course Matters

Recent Papers

from journals

Page 3: Course Matters

Good PostersBad Posters

Page 4: Course Matters

Improving I/O Performance of Intermediate

Multimedia Storage Node

Pal HalvorsenThomas Plagemann

Vera GoebelMultimedia Systems 03

Page 5: Course Matters

Problem

• Improve the performance of I/O in integrated multimedia storage node

• 3 areas of improvement are identified• reduce memory copy• checksum computation• FEC computation

Page 6: Course Matters

Reduce Memory Copy

• File system maintain pointer to an area in memory

• Communication system maintain pointer to same area in memory

• Memory copy avoided!

Page 7: Course Matters

Network Level Framing• Packet payloads are stored with

checksum• When packets are retrieved for sending,

destination address in header is updated• Checksum is updated with new

destination• No need to recompute checksum for

payload

Page 8: Course Matters

Integrated Error Management

• Data are stored on RAID-4 (single parity checks)

• Use the same error correcting code for RAID and packets

• Avoid multiple computation of error correcting code

Page 9: Course Matters

Experiment: Memory Copy

• Read 28662512B file 38 times in a loop

• The time to transmit data through the storage node is reduced by 45-50% when there is no CPU load, and by 70-73% when CPU load is high

Page 10: Course Matters

Experiment: Network Level Framing

• Transmit 255MB file• Time to calculate checksum is

reduced by 95-99%• Time spent in kernel is reduced

by 51-61%

Page 11: Course Matters

Experiment: Integrated Error Management

• With encoding FEC, the maximum throughput is 22-24 Mbps.

• Without encoding FEC, the maximum throughput is 1Gbps

Page 12: Course Matters

Let’s try again..

Page 13: Course Matters

Improving I/O Performance of

Intermediate Media Storage Node

Pal HalvorsenThomas Plagemann

Vera Goebel

Page 14: Course Matters

Contributions

• Improve performance by• reducing memory copy• reducing checksum computation• reducing ECC computation

Page 15: Course Matters

Reduce Memory Copy

• One shared copy of data for different OS component

dataFile

SystemNetworkSystem

Memory

Page 16: Course Matters

Network Level Framing

1

2

3

store payloadwith payload’s checksum

read payloadwith checksum

update header andchecksum

• Reduce time to packetize data and compute checksum for data

Page 17: Course Matters

Integrated Error Management

• Avoid multiple computation of error correcting code

data data data ECCRAID

ECC

reuse RAIDECC as ECCpacket

Page 18: Course Matters

Average Time to Transmit 1GB file from memory system under high CPU Load

0

50

100

150

200

250

300

1KB 2KB 3KB 4KBPacket Size

Tim

e (s

)

zero-copytraditional

Results: Zero Copy

Page 19: Course Matters

Results: Network Level Framing

UDP With NLF

0

2

4

6

8

1 2 4 8Packet Size (KB)

Tim

e (x

100

ms)

The RestChecksum

Traditional UDP

0

2

4

6

8

1 2 4 8Packet Size (KB)

Tim

e (x

100

ms)

Accumulated UDP Protocol Execution Time for sending 225MB file

Page 20: Course Matters

Results: Integrated Error Management

With ECC Encoding

Without ECC Encoding

22-24 Mbps 1 Gbps

Maximum Throughput with/without Encoding usingCauchy-based Reed Solomon Erasure Code

Page 21: Course Matters

Ad Hoc Networks

Session 1

Page 22: Course Matters

Mobile Ad Hoc Network

Radio

Router

Host

Page 23: Course Matters

Animation

• http://www-i4.informatik.rwth-aachen.de/~mesut/manet/manet_en.html

Page 24: Course Matters

Mobile Ad Hoc Network

RadioRouterHost

RadioRouterHost

RadioRouterHost

RadioRouterHost

Page 25: Course Matters

Examples

• Battlefield• Highway• Disaster Zone

Page 26: Course Matters

Challenges

• All the difficulties of wireless LAN• Plus• Nodes can move• Connections can go up/down• No fix route

Page 27: Course Matters

Two Papers

• IEEE JSAC • Special Issues in Wireless

Multimedia

• Baochun Li from U. of Toronto• Shiwen Mao from Polytechnic U.

Page 28: Course Matters

NonStop: Continuous Streaming Service on

MANET

Baochun Li IEEE JSAC 2004

Page 29: Course Matters

Streaming over MANET

Page 30: Course Matters

Network Partition Problem

Page 31: Course Matters

Only Solution ..

• Predict Partition• Replicate Service

Page 32: Course Matters

Partition Prediction

Page 33: Course Matters

Network Partition Problem

Page 34: Course Matters

How to Predict Partition?

• given velocity of each node• cluster nodes into “mobile

groups”• find mean group velocity

Page 35: Course Matters

Clustering Algorithm

Page 36: Course Matters

Clustering Algorithm

Page 37: Course Matters

Clustering Algorithm

Page 38: Course Matters

Clustering Algorithm

Page 39: Course Matters

Choosing Server

?

Page 40: Course Matters

How to Choose Server?

• find “stable group”• choose server within stable

group with the most similar velocity

Page 41: Course Matters

Stable Group

A B

mean <= radio rangeand variance is not too large

probability

distance

Page 42: Course Matters

Stable Group

A C

D

FG

H

E

B

Page 43: Course Matters

Stable Group

A C

D

FG

H

E

B

BCD are in my group

AGH are in my group

Page 44: Course Matters

Stable Group

A C

D

FG

H

E

B

BCDGH are in my group

ABDGH are in my

group

Page 45: Course Matters

How to Choose Server?

• find “stable group”• choose server within stable

group with the most similar velocity

Page 46: Course Matters

Summary

• Server construct mobile group by clustering nodes using velocity

• Use mean mobile group velocity to predict network partition

•Replicate service before partition to ensure continuous service

Page 47: Course Matters

Summary

• Node construct stable group by comparing distance over time

• Choose server within stable group with most similar velocity

Page 48: Course Matters

Multipath Transport and Multistream

Coding for MANET

Shiwen Mao et. al.IEEE JSAC

Page 49: Course Matters

Single Path Transport

Page 50: Course Matters

Multipath Transport

Page 51: Course Matters

Multipath Transport

Page 52: Course Matters

Video Coding: 1 of 3

I P P P P P P P

Typical Frame Dependency

Page 53: Course Matters

Video Coding: 1 of 3

II

PP

PP

PP

Multistream Coding

Page 54: Course Matters

Dynamic Reference Frame

• Choose last received frame as reference

believed to be received

Page 55: Course Matters

Predict Network States

GOOD :)

BAD :(

NACK ACK

Page 56: Course Matters

Example

0

1

2

3

4

5

6

7

ACK0 ACK2 ACK4

NACK1 NACK3 NACK5 ACK7

8

9

ACK6

10

Page 57: Course Matters

Video Coding: 2 of 3

I P P P

I P P P Base Layer

EnhancementLayer

Page 58: Course Matters

Video Coding: 2 of 3

S D

EL

BL

Page 59: Course Matters

Video Coding: 2 of 3

NACK

NACK

Page 60: Course Matters

Video Coding: 2 of 3

S D

BL

Page 61: Course Matters

Video Coding: 3 of 3

• Multiple Description Coding

Page 62: Course Matters

MDMC

• MDMC

+

Page 63: Course Matters

Example of MDMC

359 363 370

+7

Typical Reference Frame

Page 64: Course Matters

Example of MDMC

359 363 370

MDMC Reference Frame

Page 65: Course Matters

Example of MDMC

359 363 +9

Page 66: Course Matters

Example of MDMC

359 ? +9

Page 67: Course Matters

Example of MDMC

359 363 370

+9

361

Page 68: Course Matters

Example of MDMC

359 ? +9,+2

Page 69: Course Matters

Comparisons

Reference Frame

LayeredCoding

MDMC

Feedback

Buffer

Decoding Delay

Page 70: Course Matters

Improving Multicast

Session 2

Page 71: Course Matters

Organizing Multicast Receivers

Brian Neil Levine Sanjoy Paul

JJ Garcia-Luna-AcevesMultimedia Systems 03

Page 72: Course Matters

Retransmission in Mcast

Page 73: Course Matters

Idea

• Ask a neighbour for a missing packet

Page 74: Course Matters

“Helper” Tree

Page 75: Course Matters

Pick Helper By Hop

Page 76: Course Matters

Pick Helper by Hop

• Not entirely accurate• Need to consider latency, link

condition etc.

Page 77: Course Matters

Pick Neighbour By Latency

Page 78: Course Matters

Pick Helper by Latency

• How to measure latency?• unicast?• multicast?• shared-tree? per-source tree?

Page 79: Course Matters

Ideal “Location” of Helper

• share a common path, and is closer to source (“acceptable”)

Page 80: Course Matters

Idea

• Suppose node A and B know their path back to the source, then they can deduce if A is acceptable to help B

Page 81: Course Matters

MTrace

A B C

D

E

HG

F

I

Page 82: Course Matters

ERS

A B C

D

E

HG

F

I

my path is ABCDF

Page 83: Course Matters

ERS

A B C

D

E

HG

F

I

Page 84: Course Matters

Respond if

• acceptable• not too many helpee

Page 85: Course Matters

Picking Helper

• packet loss measurement

A B C

D

E

HG

F

I

30%

10%

Page 86: Course Matters

Maintenance

• Periodic refresh states (soft-states)

• Periodic repeat procedure

Page 87: Course Matters

Summary

• Organized receivers based on common path

• Enable peer-to-peer retransmission

Page 88: Course Matters

THE END