53
CS 529 Multimedia Networking Review

CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Embed Size (px)

Citation preview

Page 1: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

CS 529 Multimedia Networking

Review

Page 2: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Audio

• What is the tradeoff between sample size and fidelity? Between sample rate and fidelity?

• What uses of computer audio require a high sample rate and large sample size? Which do not? Why?

a

Page 3: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Audio

• What are the sample rate and sample sizes for typical voice-quality audio?

• If typical encoding captures a wave form “as it is”, what does MP3 attempt to do? And how?

a

Page 4: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RS75]

• What is energy?• What is the zero crossing rate?

• More importantly– how are they used?– why are they used?

Page 5: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RS75]

• What is IMN?– How computed?

• What is IMX?– How computed?

Page 6: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Digital Video

• What are typical frame rates for videos?• What are some common resolutions for

videos (e.g., HD)?• How many bits are needed for “true color”

images?

Page 7: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

QoS and Multimedia Applications

• Rank sensitivity (low, medium, high) for

Conversational Voice and DelayStreaming Video and DelayConversational Voice and CapacityStreaming Video and Capacity

Page 8: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Transport Protocols

• One reason TCP is “good” for multimedia applications? Example?

• One reason TCP is “bad” for multimedia applications? Example?

• One reason UDP is “good” for multimedia applications? Example?

• One reason UDP is “bad” for multimedia applications? Example?

Page 9: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Buffering

• What is a playout buffer?

• What is it used for?

• How big is it?

Page 10: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Skype

• What is the network architecture used for Skype?– What kinds of nodes are there?– How are the nodes connected?– Why are they connected this way?

Page 11: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

HTTP Streaming

• How does HTTP work for streaming video?

• Where is the “intelligence” in an HTTP streaming system?

Page 12: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Multimedia Quality Assessment

• Broadly, what are two types of methods to assess multimedia performance?

• What is an example of each method for assessing voice quality?

Page 13: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Experiments in CS

• What are the main steps in the scientific process?

• Provide a Hypothesis for something in Multimedia Networking– How would you test it?

Page 14: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

NetFlix

• Why isn’t frame loss a component of video quality for NetFlix?

• What are the components of NetFlix video quality?

Page 15: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

RTP

• What is it?• Can I use it instead of TCP/UDP?• What are some of RTP’s major features?

Page 16: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

SIP

• What is it? • What services does it provide?

– Registrar?– Proxy?

• How does it allow for a “mobile” caller?

Page 17: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Network Support for Multimedia?

• What are alternatives to “best effort”?• What is a challenge to “guaranteed” QoS?

Page 18: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

Video Compression

• How is it similar to image compression?• How is it different?

• MPEG– What is a GoP?

Page 19: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• What is at least one implicit hypothesis the researchers test?

• How are subjective audio quality ratings provided?

• How are objective audio quality “costs” gathered?

Page 20: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• What is at least one implicit hypothesis the researchers test?– What are some of the independent variables?

• What tool do the researchers use to test audio?

Page 21: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WS00]

• Provide order, best to worstQuiet – one recorded low volume, other normBad mic – one had low quality mic, other norm5% loss – both voices, with repetitionLoud – one recorded high volume, other norm20% loss – both voices, with repetitionEcho – one had open mic, no headsetReference – non-degraded

Page 22: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HHH+12]

• Why is commercial streaming over HTTP confused?

• Why is commercial streaming over HTTP timid?

Page 23: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[RBV+12]

• Which is best?

• What else should be considered?

Page 24: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LG14]

• For video messaging on smartphones, what are two main factors affect transmission speed?

• What are some suggested improvements by the authors?

Page 25: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LG14]

• For video messaging on smartphones, what are two main factors affect transmission speed?

Answer: file size and location

• What are some suggested improvements by the authors?

Answer: Compress/transcode and distribute images among servers in cloud

Page 26: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SKH02]

• What are the 3 fundamental limitations faced by MCGs?

Page 27: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SKH02]

• What is the tension/tradeoff between responsiveness and consistency in MCGs?

• What is interest management? Describe how it works

• What is dead reckoning? Describe how it works

Page 28: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJNC13]

• What are the benefits of using cloud gaming instead of traditional gaming?

• What are the challenges?

Page 29: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

What are the main messages from the graph based on [CFGS14]?

Page 30: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

• Order these from least downstream bitrate to most:– Thin game– Live video– Pre-recorded video– Traditional game– Virtual environment

• What are the approximate bitrates for each?

Page 31: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CFGS14]

Turbulence Summary

Page 32: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJ95]

• What is the E-Policy?• What is the I-Policy?

• When, in general, is the E-Policy good?• When, in general, is the I-Policy good?

• What is a talkspurt?

Page 33: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[SJ95]

• How does QM-120 work?

• What is QM-(600,2)? What is the motivation behind it?

• Describe one item of future work.– Why is it of interest?– Briefly, how would you approach doing it?

Page 34: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• What are the challenges proposed by the paper?– Hint: it considers buffer sizes

• What have the academics done about the challenges?

Page 35: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Briefly describe the methodology the author uses to determine the “optimal” buffer size

Page 36: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Briefly describe the methodology the author uses to determine the “optimal” buffer sizeAns: 1. Encode audio samples2. Simulate loss3. Add delay, dropping if needed4. Decode 5. Apply QoE measure – PESQ + E-model6. Repeat 1-5 for all buffer sizes, with highest QoE

being optimal

Page 37: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[WCCL09]

• Interpret the above graph• What are the main messages?

Page 38: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• What are the client loss characteristics of the Mbone (and other P2P networks)?

• Why can TCP and retransmissions be used to repair loss in the Mbone?

Page 39: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• What is forward error correction (FEC)?

• What are the two categories of FEC described by the authors? What are the main advantages and disadvantages of each?

Page 40: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[PHH98]

• Broadly, what are receiver based repair techniques? Why are they often called error concealment?

• What is a recommended repair technique for a non-interactive, multicast multimedia session? Why?

Page 41: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

2%

0%1%

0%

3%4%

5%6%

7%8%

9%10%

Significance of picture for Skype?

Page 42: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

• What’s is the optimal redundancy ratio for repair as defined by the authors?

Page 43: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

• What’s is the optimal redundancy ratio for repair as defined by the authors?Ans: Minimum amount of redundancy data needed to sustain same audio quality under different network conditions

Page 44: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HCH09]

How did the author’s generate this graph? How to read it?

Page 45: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

• What “alternate” service does ABE offer?– What is green traffic?– What is blue traffic?

Page 46: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

• What does it mean to say “Green does not hurt Blue”?

• Based on below formula, what happens if green “cuts” in line? How do you fix it?

Page 47: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

Using DSD, what is the order of the next 3 packets?

Page 48: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[HKBT01]

What is the significanceof this graph?

Page 49: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LCK10]

• What general property about network bitrates and latency sensitivity does CHAP rely upon?

• What are credits as assigned by CHAP? How are they assigned? How are they “spent”?

Page 50: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[LCK10]

• Interpret the above graph• What are the messages for CHAP?

0 100 200 300 400 500 6000.0

0.5

1.0

FIFO (only qstat)FIFO (qstat + 1 HTTP downloads)

Server Ping (ms)

Page 51: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[MSM04]

• How does the above quote relate to motivation for the proposed work?

• Describe the authors’ variant on the “method of limits” to determine video quality

Recent IBM QoS policy says:“The priority for smooth video is higher than the priority for frame quality”

Page 52: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[MSM04]

• What was difference between acceptability of video for Palmtops versus Desktops?

Page 53: CS 529 Multimedia Networking Review. Digital Audio What is the tradeoff between sample size and fidelity? Between sample rate and fidelity? What uses

[CC10]

• What are three primary ways latency affects players in network games?

• How much does latency affect players in network games?