29
NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

Embed Size (px)

Citation preview

Page 1: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Systems Support for Continuous Media

Page 2: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Scope of this class

Systems Support: Application Middleware Operating System Architecture

Continuous Media: Video, audio, animation

Page 3: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Local Media Applications

Watch Movies Listen to Music Video Editing :

Page 4: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Network Media Applications

Live Webcast Pre-recorded Webcast

YouTube, … Video Conferencing Video on Demand

Page 5: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Categories

Interactive Non-Interactive

LiveVideo

ConferencingNUSLive,NUSCast

Pre-recorded

Lecture/Video on Demand

Page 6: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Streaming Media Requires

Reliable networksLow latencyBounded latencyPlenty of bandwidth

Internet was designed as a best-effort medium

However

Page 7: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Overview

Network

Encoder

Sender

Middlebox

Receiver

Decoder

Page 8: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

We will NOT

Design new codec

Study media processing CS6212/CS5240/CS5249

Attempt to improve the Internet EE5910/CS5224

Page 9: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Summary of TopicsCovered

Page 10: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Sample of Topics Covered

Review of Media CompressionNetwork Communication Model

Network

Encoder

Sender

Middlebox

Receiver

Decoder

Page 11: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Sample of Topics Covered

AdaptationVideo on Demand

Network

Encoder

Sender

Middlebox

Receiver

Decoder

Page 12: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Sample of Topics Covered

Buffering Audio/Video Synchronization Packet Loss Recovery

Network

Encoder

Sender

Middlebox

Receiver

Decoder

Page 13: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Sample of Topics Covered

CachingApplication-Level Multicast

Network

Encoder

Sender

Middlebox

Receiver

Decoder

Page 14: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Lecture Philosophy

Cover breadth, rather than depth

Classic papers, rather than recent papers

Page 15: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Class Organization

Page 16: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Goals

Learn about existing techniques and systems

Learn about current research efforts

Page 17: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Philosophy

Students are expected to be Mature Independent Resourceful

What you learn is (should be) more important than your grade

Page 18: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Please don’t ask …

“Is this equation important?” “Is this equation examinable?” “Do I have to memorize this

header format?” “Post answer to

quiz/survey/review”

Page 19: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Please do ask …

“What is the effect of changing k in the equation?”

“Why did the designer add this bit in the header?”

Page 20: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Academic Honesty

No copying among studentsNo copying from published work

ZERO TOLERENCE to Plagiarism

Page 21: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Discussion?

Strongly encouraged ..but

must acknowledge all contributions write up solutions independently

Page 22: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Continuous Assessments

Page 23: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Continuous Assessments

Project, Writeup & Presentation (35%)

Final Exam (40%)2 Quizzes (2 × 10%)Participation (5%)

Page 24: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Project (35%)

Choose your own topic (maybe)Write proposal (maybe) Implement in C/C++

Page 25: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Project

Deliverables: At start

1-2 page proposal (maybe) At due date

4-6 page paper Source code Demo (probably; depends on the

number of students in the class)

Page 26: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Final Exam (40%)

Open Ended QuestionsEssay Style

Page 27: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Quizzes (20%)

Quizzes (2 × 10%) Open Ended Questions

Page 28: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Web Sites

Main Website http://www.comp.nus.edu.sg/~cs5248

Page 29: NUS.SOC.CS5248-2009 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media

NUS.SOC.CS5248-2009Roger Zimmermann (based on slides by Ooi Wei Tsang)

Q & A