Upload
docong
View
225
Download
2
Embed Size (px)
Citation preview
Multimedia SystemsMultimedia Systems
Overview of the CourseOverview of the Course
Course PresentationCourse Presentation
Mahdi Amiri
February 2014
Sharif University of Technology
Course SyllabusCourse Syllabus
http://ce.sharif.edu/courses/92-93/2/ce342-1/
WebsiteWebsite
Page 1 Multimedia Systems, Overview
Course SyllabusCourse Syllabus
Z-N. Li, M.S. Drew,
Fundamentals of Multimedia,
Pearson Prentice Hall Upper
Saddle River, NJ, 2004.*
TextbookTextbook
Page 2 Multimedia Systems, Overview
Saddle River, NJ, 2004.*
* We will mostly use class handouts
and lectures. Therefore, text books
could be used as a reference.
Course SyllabusCourse Syllabus
P. Havaldar, G. Medioni, Multimedia Systems:
Algorithms, Standards, and Industry Practices,
Cengage Learning, 2010.
R. Steinmetz and K. Nahrstedt, Multimedia
Other Reference BooksOther Reference Books
http://books.google.com/books/about/Multimedia_Systems.html?id=k83m5inkjXwC
Page 3 Multimedia Systems, Overview
R. Steinmetz and K. Nahrstedt, Multimedia
Fundamentals: Media Coding and Content
Processing, Prentice Hall, 2002.
K. R. Rao, Z. S. Bojkovic and D. A. Milanovic,
Multimedia Communication Systems, Prentice Hall,
2002.… and Wikipedia
Course SyllabusCourse SyllabusGrading PolicyGrading Policy
Page 4 Multimedia Systems, Overview
Quiz: Sunday, Lowest quiz will be dropped
HW: Tuesday, Due: 2 Weeks, Req. MATLAB or Octave
Course SyllabusCourse Syllabus
Examples:Traffic control using mobile phones,
Multimedia systems in schools,
Human computer interfacing,
Video chat over LAN network,
Critical ReadingCritical Reading
Page 5 Multimedia Systems, Overview
Video chat over LAN network,
Telemedicine, TeleCollaboration, etc.
* We will review the examples in a session
Report structureLiterature survey
Pros. and Cons. of the existing methods
Definition of new proposals
Course SyllabusCourse Syllabus
TA(s) and session time
See the course website.
Integral component of the course
Problem Solving ClassesProblem Solving Classes
Page 6 Multimedia Systems, Overview
Integral component of the course
Tools:
MATLAB
GNU Octavewww.gnu.org/software/octave/
www.mathworks.com/products/matlab/
Course OutlineCourse Outline
What is Multimedia?
Components of Multimedia
Multimedia Research Topics and Projects
Introduction to MultimediaIntroduction to Multimedia
Page 7 Multimedia Systems, Overview
Multimedia Research Topics and Projects
Processing: e.g. content-based retrievalGeneration, Representation, Storage, Search and retrieval.
Networking: e.g. QoSTransmission, Delivery.
End-Systems: e.g. User Interfaces
Interaction: e.g. “ubiquity“ devices
Course OutlineCourse Outline
What is “signal”!?
Discrete-time signals and systems
Sampling theorem
Review of Signals and SystemsReview of Signals and Systems
Page 8 Multimedia Systems, Overview
Sampling theorem
Quantization (Scalar Q., Vector Q.)
Transform domain analysis
FFT, STFT, Wavelet
Course OutlineCourse Outline
Audio representations
Formats and standards
Frequency Masking vs. Temporal Masking
AudioAudio
Page 9 Multimedia Systems, Overview
Frequency Masking vs. Temporal Masking
Speech processing
Synthesis, recognition, …
Audio Compression
DPCM, ADPCM, LPC, CELP
Course OutlineCourse Outline
Data storage
Data redundancyLossy and lossless compression
Entropy encoder
Entropy CodingEntropy Coding
Page 10 Multimedia Systems, Overview
Entropy encoder
Predictive coding
Huffman Coding
Lempel-Ziv-Welch
Arithmatic Coding
Course OutlineCourse Outline
Physics of Color
Human Eye
Additive and subtractive color mixing
Image, Color SpaceImage, Color Space
Page 11 Multimedia Systems, Overview
Additive and subtractive color mixing
Color space Models
YUV, RGB, HSV, …
Gamma correction
Course OutlineCourse Outline
Color Depth
Palette, Halftone
Image Resolution
Image, Acquisition and RepresentationImage, Acquisition and Representation
Page 12 Multimedia Systems, Overview
Image Resolution
Histogram, Contrast
High-Dynamic-Range (HDR)
Bracketing
Course OutlineCourse Outline
Image Noise
Gaussian Smoothing
Mean and Median Filter
Image, EnhancementImage, Enhancement
Page 13 Multimedia Systems, Overview
Mean and Median Filter
Sharpening
Edge Detection
Despeckle
Course OutlineCourse Outline
JPEG
Encoder Diagram
Decoder Diagram
Color Space Transformation
Image, CompressionImage, Compression
Page 14 Multimedia Systems, Overview
Color Space Transformation
Subsampling in color space
Discrete Cosine Transform (DCT)
Quantization Matrix
Compression Ratio
Blocking Artifact
Course OutlineCourse Outline
Video Display
Progressive, Interlaced
Analog Broadcast TV Systems
NTSC, PAL
Video, Analog and Digital VideoVideo, Analog and Digital Video
Page 15 Multimedia Systems, Overview
NTSC, PAL
Analog Color Video
Composite video, S-Video, Component video
Digital Video (HDTV)
DVI, HDMI, DisplayPort
Course OutlineCourse Outline
Interframe and intraframe coding
Motion Estimation and Motion Compensation
(MEMC)
Picture Types
Video CodingVideo Coding
Page 16 Multimedia Systems, Overview
Picture Types
I-frames, B-frames, P-frames
Video Codecs
MPEG-1, MPEG-2, MPEG-4
, h.261, h.263, h.264, h.265, …
Course OutlineCourse Outline
Standalone vs. Networked
Live vs. Orchestrated
Multimedia system building blocks
Multimedia (Networking) SystemsMultimedia (Networking) Systems
Page 17 Multimedia Systems, Overview
Multimedia system building blocks
Real-time multimedia system
architecture
Course OutlineCourse Outline
Quality of Service (QoS)
Error concealment
Prioritized Encoding
Multimedia NetworkingMultimedia Networking
Page 18 Multimedia Systems, Overview
Overlay networks
Packet-loss, Congestion
Unicasting and Multicasting
Streaming protocols
Course OutlineCourse Outline
DVB
Interactive TV, Internet-TV, IPTV
E-Learning
Multimedia ApplicationsMultimedia Applications
Page 19 Multimedia Systems, Overview
E-Learning
Human Computer Interface
Multimedia Home Platform (MHP)
Multimedia Information Retrieval System
3D Technologies
Thank You
Multimedia SystemsMultimedia Systems
Overview of the CourseOverview of the Course
Page 20 Multimedia Systems, Overview
1. http://ce.sharif.edu/~m_amiri/
2. http://www.dml.ir/
FIND OUT MORE AT...
Next Session: Introduction to Multimedia SystemsNext Session: Introduction to Multimedia Systems