1

Seminar Presentation

Multimedia Audio / Video Communication Standards

Instructor: Dr. Imran Ahmad

By: Ju WangNovember 7, 2003

2

In this presentation ……

There are many standards in multimedia world

MPEG’s standards are well-known and are used everywhere

This organization – Moving Picture Experts Group, was established in 1988

MPEG family’s standards……

3

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

4

MPEG-1

Code of moving pictures and associated audio for digital media at up to 1,5 Mbit/s

Became an international standard in 1993

Remarkable achievement

5

Why need MPEG-1

CD-ROM enabled users to have hundreds of Megabyte storages

Interactive video applications on CD

1.5 Megabit/s was the transfer rate of CD at that time (single speed)

6

MPEG-1 brought us

Video CD

MP3 – MPEG-1 Audio Layer 3

7

Five parts in MPEG-1

Part 1 – the system

Medium specific decoder

MPEG-1 system decoder

Video decoder

Clock control

Audio decoder

Digital Storage Medium

Decoded Video

Decoded AudioMPEG-1

Stream

8

Five parts in MPEG-1

Part 2, video Part 3, audio Part 4, testing Part 5, technique report for the

implementation

9

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

10

MPEG-2

Generic coding of moving pictures and associated audio information

Started in 1990, became international standard in 1995

11

MPEG-2’s goal

Improve the audiovisual quality of MPEG-1

Support digital TV

Compatible with MPEG-1

12

MPEG-2 brought us

DVD HDTV

Because MPEG-2’s performance, the MPEG-3, whose goal was enabling HDTV, was abandoned

13

Ten parts in MPEG-2

1. System 2. Video 3. Audio 4, 5. correspond to those in MPEG-1 6. Digital Storage Media Command

and control 7. Advanced audio

14

10 Parts in MPEG-2

9. Real time interface for system decoder

10. Conformance test 11. IPMP in MPEG-2

15

MPEG-2 vs. MPEG-1

Video quality MPEG-1: VCD MPEG-2: DVD / DTV

Audio quality MPEG-1: two (stereo) MPEG-2: multichannel

Bitrates MPEG-1: 0.8 – 2 M MPEG-2: 2 – 8 M

16

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

17

MPEG-4

Coding of audiovisual object

Became international standard in 1998 (version 1)

18

MPEG-4’s goal

Provide high quality audiovisual over a large range of bitrates

Enable higher level of interaction with media content

19

MPEG-4’s scope

Satisfy the needs of content authors service providers end users

20

MPEG-4’s feature

Use “media object” to represent audiovisual content

Facilitate content-based interaction Improve the video compression

efficiency Work in a wide range of bitrate

64kbps – 4mbps

21

MPEG-4’s features

Provide robustness to information errors and loss, resolution scalability, and object scalability

22

MPEG-4’s applications

Internet multimedia Interactive video game Interpersonal communication Interactive storage media Wireless multimedia Broadcasting applications And more…

23

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

24

MPEG-7

Multimedia Content Description Interface

Initiated in 1996, and became an international standard in 2002

25

MPEG-7’s goal

Search, access, filter, retrieve, and manage audiovisual information Digital multimedia spreads Transmission speeds increase and

storage costs fall Allow higher interoperability Support a broad range of applications

26

MPEG-7’s Feature

Provide a set of audiovisual description tools describe the “meaning” of the

multimedia content

The descriptions do not relay on the way the content is coded or stored

This description can be passed to, or accessed by other tools or applications

27

MPEG-7’s feature

Allow different granularity in the description Creation: author, title Usage: copyright Low level feature: color, texture Conceptual: event Collection of object Interaction: user preference

28

MPEG-7’s feature

The description can be extracted Automatically – only for some low level

features, like color, textual Manually – for most high level features

e.g. there are three persons in the scene

29

MPEG-7’s scope

30

MPEG-7’s main elements

Descriptive tools Descriptors Description schema

Description definition language System tools

31

MPEG-7’s applications

Broadcast media selection Multimedia editing Home entertainments Multimedia searching, filter Much more…

32

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

33

MPEG-21

Multimedia Framework

Part 2 & 3 became international standard this year

The rest of other parts are under developing

34

MPEG-21’s vision & goal

Enable transparent and augmented use of multimedia resources across a wide range of network and devices to meet the needs for all users.

Its goal is to describe a big picture of how different elements to build an infrastructure for delivery and consumption of multimedia content relate to each other.

35

MPEG-21’s framework

For all electronic creation, production, delivery and trade of content

Seek existing standards where appropriate

Based on two essential concepts: Digital items Users

36

MPEG-21’s digital items & Users Digital Items

Can be anything from an element piece content (a single picture), to a complete collection of audiovisual work

Users Can be anyone, from authors, to vendors

to end users Users are equal, in the sense that they

all have their rights and interests in digital items

37

MPEG-21’s applications

Digital library Broadcast usage Multimedia publishing & release Trade transactions Much more…

38

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

39

A comparison

MPEG Standard Targeted Usage

MPEG-1 MPEG-2 MPEG-4

Coding of audio/visual content

MPEG-7 Providing metadata that describes multimedia content

MPEG-21 Providing a framework for the all-electronic creation, production, delivery and trade of content. Within the framework we can use the other MPEG standards where appropriate.

40

A comparison

MPEG-1/2/4 all aim at coding of audiovisual content

MPEG-1/2 are frame-based, and MPEG-2 compatible with MPEG-1

MPEG-4 is media object-based

41

A comparison

MPEG-7 will not replace the first three, it gives the contents ‘meaning’ by describing them

MPEG-21 is much broader, dealing with units that consist of multiple resources

42

Outline

MPEG – 1 MPEG – 2 MPEG – 4 MPEG – 7 MPEG – 21 A comparison of them Other standards

43

Other standards

H. 242, by CCITT. H.320, by CCITT QuickTime, by Apple computer, Inc. RIFF, by Microsoft and IBM RTP Much more…

44

References MPEG home page: http://www.chiariglione.org/mpeg/

MPEG-1: http://www.chiariglione.org/mpeg/standards/mpeg-1/mpeg-1.htm

MPEG-2: http://www.chiariglione.org/mpeg/standards/mpeg-2/mpeg-2.htm

MPEG-4: http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm

MPEG-7: http://www.chiariglione.org/mpeg/standards/mpeg-7/mpeg-7.htm

MPEG-21: http://www.chiariglione.org/mpeg/standards/mpeg-21/mpeg-21.htm

From MPEG-1 to MPEG-21: Creating an Interoperable Multimedia Infrastructure: http://www.chiariglione.org/mpeg/from_mpeg-1_to_mpeg-21.htm

Riding the Media Bits: http://www.chiariglione.org/ride/

ISO/IEC JTC 29 Programme of Work: http://www.itscj.ipsj.or.jp/sc29/29w42911.htm

Standards in multimedia: http://cui.unige.ch/OSG/info/MultimediaInfo/mmsurvey/standards.html

MPEG-2 FAQ at Berkeley Multimedia Research Center: http://bmrc.berkeley.edu/frame/research/mpeg/mpeg2faq.html

45

The end

Thanks

To the organizations like MPEG

To everyone here today

Questions