Rate-Distortion Analysis and Streaming of SP and SI Frames

Eric Setton and Bernd Girod

CSVT, 2006

Outline

• Introduction• RD Analysis of SP and SI Frames• Rate-Distortion Performance• Optimal Setting for Streaming• Performance Analysis

Introduction

• SP/SI frame– Part of H.264 Ext Profile.– Reconstructed without drift by using different pr

edictors.• Drift-free bitstream switching.

P P SP P P SP 1 P

SI

P SP 2 P

SP 12

Bitstream 1

Bitstream 2

P

Primary SP Secondary SP

1 2

3

MV12

Referenceframe

Currentframe

http://vc.cs.nthu.edu.tw/home/paper/codfiles/cycho/200402181718/The_SP-_and_SI-Frames_Design_for_H.264_AVC.ppt by CYCho

RD Analysis of SP and SI Frames (1)

• RD function of an ideal video encoder–

– Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing And Communications. Prentice Hall, 2002, pp.233-234.

Power spectral density (PSD) of zero-mean Gaussian signal a.

Intermediate parameter

Spatial frequency

Input zero-mean Gaussian signal

RD Analysis of SP and SI Frames (2)

• RD analysis of primary SP picturesRate

DistortionAssumptions

DSP1 = D1 + D2

(at high rates)

D1

D2

RD Analysis of SP and SI Frames (3)

• RD analysis of SI and secondary SP pictures

Rate

Distortion

3

3>1 if switching up3<1 if switching down

Rate-Distortion Performance

• Theoretical vs. experimental RD performance

2 = 0.91, 3 = 1.21 for switching up, and3 = 0.51 for switching down.

QCIF, Foreman, 30fps

SP 1.9P≒ SI 1.35I≒

Optimal Setting for Streaming (1)

• Minimize

s.t.

• Minimize

s.t.

P P SP P

SI

P

x: The probability of transmitting an SI frame

D: The distortion of rest stream

At high rates,

Solution:

D = DSP1 = D1 + D2

Optimal Setting for Streaming (2)

=

=SI

SI

dR

dD

1

1

SP

SP

dR

dD

1.

2. 3.

5.

4.

Performance Analysis

SP B B B P B B B P B B B P B B B SP

I B B B P B B B P B B B P B B B I

SI B B B P B B B P B B B P B B B SI

Streaming of SP and SI Pictures

• http://vc.cs.nthu.edu.tw/home/paper/codfiles/cycho/200507272027/Video_streaming_with_SP_and_SI_frames.ppt