ITU-T Rec. H.264 (03/2005) Advanced video coding for ... · Web viewThe World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics

ITU-T Rec. H.264 (03/2005) Advanced video coding for generic audiovisual services

ISO/IEC 14496-10:2005/FPDAM 3

DRAFT ISO/IEC 14496-10 (2006)

INTERNATIONAL ORGANIZATION FOR STANDARDIZATION

ORGANISATION INTERNATIONALE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11

CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N 8241

July 2006, Klagenfurt, Austria

Title:

Text of ISO/IEC 14496-10:2005/FPDAM3 Scalable Video Coding(in integrated form with ISO/IEC 14996-10)

Source:

Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6)

Editor(s) /Contact(s):

Thomas WiegandHeinrich Hertz Institute (FhG),Einsteinufer 37,D-10587 Berlin, Germany

Gary SullivanMicrosoft CorporationOne Microsoft WayRedmond, WA 98052 USA

Julien ReichelGE Security (VisioWave),Rte. de la Pierre 22,CH-1024 Ecublens, Switzerland

Heiko SchwarzHeinrich Hertz Institute (FhG),Einsteinufer 37,D-10587 Berlin, Germany

Mathias WienInstitut für Nachrichtentechnik,RWTH Aachen University,D-52056 Aachen, Germany

Tel:Fax:Email:

Tel:Fax:Email:

Tel:Fax:Email:

Tel:Fax:Email:

Tel:Fax:Email:

+49 (30) 31002-617+49 (30) [email protected]

+1 (425) 703-5308+1 (425) [email protected]

+41 (21) 695-0041+41 (21) [email protected]

+49 (30) 31002-226+49 (30) [email protected]

+49 (241) 80-27681+49 (241) [email protected]

_____________________________

CONTENTS

Page

xviiForeword

10Introduction

10.1Prologue

10.2Purpose

10.3Applications

10.4Publication and versions of this specification

20.5Profiles and levels

20.6Overview of the design characteristics

30.6.1Predictive coding

30.6.2Coding of progressive and interlaced video

30.6.3Picture partitioning into macroblocks and smaller partitions

30.6.4Spatial redundancy reduction

40.7How to read this specification

41Scope

42Normative references

43Definitions

124Abbreviations

135Conventions

135.1Arithmetic operators

145.2Logical operators

145.3Relational operators

145.4Bit-wise operators

145.5Assignment operators

155.6Range notation

155.7Mathematical functions

165.8Variables, syntax elements, and tables

165.9Text description of logical operations

175.10Processes

186Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships

186.1Bitstream formats

186.2Source, decoded, and output picture formats

236.3Spatial subdivision of pictures and slices

246.4Inverse scanning processes and derivation processes for neighbours

246.4.1Inverse macroblock scanning process

256.4.2Inverse macroblock partition and sub-macroblock partition scanning process

256.4.2.1Inverse macroblock partition scanning process

266.4.2.2Inverse sub-macroblock partition scanning process

266.4.3Inverse 4x4 luma block scanning process

266.4.4Inverse 8x8 luma block scanning process

276.4.5Derivation process of the availability for macroblock addresses

276.4.6Derivation process for neighbouring macroblock addresses and their availability

286.4.7Derivation process for neighbouring macroblock addresses and their availability in MBAFF frames

296.4.8Derivation processes for neighbouring macroblocks, blocks, and partitions

306.4.8.1Derivation process for neighbouring macroblocks

306.4.8.2Derivation process for neighbouring 8x8 luma block

316.4.8.3Derivation process for neighbouring 4x4 luma blocks

316.4.8.4Derivation process for neighbouring 4x4 chroma blocks

326.4.8.5Derivation process for neighbouring partitions

336.4.9Derivation process for neighbouring locations

346.4.9.1Specification for neighbouring locations in fields and non-MBAFF frames

356.4.9.2Specification for neighbouring locations in MBAFF frames

377Syntax and semantics

377.1Method of specifying syntax in tabular form

387.2Specification of syntax functions, categories, and descriptors

397.3Syntax in tabular form

397.3.1NAL unit syntax

407.3.2Raw byte sequence payloads and RBSP trailing bits syntax

407.3.2.1Sequence parameter set RBSP syntax

417.3.2.1.1Scaling list syntax

417.3.2.1.2Sequence parameter set extension RBSP syntax

427.3.2.2Picture parameter set RBSP syntax

437.3.2.3Supplemental enhancement information RBSP syntax

447.3.2.3.1Supplemental enhancement information message syntax

447.3.2.4Access unit delimiter RBSP syntax

447.3.2.5End of sequence RBSP syntax

447.3.2.6End of stream RBSP syntax

457.3.2.7Filler data RBSP syntax

457.3.2.8Slice layer without partitioning RBSP syntax

457.3.2.9Slice data partition RBSP syntax

457.3.2.9.1Slice data partition A RBSP syntax

457.3.2.9.2Slice data partition B RBSP syntax

467.3.2.9.3Slice data partition C RBSP syntax

467.3.2.10RBSP slice trailing bits syntax

467.3.2.11RBSP trailing bits syntax

477.3.3Slice header syntax

487.3.3.1Reference picture list reordering syntax

497.3.3.2Prediction weight table syntax

507.3.3.3Decoded reference picture marking syntax

517.3.4Slice data syntax

527.3.5Macroblock layer syntax

537.3.5.1Macroblock prediction syntax

547.3.5.2Sub-macroblock prediction syntax

547.3.5.3Residual data syntax

567.3.5.3.1Residual block CAVLC syntax

577.3.5.3.2Residual block CABAC syntax

587.4Semantics

587.4.1NAL unit semantics

617.4.1.1Encapsulation of an SODB within an RBSP (informative)

617.4.1.2Order of NAL units and association to coded pictures, access units, and video sequences

617.4.1.2.1Order of sequence and picture parameter set RBSPs and their activation

627.4.1.2.2Order of access units and association to coded video sequences

637.4.1.2.3Order of NAL units and coded pictures and association to access units

647.4.1.2.4Detection of the first VCL NAL unit of a primary coded picture

657.4.1.2.5Order of VCL NAL units and association to coded pictures

667.4.2Raw byte sequence payloads and RBSP trailing bits semantics

667.4.2.1Sequence parameter set RBSP semantics

717.4.2.1.1Scaling list semantics

717.4.2.1.2Sequence parameter set extension RBSP semantics

737.4.2.2Picture parameter set RBSP semantics

767.4.2.3Supplemental enhancement information RBSP semantics

767.4.2.3.1Supplemental enhancement information message semantics

767.4.2.4Access unit delimiter RBSP semantics

767.4.2.5End of sequence RBSP semantics

767.4.2.6End of stream RBSP semantics

767.4.2.7Filler data RBSP semantics

777.4.2.8Slice layer without partitioning RBSP semantics

777.4.2.9Slice data partition RBSP semantics

777.4.2.9.1Slice data partition A RBSP semantics

777.4.2.9.2Slice data partition B RBSP semantics

777.4.2.9.3Slice data partition C RBSP semantics

787.4.2.10RBSP slice trailing bits semantics

787.4.2.11RBSP trailing bits semantics

787.4.3Slice header semantics

847.4.3.1Reference picture list reordering semantics

857.4.3.2Prediction weight table semantics

857.4.3.3Decoded reference picture marking semantics

887.4.4Slice data semantics

897.4.5Macroblock layer semantics

967.4.5.1Macroblock prediction semantics

977.4.5.2Sub-macroblock prediction semantics

997.4.5.3Residual data semantics

1007.4.5.3.1Residual block CAVLC semantics

1007.4.5.3.2Residual block CABAC semantics

1018Decoding process

1028.1NAL unit decoding process

1028.2Slice decoding process

1028.2.1Decoding process for picture order count

1048.2.1.1Decoding process for picture order count type 0



1078.2.2Decoding process for macroblock to slice group map

1088.2.2.1Specification for interleaved slice group map type

1088.2.2.2Specification for dispersed slice group map type

1088.2.2.3Specification for foreground with left-over slice group map type

1098.2.2.4Specification for box-out slice group map types

1098.2.2.5Specification for raster scan slice group map types

1108.2.2.6Specification for wipe slice group map types

1108.2.2.7Specification for explicit slice group map type

1108.2.2.8Specification for conversion of map unit to slice group map to macroblock to slice group map

1108.2.3Decoding process for slice data partitioning

1118.2.4Decoding process for reference picture lists construction

1118.2.4.1Decoding process for picture numbers

1128.2.4.2Initialisation process for reference picture lists

1138.2.4.2.1Initialisation process for the reference picture list for P and SP slices in frames

1138.2.4.2.2Initialisation process for the reference picture list for P and SP slices in fields

1148.2.4.2.3Initialisation process for reference picture lists for B slices in frames

1148.2.4.2.4Initialisation process for reference picture lists for B slices in fields

1158.2.4.2.5Initialisation process for reference picture lists in fields

1168.2.4.3Reordering process for reference picture lists

1168.2.4.3.1Reordering process of reference picture lists for short-term reference pictures

1178.2.4.3.2Reordering process of reference picture lists for long-term reference pictures

1188.2.5Decoded reference picture marking process

1188.2.5.1Sequence of operations for decoded reference picture marking process

1198.2.5.2Decoding process for gaps in frame_num

1198.2.5.3Sliding window decoded reference picture marking process

1208.2.5.4Adaptive memory control decoded reference picture marking process

1208.2.5.4.1Marking process of a short-term reference picture as “unused for reference”

1208.2.5.4.2Marking process of a long-term reference picture as “unused for reference”

1208.2.5.4.3Assignment process of a LongTermFrameIdx to a short-term reference picture

1218.2.5.4.4Decoding process for MaxLongTermFrameIdx

1218.2.5.4.4.1Marking process of all reference pictures as “unused for reference” and setting MaxLongTermFrameIdx to “no long-term frame indices”

1218.2.5.4.5Process for assigning a long-term frame index to the current picture

1228.3Intra prediction process

1228.3.1Intra_4x4 prediction process for luma samples

1238.3.1.1Derivation process for the Intra4x4PredMode

1248.3.1.1.1Derivation process for Intra_4x4 prediction modes

1258.3.1.2Intra_4x4 sample prediction

1268.3.1.2.1Specification of Intra_4x4_Vertical prediction mode

1268.3.1.2.2Specification of Intra_4x4_Horizontal prediction mode

1268.3.1.2.3Specification of Intra_4x4_DC prediction mode

1278.3.1.2.4Specification of Intra_4x4_Diagonal_Down_Left prediction mode

1278.3.1.2.5Specification of Intra_4x4_Diagonal_Down_Right prediction mode

1278.3.1.2.6Specification of Intra_4x4_Vertical_Right prediction mode

1288.3.1.2.7Specification of Intra_4x4_Horizontal_Down prediction mode

1288.3.1.2.8Specification of Intra_4x4_Vertical_Left prediction mode

1298.3.1.2.9Specification of Intra_4x4_Horizontal_Up prediction mode


1308.3.2.1Derivation process for Intra8x8PredMode

1308.3.2.1.1Derivation process for Intra_8x8 prediction modes

1328.3.2.2Intra_8x8 sample prediction

1338.3.2.2.1Reference sample filtering process for Intra_8x8 sample prediction

1348.3.2.2.2Specification of Intra_8x8_Vertical prediction mode

1348.3.2.2.3Specification of Intra_8x8_Horizontal prediction mode

1348.3.2.2.4Specification of Intra_8x8_DC prediction mode

1358.3.2.2.5Specification of Intra_8x8_Diagonal_Down_Left prediction mode

1358.3.2.2.6Specification of Intra_8x8_Diagonal_Down_Right prediction mode

1358.3.2.2.7Specification of Intra_8x8_Vertical_Right prediction mode

1368.3.2.2.8Specification of Intra_8x8_Horizontal_Down prediction mode

1368.3.2.2.9Specification of Intra_8x8_Vertical_Left prediction mode

1378.3.2.2.10Specification of Intra_8x8_Horizontal_Up prediction mode


1388.3.3.1Specification of Intra_16x16_Vertical prediction mode

1388.3.3.2Specification of Intra_16x16_Horizontal prediction mode

1388.3.3.3Specification of Intra_16x16_DC prediction mode

1398.3.3.4Specification of Intra_16x16_Plane prediction mode

1398.3.4Intra prediction process for chroma samples

1418.3.4.1Specification of Intra_Chroma_DC prediction mode

1428.3.4.2Specification of Intra_Chroma_Horizontal prediction mode

1428.3.4.3Specification of Intra_Chroma_Vertical prediction mode

1438.3.4.4Specification of Intra_Chroma_Plane prediction mode

1438.3.5Sample construction process for I_PCM macroblocks

1448.4Inter prediction process

1468.4.1Derivation process for motion vector components and reference indices

1478.4.1.1Derivation process for luma motion vectors for skipped macroblocks in P and SP slices

1488.4.1.2Derivation process for luma motion vectors for B_Skip, B_Direct_16x16, and B_Direct_8x8

1498.4.1.2.1Derivation process for the co-located 4x4 sub-macroblock partitions

1528.4.1.2.2Derivation process for spatial direct luma motion vector and reference index prediction mode

1538.4.1.2.3Derivation process for temporal direct luma motion vector and reference index prediction mode

1568.4.1.3Derivation process for luma motion vector prediction

1578.4.1.3.1Derivation process for median luma motion vector prediction

1588.4.1.3.2Derivation process for motion data of neighbouring partitions

1598.4.1.4Derivation process for chroma motion vectors

1598.4.2Decoding process for Inter prediction samples

1608.4.2.1Reference picture selection process

1618.4.2.2Fractional sample interpolation process

1628.4.2.2.1Luma sample interpolation process

1658.4.2.2.2Chroma sample interpolation process

1668.4.2.3Weighted sample prediction process

1678.4.2.3.1Default weighted sample prediction process

1678.4.2.3.2Weighted sample prediction process

1688.4.3Derivation process for prediction weights

1708.5Transform coefficient decoding process and picture construction process prior to deblocking filter process

1718.5.1Specification of transform decoding process for 4x4 luma residual blocks

1718.5.2Specification of transform decoding process for luma samples of Intra_16x16 macroblock prediction mode

1728.5.3Specification of transform decoding process for 8x8 luma residual blocks

1738.5.4Specification of transform decoding process for chroma samples

1758.5.5Inverse scanning process for transform coefficients

1758.5.6Inverse scanning process for 8x8 luma transform coefficients

1778.5.7Derivation process for the chroma quantisation parameters and scaling function

1798.5.8Scaling and transformation process for luma DC transform coefficients for Intra_16x16 macroblock type

1808.5.8.1Transformation process for luma DC transform coefficients for Intra_16x16 macroblock type

1808.5.8.2Scaling process for luma DC transform coefficients for Intra_16x16 macroblock type

1818.5.9Scaling and transformation process for chroma DC transform coefficients

1818.5.9.1Transformation process for chroma DC transform coefficients

1828.5.9.2Scaling process for chroma DC transform coefficients

1838.5.10Scaling and transformation process for residual 4x4 blocks

1838.5.10.1Scaling process for residual 4x4 blocks

1848.5.10.2Transformation process for residual 4x4 blocks

1858.5.11Scaling and transformation process for residual 8x8 luma blocks

1868.5.11.1Scaling process for residual 8x8 luma blocks

1868.5.11.2Transformation process for residual 8x8 luma blocks

1898.5.12Picture construction process prior to deblocking filter process

1908.5.13Residual colour transform process

1908.6Decoding process for P macroblocks in SP slices or SI macroblocks

1918.6.1SP decoding process for non-switching pictures

1918.6.1.1Luma transform coefficient decoding process

1928.6.1.2Chroma transform coefficient decoding process

1948.6.2SP and SI slice decoding process for switching pictures

1948.6.2.1Luma transform coefficient decoding process

1948.6.2.2Chroma transform coefficient decoding process

1958.7Deblocking filter process

1998.7.1Filtering process for block edges

2018.7.2Filtering process for a set of samples across a horizontal or vertical block edge

2018.7.2.1Derivation process for the luma content dependent boundary filtering strength

2038.7.2.2Derivation process for the thresholds for each block edge

2048.7.2.3Filtering process for edges with bS less than 4

2068.7.2.4Filtering process for edges for bS equal to 4

2079Parsing process

2079.1Parsing process for Exp-Golomb codes

2099.1.1Mapping process for signed Exp-Golomb codes

2099.1.2Mapping process for coded block pattern

2129.2CAVLC parsing process for transform coefficient levels

2139.2.1Parsing process for total number of transform coefficient levels and trailing ones

2169.2.2Parsing process for level information

2179.2.2.1Parsing process for level_prefix

2189.2.3Parsing process for run information

2219.2.4Combining level and run information

2219.3CABAC parsing process for slice data

2229.3.1Initialisation process

2239.3.1.1Initialisation process for context variables

2339.3.1.2Initialisation process for the arithmetic decoding engine

2349.3.2Binarization process

2369.3.2.1Unary (U) binarization process

2369.3.2.2Truncated unary (TU) binarization process

2379.3.2.3Concatenated unary/ k-th order Exp-Golomb (UEGk) binarization process

2379.3.2.4Fixed-length (FL) binarization process

2389.3.2.5Binarization process for macroblock type and sub-macroblock type

2419.3.2.6Binarization process for coded block pattern

2419.3.2.7Binarization process for mb_qp_delta

2419.3.3Decoding process flow

2429.3.3.1Derivation process for ctxIdx

2449.3.3.1.1Assignment process of ctxIdxInc using neighbouring syntax elements

2449.3.3.1.1.1Derivation process of ctxIdxInc for the syntax element mb_skip_flag

2449.3.3.1.1.2Derivation process of ctxIdxInc for the syntax element mb_field_decoding_flag

2459.3.3.1.1.3Derivation process of ctxIdxInc for the syntax element mb_type

2459.3.3.1.1.4Derivation process of ctxIdxInc for the syntax element coded_block_pattern

2469.3.3.1.1.5Derivation process of ctxIdxInc for the syntax element mb_qp_delta

2469.3.3.1.1.6Derivation process of ctxIdxInc for the syntax elements ref_idx_l0 and ref_idx_l1

2479.3.3.1.1.7Derivation process of ctxIdxInc for the syntax elements mvd_l0 and mvd_l1

2499.3.3.1.1.8Derivation process of ctxIdxInc for the syntax element intra_chroma_pred_mode

2499.3.3.1.1.9Derivation process of ctxIdxInc for the syntax element coded_block_flag

2509.3.3.1.1.10Derivation process of ctxIdxInc for the syntax element transform_size_8x8_flag

2519.3.3.1.2Assignment process of ctxIdxInc using prior decoded bin values

2519.3.3.1.3Assignment process of ctxIdxInc for syntax elements significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1

2549.3.3.2Arithmetic decoding process

2559.3.3.2.1Arithmetic decoding process for a binary decision

2559.3.3.2.1.1State transition process

2589.3.3.2.2Renormalization process in the arithmetic decoding engine

2599.3.3.2.3Bypass decoding process for binary decisions

2599.3.3.2.4Decoding process for binary decisions before termination

2609.3.4Arithmetic encoding process (informative)

2609.3.4.1Initialisation process for the arithmetic encoding engine (informative)

2609.3.4.2Encoding process for a binary decision (informative)

2619.3.4.3Renormalization process in the arithmetic encoding engine (informative)

2639.3.4.4Bypass encoding process for binary decisions (informative)

2649.3.4.5Encoding process for a binary decision before termination (informative)

2659.3.4.6Byte stuffing process (informative)

267 Annex A Profiles and levels

267A.1Requirements on video decoder capability

267A.2Profiles

267A.2.1Baseline profile

268A.2.2Main profile

268A.2.3Extended profile

268A.2.4High profile

269A.2.5High 10 profile

269A.2.6High 4:2:2 profile

270A.2.7High 4:4:4 profile

270A.3Levels

270A.1.1Level limits common to the Baseline, Main, and Extended profiles

272A.3.1Level limits common to the High, High 10, High 4:2:2, and High 4:4:4 profiles

273A.1.2Profile-specific level limits

274A.3.1.1Baseline profile limits

275A.3.1.2Main, High, High 10, High 4:2:2, or High 4:4:4 profile limits

276A.3.1.3Extended Profile Limits

278A.3.2Effect of level limits on frame rate (informative)

281 Annex B Byte stream format

281B.1Byte stream NAL unit syntax and semantics

281B.1.1Byte stream NAL unit syntax

281B.1.2Byte stream NAL unit semantics

282B.2Byte stream NAL unit decoding process

282B.3Decoder byte-alignment recovery (informative)

283 Annex C Hypothetical reference decoder

286C.1Operation of coded picture buffer (CPB)

286C.1.1Timing of bitstream arrival

287C.1.2Timing of coded picture removal

288C.2Operation of the decoded picture buffer (DPB)

288C.2.1Decoding of gaps in frame_num and storage of "non-existing" frames

288C.2.2Picture decoding and output

288C.2.3Removal of pictures from the DPB before possible insertion of the current picture

289C.2.4Current decoded picture marking and storage

289C.2.4.1Marking and storage of a reference decoded picture into the DPB

289C.2.4.2Storage of a non-reference picture into the DPB

289C.3Bitstream conformance

291C.4Decoder conformance

292C.4.1Operation of the output order DPB

292C.4.2Decoding of gaps in frame_num and storage of "non-existing" pictures

292C.4.3Picture decoding

292C.4.4Removal of pictures from the DPB before possible insertion of the current picture

292C.4.5Current decoded picture marking and storage

292C.4.5.1Storage and marking of a reference decoded picture into the DPB

293C.4.5.2Storage and marking of a non-reference decoded picture into the DPB

293C.4.5.3"Bumping" process

295 Annex D Supplemental enhancement information

296D.1SEI payload syntax

297D.1.1Buffering period SEI message syntax

297D.1.2Picture timing SEI message syntax

299D.1.3Pan-scan rectangle SEI message syntax

299D.1.4Filler payload SEI message syntax

299D.1.5User data registered by ITU-T Rec. T.35 SEI message syntax

300D.1.6User data unregistered SEI message syntax

300D.1.7Recovery point SEI message syntax

300D.1.8Decoded reference picture marking repetition SEI message syntax

301D.1.9Spare picture SEI message syntax

301D.1.10Scene information SEI message syntax

302D.1.11Sub-sequence information SEI message syntax

302D.1.12Sub-sequence layer characteristics SEI message syntax

303D.1.13Sub-sequence characteristics SEI message syntax

303D.1.14Full-frame freeze SEI message syntax

303D.1.15Full-frame freeze release SEI message syntax

303D.1.16Full-frame snapshot SEI message syntax

304D.1.17Progressive refinement segment start SEI message syntax

304D.1.18Progressive refinement segment end SEI message syntax

304D.1.19Motion-constrained slice group set SEI message syntax

305D.1.20Film grain characteristics SEI message syntax

305D.1.21Deblocking filter display preference SEI message syntax

306D.1.22Stereo video information SEI message syntax

306D.1.23Reserved SEI message syntax

306D.2SEI payload semantics

306D.2.1Buffering period SEI message semantics

307D.2.2Picture timing SEI message semantics

310D.2.3Pan-scan rectangle SEI message semantics

312D.2.4Filler payload SEI message semantics

312D.2.5User data registered by ITU-T Rec. T.35 SEI message semantics

312D.2.6User data unregistered SEI message semantics

312D.2.7Recovery point SEI message semantics

314D.2.8Decoded reference picture marking repetition SEI message semantics

314D.2.9Spare picture SEI message semantics

316D.2.10Scene information SEI message semantics

317D.2.11Sub-sequence information SEI message semantics

319D.2.12Sub-sequence layer characteristics SEI message semantics

320D.2.13Sub-sequence characteristics SEI message semantics

321D.2.14Full-frame freeze SEI message semantics

322D.2.15Full-frame freeze release SEI message semantics

322D.2.16Full-frame snapshot SEI message semantics

322D.2.17Progressive refinement segment start SEI message semantics

323D.2.18Progressive refinement segment end SEI message semantics

323D.2.19Motion-constrained slice group set SEI message semantics

323D.2.20Film grain characteristics SEI message semantics

329D.2.21Deblocking filter display preference SEI message semantics

331D.2.22Stereo video information SEI message semantics

332D.2.23Reserved SEI message semantics

333 Annex E Video usability information

334E.1VUI syntax

334E.1.1VUI parameters syntax

335E.1.2HRD parameters syntax

335E.2VUI semantics

335E.2.1VUI parameters semantics

346E.2.2HRD parameters semantics

349 Annex G Scalable video coding

349G.1Scope

349G.2Normative References

349G.3Definitions

349G.4Abbreviations

349G.5Conventions

350G.6Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships

350G.6.1Derivation process for base quality slices

350G.6.2Derivation process for base macroblock

352G.6.3Derivation process for base partitions

353G.6.4Derivation process for macroblock type and sub-macroblock type in inter-layer prediction

357G.6.5Virtual base layer macroblock conversion

358G.6.5.1Field-to-Frame base macroblock conversion

359G.6.5.2Frame-to-Field base macroblock conversion

360G.7Syntax and semantics

360G.7.1Method of specifying syntax in tabular form

360G.7.2Specification of syntax functions, categories, and descriptors

367G.7.3Syntax in tabular form

367G.7.3.1NAL unit header SVC extension syntax

368G.7.3.2Sequence parameter set SVC extension syntax

369G.7.3.3Slice layer in scalable extension syntax

369G.7.3.4Slice header in scalable extension

372G.7.3.4.1Decoded reference picture marking syntax for decoded base pictures

372G.7.3.5Slice data in scalable extension syntax

373G.7.3.6Macroblock layer in scalable extension syntax

376G.7.3.6.1Macroblock prediction in scalable extension syntax

377G.7.3.6.2Sub-macroblock prediction in scalable extension syntax

380G.7.3.6.3Residual in scalable extension syntax

382G.7.3.7Progressive refinement slice data in scalable extension syntax

387G.7.3.7.1Motion data in progressive refinement slice data syntax

388G.7.3.7.1.1Macroblock prediction in progressive refinement slice data syntax

389G.7.3.7.1.2Sub-macroblock in progressive refinement slice data syntax

389G.7.3.7.2Macroblock Luma Coded Block Pattern in progressive slice data CAVLC syntax

390G.7.3.7.3Macroblock Chroma Coded Block Pattern in progressive slice data CAVLC syntax

391G.7.3.7.4Luma coefficient in progressive refinement slice data syntax

396G.7.3.7.5Chroma DC coefficient in progressive slice data syntax

399G.7.3.7.6Chroma AC coefficient in progressive refinement slice data syntax

402G.7.3.7.7Significant coefficient in progressive slice data CABAC syntax

402G.7.3.7.8Significant coefficient in progressive slice data CAVLC syntax

403G.7.3.7.9Luma coefficient refinement in progressive refinement slice data syntax

403G.7.3.7.10Chroma DC coefficient refinement in progressive refinement slice data syntax

404G.7.3.7.11Chroma AC coefficient refinement in progressive refinement slice data syntax

404G.7.3.7.12Coefficient refinement in progressive refinement slice data syntax

404G.7.4Semantics

404G.7.4.1NAL unit header SVC extension semantics

405G.7.4.1.1Order of VCL NAL units and association to coded pictures in the scalable extension

406G.7.4.1.2Detection of first VCL NAL units of a primary coded picture / access unit

406G.7.4.2Sequence parameter set SVC extension semantics

407G.7.4.3Slice layer in scalable extension semantics

408G.7.4.4Slice header in scalable extension semantics

412G.7.4.4.1Semantics of decoded reference picture marking syntax for decoded base pictures

413G.7.4.5Slice data in scalable extension semantics

413G.7.4.6Macroblock layer in scalable extension semantics

415G.7.4.6.1Macroblock prediction in scalable extension semantics

415G.7.4.6.2Sub-macroblock prediction in scalable extension semantics

416G.7.4.6.3Residual in scalable extension semantics

416G.7.4.7Progressive refinement slice data in scalable extension semantics

418G.7.4.7.1Motion data in progressive refinement slice data semantics

418G.7.4.7.1.1Macroblock prediction in progressive refinement slice data semantics

418G.7.4.7.1.2Sub-macroblock prediction in progressive refinement slice data semantics

418G.7.4.7.2Macroblock Luma Coded Block Pattern in progressive refinement slice data CAVLC semantics

418G.7.4.7.3Macroblock Chroma Coded Block Pattern in progressive refinement slice data CAVLC semantics

418G.7.4.7.4Luma coefficient in progressive refinement slice data semantics

419G.7.4.7.5Chroma DC coefficient in progressive slice data semantics

420G.7.4.7.6Chroma AC coefficient in progressive refinement slice data semantics

420G.7.4.7.7Significant coefficient in progressive slice data CABAC semantics

420G.7.4.7.8Significant coefficient in progressive slice data CAVLC semantics

420G.7.4.7.9Coefficient refinement in progressive refinement slice data semantics

420G.8Decoding process

423G.8.1Array assignment initialization process

424G.8.2Base slice decoding process without resolution change

426G.8.3Base slice decoding process with resolution change

428G.8.3.1Base slice decoding process prior to resampling

429G.8.4Target slice decoding process

430G.8.5Motion data derivation process

431G.8.5.1Derivation process for luma vectors for B_Skip, B_Direct_16x16, and B_Direct_8x8

432G.8.5.1.1Derivation process for spatial direct luma motion vector and reference index prediction mode in scalable extension

433G.8.6Resampling process for motion data

436G.8.7Inter prediction process

439G.8.7.1Decoding process for differential Inter prediction samples

440G.8.7.1.1Differential reference picture selection process

441G.8.7.1.2Fractional differential sample interpolation process

443G.8.7.1.3Fractional differential luma sample interpolation process

443G.8.7.1.4Fractional differential chroma sample interpolation process

444G.8.7.2Scaling process for differential Inter prediction samples

445G.8.7.2.1Scaling process for differential Inter prediction samples of 4x4 luma blocks

446G.8.7.2.1.1Forward 4-point one dimensional transform process

446G.8.7.2.1.2Forward 4x4 transform process on differential Inter prediction samples

446G.8.7.2.1.3Normalization process for 4x4 blocks of transform coefficient values

447G.8.7.2.2Scaling process for differential Inter prediction samples of 8x8 luma blocks

447G.8.7.2.2.1Forward 8-point one dimensional transform process

448G.8.7.2.2.2Forward 8x8 transform process on differential Inter luma prediction samples

448G.8.7.2.2.3Normalization process for 8x8 blocks of transform coefficient values

449G.8.7.2.3Scaling process for differential Inter prediction samples of chroma blocks

451G.8.7.2.3.1Assignment process for a matrix of chroma DC transform coefficient values

451G.8.7.2.3.2Construction process for chroma DC coefficient values

451G.8.7.3Decoding process for smoothed reference inter prediction samples

452G.8.7.3.1Smoothing process for smoothed reference inter prediction samples

453G.8.7.4Derivation process for prediction weights

455G.8.8Intra macroblock decoding process

456G.8.8.1Intra_4x4 prediction and construction process for luma samples



458G.8.8.4Intra prediction and construction process for chroma samples

458G.8.9Resampling process for intra samples

466G.8.9.1Deblocking filter process for Intra_Base prediction

469G.8.9.2Construction process for not available samples

471G.8.9.2.1Constant border extension process

471G.8.9.2.2Diagonal border extension process

472G.8.9.3Upsampling process for Intra_Base prediction

474G.8.9.4Upsampling process for Intra_Base prediction of interlaced pictures

477G.8.9.5Vertical upsampling process for Intra_Base prediction

478G.8.10Resampling process for residual data

481G.8.10.1Upsampling process for residual prediction

483G.8.10.2Upsampling process for residual prediction in interlaced pictures

488G.8.10.3Bilinear interpolation process for residual prediction

489G.8.10.4Vertical upsampling process for residual prediction

490G.8.11Transformation, scaling, and picture construction processes

490G.8.11.1Initialization process for macroblock, sub-macroblock, and luma transform type

490G.8.11.2Transform coefficient scaling process

491G.8.11.3Progressive refinement process for scaled transform coefficients

492G.8.11.3.1Progressive refinement process for scaled transform coefficient of 4x4 luma blocks

492G.8.11.3.2Progressive refinement process for scaled transform coefficient of 8x8 luma blocks

492G.8.11.3.3Progressive refinement process for scaled luma transform coefficients of Intra_16x16 macroblocks

493G.8.11.3.4Progressive refinement process for scaled chroma transform coefficients

494G.8.11.4Residual accumulation process

495G.8.11.5Residual construction process

496G.8.11.5.1Macroblock residual construction process

496G.8.11.5.2Residual construction process for 4x4 luma blocks

497G.8.11.5.3Residual construction process for 8x8 luma blocks

497G.8.11.5.4Residual construction process for the luma component of Intra_16x16 macroblocks

498G.8.11.5.5Residual construction process for the chroma component

499G.8.11.6Picture construction process prior to deblocking filter process

499G.8.11.7Sample construction process

500G.8.11.7.1Picture sample array construction process

500G.8.11.7.2Macroblock sample array extraction process

501G.8.11.7.3Picture sample array construction process for a signal component

501G.8.11.7.4Macroblock sample array extraction process for a signal component

502G.8.12Decoding process for reference picture lists construction

503G.8.12.1Decoding process for picture numbers

505G.8.13Decoded reference picture marking process

507G.8.14Deblocking filter process in scalable extension

507G.8.14.1Extended derivation process for the luma content dependent boundary filtering strength

508G.9Parsing process

509G.9.1CAVLC parsing process for progressive refinement slices

510G.9.1.1Initialisation process

511G.9.1.2Bit reading process for coded_block_flag_luma and coded_block_flag_chromaAC

512G.9.1.3Derivation process for coded block flag syntax elements

513G.9.1.4Derivation process for the syntax element coded_block_flag_luma

513G.9.1.5Derivation process for the syntax element coded_block_flag_chromaAC

513G.9.1.6Derivation process for the syntax element coeff_sig_vlc_symbol

514G.9.1.7Derivation process for the syntax element coeff_refinement_ flag and coeff_refinement_direction_flag

514G.9.1.7.1Derivation process for the syntax element coeff_refinement_ flag

516G.9.1.7.2Derivation process for the syntax element coeff_refinement_direction_flag

516G.9.1.7.3Updating process for parsing coeff_refinement_ flag and coeff_refinement_direction_flag

516G.9.2Alternative CABAC parsing process for slice data in scalable extension

516G.9.2.1Initialisation process

518G.9.2.2Binarization process

519G.9.2.2.1Signed truncated unary (STU) binarization process

519G.9.2.3Decoding process flow

519G.9.2.3.1Derivation process for ctxIdx

520G.9.2.3.2Assignment process of ctxIdxInc using neighbouring syntax elements

520G.9.2.3.2.1Derivation process of ctxIdxInc for the syntax element coded_block_pattern_bit

520G.9.2.3.2.2Derivation process of ctxIdxInc for the syntax element base_mode_flag

520G.9.2.3.3Assignment process of ctxIdxInc for syntax elements significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1

522G.9.2.3.4Derivation process of ctxIdxInc for the syntax element residual_prediction_flag

522G.9.2.3.4.1Derivation process for the availability of base layer nominal residual for 8x8 luma block

523G.9.2.3.4.2Derivation process for the availability of base layer nominal chroma residual

523G.9.2.3.4.3Derivation process for the availability of nominal residual in an 8x8 luma block

523G.9.2.3.4.4Derivation process for the availability of chroma nominal residual in macroblock

525G.10Supplemental enhancement information

525G.10.1SEI payload syntax

525G.10.1.1Scalability information SEI message syntax

527G.10.1.2Scalability information layers not present SEI message syntax

527G.10.1.3Scalability information dependency change SEI message syntax

527G.10.1.4Sub-picture scalable layer SEI message syntax

528G.10.1.5Non-required picture SEI message syntax

528G.10.1.6Quality layer information SEI message syntax

528G.10.2SEI payload semantics

528G.10.2.1Scalability information SEI message semantics

532G.10.2.2Scalability information layers not present SEI message semantics

532G.10.2.3Scalability information dependency change SEI message semantics

533G.10.2.4Sub-picture scalable layer SEI message semantics

533G.10.2.5Non-required picture SEI message semantics

534G.10.2.6Quality layer information SEI message semantics

list of figures

20Figure 6‑1 – Nominal vertical and horizontal locations of 4:2:0 luma and chroma samples in a frame

20Figure 6‑2 – Nominal vertical and horizontal sampling locations of 4:2:0 samples in top and bottom fields


21Figure 6‑4 – Nominal vertical and horizontal sampling locations of 4:2:2 samples top and bottom fields


22Figure 6‑6 – Nominal vertical and horizontal sampling locations of 4:4:4 samples top and bottom fields

23Figure 6‑7 – A picture with 11 by 9 macroblocks that is partitioned into two slices

24Figure 6‑8 – Partitioning of the decoded frame into macroblock pairs

25Figure 6‑9 – Macroblock partitions, sub-macroblock partitions, macroblock partition scans, and sub-macroblock partition scans

26Figure 6‑10 – Scan for 4x4 luma blocks

27Figure 6‑11 – Scan for 8x8 luma blocks

28Figure 6‑12 – Neighbouring macroblocks for a given macroblock

29Figure 6‑13 – Neighbouring macroblocks for a given macroblock in MBAFF frames

30Figure 6‑14 – Determination of the neighbouring macroblock, blocks, and partitions (informative)

64Figure 7‑1 – Structure of an access unit not containing any NAL units with nal_unit_type equal to 0, 7, 8, or in the range of 12 to 18, inclusive, or in the range of 22 to 31, inclusive

123Figure 8‑1 – Intra_4x4 prediction mode directions (informative)

156Figure 8‑2 – Example for temporal direct-mode motion vector inference (informative)

157Figure 8‑3 – Directional segmentation prediction (informative)

163Figure 8‑4 – Integer samples (shaded blocks with upper-case letters) and fractional sample positions (un-shaded blocks with lower-case letters) for quarter sample luma interpolation

165Figure 8‑5 – Fractional sample position dependent variables in chroma interpolation and surrounding integer position samples A, B, C, and D

172Figure 8‑6 – Assignment of the indices of dcY to luma4x4BlkIdx

174Figure 8‑7 – Assignment of the indices of dcC to chroma4x4BlkIdx: (a) chroma_format_idc equal to 1, (b) chroma_format_idc equal to 2, (c) chroma_format_idc equal to 3

175Figure 8‑8 – 4x4 block scans. (a) Zig-zag scan. (b) Field scan (informative)

176Figure 8‑9 – 8x8 block scans. (a) 8x8 zig-zag scan. (b) 8x8 field scan (informative)

196Figure 8‑10 – Boundaries in a macroblock to be filtered

200Figure 8‑11 – Convention for describing samples across a 4x4 block horizontal or vertical boundary

222Figure 9‑1 – Illustration of CABAC parsing process for a syntax element SE (informative)

254Figure 9‑2 – Overview of the arithmetic decoding process for a single bin (informative)

256Figure 9‑3 – Flowchart for decoding a decision

259Figure 9‑4 – Flowchart of renormalization

259Figure 9‑5 – Flowchart of bypass decoding process

260Figure 9‑6 – Flowchart of decoding a decision before termination

261Figure 9‑7 – Flowchart for encoding a decision

262Figure 9‑8 – Flowchart of renormalization in the encoder

263Figure 9‑9 – Flowchart of PutBit(B)

264Figure 9‑10 – Flowchart of encoding bypass

265Figure 9‑11 – Flowchart of encoding a decision before termination

265Figure 9‑12 – Flowchart of flushing at termination

284Figure C‑1 – Structure of byte streams and NAL unit streams for HRD conformance checks

285Figure C‑2 – HRD buffer model

343Figure E‑1 – Location of chroma samples for top and bottom fields as a function of chroma_sample_loc_type_top_field and chroma_sample_loc_type_bottom_field

list of TAbles

19Table 6‑1 – SubWidthC, and SubHeightC values derived from chroma_format_idc

29Table 6‑2 – Specification of input and output assignments for subclauses 6.4.8.1 to 6.4.8.5

34Table 6‑3 – Specification of mbAddrN

36Table 6‑4 – Specification of mbAddrN and yM

59Table 7‑1 – NAL unit type codes

68Table 7‑2 – Assignment of mnemonic names to scaling list indices and specification of fall-back rule

68Table 7‑3 – Specification of default scaling lists Default_4x4_Intra and Default_4x4_Inter

69Table 7‑4 – Specification of default scaling lists Default_8x8_Intra and Default_8x8_Inter

76Table 7‑5 – Meaning of primary_pic_type

78Table 7‑6 – Name association to slice_type

84Table 7‑7 – reordering_of_pic_nums_idc operations for reordering of reference picture lists

86Table 7‑8 – Interpretation of adaptive_ref_pic_marking_mode_flag

87Table 7‑9 – Memory management control operation (memory_management_control_operation) values

89Table 7‑10 – Allowed collective macroblock types for slice_type

91Table 7‑11 – Macroblock types for I slices

92Table 7‑12 – Macroblock type with value 0 for SI slices

93Table 7‑13 – Macroblock type values 0 to 4 for P and SP slices

94Table 7‑14 – Macroblock type values 0 to 22 for B slices

96Table 7‑15 – Specification of CodedBlockPatternChroma values

96Table 7‑16 – Relationship between intra_chroma_pred_mode and spatial prediction modes

97Table 7‑17 – Sub-macroblock types in P macroblocks

98Table 7‑18 – Sub-macroblock types in B macroblocks

107Table 8‑1 – Refined slice group map type

123Table 8‑2 – Specification of Intra4x4PredMode[ luma4x4BlkIdx ] and associated names

130Table 8‑3 – Specification of Intra8x8PredMode[ luma8x8BlkIdx ] and associated names

138Table 8‑4 – Specification of Intra16x16PredMode and associated names

140Table 8‑5 – Specification of Intra chroma prediction modes and associated names

149Table 8‑6 – Specification of the variable colPic

149Table 8‑7 – Specification of PicCodingStruct( X )

151Table 8‑8 – Specification of mbAddrCol, yM, and vertMvScale

153Table 8‑9 – Assignment of prediction utilization flags

159Table 8‑10 – Derivation of the vertical component of the chroma vector in field coding mode

164Table 8‑11 – Differential full-sample luma locations

165Table 8‑12 – Assignment of the luma prediction sample predPartLXL[ xL, yL ]

175Table 8‑13 – Specification of mapping of idx to cij for zig-zag and field scan

177Table 8‑14 – Specification of mapping of idx to cij for 8x8 zig-zag and 8x8 field scan

178Table 8‑15 – Specification of QPC as a function of qPI

204Table 8‑16 – Derivation of offset dependent threshold variables (' and (' from indexA and indexB

206Table 8‑17 – Value of variable t'C0 as a function of indexA and bS

208Table 9‑1 – Bit strings with “prefix” and “suffix” bits and assignment to codeNum ranges (informative)

208Table 9‑2 – Exp-Golomb bit strings and codeNum in explicit form and used as ue(v) (informative)

209Table 9‑3 – Assignment of syntax element to codeNum for signed Exp-Golomb coded syntax elements se(v)

209Table 9‑4 – Assignment of codeNum to values of coded_block_pattern for macroblock prediction modes

214Table 9‑5 – coeff_token mapping to TotalCoeff( coeff_token ) and TrailingOnes( coeff_token )

218Table 9‑6 – Codeword table for level_prefix (informative)

219Table 9‑7 – total_zeros tables for 4x4 blocks with TotalCoeff( coeff_token ) 1 to 7

220Table 9‑8 – total_zeros tables for 4x4 blocks with TotalCoeff( coeff_token ) 8 to 15

220Table 9‑9 – total_zeros tables for chroma DC 2x2 and 2x4 blocks

221Table 9‑10 – Tables for run_before

223Table 9‑11 – Association of ctxIdx and syntax elements for each slice type in the initialisation process

224Table 9‑12 – Values of variables m and n for ctxIdx from 0 to 10




226Table 9‑16 – Values of variables m and n for ctxIdx from 54 to 59, and 399 to 401









235Table 9‑25 – Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset

236Table 9‑26 – Bin string of the unary binarization (informative)

238Table 9‑27 – Binarization for macroblock types in I slices

240Table 9‑28 – Binarization for macroblock types in P, SP, and B slices

241Table 9‑29 – Binarization for sub-macroblock types in P, SP, and B slices

243Table 9‑30 – Assignment of ctxIdxInc to binIdx for all ctxIdxOffset values except those related to the syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1

244Table 9‑31 – Assignment of ctxIdxBlockCatOffset to ctxBlockCat for syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1

251Table 9‑32 – Specification of ctxIdxInc for specific values of ctxIdxOffset and binIdx

252Table 9‑33 – Specification of ctxBlockCat for the different blocks

252Table 9‑34 – Mapping of scanning position to ctxIdxInc for ctxBlockCat = = 5

257Table 9‑35 – Specification of rangeTabLPS depending on pStateIdx and qCodIRangeIdx

258Table 9‑36 – State transition table

272Table A‑1 – Level limits

274Table A‑2 – Specification of cpbBrVclFactor and cpbBrNalFactor

275Table A‑3 – Baseline profile level limits

276Table A‑4 – Main, High, High 10, High 4:2:2, or High 4:4:4 profile level limits

277Table A‑5 – Extended profile level limits

278Table A‑6 – Maximum frame rates (frames per second) for some example frame sizes

308Table D‑1 – Interpretation of pic_struct

309Table D‑2 – Mapping of ct_type to source picture scan

309Table D‑3 – Definition of counting_type values

316Table D‑4 – scene_transition_type values

324Table D‑5 – model_id values

325Table D‑6 – blending_mode_id values

336Table E‑1 – Meaning of sample aspect ratio indicator

337Table E‑2 – Meaning of video_format

338Table E‑3 – Colour primaries

339Table E‑4 – Transfer characteristics

342Table E‑5 – Matrix coefficients

344Table E‑6 – Divisor for computation of (tfi,dpb( n )

356Table G‑1 – Derivation of mackroblock types.

357Table G‑2 – Derivation of sub-macroblock types.

408Table G‑3 – Name association to slice_type for NAL units with nal_unit_type equal to 20 or 21.

413Table G‑4 – Memory management control operation (memory_management_control_operation) values

414Table G‑5 – Allowed collective macroblock types for slice_type.

415Table G‑6 – Macroblock types for EI slices.

417Table G‑7 – Codeword table for sig_vlc_selector

466Table G‑8 – 16-phase interpolation filter for luma up-sampling in Intra_Base prediction

510Table G‑9 - Initialisation values for CAVLC internal variables for coded_block_flag_luma and coded_block_flag_chromaAC

510Table G‑10 - Initialisation values for CAVLC internal variables for coeff_ref_vlc_symbol

511Table G‑11 – Variable length codes used in parsing progressive refinement syntax elements

512Table G‑12 - Derivation of variable allowedVlcIdx[ ]

512Table G‑13 - Update table for variable vlcTable for coded_block_flag_luma and coded_block_flag_chromaAC

514Table G-14 – Codebook table for coeff_sig_vlc_symbol depending on sigVlcSelector (informative)

515Table G-15 – Codeword tables for coeff_ref_vlc_symbol group

516Table G‑16 - Update table for variable refVlcSelector for parsing coeff_ref_vlc_symbol

517Table G‑17 - Association of ctxIdx and syntax elements for each slice type in the initialisation process [Ed (JR) modified Table 9‑11 to add EI, EP, and EB slice type, note that syntax elements existing in I, P, B slice and used in PR slice should also have an entry in the table]

517Table G‑18 - Values of variables m and n for ctxIdx from 460 to 469 [Ed. Note(HS): The initialization values currently represent a simple uniform distribution. Suitable initialization values still need to be determined.]

517Table G‑19 - Values of variables m and n for ctxIdx from 469 to 482 [Ed. Note(HS): The initialization values are just copied from the corresponding context with levelListIdx-1. Suitable initialization values still need to be determined.]

518Table G‑20 - Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset [Ed. (DM) Table is incomplete due to missing data for last_significant_coeff_flag, coeff_abs_level_minus1 for PR slices.]

520Table G‑21 - Assignment of ctxIdxInc to binIdx for the ctxIdxOffset values related to the syntax elements base_mode_flag and residual_prediction_flag

521Table G‑22 - Determination of ctxIdxInc for special values of levelListIdx for the syntax element significant_coeff_flag depending on field_pic_flag, mb_field_decoding_flag, and ctxBlockCat

Foreword

The International Telecommunication Union (ITU) is the United Nations specialized agency in the field of telecommunications. The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with a view to standardising telecommunications on a world-wide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups that, in turn, produce Recommendations on these topics. The approval of ITU-T Recommendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology that fall within ITU-T's purview, the necessary standards are prepared on a collaborative basis with ISO and IEC.

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialised system for world-wide standardisation. National Bodies that are members of ISO and IEC participate in the development of International Standards through technical committees established by the respective organisation to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organisations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75% of the national bodies casting a vote.

This Recommendation | International Standard was prepared jointly by ITU-T SG 16 Q.6, also known as VCEG (Video Coding Experts Group), and by ISO/IEC JTC 1/SC 29/WG 11, also known as MPEG (Moving Picture Experts Group). VCEG was formed in 1997 to maintain prior ITU-T video coding standards and develop new video coding standard(s) appropriate for a wide range of conversational and non-conversational services. MPEG was formed in 1988 to establish standards for coding of moving pictures and associated audio for various applications such as digital storage media, distribution, and communication.

In this Recommendation | International Standard Annexes A through E contain normative requirements and are an integral part of this Recommendation | International Standard.

Advanced video coding for generic audiovisual services

0 Introduction

This clause does not form an integral part of this Recommendation | International Standard.

0.1 Prologue

This subclause does not form an integral part of this Recommendation | International Standard.

As the costs for both processing power and memory have reduced, network support for coded video data has diversified, and advances in video coding technology have progressed, the need has arisen for an industry standard for compressed video representation with substantially increased coding efficiency and enhanced robustness to network environments. Toward these ends the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) formed a Joint Video Team (JVT) in 2001 for development of a new Recommendation | International Standard.

0.2 Purpose


This Recommendation | International Standard was developed in response to the growing need for higher compression of moving pictures for various applications such as videoconferencing, digital storage media, television broadcasting, internet streaming, and communication. It is also designed to enable the use of the coded video representation in a flexible manner for a wide variety of network environments. The use of this Recommendation | International Standard allows motion video to be manipulated as a form of computer data and to be stored on various storage media, transmitted and received over existing and future networks and distributed on existing and future broadcasting channels.

0.3 Applications


This Recommendation | International Standard is designed to cover a broad range of applications for video content including but not limited to the following:

CATVCable TV on optical networks, copper, etc.

DBSDirect broadcast satellite video services

DSL Digital subscriber line video services

DTTBDigital terrestrial television broadcasting

ISMInteractive storage media (optical disks, etc.)

MMMMultimedia mailing

MSPNMultimedia services over packet networks

RTCReal-time conversational services (videoconferencing, videophone, etc.)

RVSRemote video surveillance

SSMSerial storage media (digital VTR, etc.)

0.4 Publication and versions of this specification


This specification has been jointly developed by ITU‑T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group. It is published as technically-aligned twin text in both organizations ITU-T and ISO/IEC.

ITU‑T Rec. H.264 | ISO/IEC 14496‑10 version 1 refers to the first (2003) approved version of this Recommendation | International Standard.

ITU‑T Rec. H.264 | ISO/IEC 14496‑10 version 2 refers to the integrated text containing the corrections specified in the first technical corrigendum.

ITU‑T Rec. H.264 | ISO/IEC 14496‑10 version 3 refers to the integrated text containing both the first technical corrigendum (2004) and the first amendment, which is referred to as the "Fidelity range extensions".

ITU‑T Rec. H.264 | ISO/IEC 14496‑10 version 4 (the current specification) refers to the integrated text containing the first technical corrigendum (2004), the first amendment (the "Fidelity range extensions"), and an additional technical corrigendum (2005). In the ITU-T, the next published version after version 2 was version 4 (due to the completion of the drafting work for version 4 prior to the approval opportunity for a final version 3 text).

0.5 Profiles and levels


This Recommendation | International Standard is designed to be generic in the sense that it serves a wide range of applications, bit rates, resolutions, qualities, and services. Applications should cover, among other things, digital storage media, television broadcasting and real-time communications. In the course of creating this Specification, various requirements from typical applications have been considered, necessary algorithmic elements have been developed, and these have been integrated into a single syntax. Hence, this Specification will facilitate video data interchange among different applications.

Considering the practicality of implementing the full syntax of this Specification, however, a limited number of subsets of the syntax are also stipulated by means of "profiles" and "levels". These and other related terms are formally defined in clause 3.

A "profile" is a subset of the entire bitstream syntax that is specified by this Recommendation | International Standard. Within the bounds imposed by the syntax of a given profile it is still possible to require a very large variation in the performance of encoders and decoders depending upon the values taken by syntax elements in the bitstream such as the specified size of the decoded pictures. In many applications, it is currently neither practical nor economic to implement a decoder capable of dealing with all hypothetical uses of the syntax within a particular profile.

In order to deal with this problem, "levels" are specified within each profile. A level is a specified set of constraints imposed on values of the syntax elements in the bitstream. These constraints may be simple limits on values. Alternatively they may take the form of constraints on arithmetic combinations of values (e.g. picture width multiplied by picture height multiplied by number of pictures decoded per second).

Coded video content conforming to this Recommendation | International Standard uses a common syntax. In order to achieve a subset of the complete syntax, flags, parameters, and other syntax elements are included in the bitstream that signal the presence or absence of syntactic elements that occur later in the bitstream.

0.6 Overview of the design characteristics


The coded representation specified in the syntax is designed to enable a high compression capability for a desired image quality. With the exception of the transform bypass mode of operation for lossless coding in the High 4:4:4 profile and the I_PCM mode of operation in all profiles, the algorithm is typically not lossless, as the exact source sample values are typically not preserved through the encoding and decoding processes. A number of techniques may be used to achieve highly efficient compression. Encoding algorithms (not specified in this Recommendation | International Standard) may select between inter and intra coding for block-shaped regions of each picture. Inter coding uses motion vectors for block-based inter prediction to exploit temporal statistical dependencies between different pictures. Intra coding uses various spatial prediction modes to exploit spatial statistical dependencies in the source signal for a single picture. Motion vectors and intra prediction modes may be specified for a variety of block sizes in the picture. The prediction residual is then further compressed using a transform to remove spatial correlation inside the transform block before it is quantised, producing an irreversible process that typically discards less important visual information while forming a close approximation to the source samples. Finally, the motion vectors or intra prediction modes are combined with the quantised transform coefficient information and encoded using either variable length codes or arithmetic coding.

0.6.1 Predictive coding


Because of the conflicting requirements of random access and highly efficient compression, two main coding types are specified. Intra coding is done without reference to other pictures. Intra coding may provide access points to the coded sequence where decoding can begin and continue correctly, but typically also shows only moderate compression efficiency. Inter coding (predictive or bi-predictive) is more efficient using inter prediction of each block of sample values from some previously decoded picture selected by the encoder. In contrast to some other video coding standards, pictures coded using bi-predictive inter prediction may also be used as references for inter coding of other pictures.

The application of the three coding types to pictures in a sequence is flexible, and the order of the decoding process is generally not the same as the order of the source picture capture process in the encoder or the output order from the decoder for display. The choice is left to the encoder and will depend on the requirements of the application. The decoding order is specified such that the decoding of pictures that use inter-picture prediction follows later in decoding order than other pictures that are referenced in the decoding process.

0.6.2 Coding of progressive and interlaced video


This Recommendation | International Standard specifies a syntax and decoding process for video that originated in either progressive-scan or interlaced-scan form, which may be mixed together in the same sequence. The two fields of an interlaced frame are separated in capture time while the two fields of a progressive frame share the same capture time. Each field may be coded separately or the two fields may be coded together as a frame. Progressive frames are typically coded as a frame. For interlaced video, the encoder can choose between frame coding and field coding. Frame coding or field coding can be adaptively selected on a picture-by-picture basis and also on a more localized basis within a coded frame. Frame coding is typically preferred when the video scene contains significant detail with limited motion. Field coding typically works better when there is fast picture-to-picture motion.

0.6.3 Picture partitioning into macroblocks and smaller partitions


As in previous video coding Recommendations and International Standards, a macroblock, consisting of a 16x16 block of luma samples and two corresponding blocks of chroma samples, is used as the basic processing unit of the video decoding process.

A macroblock can be further partitioned for inter prediction. The selection of the size of inter prediction partitions is a result of a trade-off between the coding gain provided by using motion compensation with smaller blocks and the quantity of data needed to represent the data for motion compensation. In this Recommendation | International Standard the inter prediction process can form segmentations for motion representation as small as 4x4 luma samples in size, using motion vector accuracy of one-quarter of the luma sample grid spacing displacement. The process for inter prediction of a sample block can also involve the selection of the picture to be used as the reference picture from a number of stored previously-decoded pictures. Motion vectors are encoded differentially with respect to predicted values formed from nearby encoded motion vectors.

Typically, the encoder calculates appropriate motion vectors and other data elements represented in the video data stream. This motion estimation process in the encoder and the selection of whether to use inter prediction for the representation of each region of the video content is not specified in this Recommendation | International Standard.

0.6.4 Spatial redundancy reduction


Both source pictures and prediction residuals have high spatial redundancy. This Recommendation | International Standard is based on the use of a block-based transform method for spatial redundancy removal. After inter prediction from previously-decoded samples in other pictures or spatial-based prediction from previously-decoded samples within the current picture, the resulting prediction residual is split into 4x4 blocks. These are converted into the transform domain where they are quantised. After quantisation many of the transform coefficients are zero or have low amplitude and can thus be represented with a small amount of encoded data. The processes of transformation and quantisation in the encoder are not specified in this Recommendation | International Standard.

0.7 How to read this specification


It is suggested that the reader starts with clause 1 (Scope) and moves on to clause 3 (Definitions). Clause 6 should be read for the geometrical relationship of the source, input, and output of the decoder. Clause 7 (Syntax and semantics) specifies the order to parse syntax elements from the bitstream. See subclauses 7.1-7.3 for syntactical order and see subclause 7.4 for semantics; i.e., the scope, restrictions, and conditions that are imposed on the syntax elements. The actual parsing for most syntax elements is specified in clause 9 (Parsing process). Finally, clause 8 (Decoding process) specifies how the syntax elements are mapped into decoded samples. Throughout reading this specification, the reader should refer to clauses 2 (Normative references), 4 (Abbreviations), and 5 (Conventions) as needed. Annexes A through E also form an integral part of this Recommendation | International Standard.

Annex A specifies seven profiles (Baseline, Main, Extended, High, High 10, High 4:2:2 and High 4:4:4), each being tailored to certain application domains, and defines the so-called levels of the profiles. Annex B specifies syntax and semantics of a byte stream format for delivery of coded video as an ordered stream of bytes. Annex C specifies the hypothetical reference decoder and its use to check bitstream and decoder conformance. Annex D specifies syntax and semantics for supplemental enhancement information message payloads. Finally, Annex E specifies syntax and semantics of the video usability information parameters of the sequence parameter set.

Throughout this specification, statements appearing with the preamble "NOTE -" are informative and are not an integral part of this Recommendation | International Standard.

1 Scope

This document specifies ITU-T Recommendation H.264 | ISO/IEC International Standard ISO/IEC 14496-10 video coding.

2 Normative references

The following Recommendations and International Standards contain provisions which, through reference in this text, constitute provisions of this Recommendation | International Standard. At the time of publication, the editions indicated were valid. All Recommendations and Standards are subject to revision, and parties to agreements based on this Recommendation | International Standard are encouraged to investigate the possibility of applying the most recent edition of the Recommendations and Standards listed below. Members of IEC and ISO maintain registers of currently valid International Standards. The Telecommunication Standardization Bureau of the ITU maintains a list of currently valid ITU-T Recommendations.

–ITU-T Recommendation T.35 (2000), Procedure for the allocation of ITU-T defined codes for non-standard facilities.

–ISO/IEC 11578:1996, Annex A, Universal Unique Identifier.

–ISO/CIE 10527:1991, Colorimetric Observers.

3 Definitions

For the purposes of this Recommendation | International Standard, the following definitions apply.

3.1 access unit: A set of NAL units always containing exactly one primary coded picture. In addition to the primary coded picture, an access unit may also contain one or more coded pictures or other NAL units not containing slices or slice data partitions of a coded picture. The decoding of an access unit always results in a decoded picture. All slices or slice data partitions in an access unit have the same value of picture order count.

3.2 AC transform coefficient: Any transform coefficient for which the frequency index in one or both dimensions is non-zero.

3.3 adaptive binary arithmetic decoding process: An entropy decoding process that derives the values of bins from a bitstream produced by an adaptive binary arithmetic encoding process.

3.4 adaptive binary arithmetic encoding process: An entropy encoding process, not normatively specified in this Recommendation | International Standard, that codes a sequence of bins and produces a bitstream that can be decoded using the adaptive binary arithmetic decoding process.

3.5 alpha blending: A process not specified by this Recommendation | International Standard, in which an auxiliary coded picture is used in combination with a primary coded picture and with other data not specified by this Recommendation | International Standard in the display process. In an alpha blending process, the samples of an auxiliary coded picture are interpreted as indications of the degree of opacity (or, equivalently, the degrees of transparency) associated with the corresponding luma samples of the primary coded picture.

3.6 arbitrary slice order: A decoding order of slices in which the macroblock address of the first macroblock of some slice of a picture may be less than the macroblock address of the first macroblock of some other preceding slice of the same coded picture.

3.7 auxiliary coded picture: A picture that supplements the primary coded picture that may be used in combination with other data not specified by this Recommendation | International Standard in the display process. An auxiliary coded picture has the same syntactic and semantic restrictions as a monochrome redundant coded picture. An auxiliary coded picture must contain the same number of macroblocks as the primary coded picture. Auxiliary coded pictures have no normative effect on the decoding process. See also primary coded picture and redundant coded picture.

3.8 B slice: A slice that may be decoded using intra prediction from decoded samples within the same slice or inter prediction from previously-decoded reference pictures, using at most two motion vectors and reference indices to predict the sample values of each block.

3.9 bin: One bit of a bin string.

3.10 binarization: A set of bin strings for all possible values of a syntax element.

3.11 binarization process: A unique mapping process of all possible values of a syntax element onto a set of bin strings.

3.12 bin string: A string of bins. A bin string is an intermediate binary representation of values of syntax elements from the binarization of the syntax element.

3.13 bi-predictive slice: See B slice.

3.14 bitstream: A sequence of bits that forms the representation of coded pictures and associated data forming one or more coded video sequences. Bitstream is a collective term used to refer either to a NAL unit stream or a byte stream.

3.15 block: An MxN (M-column by N-row) array of samples, or an MxN array of transform coefficients.

3.16 bottom field: One of two fields that comprise a frame. Each row of a bottom field is spatially located immediately below a corresponding row of a top field.

3.17 bottom macroblock (of a macroblock pair): The macroblock within a macroblock pair that contains the samples in the bottom row of samples for the macroblock pair. For a field macroblock pair, the bottom macroblock represents the samples from the region of the bottom field of the frame that lie within the spatial region of the macroblock pair. For a frame macroblock pair, the bottom macroblock represents the samples of the frame that lie within the bottom half of the spatial region of the macroblock pair.

3.18 broken link: A location in a bitstream at which it is indicated that some subsequent pictures in decoding order may contain serious visual artefacts due to unspecified operations performed in the generation of the bitstream.

3.19 byte: A sequence of 8 bits, written and read with the most significant bit on the left and the least significant bit on the right. When represented in a sequence of data bits, the most significant bit of a byte is first.

3.20 byte-aligned: A position in a bitstream is byte-aligned when the position is an integer multiple of 8 bits from the position of the first bit in the bitstream. A bit or byte or syntax element is said to be byte-aligned when the position at which it appears in a bitstream is byte-aligned.

3.21 byte stream: An encapsulation of a NAL unit stream containing start code prefixes and NAL units as specified in Annex B.

3.22 can: A term used to refer to behaviour that is allowed, but not necessarily required.

3.23 category: A number associated with each syntax element. The category is used to specify the allocation of syntax elements to NAL units for slice data partitioning. It may also be used in a manner determined by the application to refer to classes of syntax elements in a manner not specified in this Recommendation | International Standard.

3.24 chroma: An adjective specifying that a sample array or single sample is representing one of the two colour difference signals related to the primary colours. The symbols used for a chroma array or sample are Cb and Cr.

NOTE – The term chroma is used rather than the term chrominance in order to avoid the implication of the use of linear light transfer characteristics that is often associated with the term chrominance.

3.25 coded field: A coded representation of a field.

3.26 coded frame: A coded representation of a frame.

3.27 coded picture: A coded representation of a picture. A coded picture may be either a coded field or a coded frame. Coded picture is a collective term referring to a primary coded picture or a redundant coded picture, but not to both together.

3.28 coded picture buffer (CPB): A first-in first-out buffer containing access units in decoding order specified in the hypothetical reference decoder in Annex C.

3.29 coded representation: A data element as represented in its coded form.

3.30 coded video sequence: A sequence of access units that consists, in decoding order, of an IDR access unit followed by zero or more non-IDR access units including all subsequent access units up to but not including any subsequent IDR access unit.

3.31 component: An array or single sample from one of the three arrays (luma and two chroma) that make up a field or frame.

3.32 complementary field pair: A collective term for a complementary reference field pair or a complementary non-reference field pair.

3.33 complementary non-reference field pair: Two non-reference fields that are in consecutive access units in decoding order as two coded fields of opposite parity where the first field is not already a paired field.

3.34 complementary reference field pair: Two reference fields that are in consecutive access units in decoding order as two coded fields and share the same value of the frame_num syntax element, where the second field in decoding order is not an IDR picture and does not include a memory_management_control_operation syntax element equal to 5.

3.35 context variable: A variable specified for the adaptive binary arithmetic decoding process of a bin by an equation containing recently decoded bins.

3.36 DC transform coefficient: A transform coefficient for which the frequency index is zero in all dimensions.

3.37 decoded picture: A decoded picture is derived by decoding one or more slices or slice data partitions contained in one access unit. A decoded picture is either a decoded frame, or a decoded field. A decoded field is either a decoded top field or a decoded bottom field.

3.38 decoded picture buffer (DPB): A buffer holding decoded pictures for reference, output reordering, or output delay specified for the hypothetical reference decoder in Annex C.

3.39 decoder: An embodiment of a decoding process.

3.40 decoding order: The order in which syntax elements are processed by the decoding process.

3.41 decoding process: The process specified in this Recommendation | International Standard that reads a bitstream and derives decoded pictures from it.

3.42 direct prediction: An inter prediction for a block for which no motion vector is decoded. Two direct prediction modes are specified that are referred to as spatial direct prediction and temporal prediction mode.

3.43 display process: A process not specified in this Recommendation | International Standard having, as its input, the cropped decoded pictures that are the output of the decoding process.

3.44 decoder under test (DUT): A decoder that is tested for conformance to this Recommendation | International Standard by operating the hypothetical stream scheduler to deliver a conforming bitstream to the decoder and to the hypothetical reference decoder and comparing the values and timing of the output of the two decoders.

3.45 emulation prevention byte: A byte equal to 0x03 that may be present within a NAL unit. The presence of emulation prevention bytes ensures that no sequence of consecutive byte-aligned bytes in the NAL unit contains a start code prefix.

3.46 encoder: An embodiment of an encoding process.

3.47 encoding process: A process, not specified in this Recommendation | International Standard, that produces a bitstream conforming to this Recommendation | International Standard.

3.48 field: An assembly of alternate rows of a frame. A frame is composed of two fields, a top field and a bottom field.

3.49 field macroblock: A macroblock containing samples from a single field. All macroblocks of a coded field are field macroblocks. When macroblock-adaptive frame/field decoding is in use, some macroblocks of a coded frame may be field macroblocks.

3.50 field macroblock pair: A macroblock pair decoded as two field macroblocks.

3.51 field scan: A specific sequential ordering of transform coefficients that differs from the zig-zag scan by scanning columns more rapidly than rows. Field scan is used for transform coefficients in field macroblocks.

3.52 flag: A variable that can take one of the two possible values 0 and 1.

3.53 frame: A frame contains an array of luma samples and two corresponding arrays of chroma samples. A frame consists of two fields, a top field and a bottom field.

3.54 frame macroblock: A macroblock representing samples from the two fields of a coded frame. When macroblock-adaptive frame/field decoding is not in use, all macroblocks of a coded frame are frame macroblocks. When macroblock-adaptive frame/field decoding is in use, some macroblocks of a coded frame may be frame macroblocks.

3.55 frame macroblock pair: A macroblock pair decoded as two frame macroblocks.

3.56 frequency index: A one-dimensional or two-dimensional index associated with a transform coefficient prior to an inverse transform part of the decoding process.

3.57 hypothetical reference decoder (HRD): A hypothetical decoder model that specifies constraints on the variability of conforming NAL unit streams or conforming byte streams that an encoding process may produce.

3.58 hypothetical stream scheduler (HSS): A hypothetical delivery mechanism for the timing and data flow of the input of a bitstream into the hypothetical reference decoder. The HSS is used for checking the conformance of a bitstream or a decoder.

3.59 I slice: A slice that is not an SI slice that is decoded using prediction only from decoded samples within the same slice.

3.60 informative: A term used to refer to content provided in this Recommendation | International Standard that is not an integral part of this Recommendation | International Standard. Informative content does not establish any mandatory requirements for conformance to this Recommendation | International Standard.

3.61 instantaneous decoding refresh (IDR) access unit: An access unit in which the primary coded picture is an IDR picture.

3.62 instantaneous decoding refresh (IDR) picture: A coded picture in which all slices are I or SI slices that causes the decoding process to mark all reference pictures as "unused for reference" immediately after decoding the IDR picture. After the decoding of an IDR picture all following coded pictures in decoding order can be decoded without inter prediction from any picture decoded prior to the IDR picture. The first picture of each coded video sequence is an IDR picture.

3.63 inter coding: Coding of a block, macroblock, slice, or picture that uses inter prediction.

3.64 inter prediction: A prediction derived from decoded samples of reference pictures other than the current decoded picture.

3.65 interpretation sample value: A possibly-altered value corresponding to a decoded sample value of an auxiliary coded picture that may be generated for use in the display process. Interpretation sample values are not used in the decoding process and have no normative effect on the decoding process.

3.66 intra coding: Coding of a block, macroblock, slice, or picture that uses intra prediction.

3.67 intra prediction: A prediction derived from the decoded samples of the same decoded slice.

3.68 intra slice: See I slice.

3.69 inverse transform: A part of the decoding process by which a set of transform coefficients are converted into spatial-domain values, or by which a set of transform coefficients are converted into DC transform coefficients.

3.70 layer: One of a set of syntactical structures in a non-branching hierarchical relationship. Higher layers contain lower layers. The coding layers are the coded video sequence, picture, slice, and macroblock layers.

3.71 level: A defined set of constraints on the values that may be taken by the syntax elements and variables of this Recommendation | International Standard. The same set of levels is defined for all profiles, with most aspects of the definition of each level being in common across different profiles. Individual implementations may, within specified constraints, support a different level for each supported profile. In a different context, level is the value of a transform coefficient prior to scaling.

3.72 list 0 (list 1) motion vector: A motion vector associated with a reference index pointing into reference picture list 0 (list 1).

3.73 list 0 (list 1) prediction: Inter prediction of the content of a slice using a reference index pointing into reference picture list 0 (list 1).

3.74 luma: An adjective specifying that a sample array or single sample is representing the monochrome signal related to the primary colours. The symbol or subscript used for luma is Y or L.

NOTE – The term luma is used rather than the term luminance in order to avoid the implication of the use of linear light transfer characteristics that is often associated with the term luminance. The symbol L is sometimes used instead of the symbol Y to avoid confusion with the symbol y as used for vertical location.

3.75 macroblock: A 16x16 block of luma samples and two corresponding blocks of chroma samples. The division of a slice or a macroblock pair into macroblocks is a partitioning.

3.76 macroblock-adaptive frame/field decoding: A decoding process for coded frames in which some macroblocks may be decoded as frame macroblocks and others may be decoded as field macroblocks.

3.77 macroblock address: When macroblock-adaptive frame/field decoding is not in use, a macroblock address is the index of a macroblock in a macroblock raster scan of the picture starting with zero for the top-left macroblock in a picture. When macroblock-adaptive frame/field decoding is in use, the macroblock address of the top macroblock of a macroblock pair is two times the index of the macroblock pair in a macroblock pair raster scan of the picture, and the macroblock address of the bottom macroblock of a macroblock pair is the macroblock address of the corresponding

Documents

ITU-T Rec. H.264 (03/2005) Advanced video coding for ... · Web viewThe World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics