Embed Size (px)
Citation preview
National Library of Canada
Bibliothèque nationale du Canada
Acquisitions and Acquisitions et Bibliographie Services services bibliographiques
395 Wellington Street 395, rue Wellington OttawaON K1A O N 4 Ottawa ON KI A ON4 Canada Canada
Your file vme rstersnce
Our iye Notre teUrence
The author has granted a non- exclusive Licence allowing the National Library of Canada to reproduce, loan, distribute or sell copies of this thesis in microform, paper or electronic formats.
The author retains ownership of the copyright in thts thesis. Neither the thesis nor substantial extracts fiom it may be printed or othenirise reproduced without the author's permission.
L'auteur a accordé une licence non exclusive permettant a la Bibliothèque nationale du Canada de reproduire, prêter, distribuer ou vendre des copies de cette thèse sous la forme de microfiche/nlm, de reproduction sur papier ou su. format électronique.
L'auteur conserve la propriété du droit d'auteur qui protège cette thèse. Ni la thèse ai des extraits substantiels de celle-ci ne doivent être imprimés ou autrement reproduits sans son autorisation.
Abstract
riiriit ari II.263-1)aierl t - i ( l t ~ ) coller aiid an LIPL(;-2 coiiipliaiit 1-irlco d i ~ r for \-vt-!. Ion. Il i1
r a t r viclco applicaiioiis. au<l Iiigti bit ratc iiitrrlaccd \- i ( l rm applicat ions. rcrptw i\.i\l)-. -['lit*
rrsiiltiiig vidro co<lt.rs acliitt\-tb escellerit tratlroffs aiiiorig I>it ratc. qtiality. aiid coiiipiita-
t ioiial coriiplcsit!-. I t i Iact . cspcrirneiital r<-siilts sliutv t k i t oiir \*ide0 codt>rs oiit prrforrii
t lic Iwst krio~vri 1 - i r l w corlim i r i ternis of coniprcssioii pcrforriiarice a n d ericotlirig spcid.
Table of Contents
*.
Abstract 11
List of Tables
List of Figures
vii
1 Introduction 1
2 Background 5
2.1 Iriforriiat iori . l ' l i t w r ~ . C'o~ic-cpt s - . . . . . . . . . . . . . . . . . . . . . . . . .->
2. 1 . 1 E r l t rop>- . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . t i
. . . . . . . . . . . . . . . 2.1.2 .Joiiit Eiit roll!* ancl ('oridit iorial Krit r o p ~ - ti
- 2 . 1I i r t iial i~iforriiat iori I . . . . . . . . . . . . . . . . . . . . . . . . . . ....
2 . Erit r op~- ('wliiig . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . s
1 f i i . . . . . . . . . . . . . . . . . . . . . . . . . . . S
. . . . . . . . . . . . . . . . . . . . . . . . . . 2.2.- r i t l i t i l i r !)
. . . . . . . . . . . . . . . . . . . . . 2 . Rat c-Dist or t iori 'I'licorrrii C'oricrpt a 10
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4 H ~ - h r i c l \-ideo ( ' d i iig 12
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.S .\lot ion Est iiiiat ion 1.5
. . . . . . . . . . . . . . . . . . . . . 2..i. 1 Blork Statrliiiig .-ilgorit linis 16
. . . . . . . . . . . . . . . . . 2..5.L> Fast SIot ioii Est irtiatioii Algori t liiii lS
. . . . . . . . . . . . . . . . . . . . . . 2.6 Discretc C'mi rie Trarisforiii ( DC'T ) 23
3 Block-Based Motion Estimation 29
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.1 l [ o t i\.aticjn 2:)
. . . . . . . . . . 1 . l l o r i o n E.çtirii;ttioii tvi t i l Ritte-t 'i>iiipiitnt ion ( 'oiistraint :il
. . . . . . . . . . . 1 . 2 . Ra t r -Dis to r t ion Optiniizil(l l lot i( j r i E s t i n ~ a t i o r i lj.7
. . . . . . 1 . 2 . ( o n i p ~ r t ; \ t iori-Distortiori 0pti:iiizmI .\ Iorion Estir i iat ioi~ 11.;
1 Priiposrt l \ lot ion Est lriia t ion .\lqori t lin1 . . . . . . . . . . . . . . . . . . . : { f i
. . . . . . . . . . . . . . . . . . . . . . 1 . . 1 St a r t iris I 'oi i i t : Prv(lict,ion :!b
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Stwrc-il P;rt I I 4 1
. . . . . . . . . . . . . . . . . . . . 1 Tt~~-riiiii;itioii P ~ i i i r . \ l ~ o i i t l i r i i 1-i
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 . 1 n i t i R I . !fi
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . :1. 1.1 [ i i i t i i i l i z i t i c ~ r i i(i
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 . 2 Stxari-ii I);tr l i I I )
. . . . . . . . . . . . . . . . . . . . . . . . . . :1. i.:3 ~ i t i i 7 1
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 i i .;:i
5 Application: H.263 Based Low Bit R a t e Video Coding 6'7
. . . . . . . . . . . . . . . . . . . . . . . . . 3.1 liot il-at i<iii ari(l Hii(.kqi.oiiri(l ti7
. . . . . . . . . . . . . . . . . . . 5.1.1 Tlic t 1 .'iti:I Si a;itlar(l: O\-r.ivic.~v t il)
. . . . . . . . . . . . . . . . . . 1 . 2 - T h o II.Z(i:l I3 i t StreaiiiStrii(-tiirc.. ;O
5 . 1 11.26:3 JIac-rol) l i~k I.a>+c-r . . . . . . . . . . . . . . . . . . . . . . . 12
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 . 2 Prupos<v l ( 'u<ltxr 7 I -- . . . . . . . . . . . . . . . . . . . . 1 I -p i c t i i i ( \ . \ I I 3 ( 'ucliiig S t r a t i ~ g ~ - 1 .)
- . . . . . . . . . . . . . . . . . . . . 5.2.2 1'-pict i i i . ib JI13 ('odiiig . \ l<*t l io ( l 1 ( i
5 . 3 13 a t (. ( ' o r 1 t t'ol <* ) - . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 F A p ~ r i i i i i ~ r i t al R ~ ~ ~ i i l i s . . . . . . . . . . . . . . . . . . . . . . . . . . . . . S.)
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . i. I slliiiiiiar>~ ! I l
6 Application: MPEG-2 Video Coder 9 2
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ii. 1 51 PL(;-2 O\-<.ri-it*~v !t!
. . . . . . . . . . . . . . . . . . . . . . . . . . . 6 . 1 . 1 Profil(. arid 1 . ( 3 \ . ~ 1 !Kl
. . . . . . . . . . . . . . . . . . . . . . 6.1.- Fir l r la . I'raiiios a i i ( l I'ivt iir(. ! L I
. . . . . . . . . . . . . . . . . . . . . . . . . . 1 1Iot ioii I'rtvli(-t i o n !).5
. . . . . . . . . . . . . . . . . . . . . 6.1 .-l Fraiiie D( '-1- ;iii<I Firicl D ( ' T !)7
. . . . . . . . . . . . . 6.1 .i R i t St rraiii 51-iitas alid .\larrol~loc.k i,a~-(.r !H
. . . . . . . . . . t ('o~ii~)utatioii-1)ist ort ion Optiiiiizrd Slotiori Est iiiiatiori !FI
. . . . . . . . . . . . . . . . . . . . . . 2 . 1 Slot ion \ i ~ t or Pn.dict iori 1 O 1
. . . . . . . . . . . . . . . . 6.2.2 Scarcti Pat Ii ancl Scarcti Terrtiiriat icm 102
. . . . . . . . . . . . . . . . . . . . . . . . 6 . 2 . bIicrarc-liic-al St r i~c - t iirc 1 O:{
. . . . . . . . . . . . . . . . . . . . . . . . . 2 . Iiiipltwi<mtat ion Isïiir 105
. . . . . . . . . . . . . . i Fast Riittx-Diitort ioii Opt itiiizcd .\[o<lt* St+-(.r iori I O(;
. . . . . . . . . . . . . . . . . . . . li.S.1 RD Opt iiirizcvl IIo<l<> S c l ( ~ t i o n IO;
. . . . . . . . . . . . . . . . . . . . . . . . 3 Eric-«(lin(: o l 1-Pictiirrs 1 12
. . . . . . . . . . . . . . . . . . . . . . . . 3 . 3 I.:iicotliri~ o f 1'- Pict iircï 1 1-1
. . . . . . . . . . . . . . . . . . - Tlit- Finit(. Statc '\Iaclii~ie ( F S J I ) 11.;
. . . . . . . . . . . . . . . . . . . 3 . '~lirr~sliold .In ailcl Rat<. ( 'ont roi 1 1 d
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ti..l Si~~it i iat i o ~ i Rcst~lt.; 1 l!)
. . . . . . . . . . . . . . . . . . fi.-!. l ('JI O p t i i l i i zor l \lot ioti Est iiiiat i o i i i 20
. . . . . . . . . . . . . . . . (i. 1.2 R D Opt i i i i i n v l JI PIa:(;-'> \'iilvo ( ' o ( l t ~ 125
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . (i..? i i a 12!1
Bibliography
List of Tables
ti.S Tlic a \ - a i l a t ~ l ~ tlinc-rol)lcxk ~ i i o t l ~ t>.pvs for 1'-fra~iiv. . . . . . . . . . . . . . !)s
fi.!) - T h o i b i i t ropj-. joi r i t t'riii.fq)?-. a i i d I ~ I I I I iial-iriforriiai ioii for ( . I I . Q) . . . . . . 1 1 1
(i. 10 Tlie orit rop). aricl c - o i i c l i t iurial critrupy for cxxliiig rriodc . l l . . . . . . . . . 1 12
-- i . 1 1 i d t i r o f o i t a r i o r i l r i I I r i t t o r . . . . 1')''
ii. 12 ( 'uitipiitat ional p<~rfori l iariw for t Ii(* 2II-log. ii.iirt.11 iiricl oiir ~('iil.i.Ii . . . . i2:I
6.1 :l ( 'oiiiput at ioiial pi~rfi>i.rii;i~i(.i. for. t \ IV Iiitkiarcliiral ic*ai.cli aiid oiir w a r r l i . . 125
List of Figures
tj.2S S[PF,(.;-? Protilt. an(! L(-\.t\I . . . . . . . . . . . . . . . . . . . . . . . . . . !):I
Ti.')!) [iiter'iar-ec 1 1-irleu frariie c:o;isis t 5 of t ivo fit'/( 15. . . . . . . . . . . . . . . . . ! 1.;
. . . . . . . . . . . . . . . . . . . . . . . . . f;.:!O \ I PE(;-2 S[cjt iori \.tv.tor r~-pt ! ! ) ( ;
ii.:i 1 \IFE(:;-2 D( "r r!-pt. . . . . . . . . . . . . . . . . . . . . . . . . . . . . - . 9;
. t h i r a t l i t r i o r D ' i i r 1 i r r r i - 1 i )O
....K. T t t i r of p o r t 0 5 j . . . . . . . . . . . . . . . . . . . . . . . . . 10 1
. . . . . . . . . . li.:ll Uiariiori(i--liaPril ii.ar(-ii ilira I L W ( I i r i tiiotiori r~~tiriiiitiori 10:i
. t t a t r i 1 1 1 1 1 t 1 1 - t i ~ t i i t . . I O - I
ii.:iti 1'SS R of r lit. Tl[.> (-oclrlr arifl r lit. i'iil!-+t1ac<-li F! D ~>ptii!iizr~(l (-u(!t\r . . . . . LOh
.i.... PSS R o f t lit. i-o(lor ;tri(I r i i t ~ I'iill-icbari-li !{il optiriiizrvl (.o(Irxr . . . . . IO!)
5 J i l i r i i t o r . ï ; . . . . . . . . . . . . . . . . . . . . . 1 11)
ii.:i!i T\it% Iiiritoqrarii ( j f r titi (lii;iririz;ttit)ii stt . [> i t t . 1 ) l > t - t x ( l i ( - r i o r i tbrr(ir. . . . . . . . 1 1:;
. . . . . . . . . . . . . . . . . . . . . . . . t;.-10 S [ H riio(lr.;t>ltx<-tiori: [-pi(.tiirti.-. I I I
j 1 [ B 0 1 t t : P t 1 1 . . . . . . . . . . . . . . . . . . . . . . . 1 I <;
. . . . . . . . . . . . . . . . . . . . . . . . . 6-12 -[-lie. ROS lrsecl i r i tliis ~vtjrk. 11s
. . . . . . . . . . . . . . . . . . . . . . . . . . ii. -13 ( '(.' I R (iO 1 \. i d w wqi itxri<-es. 1 '1 1
. . . . ij.-l-I PSSR porforrriance a': a fiirictiori <if i:onipiitatioii for oiir aigoritlirii 12 l
. . . . . . . . . . . . . . . . . . . . . . . 6-1.5 PSXR as afurict ioriof1)i t rate. 1%
t i . 16 i3ritff.r fiiilriess and X 1-ariat iori. . . . . . . . . . . . . . . . . . . . . . . . 12;
t i . C'; PSSR anri bit rate a5 a f'i~ric-tion of r i r i i t x . . . . . . . . . . . . . . . . . . . 1 3
Chapter f
Introduction
rtiwkl. riiotioti \-cctor( s ) . arid assoc-iattvl [)arartit:ttars (sut-h as q ~ i a ~ i t i ~ a t i o r i <tep ~ i z t ) ~ . c t r . 1
t i i a t ?-iclll t Lie rniriiniiin~ 1.agrarigiari \-a11 itx .l = D + ,\ R. w h w c LI a r i < l R art. t lit. associa t t t i l
i w i o i i (.si i i i i i i i i o i i algorit Iirii t tiat \vil1 ~ - i t b l i l giiorl i ~.;L(I(Y)IFS aiiioiiq i i i o t i o i l (-otiipta[~~itr ioii
([islort i o r i . rilot i o n \-wtc~r \ ) i l rai <.. ;iii(l t.oriipiitat ioiial cost . First . ii ric8iv rus1 ~ i i i i ( . l ioii
fur r i lo t i o i i t5stiiiiatioii \v\iic-li is il \ i ( ~ i q l ; t i ~ r l ï1111i of I ~ I C t l i r (~8 <I~liiritilii*~ i r i a ~.ngi.itiigiiiii
foriiiiilat i o t i is i i i t rorliicod. TIic a<l\.iiiit agt* of t 1iv L ) r o l ) u ~ ~ < l c-ost f t i r i c i i o r i is t tiat via i Ili8
[>a ra i~ i~~t (~ i . s i l i 1 II(. cost ftirit-t ioti. 1 l i v iiiot i o i i \x-ctor \ > i l rat t t ari(1 t l i ~ ( w r n p u t i ~ t i o id co>t
i x r i hr <.itrt~fiiII>- w i i t r o l l d . Srcoiid. t lit. .;(*arc-li ;ircBa is alloivt.il r o t a s p a i i d or coiit raisr as
a f i i r i c - t i o i i o f t t ic . local statistics of tlir tiiotioti f i t x l d . S i t i i i~ l ;~t i~r i rcsiilts .hot\' t 1 1 ~ IIIU-
posrd p r ~ d i c t itx' 11iot iori pst inla t i011 alpori t 1 1 1 1 1 CiiIi ica(l t o a CI raiiiat ic iiic-r(5as<x i 11 iiiot i o i i
~ s t iiiiat iaii s l ) i~v l for oril'. a sirial 1 loss i r i coiii pi-{*ssiori pcrforrii;iriw. .-\ ciiiiqiifl f m t i i i . ~
of oiir algorit l i r i i is t iiat t lir rrroiist iiict ioii rliialit>- of t tir assoc-ia t i d t.i(iro (vi(-o<l(lr is
Chapter 2
Background
2.1 Information Theory Concepts
2.1.1 Entropy
t i t n n of t 1 r i t r i o f . i t t l o t ~ r ioi f l q > t m ( l o r 1 t lit. a<- t ~ i a l \-aliitts
1.1.2 Jo in t Entropy and Conditional Entropy
v.-~M-P t t l t ~ . Y i t r i t l J' art. t ho alpliai,t.r- of -1- ; I I I ( ~ \ ' i . i ~ s ~ > o ( . t in.l!-. L I i t t [{( -Y. \ - I t I i t 3 r 1
asiiqriwl sho r t e r (.od~s. Clii ffnian wiim lia\.(% t lit. p r ~ t i s i - o r i c l i t iori propcri J-. T t i (vl ; ) rv.
t! i t~>- ( - an I)t> i -orrr t - t 1 ~ - dtv-otltvl \ri t holit kriij\viiiq r lit. iri(li\-irliial (-ij(lr. l r n q t lis in ;u lvanw,
t i i o . ~ O ] t a Fliiifriiari (-r>ilt)s ix r i I F (ltlriyntlrl < l i t - l i t \kat t lie i i \ - t x r a ~ e I) i r rat^ is
:vit h in ont2 I,it of r hr rn t ropl- ( Eciiia;ion i7.1:l j I. \[O~PO\-CT. i f t 1w ~!-r i i lwl prol>aIiiliriw
aria po\vi>rs o f i. t l icn t lip a i - r r a q ~ ratrl OF r lit) IIiitfriian (.o(lt~ i; t il(. G a r i i c i t ~ t h . t ~ i i roi>!- - of t l i ~ ~ ~ . i ~ ~ I > o l s . Hi~ffrnan (-ocles iirr r!-pic-all~- < :cn t~ra~tvI iisinq a r r w . Han-t.\-t-r. iinlik{t
Sl iannon- F a n o rwrlrs. Hiikfnian coclrs a r tx hiiilr fronl t iitl ho t toiii 1 1 p. <lm-t in$ \vit 11 T lit)
I i ~ ; i \ - t ~ ~ o l r r w a n < 1 ~ v o r k i na - proqrtwivt.i!- loi(^- t 1) r i i t x root .
Orir clra\rhai-k o f H i i f h i a n i-ij(ling is t li;tt ,111 (.ij(itw-or(is lin\-<% iriitaqtxr liw$t lis. So
r i t t 1 liiqli t h e p r o h a l ~ i l i t ~ - of oritk of r lie .-~.riihol.: is. r liat .';>-nihol i t i l 1 ri i lfit IN.
2.2.2 Arithmetic Coding
.\ri: liriiilt ic c-o(liriq is a loislr~s c o n i p r r a ~ i o r i T rv.liiiicliit\ I !iat h t~r i (~f i t .; f r o t i ~ t nS;tt itiq rniiliipltl
~ ~ - i i i l ) ~ l s aa n ~ i r i e l t x dam iinit htit a t r l i t x ~ i 1 1 ( ~ t i r i i r l rotaiiis th<. iiii-ri~!iit~rititl ~~. i i ih>l- l ) !--
<!mibol (-o(liriq a p p r i m - t i of Hiiffnian t u l i r i q . Arithnit>ti(- i*o(linq Gc\parattas t l i ~ ( u ( 1 i r 1 ~
i.onipontDnt f ron i t hcx riioclelirig roniporittrir . Tliis p ro ( - t3~s a l l o w f<)r t lit. 4l>-riaiiiit- a(laprii-
t ion o i t tir. p rohah i l i t y riio(lr1 ~ v i t lioiit afftv-ri ri? t tit) i i r i iqn of t i ic ( .O( 1t.r. ïlit.i)rt)t i<.iill>.. in
a r i t l i r i i c t i i cocling. a sirijle cotle\vor(l is aiiigiit->tl to t w l i posr ih l r wqiit.ri(-i. of * y i r i l > d ~ .
Eric-li co(lrn.or(l (*an a lways he r ep re s r r i t r f l 1)'. a tialf-opcri s ~ i l ~ i n t e r \ - a l i r i r l i ~ i i i t i~r\ .al [O. 1 1 .
2.3 Rate-Distortion Theorem Concepts
First. Ici .Y aiitl .Y Iw (lisrrctc raticlorli varial)lrr; ivitll alplial>ctt .I' iiriil .ï w s p c t i\-vl>-.
iiiitl t Iic joiiit prol)nl>ility riiass fririctiori I N * gi\-tw 14.1.. .i- j = Pr{.Y = . r . .Y = .i.). wli r r (~
.r E .Y arid .i- f .Y. Sost. Ict t lic distartioii f i i t i c t i o r i d( .r . .i.) 1)c a riioasiirc o f t l i v c-ost of
rrprcs(~rit itig t l iv s>-riilml .r it*ith tlic s~-iiihol .i*. Tlic distort iori f i i i i c t ion d(.r. .ia). togrt lier
Tliv r x l t -(ii.+wt iorl Juricl ior, R( D ) for a soiircis .Y i i - i t l i ii\v.ragt8 (listort ion d,,, i i ; ai\-t:ii I>>.
2.4 Hybrid Video Coding
i r i t h e 11)-hrid i.i(lro cudiiig sctienie. Iritra-frariit* (-wliriu, t~iipli>?-s oril!. spatial r<-:(iiirii.lanc!.
recliicriori rilet hud. t lierefure. t tiv frariirs (-a ri I>e twiro(l~i I irl(ltlpi'n(len t 15 For h t t ~ r - f r a r w
cotli riz. tio~vr\-m-. Imt ti rerriporal and spatial rt.f liiri(lanc!; recli ic-rion riivt l i w 1.; arc: iiie(i
Generic Encoder
Generic Decoder
Fiesiduai
Coding I
, +.<. FiSliri) 2.1 1 . ; i i l<i fi.;] Iil(.5 i I i r lit . p a s t a i i i o r 1'1ir i ~ r t b ~ i r t l r e ~ ~ , i i i r t ~ ( 1 t o [)clrfi,r:ll tt1~ll[)ot':i1
p l \ r i r i t 5 1 1 1 i 1 - 1 1 O ! i 1 1 1 1 p i - 1 . .\
1 i i l i l t ) ki t l l l t l i lnt i \ I)!. intrr-fr;rriicx < . i ) i I i i i c i.: <-; i i l i .qI ;i P o r pic-t iirit. [.'OS 1' p i i - 1 Iiï('5-
o ~ i l \ . i i~ l ( . fraiiitx i I1 :lit> p s t . i I ~ > ; P I ! a: r t lf t>r1~111-(~ for t < * i i i [ > ~ ~ i i ! [)t-(vli(,t iot i . F-O1 [ k t llr('5.
O[,<. fr;tril(. i r l t I l i . p s t ; ir i [ l oritl frariitl i 11 t lit. f i l r iirt. art. 115(3 1 for ttlrri para 1 [)rti(!i(.t i o i i . [ri
tjrfitbr 10 r t v l i i r - ( l t i r i i l l l t !ni~~ritat iori c o r i i p l v s i r j of i~ot li t Ili. c>n(.o(l<lr ; I I I ( \ ( h - d t l r . 1 Ii(' B
I>i~-ri lr t . . ; anb 1iut r ($prr~r l ( - iy[ 1);- ariy o t 1it.r t! l > t + of [)ii.t iir(x. an(\ or i i?- t litb ( ' l i ~ ' + r [ O r P
pi(.t ~irtb is ii.;(aiI as a rt*ftmlrir.t>.
T
Motion Estimation
Inverse Quantization
A
lnverse DCT
_j Motion F rame ! Compensation Memory
moticn vector
Block Motion-Conipensated Prediction and DCT-based Residual Coding
2.2. siicii as biock riiatcliirig. D(.lrl' arid scalar q~iantizatiori. i l I,c (liscusscrl i i i riioro
tlctail.
2-5 Motion Estimation
2.5.1 Block Matching Algorit hms
Current Frame Reference Frame
Search Region
Figii rv 2.3: Fii I I srarrli riiot iuti ~ s t iriiat ioii prowss
Matching Criterion
2.5.2 Fast Motion Estimation Algoritlini
2D Logarit hmic Search Met hod
Fiqiiw 2 . 1: TIiv 2 D Ioqui r l in i i i - wiirr-ii
i-ori\.fxrqt-s ori a lwal niininitini.
Three-step Search M e t h o d
Parallel Hierarcllical One-Dimensional Search (PHODS)
I ' l l i c ; rlltat l l o ( i is i!i?:c'tl o r 1 il. r jn t~-<t i f i le~nsio~l ; \ l I)iriii~>. r r - / l t t i a t n ~ l i w ( in t l i t . i i w i i i i p r ion
t t D f i i r i t r i i l o t . i l I t i i Diir i i iq tliis
~ c ~ : i ~ r - I ~ p r o c ~ s s . h - 1 l~orizorita] a n r ] \-cartical 5 p t i a l ( l i ~ ~ ~ t ~ i ~ s i o i i s aso s(\ar(.\ltx(i i ~ ~ t l t ~ l ) ( % ! i ( l o ~ i t l ~ -
-- - 1 . . , . - 1 . \ s in t I i r ~ I<igasitliniir- +rarcli . a ( i p . = p ) \ ( > i d l rt-ycjri i.; li(lril a s . ; l i i ~ i ( ~ t I .
Ft)r a onex-<iirrirrisiorial warcli alon; 1 . I I I I s t t i s 2 . . t I i t x
1 I ~ s w samplirig %ri(/ for t / w iirst itwation is 0 1 . i, Il. 0 j . / ( I o . 0 ). i v i t h t h t - > s i rn~h11g
i~l t( lr i-n[ ti,, = 2rii+'i(~)1. Thts I o c : a t ion ivi t h t f w 111i n i t ~ l ~ ~ i ~ l l[:\ D a n ~ o n g r t.lisvt~ point.< is
i l . w t l 21s the cc~rltcr of t h rit"st. iterat.iori. The st-lr:ori(l itc->ratiori var(-h(->s for ~ h t - % i1ii11i11111r11
l).lr..in ar t lie following r i t 1 points. (-ri,. O ) . i O. 0 1. i t i , . O j . irrtirrrwl at th<. Io(-atiori iritii
Hierarchical Searcli Met liod
1.0 ci rriirii\-riit i l i ~ t 1itficici:i-irs in fast smrcli a!gurit Iiriis. ivliic-Ii ( I t p ~ t i ( i oii a i i i ~ ~ i o r u r i i < -
cI(u-(*asi riz .\ I :\ D sr rfaw. Ii icra rcliical scarch riiet lier 1.: \ ~ i w (dt~\v~lopc~r l [Ci]. [ I I liit~iarclii(,nl
warcli. t Iir scarcti procws is iiut coiifiiied to a siil>sct o f t I N ) witrc-Ii i.rgioii. iiii[l is l c s i ikc~ l j -
t o h c t r a p p d i i i a local mi iiiriiiirii. L-sirig loiv rowli i t ioii rrprt~st~ritat ioiis of t lir fraiiles.
t Iic ciitirr warcli rcxgioii cari processet1 at diffrrrrit la>xw. Iri adclitiori. t h hi<~rarchical
st riictiirib nlloivs t l i ~ ilse of di tfcrmt sizctl searcli regioiii aiitl iiit8arureriimt n.iricloivi t tint
Full Resdution
Scale
-- -- , Motion
Estimation Level 1 -.
r 2 Scale
r - - -- - - - -. - Motion
Level2 Estimation
i i iot ion r s t iriiat iuri i?: t lieri perforniecl at t l i e 1iight.i. level. Higlier ivt-~ls i n t lit. p>-raiiii(l
2.6 Discrete Cosine Transform (DCT)
t rarisfortii t ( ~ c . h i i i q i i e s u-liicli can acliic.\-r goorl dm-ornblat ioii pdoriiiaiicr. aiid artb iiiiicli
vasiw to i riiplcriicrit . *flic!- a rc t lie Discrets Ibiricr Trarisfot~ii ( D FT) . t liv FIadatiiar(1
-1'raiisforrn. t tic Slarit Transforrii. aiid t lie Discrctc ( 'osiric -1-rarisforn~ ( DC'T). Eadi of
2 DCT Coefficient Quantization and Codiiig
I l Sirice t tir ti~i~tiari CJ-c is IPSS scnsit ive to ~ r i ~ r g y wit li higli spat id fwqiii~ricii~s. t tic.
ioivi.r frt.(liimîy I l ( 'T' cochfficiç.iits arc. in grrirral. 1-isuall!- rilori. iriipost aiit t tinii ot l i t m
[.?l]. I r t h i r P a s a sct o f non-iirii forrti wiglit a (-nll<d t lie I I t I I nint r i r is
iisid to quarit izc t lir <-otdfi(-iwits. Eadi w\.rip\it slioiilcl \ai.>- i v i t li t l i t . frr(lii(w<-y. as ivvII
;ib t hi* t>.piz ( i n t ra. iriter, of t lie iriiagc. T I w p n m w o f ~~i iar i t izat iori o f t lit. \ < 3 I l ( '-T - 'il J
i-otbfiit-iibiit s g ,,. i. J = 0. 1. . . . . . cari I)c <.spri~ssrd 11)- ! j ,., = roii ~ t < / ( - ). i t - l i t ~ t . q,., i': t l i t * ' T l j ' i
i v ( * i n l ~ t in tlie quarit izat iori iiiat ris (2. aiid t lir q is t l i t . qi:aiit izat ioii factor. [ I I g ( ~ i t ~ a 1 .
i i v o ~l~iaiitizatiori riiatrisrs. Q,,,t,.,, nii(1 (J,,,t , , . ai(. rivliiirt.cl i r i \-idt'o (-o<liiiq Iit~aiist. oc t Iic
rliiriw.nt prolwrt ics of t lir D( '-1' cocf ficirnts in i i i t ra ari(l i r i t or co<lvc! pict iiri8-.. -flii- lo~v-
l i . i ~ ~ u r i i ( - j - tv(-iglits iisiial1~- ha\-e siriaIlci iiiagiiit iiclrs t liari t lit- Iiig1i-fit~rl~irtic~~ wiglit s i i i
(),,,,,.,,. Ilo~vr\.er. i i i gcrirral. iiiiiforrii ivciglits are iisecl i i i Q,,,t,,. Brraitst. t liv qiia:itizatiori
iilatiis (2 \\-il\ iiot cliangc. at Ivast n-itliiri a fraiiic. tlii. ratc niid t lit. cliialit~ of t l i ~ coclcd
frniiie are directly coritrolltd II)- ttic qiiaritizatiori factor q of eacli hlock. Tlic algoritlirii
t liat ~Ictcrmi~ics the i-ali~c of q drpr~icls or1 tlic applicatiori. thr rate. aiid t h t b iliialit>*
r ilt. rli1ant izi.(l (-ipffi(-itbnt.s arc3 -apprt)';inixti.l~." ;trrniictvl in o r f i e r ot' a.-(-im( lin: f r ( ~ ~ ~ i i ~ i i - > - .
-rllis proc-ess il.;iiall!- iiicyraïrs t lie niinii->rr of (.orisr(,iit i \-r D( "r rt~ro-\-aiiiwl t-ot+fi(-irrit.;.
- i r i i p n > \ - ~ s s iq ih i - a r i t 1 ~ - w n i p r r i s i o n rtficirri(->- ii 3. :{r i . : 5 I . :i 1:.
2.8 Video Coding Standard
I r i t l i i s rl ie1i. i~. oiir proposwl n i q j r i t h n i s n-il1 Iw iriipl(~nit~rittvl i r i r l i r ( - o n t r s t o f t h ( % II.%:$
;i;ii 1 SI P E:(;-i! \.i<lt.o lin? i t an ( i a r [ l Franiework.;. [ -Iwrt~fort~. i 11 î lit> f c ) l l o ~ v i ~ i ~ ~ i ~ h ( . t ions.
a Ili-it*f tltw-ripriori 01' .;ii{.li i-iilro cwl ing st a n ( lasils il; prvwti trr l .
2.8.1 The H.263 Video Coding Standard
2.8.2 The MPEG-2 Video Coding Standard
Chapter 3
Block-Based Motion Estimation
3.1 Motivation
irii~)lc.riit~ritatiori. i t also lias tivo rvcll-kriowri clrziwtmc-ks.
1-tif. tirst (!rnivl)ack is a drgratlcd i-idtw r l i i a l i t ~ - i i i low hit r a r r api)li(-atioris. f l i i -
psoblt~ii is t liv r ~ s i i l t o f t iro liriiitat ions: ( 1 i i i t b t . i i m ( l c - r (-aiiriot J I sol t lit. riiotiori
\ - t ~ - t or bi t rat P . and ( 2 1 t lic rwcoder c-anriot 1001.: alwacl. 1 [cric-t-8. t. lit. o l ~ î ai ricd triot iori
i-txrtors ( 1 0 rio! riei.i.ssaril>- >-i<.ld t tic --hrst" ovt-rall imcwliri: rrriilts. 1 - l i t . i i i ipact of t lie
almi-r liriiitatiori': i': iisiiallj- more si:nifi(-nrit iit Ion- h i t rattXs. siri(.t. t.litb i:iotio;i \.thi.tor h i r - -
rat h t * ( - o i : i c ~ wlnt i i -cl~- l;,ra~l (:!O(% - .iI)'.< of t li t . t t > ~ ; i l I ) i t r a t i l ) i 1-1. 2-1. 1!)1. Iri ui.(l(br t o
sat ir&- a ccrtairi !)i t ratta i.c-qiiirmicrit. t II(: (-ricocl(.r t h c ~ i tias I O iic;tX a I ~ I . S ~ ' I - <I~iarit izat i on
s t q ) diiriiig t l i t . cliic.orlirig o f t l i r D ( - ' I c-oi.fFi(-kiit 5. 'f'lli.;. i i i t iirii. stb\*tw*l> (lty-ailils r lit-
r o p s ~ l d ~ i r - t i o i i cliralit>.
' l ' l i t* wi-urirl drairl)acl; is F'S- B.\l--\'r \-(.ri- iiirgi. i-oiiipiitat i o i i r t~t~ii i r . t ~ r t i t ~ ! i t . ~ . For iBs-
;iiiipl(. t lit. trrn-sttXl) 1 - algorithiii t i s t ~ l i i i r lic 1 ' - 2 -l-.\l5 c~ii<-o(lt~r t>-i>i(.iill~-
r~~( l i i i i . os !,O'.Z - !)ri'.;,( of t l i t . 1 o t al iiiiriii~r ol rorii ~ > i i r ii t ioiis. 1'5- B1 1 :\5 i.t*t[rii rtb IiiiiriJ- r - u r l l -
1 ) 1 i 1 at ioiis iiiaiiil!- I)t~t.atist~ t I i e . ~ . i i ~ i i a l l ~ . folloiv a firtvl s(a;ir(-11 [mi I i ivliorib ~ t ; i r t iris poirit
i.: i i l ~ ~ t i s t d . -lliis iiiipfios. t liat. t u accu~~iiiioclatt~ \-i(lcv s c ~ t ~ i i t 3 ~ l ( - t ~ s ~ v i t h riori-it;i!ioiiiir>-
t i i o t ioii fields. a w;irr-li pat li t ravtmi rig al1 poirit 5 i I I a Iiirgt. s(.ari-li asoit i i i t i s t I)t.
ti.;tvl. - 1 ' I i ~ FS-BS IA' i liigli coriipiitat iorial rriliiirviii<-tit s lia\-(. fiiiblt~l niarll- i-iwar<.1i ar-
t ii.ii k a s . rrliicll liai-(% pro(llic(vl sri-cral rffici<~iit algorit liiiis siiïii a s 10% warch. t tirw-st<*[)
5t.n rcli. cross srarcli. corij iiga t c graclicrit scarrli. Iiii~r;irïlii(.al warcli. aricl I~luc-k haarii-
pliiig [r>. S I . $2. 2. I l . 2 . 5 . Clo~vri.er. iiiost of t lic. al)o\.c. algorit tirlis nia!- qiiickly 0t.t
I i.appc(l i i i lucal iiiiiiiriia. J-icldirig a sigriificaiit l o s i i i ~1st irtiat iori 1)d'orriiaticr.
I i i t tiis ivork. irv proIIosr a i imv iiiotioii cstiitiatioii algorit liiii t l i a t is J~otll (ltficierit alid
3.2 Motion Estimation witli Rate-Computation Constraint
n-Iitxrp t Iic non-ntlqat ii-e. in111rs t i f t Iir Laqranqiar i iiiiilt iplirr.: X arif l riiiist !j(- ( . i i< j~(%i i i o
The Prqosed Lagrangian Cost Function .li 1 1 i
Lt.1 115 n s i r ~ ~ r r bar for ;i riia(.rol~locli , i . j j a p rc - ( l (~ l i t~ i~ i l .i('ilr(.I~ ~ > i i t Il P t Iiiit (.o\-i1r5 t I i ( 1
-ta;iri.ii a r a t~s is t i . arici t h a t P corisisrs of t h r ie<liirn(x. of niotioii \-(3cti~r.; i V I . VL. . . . . v \- i.
T h t h s t ihsc ip t 1, i n vrL in(li(-at(as thtx scarrh ort1t)r. t h a t is v,, = I .r,,. y,, 1 is ! I l i x tjtli riwtiori
\-(b(-tor in thr sparcli par/,. A f r ~ r con~i(1ering th<-> l-e<.tor v,, nloriy tlitl ~t.iii.(.Ii parh 'P.
3.2.1 Rate-distort ion Optimized Motion Estimation
3.2.2 Computation-Distortion Optiniized XIotion Estimation
3.3 Proposed Motion Estimation Algoritlirn
i l r i t v i t o i i i l i l t lit. saar(.li par 11 t ~ i i i p l o ! . ~ . r l i i i r l l i ~
ii-or!;. Ttit. ioi~r(*i! pat li i l i i > i i l i l ipt.<-ib- a +->iiiitlri(-il of riiot iori \-tbi.t o r K . i \ . I i < ~ i . t ~ T l i i b .*opt inial"
riloi iuri ~ - t > ( - t o r (-a11 I > t l Foi i n ( l iv i t hi ri n ~ i r l i r l i i ~ t l ~ ( .o~lipi i t i l t ionai i-ost . r h i - t ~ t ~ -oitsi-Ii p i r lis.
, .pirai it.ari.li p t J I . a (l iarl ioi~cl-sl ia~)c~ I .twri.li 1);it li. a ri( 1 a tlo;it in.--(-i~ritt~r *ib;iri.li [ ~ i i t I I
r 1 s t . ln t h ( > f rial s i i h ~ c t . t i o t ~ . t ~ v o otfi.(-~i\.tl ttlrniinatiori a ly~ri t l i i i i . : Imi tvI o n t ivo
prolxthi list ii- rliorlrls 1 rrspt.ct i i- i . l?- ) rvill I>tx i nt ni(liicr( l an<! (lis(-ii+tv 1.
3.3.1 Starting Point: Prediction
hlean Predictor
Weighted Mean Predictor
rlirtor oiitprrfornis r h r iinifarni mean prtvlir:tor r l i i r i i s d ahw.c. fiirtlier i n i p r o v m i m t s
i i i pcrforniarim are r ~ s p ~ c t r t - 1 b ~ - irhangiri? t h . i-aliiel; o f r l i r (-ot*fficitwts r i ; ' i arlapti\-txl>-
(tiiriris nint ion tlsrirrinrion.
Median Predictor
Stat istical Meaii Predictor
-4 rriorp porvt~rfii~ riori-lirirar prrclirtor is tlitl -iat i.rii-ai riit-ari \ - t ~ ( - r ~ ) s Y = P. r / 1. r~lio-ta trvo
a ~ r r i p o n t ~ t . ~ arta al-O w r ~ ~ [ I I I ttvl i r i ~ l * ~ ~ > t ~ r i t I e r i r l > - MI(! i ri x i i ( h i r it-al riiiiriritlr. i\Ï t l i o ~ i t l c w - o f
qtliitnlit!-. wix will rit^: iltw-rilw t Iitl priwtvliirt> i i ~ t v l :O tx-tiriiatia P . i l i t ~ .r ( - o r t i l ~ ~ i i t ~ r i t o f c . flitx wa la r .i- i.: t i l t . ni3iqiittvl a\.t-ragtx of .r i - ~ i i i p j r i t ~ i i t - o f a i l p o ~ ~ i l , i t ~ r i i o t iori \-v(.ror<. I I i t x
~ w i g l i t iris w~t f i c i twt 3 arcb t ~ ~ i ial t o t tir coriiiir iorial prui);iI>ili t it+ o f t l i t . .r i-orti potitlrit.;. T!i tx
(-oridit iorial prohabili t it.5 art1 (lrtrrriiiriril i i i . i r i q a ririitt-t art. [lia(-hi rit. i FS.\ t r t i o i l t ~ l t haf
i' rt~prcw~r1ttvl 1 ) ~ - a (-oiltal)o~i<. o r a .;et of stittt. c-uclt. t - t v . t ~ r \ . E<t<.li c.i,(Io \vt.tor r rps twr i t s
a ro la t i \ - t~ l~- larqtb <tat of tixriiplaitx \ - rc tor i ut . -flic. i-uriipoiit~iit.; of r i i t l ttwiplart. w . f o r s ut
a r r feat iirr q~-rtil~ul' reprtw\iit irig t tir .r curtipuiitaiit uf p r i ~ \ - i o i i s l ~ - (-wlt~il riior iori \-tlc.rors i r i
t h ROS. [ r i ot1ir.r u-unis. a rcri iplat t~ \xlctor ut i \ t l i t b oiitpiir uf ü riiappiriq fiirictiuri rvhoatb
iiipiits are the ROS mot iori 1-wtor .I coniporicritç. is t h r iripiit tu a ttxctor qiiaritizt\r
i \ -Q) wtiose coclrhouk coiirairis ail statc code vcctors. Iri t tiis rvork. t tir. Follou-ing t i w
itiapping Fiinctioiis aricl \-Q:: a r e corisitlered:
( b s p c ~ t ~ d t o >-icld ver>- aisi-iiratt3 + t at i-rical nit>ari prwlictml rtior ii,ri i-ta<-ror.;. So t t l rliat
ol i r iii
( ' h a p ter :j. Bloc-k-Bas-ed .\lot ion E.st irrlariorr
A - -
v u -
Float ing-Center Search Pat h
-Y. v.ilI t hrii ht-1 t h v reritvr of t tie new- war(.h ri.-ic,ri rilarktvl as l r r y r - I i. Ifo\vcl\-t.r. I~v-ai isc~
o f tht* ijvr~rlal). uiil!- t l i t . :l in [ri!-er 1 i v i i l I N * t t~ . ; tcv l . S t ~ t . t l i t . I w r t r ~ t , t i o r i \ . ( ~ t o r
f w i r i d artlori.; t lit. :1 point': rvill be tllr i-eriter OF t l i t . iit3\v stw-cli rt:;riori riiarkr-l as l<l!)t r - 2.
('linpter 5. Block-Based -\lot ion Est irriat iori
3.3.3 Termination Point Algorithni
I r i Ri) optiitiizctl rnotioii cst i mat ion. iriiiiiitiizirig . I ( l i ) = I l ( 1 ) ) i X R( i l 1 caii Iw \-cr>- (-«III-
p u t atioiiall>- tlcniaiicling. III (.'D opt iriiiztd riiot ion cst iiiiat ioii. to fir icl t lic rilot ion \-cctor
aiid cliiiosiiig sri appropriatr teriiiiriat ion p i t i r is t licrc~forr a d i f f i î i i l t tas k. 0 i i ~ solii-
arcas i v l i (w3 t tir iiiotioii field is not srtiootli. I i i siicli a cast.. t h t a i.açraiigia;i si i r facr
is likcly riot coii\~:s. Ei-rri whcn tlic niot ioii field is stiiootli. tlir scarcti as spccified
1)). tliis II>-pot licsis <.an cliiickly get t rapped ir i a local iiiiiiiiiiurii.
3.4 Sinlulation Results
iis(v1 t o ( [ r i ~ - t - the3 FSlI t ~ d t x \ . tlitx tv(-~i~/it.cvl n~t*ar i \ V J ! - s \ l 1 a I w oiitpt~rIi)r11i5 t ~ I P ~ ~ r l i f o r r i i
~ ~ i t * a ~ i I \ I - - \ -S\ l a n ( ] ~ I - u - s \ I j i r i rtXr:m of pr t>( l i ( - t io~i a(-~-l i r i i ( - j* . \ [on*o\ -~*s . t l i t x ~ t a t i 5 r i ( - a /
t a r i - t 1 - 1 a t a t t t r i t I I I l . l'iriiill!-. r io t . i ( . tb
t lint \[ED-.-\ ~-icI(h a [ O I Y P ~ tSrlt rop!; tllan t . I i (~ ilicjrt.* ~ - o ~ t l l ) I t * ~ \iritXiir ~ I I I ~ 1 G r i l t i51 i(-al riltxln
i)r-idit.tors. This. coii[>lr*(l \vi r l i i 1.; Iiialier rohtist r i t w t o (r1iaririi.l tmx)rs. i.: l i l < ~ l > - t ~ l i ; i ~ riiit(lt1
i t pitrt of t h e H.2GI ~ i t a r idan ! .
[ t i.: (-1ear frorii [ -a l1it.5 :I.:! :1.:1 t ha t t lie ( l i tFerrtictas i r i a\x>ragi- (-.rit rijpiv.; a r t - r r la -
i l I l This siiggr:xts rliat niotiori zitiriintiuri/i*otlirig is riot wrisii i\-e tu prmlictiori
ai.riiracj-. .\Loreo\-er. as . l i ~ w r i i r i Tahl i~s 3.4 a n d :I.3 for \ i 15s .\\I ER[(*, \ ;tri( i ( ' A R F H O . ~ E
Previous Frame Present Frame
- - a . E:iitrop~. for C A R P H 0 3 E of iiiotiori w c t u r .r cotiiporirrit offscts i r i t i l tb rcaruti ai-va c.c.ritcro(l at I l i t1 rricari ( ' r I E X S - h ancl S I E A S - t3 ). wcigtittd riicari (\l'.\I ). tiirrlia~i
(11El)-.-1 niid IIED-El j. iiicaii-l)ascrl statistical iii(nari (\I---\-S.\I a~icl 51-0-511) . ari(l ~i-cigl i t (~l rtirari-l)asclc-! staf ist ical iilcari (\\'SI-511 ).
~ u i i ~ i t s aiid (.rit ropy of t tir .r r-oriiporiciit o t r w t s of t liow mot icj i i i ~ v - t o r s loi-attvl i i i t lit.
i~imts and eiit.ropy of t l i i ~ .r cottiponrtit offsots of t tiow riiotioii i-rctor-s lo(-iit~(l i i i tlic wascli
3.4.2 Search Path
111 t Iiis p a r t 1 lit1 cortipiit at iori-rlistort ioti pri.rorrtiaiir(~ OF rtirt hot!.; Imwd ori t I l t b t hrcc
s(~iscli pat lis (spiral warcli pst li. <liartiorirl-slia~)<.<I soarcli pat li. aiirl Lloar iiig-wiit<v warcli)
<liac.tiiscd i i i S ~ c t ion :1.:1.2 is <~\aliiatrti . T1ic c.uitipittat ion-distort ioii q ) t irtiizi~d iiiot iori
(.si iriiat ion algorit iinis assoc-iatctl ivi t I I t lic t III-w smrcli pat lis art. ic~iplriiiwtc~rl ir i t hc
roiltcst of tlic SIPECi-2 TA15 \-itiim cncodri. llorlel l (2-la?-rr II>-poilic.sis) (lisciisscd
PSNE vs. Csrnputat~on 38 I
football. dl3 frames
Search '~Vindow: -47 Io 47
Rate: 8 MbitUsec
i /'
/ //
x Spiral
Diamond
o Roating center
PSNR vs. Cûrnputation 35.1 :
34.9 i Searcn Window: 4 7 IO 47
Rate: 8 Mbituses 34 8 1
x Sprral
Diamond
o floatrng center
3.4.3 Termination Point
f lit1 ~)rt)poswI p r ~ l m h i l i i t i ( - nlwit!l.: I h a ~ t ~ 1 < > I I 1 I I<- ' > !a~ .o r I ( > - l > o t I i~i i i : ilil( : I - / ~ \ Y < . ~ T Cf ! . p > t 11-
P . O t - i l f l i t i i t i 1 O w 1 t t 1 1 O . ïlitl
i . i i l w CII(:U( lrr t q i plo!-et-l a Huat iiig-wriii.r .;r*ar(-li j>;i t li i ri t hi. rxp(.i.i riitbrit . 1 1 t s \ - i ( lt-.O
+<y~ii(-~tiws are t lir ( 'C' 1 R cil) 1 ( 0 < - 0 pi st .1~. :;O frnrii(-?/wc i T L r i 1 ( ; , \ R D E S
,w(ltitxnc(is. niid the. t a r y t I ~ i t r a t t is d S l h i t s / w r . K t ~ s ~ i l t s ;inJ show~i iri F i ~ ~ i n ! :$.l.l .
[--or t i l t x FOOTBALL .wqiieri(re. the two riiethoih arv \-ri-'- crioie iri [,rrforiliari(-rb. t-tolv-
P . for C;.\ R D E S wqi iencre. t lie riict ho([ haird o!i '\ loflol 1 is [ilor(-. (?ffii.irrit i liari t litb
ur i rb I~asc.tl Uri Slo(lr1 t I. For ver>- a c t i ~ ~ wrl i i r r i<-vi : . siicii as t lie i;oo-rn.-\~r.. tlit. propow(l
PSNR vs. Computation
38:
Football. 36 frarnes
Search 'SJindow: 1 7 !O 47
Rate: 8 Mbit~sec
x 2-cayer Hypothesis
a 3- lay~r Hypolhes~s
Eoat Region
3 7 ( 0.6 0.8 t 1 2 1 d 19 t e
CarncuraiianuMB ( * al operations) x tif
PÇNR 2s. Carncutaticn 33.0 r
33 d k B Mbilu sec
x 2-iayor 3ypcthesis
û 3-iayer Hypothesis
F i g r 1 ('oriipreisiori perforirianct~ of 2 riioclt~ls for warch trrriiiriatio[i i n terriis of PSS R nricl riurii l ~ e r of conipiitations per r~ iac roh lo îk .
C'hapter :I. Block- H a s d .\[ut i o r i Est irria t iori
Chapter 4
Rate-Distortion Optimized Mode Selection
1.1 Multi-niode Video Coding
4.1.1 >Iacroblock Coding Mode
( ' l~apter- -1. Rat r-Distortiori Optirriizetl .\loclr. Sclrrrt i o r l
4.1.2 Conventional Mode Selection Algorithms
T i i ~ <Iran-lmck o f t l i ~ approacli is rliat t lie r i i o d i a ii rid i t s associntivl paraiilet ers are s r ~ l c ~ t wl
\vit hoiit jo in t coiisidcration of t lie h i t rat(. ari(l t lit . \*idiw rcprodtict ion cliialit>-.
4.2 Rate-Distortion Optimized Coding Mode Selection
[ r i t tiis WC-t ioii. a i-asranginri forniiilat ioii i:: (wiplo~*(~rl t o arldrc-5.: t lit* prohlcni o f w l ( ~ - t i i i <
siibjtct to R(.l ' . .U ) < B...
- - CI
- C - d e - w d
C 4
* .6 CI -
C C. -. -+
ii - h w r - r..
T:
ris 2 ri - rr h u
e - Z Ci d - cil +
z - F: '1.
5 - C - - A - - 3 b'
'7
M - + C
,
5. - L C - - - d
?; h
-7 Y - V - S
T '7 , 5 - - r -. - L
3$
4.2.1 Exliaustive Search: Performance Upper Bound
[Ioirc~\- t~. 1 lit. al)o\x. t.rliaristi\-r. scarrli r t i t ~ t l i o ~ l (-aii I N * \x-r>- i i i t~f f ic ic r i t for \ . i ( l i u i-udirig
i t a i~( la r ( l s s~ ippoi .~ i r iq riiariy codirig riio(lw aii(l ~>;trariit~ti~rs. For tisariil)lc. t lic i i i i i i i h
or possil>l(. cotiihiiiai ions r > f codirig rtiotles ar~(l iiaaoi-iat(*(l ([iiarii izat ion . ~ t ~ p s i r c 1IPEC;-2
iiiniri p ro l i l (~ /~ i ia i~ i l ( ~ i - ~ I for P p ic t~ i r r s is 259. 111 t liis t w i D . t hi: r~sti l t îr ig S[PE(L2 t w u l i ~ i q
t iriw ivill 1~ 30 -10 t iriivs longer tliaii tliat of r lit- 11 PEG-2 l'II5 c.iirurlcr. [Ioivt.\.rr. a5
sliown i i i Figiirc -1.15. t liv associatecl gain iri roiiiprrssioii efficitwc~. ivoiiltl t)c 1 .r> - 2.0 d B
iii PSXR as coriipartd t o t lie .\IPEC;-2 T.\lr> t~ricodcr.
To iiirrcasc. wriipii t at ioriaI cfficiency. i v r propose t iro fast iiiotlc-sclrct ioii algorit liiiia.
Tlie firsi algoritlirii is hasrci on a t krcstioltliiig riivt liotl. For I-icleo cûtliiig staiiclards wit li a
rclatii-ri!. -n ia l le r n i i n i h r o f i .LI,. (2, ) i.onikitintionç. tlir t lirr~sliolciinq r w t l iwi CRII bta \w-y
t.fFwt itx- i:i rcvliiciri? t h e r-onipiitat ional iIc~riiariris. The- th e on ri alqori t l i r i i i.; Ix tsrc i on a i l
nrlapt ii-e tirii te .;tatts rriacliinr F5hI I n i r t l i ~ i . \v l i i r l i txploii >i r ht- i ta t i ~ t ical rtvliiiiiinii(-!-
ariii)riq rit~iglii jori nq niacrohlocks.
-1.3 Fast Mode Selection Algorit hm 1: Thresholding hIet hod
Rate VS. PCINP. 39
38 - %S. 60 trames
W:n Size 3 1 37- ,' /
/ :P. GOP 12 1'
/
Football. 74 frames
'Elin SIZP -7
IF. GOP 12
320 2 4 6 9 1 O 12 14
Rate tbps) x 10'
I . iR~iw 1. i.j: -r kit. coiIipresiiori per for r r in i ic~ curti pariwri ber wcarri t l i t . SI P EG-2 T S I i c.u(-lilr
aiid t lie full-warcii R-D upt iriiizetl rrioclv arirl qiiarit izatiori i t ~ p ~ I c < - t iuri alqorir l i r i i c.o<lrr for Hiis wqiicrice ( top 1. arii.1 F*üotl~all wqriprice ( hot torii 1.
4.4.1 Finite-State Machine (FSM)
4.4.2 The Reference Lagrangian .In
.As rhotsn i r i Figura -1. Iü. t lie tlistrihiit iori of t lic opt i r n i i r i i Lagrangiari .lm is a lw 1 - t . q -
sr r i tc t tirid. Thefore . t htb refcrence Lagraii5iari .IR cari bc &rit-ed frurii t lit: opt i i t i c i r i ~
( r ) .\.[ODE
step For a frnriir o f t I i r Foijtlxtll 2(-1c11ir~:1~-(~.
d e r
i \ . h r r ~ r r * , , are t lie n-eiglit ing rnefficimts at position ( i . j 1 in t ht> ROS. 7 - h ~ Laqançinri .In
<:an hc controlietl t ~ y scalinq t h e .IR. For t-xanipb. il i v e s(-altl rlown .IR. niorr i .Il,. 0, i
pairs ivill h e consiil~rrrl. and t l i c prohahilit.? of finding t h e optimiini I .\Il. Q,) in(-rc-ast.5.
T'tic. cost. t10n.c~-cr. is a ..;tibstantial increase in niinifwr o f mn~piitation,. .
4.4.3 Impiementation Issue
- * - C
> 1 A
L
g L kr' '31' Y . d i '4- . - d
5- c . d '1:
;. 2 -4
TL' u G LI rG 0. g L
5 Y
bl' . d -1. ri, - L
L ,-
A
c ct t
L L e-. 'fi
+ U h V . d *.
rc N . - 4-. C Li
5 - d b
5 - C - " C U
:t:
G, - b
0 C C I
L . c
2r U . d - - + ir
ir h -A
-Ci' d w
2; c' - b' h 4 - C Ci
d
Cr: a . - , , C b. . - L C b C A
u
L u i(
k'
r: I d
.Id -4 d
w 3 + c. - t: C - L
L 3 L Y d
V Li h 4
u 'Il 9 U
Ij e
rY
l- ia 3
4 2 rr Y
'ji . - tr tr: .&. C
t L
0 c L w - u
5 C M
t i t i
4.5 Summary
Chapter 5
Application: H.263 Based Low Bit Rate Video Coding
.5.1 hlotivation and Background
BitsArames VS. rare 70a.
6ûûr W.263 Miss A m e n a
149 frames 500 -
/ DCT coeii 2 JOO-
side info
/= 5 i<
1 0 0 - mohon vedor
switrhing Iwtwren i1itt.r nrid iritra coding is iiiost Iy ad-hoc.
5.1.1 The H.263 Standard: Overview
' I ' l i v II.263 standard ivas rlr~-(~Iolw(l for \-idc.o codiiig for loir h i t rat<. aiitlioi-isiial cwiiiiiiii-
iiicat ioii SJ-sreriis. II.?(i:l is I>iisml o i i I I . L i l 1 P - 1 I i t*iiiploj-s a.; itiput t liv .;aiiit3
I~iiiiinaric~~/c~iroiriina~ic~~ r-olor Ç ~ ~ I T (-[:'>:O. 1- C'l) ( ' r ) . aiicl oril>. riori-iritvrlacd pici tiros
tir<. (-odrcl. 7'Iir riiarroblork. I>lork r l o l i r i i t ioiis atid D( 'T/ I l ) ( '-f t ~ l u a t ions arc i<l(mt ical t O
t Iioscl of EI.26 1 aritl '\IPEC;- 1.
I i i a(1ditioii to tlir H.261 ( ' I F ;iri(l ()('II.' iriiag. forriiats ( s ( ~ -1iil)lc ;.fi). £1.263 slip-
port sor ic srnaller source iiiiagv foriiiat (siil)-QC'IF) aiid t ivo liir2cr foriiiat i ( - IC ' I F i i t i < l
I(i( ' IF). .-\iiotlicr cliflrreiiw froiti C 1 . X is quant izatioii. 1 - i i l i k t a [ I .% 1. qiiaiiiizat iori is
riot r rs t r ic td to cliangr oiil~. for i.\x.rj- I i riiacrol>locks. [ t caii I N . cliaiigd a t t lit. pict tir{..
1 group of hlocks (CO B ). arid iiiacrohlock la>-ers. l lorroi-cr. I I.263 allon-s ;-pcl acctirac!.
5.1.2 The H.263 Bit Stream Structure
Figtlrc . 5 . L $ siio~vs an !1 .Z63 1-itleo scqiimcr la!-rr rt r i i î t iirv. Tlie H .263 b i t ar rtbarti s!.nt a s
is arraiigt*cl iri a tiierarchical st riict iirr iv i t li foiir laytw. Dat R for cach pirt tire coiisisi 5
, . ! header
I 'OB [ M8 1 MB 1 MB -mm..- 1 MB , Group of blocks
p'c'u'e header
rta-i>.iicliroriizat ion alid th<- iriSoriiiitt ioii n h i i r t h . pirttirct 5izr. t<~rripoial r<~ft~r(*ri<.t~. ([iiiiii-
t izatioii SI('[). t I IP typr iiiforiiiiit i o i i k)r t I N * foiir optional (-o(lirig riirxii~. V I i..
I ) a t a for tlacli Groiip of Bloclis ((;OLi) i i i a (;OR 1ayt.r rorl5ists of ii (;O13 lii*nflr'r
follo~vocl 1))- ilata for niacrol>lo(~lis. l-:arli (;OB coritaiiis o i i ~ o r riiorib roi^.; of rtia~rol)li><*lis.
k'or t lit* firsi GOB. rio COB Iic~atlw is I ratisniittd. Tlic GOH fitbacltv- coiisists of t l i c * i t i i r t
c-odi. for rcl-syricliroriizat ioii. I Ili. (;O 13 iiiiiiiI>(~r. quant izat iori i t q ~ . rti-.
Ilata iri t Iic iiiacrol>lock ( 1 1 13 ) I;i>-tbr iurisist s of a riiacrol)loc-li Iittiid(3r folloi~ccl II> . (la1 a
for tlic sis d x S I~locks. .\ri I I I 3 i.: c.oiiiprisrd of fair Iiiriiiriancr ! 1-) l>ii>rlis arid oiio of (YI~.II
of t Iiv t \w cliroiiiinance bloclis ( ( 'r. ( ' 1 ) ) . \\.licri t tic PB-frariic iiioclc is st~lcctrd. t lit- . \I 13
i r i ;i [>-pirtiirr and the I I B i r i a B-pirtiirr- arc3 codecl as o i i ~ uni t . i r i this case an ' \ I f3 la>.t-r
i-oiitai iis 12 hlocks. Tlie Iicadcr roritairis t lie niacroblocli t!.pr t licl co(lt~l I)lock pat tcrii.
t l i i x niot ioii f x ~ t ors. etc. .-\ dct ailmi disriissioii ahout t lic 1 1 B 1-i~r \vil1 I > P $\+(.ri i ri t lit.
I I'
/' ./-
GO6 .... e... GO8 GO6 Picturc
I Picture
P Picture
3.2 Proposed Coder
('hapter 5. ;\pplir-arion: H.76:I Hast~rl Lori. Bir Rate \ - id ru C'uding
5.2.1 1-picture MB Coding Strategy
.\I; .spt*cihrrI i r i t lie F[.')6:1 .;t sri( lari i. irit ra (xjrling of [-pii.t I i r rr (-i>ri.;i';is <jf S < \ D( 'T t-<j(-.C
fit-imt 5 ( ~ a l c i ~ l a t i o r ~ . :iniforni f l i i i i r i t izat ion. arid t htw si i r i - l t a \ - t > l ~ I A ( I 1-arial)lt~-lt~rigt.li ( . ( j( l in?
i or a r i t hrrietic (-o<ling !. I.t*ft to t lit. (1rsioni.r. Ii<j~\.t~\-t~r. ic t l i t1 prohlr-ni of (itl~t-rriiiiiirig t l i r
vallit) o f tht. qiiantization of t [ i f . I l ( 'T (-«~tfi(*ient.s. T l i t k oriiy ~ L V O s t - t~~i i r tmeri ts : u t a t t
( 1 j t l i t 8 ~-ai~ita of QI -.-\KT t-arl t-lia:iqtvl ari(1 t r a w r t ~ i t t t ~ l o r i l > . k i t t lit: pi(-[ lire :tri( 1 o r t 1 1 t b
qn>ii~~-<~f-l>loc!.;s ( (;OR lii~-t.rs i i i i t l I 2 i t tir f<jiir poi.iil)lt. \-:i-I~it>+ o f D Q I - . \ K T ! 2 I>its 1 ; I I . ( .
I L P C ~ T O atljiiit t t i ~ valiit* of ()( ' . \YI at rlit! .\IB 1a~x.i.. \\;. h j l l o i ~ t l i e H.Zfi:l a p p i ~ o a 1 ~ 1 ~
\slirrv (11-.\Y[ of tlie tirsr rtiacrc,l)lw-k of rlir tirsr I-pi(rr.iir(1 i.: i n i r i a i i~ - w t to t I i (8 r i i i t i ~ i l t .
i a 1 1 1 c b ( i . ~ . . Q[-:\ST= l t j 1. a r l f i QI - - \ K T d'tlacli ot.livr ~i~ti(-rol)ltj(-Ii is stlt {ii~riri? t i l t * t>ri(-o(l-
i rig p r o c t ~ tu t Iw \-alt ic of (2 1 -.\SI- c j i ' r lit* prvt-ioiis ii~acrol>lo(-li. . I - l ie~r i . si~i-*ii a Liqra~iqia i i
paraii ietw X t tiat coiitrol': t lit' K D t ra(dt-otl. t lit. i a l i i t - of 4) i - ; \XI ' cari I ) t 1 ailjiisttvl I)!.
oiit1 of t h r I possible valurs of DQI-.\KT r tiat n1iriir1iizr.a .J:i X j = D + A ( R, - R.. 1. 1 1 - l i t w
R.: and D art. t h e riiirribt:r of hirs a n d t h e ciistortiori ( 1 ISE or 11:iD assoc-iate(l \vi t h t tic*
correupoiitlirig DC'T coder. rtsipcct ive l~ . . and the R, is i d e i riforriiat ion as s1ioci.t~ in l;li)lt-:
- - .7. t . S r x t . LW compare t lie s r i i a l l e~ t -1: ( A I wit.h . I f ( X ) = D + X i K, -+ R.:). t lii: Lagraiigiaii
Direct Method
1 1 1 . llorm\-er. as can I>e sceri frurii tqiiat ion ( 5.-l?). c\-eii r he evaliiatiori of D r i i i is t l w
Two Stage Method
RD Optimized Motion Estiiiiatioii
Mot ion Vector Accuracy
Nhti011 Prediction
Diamoiid Shaped Searcli Method
bIB Mode Selection Criterion
. \ f t r r riiot ion wt iiiiat iori i i i t hi. t il-O-st an(. rii<.t i i o ~ l . t l i ~ w c o d ( ~ lias to r i o t < m i i i r i v r l i t b i i i o ( I t s
of t Iit) JI B. aloiig \vi t l i t I I ( . i-alii(1 of t hc q~rarlt izat ion of t ho I l ( '-1- cocffiri(~rii S. -1:: (lisi-ii-s(-cl
iri ( '1iapti.r -1. t lie ..l)c-at" .\ 1 I3 riiu<l(% s c l ( ~ - t i o r i is t Iiv oric t Iiat ~ - i i~ lds t lir I)(lst R D t r;i(lwtF.
Ilor-c spm.-ificall~.. w\.r sliortld .;(YI; t Iic niocIo 1 i l t lie qualit J- factor ( Ql '.-\ST ) 0.
zii-<w t lit mot iori i - ( ~ t o i - ( s ) ohtainrd i i i t lic iiiot ion e s t iriiat iori s t agc t liat riiiiiiriiizit t l i ~ b
Lagrar~giaii
.j.,(.ir. y ) = D + x IR,,, + n, + R,] . (.~-i:l
.3.2.3 Rate Control
5.3 Experimental Results
'I'he fol lo iv ing espeririir~ii al rt.st i l t i: i l i i iat ra te t lie coniputat iorial coniplcsi t!- ari(l [wrfor-
rilarice of the proposeci H.'l(;:l-l)ascd \ . i r l w c-oclirig algorithni at i-rry loiv h i t riitt.5. :\-; in
PSNR us Rate
J' jJ5- '{. CE. Cr
d ' d
3a- :; I s USE - f
33 5-- f 1 LRAD 1 t
33 - & - H263
Btl~frames YS. rare 7Gû r
6c@ Our ccder Miss Arnertca
Figiirc 5.21 also slioivs t liat. wlicn tiic 11.-\D is s t i b s t i t u t d for the SISE. t lit. PSSR
gaiii ( i n d B ) is rcclucerl II>- IO'%-'15<%. Sinre i Iir PSSR is iii\.erscly proportiorial t o t l i e
- Our ccaer (MB strategy aniy: -
3 Our coaer tMB nraieqy + new
mcoon vector ssnrnaocn ccang!
32 5 40CO 6000 ;-O00 3000 Tûûrï)
Raie laps)
PSNR vi Raie
2 C s H 263
F d
?3 5 - - WB nraieçy . new rnoticn estirn~~~arvczoicg
1
C MB waieqy . i e w rnciicn estirnaacn~coainq
Z 23 - < - M-Pain. :M = f i
( a ) ni-r' R A T E ( BITS )
Bits vs. Frames 900
I
I O O C I
O O 50 100 150
Frarne Index
PSNR vs. Frames JO. I
30 O 50 100 150
Frame Index
Figiirc 5.2.5: 'Thr rat(.-distoi-tioii prolile for oiir cotlcr: ( a ) Bit rate aiif1 ( I I ) PSSR for 150 I.raiiics of t hc test s~qiici ic(~ \ I I S -411 ERICA. The distort ion and b i t rat c is miit rollvd t lirough coristarit pai.arii<~t vr X.
i a ) BiT H.-!TE i BITS 1
110' Sutier Lenqth vs. frame
Miss Amenca
8 kbps
Full Buffer lenqth 20 kbils
Frarne lndex
a 35- z m a Miss Amenca
3-
10 9 50 1 O0 l5O
Frame lndex
Figiire 3-26: The ra t r -{ l i~tor t ioii profile fur uiir ïo(ler: ( a ) Bit ratt-3 an(l ( I I PSS R foi. 1-50 frariies of the test w~~ i i~~ r i c t : \ [ ISS E R - . The btifft'r itatr is iisrd to <:oriti.ol t l t e l i t .
x H 262
r Our :rCer
t llr prrfor tnar~( .~ i i ~ i p r o t w ~ i m t is large o v ~ r a tri&> rarigr of hi t ratrs. This is s~ll)jcr.t for
fiirt hcr rcw~arcti.
Chapter 6
Application: MPEG-2 Video Coder
6.1 MPEG-2 Overview
- -- - - - - --- -- , I &2:0 4:2:0 3:2:2
H l t H 1 1 1920 x 1152 1920 x 1152 , 80Mbls 1 OO Mbis
l a I.P.6 -- --- - I.P.6
1
! 4:2:0 4:2:0 4:2:0 4:2:2
HlGH 1440 , 1430 x 1152 1440xf!52 1440x1152
60 Mb/s 60 Mb:s 80 hl bls 1.P.B 1.P.B !,PB . - - - .- --- - -- + -- -- -- - - - - -- - - - - - - - -- - - .- - .
4:2:0 4:2'0 4:2:0 4:2:0 4:2:2
MAIN 720 x 576 720 x 576 720 x 576 720 x 576 15Mbls , 1 5 M b/s 15 Mb/s 20 Mbls
I 1.P 1 1,P.B 1.P.B I.P.6 - - *-- ---- ---- - - ----- - -.
4:2:0 4:2:0 1 l
LOW , 352 x 200 352 x 200 4 Mb/s 4 Mbis
I 1P .Q 1.P.B
Level , / /'
' SIMPLE MAIN SNR SPATIAL HlGH ,/ Profile '
6.1.1 Profile and Level
6.1.2 Fields, Franles and Picture
, ' < ' e 1
Top Field < ' 8
1 , *
6.1.3 Motion Prediction
th-pe for eadi rtia(.rol~lock. [ r i mt ia t tolli~w. ire only <lis<-iiis Iranit. pr<~<li(-tiori ari(1 tidd
Frame motion vector
16x16 I I 1
1 l - F rame motion vector
Field motion vector
16x8 Top
16x8 Bonom
......+ Top field motion vectGr - Bottom field moticn vector
Frame DCT of the luminance macroblock
Field DCT of the luminance macroblock
6.1.4 Franie DCT and FieId DCT
6.125 Bit Stream Syntax and Macroblock Layer
6.2 Computation-Distortion Optiniized %lot ion Estimation
Bit Rate Ratio vs. Brt Rate 1 I
0.9c Garden Ssquence. 60 irarnes
0.8 b IP. Windcw size 3 1
9 DCT
Motion Vector
+ Macro Block Header
0.3 t o Video Sequence Header
Bit Raie iMbtWsecl
Previous Frame Present Frame
6.2.1 Motion Vector Prediction
6.1.3 Searc11 Path and Searc11 Termination
6.1.3 Hierarciiical Structure
2. J:
1. J ;
0, J , ,
6.2.4 Implementation Issue
16: 16 Frame Prediction and 16 x 8 Field Prediction
Full Block Matcliing and Part.ia1 Block Matching
6.3.1 RD Optirnized Mode Selection
Tli(wrrti<-ail!-. i t i ori1i.i to obtairi t h optii~iiil tiiocl(. aiici aswciat(d t~iiaririzntioii s t t 8 p
t liai iiiiriiiiiizcs t l i v . / ( A ) iri Ecitiat ion (-1.40). t lit- (mcwlilr lias r i ) t~sliaiist i\-i.l!- ç(l;irr.li a l \
r liv a\.ailiil,li* [-oriil)inatiori:: o f iiioclc .\ I ;ir:<l c ~ i i a i i t inat ioii .~ r c.p Q. Fur 1 1 PEG-2 riiiiiri
profiltb,/rii;iiri Ir\-el. t tic t.sliaiist i\-c searclii tig i itiplics t lint al1 ci-l -1 1. (2) c-oriihiria t iorii i ri
( a ) Br's
Rate vs PSNR
Bus. 60 frames
Win Size 31
IP. GOP 12
/ - full-search RD cptirnized I i TM5
32 1 /
31 C /
1 30
O 2 4 6 a 1 O 12 14 Rate (bps) x loi
Rate vs. PSNR
Football. 24 lrames
Win Size 47
IP. GOP 12
32' 1 1
O 2 4 6 a 1 O 12 14 Rate (bps) x loi
g r 6 . 6 : PSS R ( i i i d B ) of t lie T\13 nritl t lir full-warcli Il 1) opt irtiiz~tl algorit l i t i i for t lic n u and I-'C)O'I'il--\ L I. s < ~ ~ r i c i i c ~ ~ s .
Rate vs. PSNR 37 1
i
/ ' Win Size 15 /
1P. GOP 12
l / / -
/
/ - full-search RD oplimized
29 t TM5 -
- O 2 4 6 8 1'3 12 1 J
Rate (bps) x loL
Dependency Betweeii Codiiig M o d e and Quantization Step
Distribution Function of Q and Mode
40 1 Mode lndex
O lndex
Coding Mode
I l i t liie scctiori. tlit- corridatiori ariiong t l i r rieig1il)oririg iiiac-rol,luc-lis' iiio&% îrill I)o aria-
I > - z d . n-li(w t tic r r i t rop!. is iis~cl as the corrriat ioii riiiDasiirr. -1'lic piirpow of t liis a t ud>-
is t o ItBl (wnirii: \vIict ~ C T or riot t lit ~wiphl~oririg r~ia~rol>lc)~ks ' (*odiriq r l l O t l t b 1'-l)fbs of(^
iliiorriiar ioii a h i t t hc riio(l(. of t tie preswt riiacrohlock. T ~ v o qiiarit i t it.5 \\--il1 1 ) ~ ~t i id id
i i i t liis w c t iori: ( 1 ) t l ir- riitiwp>. il( .\l) of the iiioriv .II of t titi priwrit i~ia(-rol>lor-k. aiitl
6.3.2 Encoding of 1-Pictures
x 1 0 ~ Histogram of the quantization prediction error
-.
Bus. 60 ftarnes -
Quantitalion prediction error
SI 13 is tcrriiiiiated. Or ii(.rwisc. t lie valiic Q- rcprcwrit itig t lir r i i i r i i r r i i i r ~ i Lagraiiginii i?:
FSM Q h MSE I- STOP
4
FRAME DCT & a
t W +b- Rate b CONTROL
CONTROL L
MSE STOP FIELD DCT
6.3.4 The Finite State Machine (FSM)
l ' \ i r coiiipiitatiori-~1crf01~1i1a1icc tradeoffs tliat cari I)c ohtniriecl h h - t l i t . aljoi-t* algoritlirii
(I(~[)ctid oii t lie cliaractrrist ics of t lie inpu t iiitcrlacul i-itlco s t 8 q t i t ~ i i c - c i i i i < l or1 t hi. cttit.-iivicl-
Motion Only
- i - O 1
USE & yI
3.1. + - % B 1
STOP Us€ r
nm8
I - CONTROL Motion+DCT
\\ FFIAUE OCT .) USE i ,* v1 STOP
lntra - + ' % F
o w ) ~ i t i a l l ~ - thtl ~ : m i o 215 t l i t 1 c~ lqo r i t l i r~ i I I S - > ( ~ i n Siv-tioii t;-2-3. rI1t1 p r o p o ~ ( v l niot ior l h (~ i r (91
;ilzi,rit tirri i.; vvry ~ t f tw ii tB h c ~ ï i i i . ; ~ c-a~i(liciatt* r t io t iori ixxc.t or. aiva!. f'rorii t l i t . prc.(licrivI
n i o t i ~ r i c-ec-tor a r e tIiiickl!. ~ I i r i i i n a t ( d li.orii ruriclictt~ratiori. rlii.; I)c.liai-ior i3 c q w c - r c d 4 r i c . o
l i l i r > l ~ - niotiori veç to r s art. i i .~ i in l l~ . localize<l ivit liiri a *iiiiill i i t~igl i lx>ri i tm\ o f t l i t x pnvli(.itvl
111ot ion \ - ~ t o r and t l i t . niirril,rr of <-onipiitat ions incr iwair ~ t i h s t a i i t iitily a.; iiior.i3 la>-ers ;ina
ttsarrii rieri.
6.3.5 Tlîreshold .IR and Rate Control
Tlireshold . II ,
Rate Control
T t s c i inipoirarit practiral issiir is lirirliriq itppropriari. \alii(>s for t ho L;iqraiizi;iri
paranitatrr A. t i ic I<(l>- pnranirters t liai. ïoiit rol riiainl!. t l i ~ R D tra(ltwffs. 111 this ~ ~ o r l ; . t l i t s
pi~rariii.ttlr ,\ is iriitiaIl>- i r t i m a t e f l b a s d o r 1 (uriipiirtarl long-trrni ~~~~~~~~~~5. i i i i ( I i.: tli(1ii
ivli(brt- t lit. ~ ~ a s a i i i t ~ t ~ r a is t lit dcc-ay factor i i w r l t o i-oiii rol t i t i . \-itriat iuii of t Iit* parar:iiDttxr
X ( r ). T l i ( 3 p i i r pow of i i i t rorliicirig ttic pasaiiitBt(br O i i ~ Ecliiat ioii ( ti.52 i ir tu r(xiliirib t l i t .
i-ariat ion o f t liv A. I ) t ~ - a ~ i s c s i ~ n ~ i l a t ion rcs~i l t s S ~ I O U - 1 liat l w t i t x ~ R [) p(~-~or ! i i a i i c (~ (+ail h t v
a(-liic.\.cd \vI i (~ i X is (wri i tar i t ivitliiii a fraiiio. I*i)clntirig X t>;icrvl o i i r f i t . iil,t,\.tx i-tbciir~ioii fur-
i i i~ i la i h foiiii(1 t o ho a 1 1 (%fficimit sol111 ioii. 111 f i i ( * ~ . s d a t ive> t u t l ~ t b iiiortb ( . o i i i p l t - x iilqorit h r i ~ s
~ l iwr i l )cvl iii [dl. t l i r i .~~s i i l t i i ig I tD coritrol iilgoi.itliiii i.- \-tXr>- siriil>l(-. ?.tat i t . [>tdorriiaii(-tb
is goo<l.
6.4 Sinlulation Results
The Test Video Format
6.4.1 CD Optimized Motion Es t imat ion
i r e 3 : C'C'IR 60 1 \,itleo stBqriences.
Table 6.1 1: Rrqiiircrl riiirlilwr o f conipiit atioii in riiot ion est iniat iori per riiacrol~locli t liai i l se full searcti algorit lirii aticl partial hlock niatching iiict tio(1.
2D-logaritlimic Searcli vs. CD Optimized Diamond-Shaped Layer Search
trwt hoci. the samc 2-lei-cl tiicrarchical st riict tire of t tic SIPEG-2 TSI:', coclttr. sri(
riiot iori searîli nict hocl in Ilal f- pel rcsoliit ion fraiiie. Siriiiilat ion resitlt s arc slioiv
6.12.
a 6 - 1 2 P(xrforiiiaiit-<a coniparison hvtivceri t tic ZD-logarit hniic riiotioii searcl! aricl oiir C D optiriiizetl cliariiorid-stiaped laycr srarcti.
Froni Tahle Li. 12. \vr caii sec t tiat o u r algorit lirii is more efficient tliari r h r 2D-
a lot of t e ~ t i i r c (for rxariiple. t lie Roiver I~ccl ). arid t lie 2D-logarit liriiic ~t~iii .~.li algorir lirii
i i i a srrial1t.r diffrri-ncc twrwcrii the 2D-loyaritliiiiic scxircli algoritlirii aiiil oiir algorit lirii.
4-level Hierarcliical Search vs. 3-level Hierarcliicai CD Optimized Diamoiid-
Sliaped Layer Search
I l i tliis part. \vc \\.il1 coiiiparc tlie -1-level liicrarcliical srarcli algoritlirii iritti oiir 3-le\-cl Iii-
crarcliical CD optii~iizrd cliari~oiicl-stiaped laycr warcti algorit hiii. T l i r l - I - l c \~ l Iiicriirclii(.al
srarch will geiicratc t ir0 otlier loivcr resoliitiori franics for riiotio~i searcli. aricl pcrforiiis
PSNP. vs. Camputation 38
Search Window: -47 to 47
Rate: 8 Mbitssec
/'
,d'
iiiuch riiorc efficient. Bericles. oi i r algori t ilni reqiii res l e s rriernorJ- arirl i i iril,stari t iall~. Itw
coriiples. T tiis is he(,iiiiw oril>+ oriv low rcaol i i t ion i riiagt> i i reqiii r d . Fi y i i r t a t i . 1-1 5 hoiw
6.4.2 R D Optirnized MPEG-2 Video Coder
t e 6. .-\pplicat ion: .\ [PEC-2 \ 7 r h C'der
Bus. IIP. W-31
I
7. . MPEG-2 TM5 coder
-. Full-search RD Optirnired
- Efficient RD Optimized
30 29 1 O 2 J ô 8 :O 12
Rate (bps) 105
. MPEG-2 TM5 coder
- Full-search RD Optimized
- Efficient RD Optimized
1
2 4 ô 8 1 O 12 Rate (bps) x loC
( a ) Biiffer fiillncss
x 105 Buffer vs. Frarne 12 1
f Optm Buffer 655360 bits 10k
Bus 60 !rames
Buffer Size 80'163854 nits
36.12 dB. 7 96 Mbps 2;
Decay Factor 0.25
O' O 10 20 30 40 50 00
F rame
Lambda vs. Frarne I J O r
Deay Faciar 0.25 - ao- 2 ,
Frame
( ' l iap ter 6. .-lpplic-at ion: .\.IPEC;-i! \ ïdro ("odrlr
PSNR vs. Frame 40:
US 60 frarnes
Suifer Size 80'163853 bits
36.12 38. T 36 MbpS
33 ' f3 10 20 30 40 50 60
Frame
i li i Bit rat tl
- r 10' Bits vs. Frame i
Bus 60 frarnes
Buffer Srze 80'1 63854 bits 1
36.12 dB. 7.96 Mbps
Decay Factor 0.25 G O 1 O 20 30 40 50 60
Ftame
F i 6 - 1 7 P S S R aritl bit rate as a fiinction of tirilil.
\\*cl p r c w ~ i t ( V I i i i i 11 1' E( ;-2 wrtipliarit i~i t t>sla(- tvl l-it-irw ~ ~ r i c ~ ~ ~ l t ~ s t I i a r c a r r i [)Io!.> tir1 t ) t t i ( . i t > r i t
riiricrol)ludi iiiotl<. - t * l t ~ - t i o r i t i i d i d . a >i!iipltl iiiotiori \xrctoi. p i . t * r l i < - t i t ~ r i r t ~ ( . l i i ~ i ~ ~ i i t ~ . : t r i ( / a
coriipiitat ioil-t 1i.t ort iuii opt iitiizrvl riiot ion i - ( ~ t o r warc-li algori t lirii. l ' l i t . rtiiif-rol)lo(*k iiiot l t b
is w l ~ r - t tv I I)il~(l(I or1 a t-atc-distortiuri o p t iriiizwl <-ri twiori. kIonvt>\-t~-. 1)rtv [ i ( - t ii-tb :III f i - 1 a t is-
t ical tiio<lt~lirig t ( v . l i i i i c l i i c s arc i r i t l -wlr ic - rv l t liat Itm! to siil>-tarit inl1~- 1 ~ t . t 1t.r (-oriipiit at i o i i -
perforriiaiicc t racltwtfs. Tlic propowl -\IE'E(;-2 ~.-i&w cric.oclt3r is sliuivr! i~;~)t~riiiit~ritall?- t o
otit [>erfoi.rii t f l t b 11 FE(;-'> 7'.\1.' encocler. tlspi-esrd iri a 1.5 - W,; wlt ic i iori iri h i r rattB
u r a 1 .i, - 2..i (IR iricrcase iri ol>jrrtii+e qiia1it~-. Bt.sitlrs its coiiiprtwiori ad\-arit ngt). uiir
cnrodcr nqui rvs I r w coriipii t at ions t liari r q i i iretl b?- t lie TSI.5.
Cliap te r 7
Conclusion and Future Study
7.1 Contributions of t h e Thesis
1. A riew cost funct io~i ./ for niotiori estiniation
T I i t B first coiit ri1)irt ioii of t lic t hc.sis i.; t lit: i r i t rotliiçt ion of ;i ric%iv <wc;t f i i r ic- t iori. t f i t .
Lagraiigiaii . J . for riiotioii cstiiiiat ion. Tlic irit rodiiced coït f i i r i c t i o i i .l is a \v<*iglitt l(l
siliii o f ihr rlistortioii D. iiiotioii t w t o r bit ratc R. and coliipiitat ioiial cost ('. tliat i?;.
.I = D + X R + . j ( ' . Th<* tira pnrariicters. X aiid .l. con t rd t l i ~ iiifl~it-iicc of t h riiotiori
v w t o r h i t rate H aild roiiil)iitationa[ cost C' diiririg t fie iiiot ioii t3st iriia t ion proces. OriiB
2. Predictive motion estimation algorithms
Th.\ . t v - ~ r i ~ i ( - o t ~ t r i l)~itiorl of t lit1 t litxsis is ~ I I P irit rwli lct ion t ) f l~rtvii(-rii.tb ~ I I O T i o n t ~ t iriia-
r i o r i a/co~+ir 11111s i~ l l i ( - i l t -üi~sis t o f itiot i o n [ - tva tor prt*t!i(-tiori. + t b a r ( - l i l x i t \ i . ;iu(l t t > r ~ i i i ~ l a t i o ~ i
t r i I i i t i i i i tlityis. foiir n.i.11 kiivn.ri pr tvl i i -~iori t i v . l i~ i i (~ i i t~ \ 1 : t i < > a r i i>rtvli,.tor. i 1 i t s -
(li;ttl i~r t i ( l i ( - t~) r* . i~t)i<Iit tv i r l i t ~ ~ r i p ~ - t v l i ( - t o s . s t a t is t i ( .a / itit>aii ~ ) r t v i i ~ - t o r \ 11stvi for ~ ~ i o t i o l i
i - w i o r ~>i.ib(li(-t iori art' i t . i i ( l i w l R I I ( I < - < > ~ ~ l j > i t ~ t ~ i l . rh t ) -irtilil<ît.io~i r t 4 r \ siioii t!i;it t i i t a 111tl-
iliati r l i t t o r i i e t v;it 11 rt>qar[li to prr(li(.r iori a(-r-iir;i(->. a n ( i (-ut11 i ? l t>x i r~- . \ii%
t ~ s t t d r iirttt) r ~ - [ ~ s of warc i i pnt li s t ratvgit~s i i p i r a l warï l i par l i . ( l i a i t i ~ ) i i ( i - + i i i t ~ ) ~ ~ ( 1 .+l;ir(-li
pat 11. a i i f l fI~)iit irig crritvr warrti pat li 1 aritl f o c i r i < l t l ia t tht- tioariiig i.t.ritt¶r wnrr:ii art(! t ! i t x
cliariioiirl--lia[)<. arc h t h qiiite t~f-ficierit. \.\i! alsu proposecl nritl ~ s r i i d i t 4 t i w t.c.rr~iiriarioii
algori t linis fur. riiut ion searcti. T tie proposetl terriii i iat i«ri s t rategic-: irir l i t I I ( . p r o p o s t ~ l
cust f i t i r i s r i c a r c h pat lis cai i cl?-riariiicall~. s l i r i~ i l i o r esparicl t lit. searr l i retaiori.
Siriiulat iori r~siilt . : 5hoiv t hat t lit. Stoclel i i 2-la>-er Ci>-por hcsi.; alyurit lirti pvrforrii hc.ttrr
3. The fast rate-distortion (RD) optirnized mode selection algorithms
4. Implementation of an H.263-based video encoder for very low bit rate
video applications
TI~P f o i i i t ii i - o r i t rihiit iori of' t lit. t lirsis i.: t liat of iising oiir prt~posi*i l t ~ i o t i o t i ( - ~ s t i ~ ~ i a t i ~ , ~ i
aiitl riiotlt* .st~lwt i o r i algori t liiiis to i riipltmrrit a n H.Zii:l-lmwl i.i(ltw (w(-o< I ~ Y l'or \-iar)- Ion
I>it ratra applicatioris. TIitx proposeil H.Xl-bascd i - i c l m (-o<I(T i)\-t~r<.oriit~s . w r i i r o f t l i t l
5. Iniplenientation of an MPEG-2 cornpliant video encoder for iiiterlaced
video
4.2 Topics for Future Study
1. More sophist icated rate control mechanisrn
I I I ihis tlicsis. i v ~ iritro(iiicr* a siriiplt~ uiic-pass rate coritrol riit*ch;iiiisrii \rliit-ii (l(.t(~i-iiiiri(~s
1 I i v i-nIiitb o f t I i v pnrarti<ar<*r A iisirig r Il<' I ~ i i f f w ftillritss an(l t I i v I ) i i i.iitta i.(~qiiir-i~rtit~!it. Iloiv-
tD\-tir. t Il(. rato-distort iori ( I< D i-liaractrrist ics of t Iir iriiagc sr roiiql!. & p . r i d o r 1 1 Iit. [)ici iirc
i-orlirig t!.lw ( 1. P. L3) . T l i t ~ n l f o r ( ~ . oiir propost~l ra te writ roi nlqorit Iirii nia>- i*sliil)i t os(-il-
lat i o i i ~)i.ol)lriiis ~ v l i t ~ r i X is iil)<liit(vl oril>- oiic-c p r r frarii<*. O r ~ t b w l i i t io11 t u t I1t3 cjwil/at i o ~ i
1 ) ro I> l<~i i is t o i ~ i i p l o ~ - a (It-rx!- f a c - t or \rliicli rdiic-rs i Iic cliiiiiglriq r~iaqnit i l ( l t l o f t I I ( > iiib\v A .
~o\r(v-os. a Iiirgrr d~.ca\- fiict or \vil\ iiiso rtvliiw t l i t * rat<% (-oiii rolliil)ili t 1.. .\iiot 11i.r soliii iuii
is i o ( ~ r i i \ ) I o ~ - t l i t F t w w t 11l~1;it i i i q 51 riittyit?; for (liffm-<~rit pirt i i n b ( . o i l i r i q t J'INY.
a ion 2. Coniputation allocation algoritlini for motion estiiii t'
3. Fast RD optiniized mode selection algorithni for MPEG-2 B picture
Bibliography
[ 1 F. Iiosseiit i n i . 1.. I .w. II. Sriiitli. arid El. \\*ar(l. I'rtrlict ive R D-wrist raiiirrl iiiotiori r s t iriiiit ioii for \-ei.!- loiv I>it rat<* \-idro roditig. Srpl,rciol li..<<rr oj' l l t t [[(LE T ~ ~ ( ~ r i . - ~ ~ ~ ( ~ ~ ï o r t . s
o r t . S f / ï r t f d ..l I Y (1s i r l { . 'OII) rrt ur)i(wtiorl.*. 1.7: i 752- 176:j. I h - . l!l!Ni.
[-l5j . r i l o i i . .-\il irit i.od~ict ion to arithriietic rodi .\Iar. l!H-l.
[ I(i] Ci. G . Larigtlori arid .J . Hissarieri. ('oriiprrssion of I>la(-li-ivliittt ir~iiigcs iv i t l i arit l i i r i o t ic (-o(Iiris. ~ ' I W ~ l - - ( i r t i o r ~ . - 011 'orrtr~/ (1 I I ~ c * ~ z ~ ~ o I I . ~ . 2!)( fj ):S.% M T . 1:)s 1.
[Xi \\'. Li. 1.. Q. Zliaiig. aiid 11. 1,. Lioii. Special Issii<~ on : \cl~xiict~ iri Iriiagr aiid \-itlco (-'oriiprcssiori. f r o c . . o j t l ~ r IEEL'. 5 3 ( 2 ) : 13.5 -3-10. Fvb. LW5.
[ C'. E. SIiaiiiiori. (.'ocliiig t lieorcriis for a discrrt i. wi i rc r wi t li a fideli ty cri t crioii. 1 ii IRE .\iitio11ri/ ( Or~wi~t iori R c c o ~ . ~ . Part /. pagtBs 1-12 - 163. [!)5!1. :Ilm in [rtfor*utut/or~ «rd Drci.siorl PI-oc< . ~ t - S . R. E. .\iachol. Ecl. St.\v 'i-ork. Si-: \[c-Gra~v-Hill. 1!)60. pl). !)3- 1 26.
IMAGE EVALUATION TEST TARGET (QA-3)
APPLIED - IMAGE. lnc = 1653 Ea.3 Main Street ,=- Rochester. NY 14609 USA -- --= Phone: 71 61482-0300 -- --= Fax: 71 61288-5989
![Research Article Highly Sensitive Loop-Mediated Isothermal …downloads.hindawi.com/archive/2015/147173.pdf · 2019. 7. 31. · Leptospira [ ]. e lipL geneisconservedinserogroups](https://img.pdfslide.us/doc/110x75/5ffa36453a84fe453e1bfd6b/research-article-highly-sensitive-loop-mediated-isothermal-2019-7-31-leptospira.jpg)
