Motion Estimation Using Low-Band-Shift Method for Wavelet-

Based Moving Picture

Hyun-Wook Park, Senior Member, IEEE, and Hyung-Sun Kim

IEEE Transactions on image processing, vol 9, No. 4, April 2000

Outline

• Motion Estimation in Spatial and Frequency Domain

• Proposed Motion Estimation and Compensation in Wavelet Domain– Wavelet Analysis and Synthesis Filter Banks

– Low-Band-Shift Method

– Generation of Wavelet Block

– Motion Estimation and Compensation Using Low-Band-Shift

Motion Estimation in Spatial domain

Frame n-1 Frame n

Motion Estimation in Frequency domainImage Source

T Q Coded Stream

ME T-1

Q-1

-

Image SourceT Q Coded Stream

ME

Q-1

-

Motion Estimation in Frequency domain

Image SourceT Q

ME

Coded Stream

Q-1

-

Transform DomainSpatial Domain

234 10 50 30 20 22 23 56 45 63 80 36 45 56 ...

T -

？

Motion Estimation in Wavelet domain

Image SourceT Q

ME

Coded Stream

Q-1

-

+

Problem: Shift variant propertyOriginal signal

Shift 1-pixel signal

[ 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0]

[ 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0]

[ 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0, 0, 0]

0 0 50 0 -50 0 0-0.5 -0.5

0 13 113 87 -13 0

0.25 0.25

[ 0, 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0, 0]

0 0 -50 0 50 0 0-0.5 -0.5

0 -13 87 113 13 00.25 0.25

[ 0, 13, 113, 87, -13, 0, 0, 0, 50, 0, -50, 0, 0]

[ 0, -13, 87, 113, 13, 0, 0, 0, -50, 0, 50, 0, 0]

Problem: Shift variant propertyOriginal signal

Shift 1-pixel signal

Shift variant propertyOriginal signal

Shift 1-pixel signal

[ 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0]

[ 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0]

[ 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0, 0, 0]

0 0 50 0 -50 0 0-0.5 -0.5

0 13 113 87 -13 0

0.25 0.25

[ 0, 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 0, 0]

0 0 -50 0 50 0 0-0.5 -0.5

0 -13 87 113 13 0

0.25 0.25

[ 0, 13, 113, 87, -13, 0, 0, 0, 50, 0, -50, 0, 0]

[ 0, -13, 87, 113, 13, 0, 0, 0, -50, 0, 50, 0, 0]

Shift variant propertyShift 2-pixel signal

Shift 3-pixel signal

[ 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0,]

[ 0, 0, 0, 0, 0, 0, 0, 100, 100, 100, 100]

[ 0, 0, 0, 0, 0, 0, 0, 100, 100, 100, 100, 0, 0, 0, 100]

0 0 0 50 0 -50 -50-0.5 -0.5

0 0 13 113 87 -26

0.25 0.25

[ 0, 0, 0, 0, 0, 0, 0, 0, 0,100, 100, 100, 100, 100,100]

0 0 0 0 50 0 0-0.5 -0.5

0 0 0 13 113 100

0.25 0.25

[ 0, 0, 13, 113, 87, -26, 0, 0, 0, 50, 0, -50, -50]

[ 0, 0, 0, 13, 113, 100, 0, 0, 0, 0, -50, 0, 0]

Level 3

Level 2

Level 1

Block diagram of the proposed motion estimation and compensation scheme

1 2

3

4 5 6

7

8 9

10(15/16)

Wavelet Analysis and Synthesis Filter Banks

• D(9 ,7)

Low-Band-Shift Method shifted pixels

Location

2-fold decimated coordinates

Low-Band-Shift Method

Shift 1 pixel

Shift 2 pixel

Shift 3 pixel

Shift 4 pixel

Shift 6 pixel

Shift 5 pixel

Shift 7 pixel

Generation of Wavelet Block

Motion Estimation and Compensation Using Low-Band-Shift

Motion Estimation Motion Compensation3-Level

Simulation

Average 0.7dBbetter

MAD of Football Sequence

Average MAD

Computational Complexity

Giga operations

~ The End ~