9
Copyright © 2012 Elsevier Inc. All rights reserved. . Chapter 19 Chapter 19 Motion

Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

Embed Size (px)

Citation preview

Page 1: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

Copyright © 2012 Elsevier Inc. All rights reserved..

Chapter 19Chapter 19

Motion

Page 2: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

19.2 Optical Flow

When scenes contain moving objects, analysis is necessarily more complex than for scenes where every is stationary.

Image differencing over successive pairs of frames is a straightforward method.

More careful consideration shows that things are not quite so simple (Fig. 19.1)The edges parallel to the motion direction do not

show up.Regions of constant intensity give no sign of motion.

Copyright © 2012 Elsevier Inc. All rights reserved.. 2

Page 3: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

FIGURE 19.1

Copyright © 2012 Elsevier Inc. All rights reserved.. 3

Page 4: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

Optical Flow: a local operator is applied at all pixels in the image and lead to a motion vector field that varies smoothly over the whole image.

The attraction lies in the use of a local operator, with its limited computational burden.

We start by considering the intensity function I(x,y,t) and expand it in a Taylor series:

Copyright © 2012 Elsevier Inc. All rights reserved.. 4

Page 5: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

Ignoring the second and higher order items, Ix, Iy and It denote respective partial derivatives with respect to x, y, and t.

Next, we set the local condition that the image has shifted by amount (dx, dy) in time dt so that

Hence, we can deduce

Copyright © 2012 Elsevier Inc. All rights reserved.. 5

Page 6: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

FIGURE 19.2

Copyright © 2012 Elsevier Inc. All rights reserved.. 6

Page 7: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

Let the local velocity v in the form:

We find:

The component of v lie on the following line:

Therefore the normal to the direction (Ix, Iy ):

Copyright © 2012 Elsevier Inc. All rights reserved.. 7

Page 8: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

FIGURE 19.3

Copyright © 2012 Elsevier Inc. All rights reserved.. 8

Page 9: Copyright © 2012 Elsevier Inc. All rights reserved.. Chapter 19 Motion

19.3 Interpretation of Optical Flow Fields

Copyright © 2012 Elsevier Inc. All rights reserved.. 9

FIGURE 19.4Interpretation of velocity flow fields. (a) A case where the object features all have zero velocity. (b) A case where an object is moving to the right. (c) A case where the camera is moving into the scene, and the stationary object features appear to be diverging from a focus of expansion (FOE), while a single large object is moving past the camera and away from a separate FOE. In (d), an object is moving directly toward the camera that is stationary: the object’s FOE lies within its outline. In (e), an object is rotating about the line of sight to the camera, and in (f), the object is rotating about an axis perpendicular to the line of sight. In all cases, the length of the arrow indicates the magnitude of the velocity vector