40
3A-L1 Cameras and images CS4495/6495 Introduction to Computer Vision

CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

3A-L1 Cameras and images

CS4495/6495 Introduction to Computer Vision

Page 2: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

What is an image?

• Up until now: a function – a 2D pattern of intensity values

• Today: a 2D projection of 3D points

Page 3: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

First Known Photograph – Heliograph

Reproduction, 1952 View from the Window at le Gras,

Joseph Nicéphore Niépce 1826

Page 4: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Projection

Page 5: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Projection

Page 6: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Image formation – (bad) method

Page 7: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Pinhole camera

Page 8: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Camera Obscura (Latin: Darkened Room)

Page 9: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Home-made pinhole camera

http://www.debevec.org/Pinhole/

Why so

blurry?

Page 10: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Shrinking the aperture

Page 11: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Shrinking the aperture

Page 12: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

A little bit of computational photography

Page 13: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Adding a lens – and concept of focus

“circle of

confusion”

Page 14: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

focal point

F

Lenses

Page 15: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Thin lenses

Slide by Steve Seitz

Page 16: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

Computer Vision - A Modern Approach

Slides by D.A. Forsyth

|| ' ||z || ||z

Page 17: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

|| ' ||

|| ||

y z

y z

|| ' ||z || ||z

Page 18: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens

|| ' ||y z f

y f

|| ' || || ' ||

|| ||

z z f

z f

|| ' ||z || ||z

|| ' ||

|| ||

y z

y z

Page 19: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens equation

1 1 1

|| || || ||z f z

1 1 1

|| || || ||z z f

|| ' ||z || ||z

|| ' || || ' ||

|| ||

z z f

z f

Page 20: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

The thin lens equation

1 1 1

|| || || ||z z f

Any object point satisfying this equation is in focus.

|| ' ||z || ||z

Page 21: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Thin lenses

http://www.phy.ntnu.edu.tw/java/Lens/lens_e.html

(by Fu-Kwun Hwang )

Page 22: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Varying Focus

Ren Ng

Page 23: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Depth of field

f / 32 = small aperture

f / 5.6 = large aperture

Flower images from Wikipedia http://en.wikipedia.org/wiki/Depth_of_field

Page 24: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Nice Depth of Field effect

Page 25: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View (Zoom)

Page 26: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View (Zoom)

Page 27: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

FOV depends on Focal Length

Larger Focal Length => Smaller FOV

1/ 2

2 tand

f

d is the “retina” or

sensor size f

Page 28: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Zooming and Moving are not the same…

Page 29: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Field of View / Focal Length

Large FOV, small f

Camera close to car

Small FOV, large f

Camera far from the car

Page 30: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Perspective and Portraits

Page 31: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Perspective and Portraits

Page 32: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

From Zisserman & Hartley

Effect of focal length on perspective effect

Page 33: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Dolly Zoom

Pioneered by Hitchcock in Vertigo (1958)

Original(YouTube link) (2:07) Widely used (YouTube link)

Jim Rehg

Page 34: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

But reality can be a problem…

Page 35: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Geometric Distortion

No distortion Pin cushion Barrel

Page 36: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Correcting radial distortion

from Helmut Dersch

Page 37: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Chromatic Aberration

Rays of different wavelength focus in different planes

Page 38: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Chromatic Aberration

Page 39: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Vignetting

Page 40: CS4495/6495 Introduction to Computer Vision€¦ · First Known Photograph – Heliograph View from the Window at le Gras, Reproduction, 1952 Joseph Nicéphore Niépce 1826

Lens systems Nikon 24-70mm zoom