18
1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

Embed Size (px)

Citation preview

Page 1: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

1

Computational Vision

CSCI 363, Fall 2012Lecture 33

Color

Page 2: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

2

Three types of cone photoreceptors

The retina has three types of cone photoreceptors. Each has a different pigment molecule that absorbs best at a given wavelength.

S (Short wavelength), "Blue"=>440 nm

M (Middle), "Green" => 530 nm

L (Long), "Red" => 560 nm

A single wavelength stimulus will stimulate each type of cone by some amount.A mixed color match is a set of stimuli that stimulate the cones by the same amounts as the single wavelength.

Page 3: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

3

1 cone cannot detect color

1 cone type: Cannot tell change in brightness from change in Hue.

2 cone types: Can distinguish some colors.

3 cone types: Can distinguish more colors.

Page 4: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

4

Color perception requires comparison of responses

A given wavelength of light will cause a set of responses in the three receptor types.

If the intensity changes, the ratio of responses between the photoreceptors will stay the same (but all will increase or decrease).

If the wavelength (or spectrum) changes, the ratio of responses between the photoreceptors will change.

Page 5: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

5

Color Opponency

Observation: Color appears to be organized in terms of 3 sets of complementary colors. (This was first established by Hering)

Red/Green Blue/Yellow White/Black

Evidence: 1) We don't see a Reddish-Green when mix Red and Green light. Instead, we see less red and green and more yellow.

2) Color adaptation: If you stare at a Green surface for a while, then look at a white background, it will appear red.

Page 6: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

6

Color Adaptation

Stare at the white dot

Page 7: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

7

Color Adaptation

Stare at the black dot

Page 8: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

8

Color Opponent Cells

Retinal Ganglion Cells and LGN cells have center-surround receptive fields that show color opponency.

Concentric single-opponent

(G+R)-

(G+R)+

(G+R)+

(G+R)-

Concentric Broadband

B+

(R+G)-

B-

(R+G)+

Co-extensivesingle-opponent

Page 9: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

9

Types of Single-opponent cells

Concentric single-opponent: Signal Red vs. Green. Also useful for edge detection.

Concentric broad-band: Useful for overall luminance changes (responsive to white light changes). Useful for edge detection.

Co-extensive single-opponent: Signal Blue vs. Yellow.

Blue cones are probably not involved in edge-detection because of chromatic aberration. The image of the blue wavelength light is more distorted on the retina than of red or green wavelength light.

Page 10: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

10

Responses of Single-opponent cells

Page 11: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

11

Color ContrastObservation: The appearance of a color depends on the surrounding colors.

There is only one shade of pink in this picture.

Page 12: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

12

Color ConstancySome surfaces appear the same color, even when the ambient lighting changes.

The wavelength of the blue squares on the left matches the wavelength of the yellow squares on the right!

Page 13: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

13

Color Constancy

This is the same picture as before, but the surrounding squares have been masked out to show the "true" color of the blue and yellow squares.

Page 14: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

14

Double-opponent cellsIn V1, many color sensitive cells are double-opponent (found in the blobs).

G+R-

G-R+

G-R+

G+R-

B+(G+R)-

B- (G+R)+

B-(G+R)+

B+ (G+R)-

Page 15: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

15

Responses of double-opponent cells

Small red or green spot

Red or green annulus

Large red or green spot

Spot inside annulus

Page 16: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

16

Retinex Theory

The perception of a color depends on the colors of all objects in the scene.

Edwin Land came up with Retinex Theory to predict what appearance colors would have for a given scene.

Retinex theory integrates colors across space by measuring the ratios of color changes across color borders.

Because we can only measure the relative luminance of surfaces, the retinex theory uses the brightest region in the scene as an anchor. It sets this region to white, and all other regions are computed relative to the anchor.

Page 17: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

17

Color BlindnessA small proportion of the population is missing one of the types of cones. Another small proportion has an anomalous pigment.

Trichromats: 3 pigments: Normal color visionDichromats: 2 pigments:

Red/Green color blind (1% of males and 0.01% of females)Missing red cones: protanopiaMissing green cones: deuteranopia

Blue/Yellow color blind (0.02% of males, 0.01% of females)

Color anomalies: One of the pigments has a different absorption spectrum.

Page 18: 1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color

18

Colorblindness test

Can you see the numbers?