1
Scotopic hue percepts in natural scenes Sarah L. Elliott 1 & Dingcai Cao 2 1 Institute for Mind and Biology, University of Chicago, Chicago, IL, USA 2 Dept. of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Chicago, IL, USA Background Results Methods The color appearance of an object under scotopic illuminating conditions varies depending on the context. Objects generally appear bluish-green when viewed in isolation, but can appear red or orange when seen with another object in view (Pokorny et al., Visual Neurosci., 23, 2006). The scotopic hue percepts depend on the relative contrast, number, and spacing between an object and the surrounding context (Elliott & Cao, VSS 2011). This study explored whether relational scotopic hue percepts occur in natural scenes, and how hue percepts depend on natural image statistics in luminance and spatial frequency. Summary Original Image Calibrated Image Images. 24 calibrated natural images (McGill Colour Image Database) were presented using the blue phosphor, so the luminance for each pixel was linearly related to 256 gray-levels. Luminance. Calibrated ND filters (~4.1 log units) reduced the mean luminance of each image to ~0.0011 scotopic (~0.0001 photopic) cd/m 2 . The max luminance did not exceed 0.0056 scotopic cd/m 2 for any image (well below cone threshold). Procedure. A hue scaling technique was used to measure the perceived hue and saturation of a 4 deg “test patch” for each 24 deg image. Subjects. Ten observers participated. Each observer completed 10 hue and saturation judgements (on spearate days) per image. Data Analysis: 1. Factor analysis used to extract common factors in 10 natural image statistics. 2. The association between reported hue percepts and the resulting factors were examined by Multinomial Regression Analysis. Data Analysis Desaturated hue percepts (saturation 5-15%) were reported in 29-96% of the trials for each image, clear evidence for relational scotopic hue percepts in natural scenes. For the current sample of images, compared to the green/blue/gray hue category: nred/orange & sometimes purple [yellow] are more [less] likely reported when: 1. the variance, skew and kurtosis describing the luminance distribution are higher; 2. the test patch luminance is a decrement compared to the mean image luminance; 3. the amplitude for frequencies below 2 cpd is low [high] for the test patch [whole image]. nYellows are less likely reported with and increase in the texture properties within the test patch. Factor 1: Texture properties 38% of the variance Multinomial Regression Analysis Reference Category: includes green, blue, gray and F32EY021036 (SE) Variance Skew Kurtosis Total amplitude for frequencies < 2cpd within the test patch Mean contrast of the test patch Mean image luminance Total amplitude for frequencies < 2cpd for the whole image Skew (test patch) Kurtosis (test patch) Slope describing the amplitude spectrum Factor 2: Luminance Relations 32% of the variance Factor 3: Texture properties within the test patch 17% of the variance Rotated Factor Loadings (red arrow for negative loadings) Category 2: includes red & orange Category 3: includes yellow & yellow-green Category 4: includes purple Testing Sequence Passive viewing 5 sec Test “patch” cue 5 sec Hue judgement No time limit Compared to green, blue and gray, there is: Higher probability to perceive Lower probability to perceive p < 0.0001 p < 0.0001 p < 0.0001 p < 0.0001 p < 0.001 p < 0.0001 Example natural image statistics for 3 images Natural image statistics included in factor analysis 0 20 40 60 80 100 0 20 40 60 80 100 0 20 40 60 80 100 Factor 1 Factor 2 Factor 3 Reported perceived hues for each image in order of ascending factor score Number of trials 0 4 8 12 x 10 3 24 16 0 8 x 10 -4 +28% +7% -60% Mean scotopic luminance (cd/m 2 ) for the whole image and test patch Scotopic luminance (cd/m 2 ) 0 11 22 33 44 55 Variance: 0.77 Skew: 0.10 Kurtosis: 1.90 Variance: 0.68 Skew: -0.03 Kurtosis: 1.62 0 11 22 33 44 55 Variance: 1.43 Skew: 1.66 Kurtosis: 17.53 0 11 22 33 44 55 Number of Pixels x 10 -4 Reported perceived hues for the 3 images Test patch amplitude / whole image amplitude for frequencies < 2cpd .032 .025 .012 .019 Supported by R01EY019651 (DC)

VSS 2012 NaturalImage Contrast - vpl.uic.edu

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: VSS 2012 NaturalImage Contrast - vpl.uic.edu

Scotopic hue percepts in natural scenesSarah L. Elliott1 & Dingcai Cao2

1 Institute for Mind and Biology, University of Chicago, Chicago, IL, USA2 Dept. of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Chicago, IL, USA

Bac

kgro

und

Results

Met

hods

The color appearance of an object under scotopic illuminating conditions varies depending on the context. Objects generally appear bluish-green when viewed in isolation, but can appear red or orange when seen with another object in view (Pokorny et al., Visual Neurosci., 23, 2006). The scotopic hue percepts depend on the relative contrast, number, and spacing between an object and the surrounding context (Elliott & Cao, VSS 2011). This study explored whether relational scotopic hue percepts occur in natural scenes, and how hue percepts depend on natural image statistics in luminance and spatial frequency.

Sum

mar

y

Original Image

Calibrated Image

Images. 24 calibrated natural images (McGill Colour Image Database) were presented using the blue phosphor, so the luminance for each pixel was linearly related to 256 gray-levels.

Luminance. Calibrated ND �lters (~4.1 log units) reduced the mean luminance of each image to ~0.0011 scotopic (~0.0001 photopic) cd/m2. The max luminance did not exceed 0.0056 scotopic cd/m2 for any image (well below cone threshold).

Procedure. A hue scaling technique was used to measure the perceived hue and saturation of a 4 deg “test patch” for each 24 deg image.

Subjects. Ten observers participated. Each observer completed 10 hue and saturation judgements (on spearate days) per image.

Data Analysis:1. Factor analysis used to extract common factors in 10 natural image statistics.2. The association between reported hue percepts and the resulting factors were examined by Multinomial Regression Analysis.

Data Analysis

Desaturated hue percepts (saturation 5-15%) were reported in 29-96% of the trials for each image, clear evidence for relational scotopic hue percepts in natural scenes.For the current sample of images, compared to the green/blue/gray hue category:n red/orange & sometimes purple [yellow] are more [less] likely reported when: 1. the variance, skew and kurtosis describing the luminance distribution are higher; 2. the test patch luminance is a decrement compared to the mean image luminance; 3. the amplitude for frequencies below 2 cpd is low [high] for the test patch [whole image].n Yellows are less likely reported with and increase in the texture properties within the test patch.

Factor 1: Texture properties

38% of the variance

Multinomial Regression Analysis

Reference Category:includes green, blue, gray

and F32EY021036 (SE)

Variance

Skew

Kurtosis

Total amplitude for frequencies < 2cpd within

the test patch

Mean contrastof the test patch

Mean image luminance

Total amplitude for frequencies < 2cpd for

the whole image

Skew (test patch)

Kurtosis (test patch)

Slope describing the amplitude spectrum

Factor 2: Luminance Relations32% of the variance

Factor 3: Texture properties

within the test patch17% of the variance

RotatedFactor Loadings

(red arrow for negative loadings)

Category 2:includes red & orange

Category 3:includes yellow & yellow-green

Category 4:includes purple

Testing Sequence

Passive viewing5 sec

Test “patch”cue

5 secHue judgement

No time limit

Compared to green, blue and gray, there is:

Higher probability to perceive Lower probability to perceive

p < 0.0001 p < 0.0001

p < 0.0001

p < 0.0001

p < 0.001p < 0.0001

Example natural image statistics for 3 images

Natural image statistics included in factor analysis

0204060

80100

0204060

80100

0204060

80100

Factor 1

Factor 2

Factor 3

Reported perceived hues for each image in order of ascending factor score

Num

ber o

f tria

ls0

4

8

12x 103

2416

0

8

x 10 -4

+28% +7% -60%Mean scotopic luminance (cd/m2) for the whole image and test patch

Scotopic luminance (cd/m2)0 11 22 33 44 55

Variance: 0.77Skew: 0.10Kurtosis: 1.90

Variance: 0.68Skew: -0.03Kurtosis: 1.62

0 11 22 33 44 55

Variance: 1.43Skew: 1.66Kurtosis: 17.53

0 11 22 33 44 55

Num

ber o

f Pix

els

x 10 -4

Reported perceived hues for the 3 imagesTest patch amplitude / whole image amplitude for frequencies < 2cpd

.032

.025

.012

.019

Supported by R01EY019651 (DC)