54
Color Image Processing with Biomedical Applications Rangaraj M. Rangayyan, Begoña Acha, and Carmen Serrano University of Calgary, Calgary, Alberta, Canada University of Seville, Spain

Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Image Processing with Biomedical Applications

Rangaraj M. Rangayyan, Begoña Acha, and Carmen Serrano

University of Calgary, Calgary, Alberta, Canada University of Seville, Spain

Page 2: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

2

SPIE Press 2011 434 pages

Page 3: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

The Nature of Color Images

3

Photo courtesy of Chris Pawluk

Page 4: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Attributes

4

Hue: dominant wavelength or band Saturation: quality or colorfulness, not diluted with white Intensity or Brightness: primary visual sensation related to physical luminance Also used: Chroma, Lightness

Page 5: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Perception and Trichromacy

5

Page 6: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

6

Representation of Color Images: Color Spaces

A color image may be represented using the following standard representations:

• [red, green, blue] or RGB

• [cyan, magenta, yellow, black] or CMYK

• [hue, saturation, intensity] or HSI

• L*u*v*, L*a*b*

• YIQ, YUV, CIE RGB, CIE XYZ

• others…

Page 7: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color-matching Functions

7

Page 8: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color-matching Functions

8

Page 9: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

CIE Chromaticity Diagram: Triangular Gamut of sRGB

9

Page 10: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

The RGBW-CMYK Cube

10

Page 11: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

11

Relationships between RGBW, HSI, and CMYK representations of color images

Page 12: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

12

Hue, Saturation, and Intensity

Varying hue with constant saturation and intensity

Varying hue and saturation with constant intensity

Page 13: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

13

Representation of Color Images: RGB

Original image Red component

Green component Blue component

Page 14: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

14

Representation of Color Images: RGBV Histograms

Page 15: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

15

Representation of Color Images: RGB Histogram

Page 16: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

16

Representation of Color Images: HSI

Original image Hue

Saturation Intensity

Page 17: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

17

Representation of Color Images: HSI

Original image Hue

Sin (hue/2) = distance from red Sin[(hue-120)/2] = distance from green

Page 18: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

18

Representation of Color Images: HSI

Original image Hue-saturation histogram

Page 19: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

19

HSI: Roles of Hue Saturation and Intensity

Page 20: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

20

Chromatic vs Achromatic Pixels

Page 21: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Natural versus Pseudo Color

21

Page 22: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Acquisition of Color Images

22

1. Sensor color filter array data

2. Dark current correction

3. White balance

4. Demosaicking

5. Color transformation to unrendered color space

6. Color transformation to rendered color space

Page 23: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Demosaicking by Interpolation

23

Page 24: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

The Need for Calibration of Color Images

24 Image Alert!

Page 25: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Characterization

25

Page 26: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Filtering to Remove Noise

26

Page 27: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Neighborhood Shapes

27

Page 28: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Mean and Median Filtering

28

Mean = 90.67 Median = 87

Page 29: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Ordering of Vectorial Data

29

RGB pixel values in a 3x3 neighborhood of a color image:

Page 30: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Marginal Median: sort by R, G, B

30

Page 31: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Reduced Ordering: Euclidean distance to mean

31 =

Page 32: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Vector Median and Vector Directional Filters

32

sum of distances from each vector to all other vectors

Page 33: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

33

Filtering using statistics derived using adaptive neighborhoods

Page 34: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

34

Page 35: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

35

Page 36: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Enhancement of Color Images

36

Quite often, the enhancement required would be only in the intensity component: Gamma correction, Histogram equalization. Sometimes, saturation may need to be increased. Rarely would we want to alter the hue component. Processing the RGB components individually is not usually recommended.

Page 37: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

37

Page 38: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Enhancement of Contrast in Luminance and Color

38

Page 39: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

39

m: mean over 5x5 region max: max over image

Enhancement of Contrast in Luminance and Color

Page 40: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

40

Enhancement of Contrast in Luminance and Color

Page 41: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

41 Green and Blue channels also scaled as above [Liu & Yan]

Enhancement of Contrast in Luminance and Color

Page 42: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

42

Page 43: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

43

Color Histogram

Equalization

Page 44: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

44

Segmentation of Color Images

Selecting ranges in RGB Selecting ranges in HSI

Page 45: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

45 Image Alert!

Page 46: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

46

Segmentation of Images of Skin Ulcers

Black (necrotic scar) Ulcer regions

Red (granulation) Yellow (fibrin)

Original image Hue-saturation histogram

S>0.4 and H 300º to 0 to 30º

S>0.2 and H 30º to 90º

S<0.2 and I<0.25*max

Page 47: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Segmentation: k-means Algorithm

47

color pixel dataset

code book of centroids

set of pixels corresponding to vi : for which vi is nearest

Page 48: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Segmentation: k-means Algorithm

48

Starting from the finite dataset X, iteratively move the k code vectors so as to minimize an error measure and recalculate the sets.

Page 49: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

49

Page 50: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

50

Page 51: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Deconvolution in Histopathology Images

51

R G B

P =

Page 52: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Color Separation in Histopathology Images

52

Page 53: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Additional Topics

53

Edge detection in color Region growing in color Morphological image processing in color Hyperspectral image processing Analysis of texture in color Coding and data compression of multispectral data Analysis of burn wounds Analysis of skin ulcers Teledermatology Telepathology Aerial photogrammetry...

Page 54: Color Image Processingranga/enel697/ColorImage...6 Representation of Color Images: Color Spaces A color image may be represented using the following standard representations: • [red,

Thank You!

Please see the book for details, references, and credits