24
Retinex Image Enhancement: Applications to Medical Images Zia-ur Rahman TruView Imaging Company z[email protected] Glenn A. Woodell Daniel J. Jobson NASA Langley Research Center g[email protected] [email protected] July 17, 2001

Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex Image Enhancement: Applications toMedical Images

Zia-ur Rahman

TruView Imaging Company

[email protected]

Glenn A. Woodell Daniel J. Jobson

NASA Langley Research Center

[email protected] [email protected]

July 17, 2001

Page 2: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 1

Retinex Image Enhancement—General

Information

• The Multiscale Retinex with Color Restoration—Retinex forshort—is a general purpose image enhancement algorithm.

• It is patented:

– US patent #5,991,456, and two others pending.

– Australia patent #713706 (International #US97/07996)

– Pending in several other European and Asian countries.

• TruView Imaging Company, Hampton, Virginia holds theexclusive licensing rights.

Page 3: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 2

Retinex Image Enhancement—Potential

Applications

• Any medical imaging application where automatic contrastenhancement and sharpening is needed. Potential areas ofimpact may include

– Digital X-ray

– Digital Mammography

– CT scans

– MRI

• Telemedicine applications where bandwidth between patientand doctor poses a potential bottleneck. The Retinex compactsthe high input dynamic range, potentially reducing thebandwidth requirement.

Page 4: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 3

Retinex Image Enhancement—Background

• The Retinex provides automatic

– Dynamic range compression: i.e., the ability to representlarge input dynamic range into relatively small outputdynamic range.

Page 5: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 4

– Sharpening: i.e., compensation for the blurring introducedinto the image by the image formation process. This allowsfine details to be seen more easily than before.

Page 6: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 5

– Color constancy: i.e., the ability to remove the effects of theillumination from the output. This allows consistency ofoutput as the illumination changes.

Page 7: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 6

Retinex Image Enhancement—Technical

• The Retinex takes an input digital image I and produces anoutput image R on a pixel by pixel basis in the followingmanner:

R(x, y) = log(I(x, y)

)− log

(I(x, y) ∗M(x, y)

)= log

(I(x, y)

I(x, y) ∗M(x, y)

)where M(x, y) = exp

((x2 + y2)/σ2

), σ is a constant which

controls the extent of M , and ∗ represents spatial convolution.

Page 8: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 7

• This non-linear transform has some interesting properties:

– It mimics the spatial aspect of color perception by settingthe output value as a function of the center (numerator inthe equation) and its surround (the denominator in theequation).

– The ratioing operation in conjunction with the log functioninherently perform dynamic range compression.

– The output is independent of the illumination source.

Page 9: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 8

• The input image can be written as the product of twocomponents: ρ(x, y) the reflectance component whichrepresents the light reflected from all the objects in the scenebeing imaged, and i(x, y) which represents the illuminationcomponent. That is,

I(x, y) = i(x, y)ρ(x, y).

• Since the illumination component varies very slowly across thescene, I(x, y) ≈ Ioρ(x, y), and

R(x, y) = log(

Ioρ(x, y)Ioρ(x, y) ∗M(x, y)

)= log

(ρ(x, y)

ρ(x, y) ∗M(x, y)

)

Page 10: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 9

• By performing the same operation on each color channel, theoutput color image can be written as

Ri(x, y) = log(

Ii(x, y)Ii(x, y) ∗M(x, y)

)i ∈ {R,G,B}

• Ri(x, y) is dependent upon the size of the surround maskM(x, y) which is parametrized by σ.

• Different values of σ enhance different features of the inputimage: large values provide good spectral information, andsmall values provide good spatial information.

• So,

Ri(x, y) =1K

K∑k=0

log(

Ii(x, y)Ii(x, y) ∗Mk(x, y)

), i ∈ {R,G,B}

Page 11: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 10

Retinex—Examples

• Many digital medical images suffer from lack of contrast andsharpness.

• The Retinex automatically provides both enhanced contrastand sharpness.

• The following slides show the application of the Retinex imageenhancement algorithm to

– X-rays

– Mammograms

– CT scans

– Other medical images

Page 12: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 11

Retinex—Examples—X-rays

Page 13: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 12

Retinex—Examples—X-rays

Page 14: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 13

Retinex—Examples—X-rays

Page 15: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 14

Retinex—Examples—Mammograms

Page 16: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 15

Retinex—Examples—Mammograms

Page 17: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 16

Retinex—Examples—CT scans

Page 18: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 17

Retinex—Examples—CT scans

Page 19: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 18

Retinex—Examples—Comparisons

Page 20: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 19

Retinex—Examples—Comparisons

Page 21: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 20

Retinex—Examples—Other

Page 22: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 21

Retinex—Examples—Other

Page 23: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 22

Retinex—Examples—Other

Page 24: Retinex Image Enhancement: Applications to Medical ImagesRetinex Image Enhancement|Potential Any medical imaging application where automatic contrastApplications enhancement and sharpening

Retinex—Medical Applications 23

Contact Information

• Zia-ur Rahman(757) 221-3479; [email protected]

TruView Imaging Company10 Basil Sawyer DriveHampton, VA 23666

• Glenn A. Woodell Daniel J. [email protected] [email protected]

(757) 864-1510 (757) 864-1521

NASA Langley Research CenterMS 473, 8 North Dryden StreetHampton, VA 23681

• URL: http://dragon.larc.nasa.gov/retinex