15
392 IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEPTEMBER 1992 ReEion-Based Contrast Enhancement U of Mammograms William Mark Morrow, Raman Bhalachandra Paranjape, Rangaraj M. Rangayyan, Senior Member, IEEE, and Joseph Edward Leo Desautels Abstract-Diagnostic features in mammograms vary widely in size and shape. Classical image enhancement techniques cannot adapt to the varying characteristics of such features. An adaptive method for enhancing the contrast of mammographic features of varying size and shape is presented in this paper. The method uses each pixel in the image as a seed to grow a region. The extent and shape of the region adapt to local image gray-level variations, corresponding to an image feature. The contrast of each region is calculated with respect to its individual background. Contrast is then enhanced by applying an empirical transformation based on each region’s seed pixel value, its contrast, and its background. A quantitative measure of image contrast improvement is also defined based on a histogram of region contrast and used for comparison of results. Using mammogram images digitized at high resolution (less than 0.1 mm pixel size), it is shown that the visibility of microcalcification clusters and anatomic details is considerably improved in the processed images. I. INTRODUCTION ECENT studies show that one in 10 Canadian women R will contract breast cancer in their lifetime, and that breast cancer is the leading cause of death of women between the ages of 35 and 54 [I]. Early detection is the most successful method of dealing with this epidemic. Currently, the best method for early detection is the use of mammography. Other techniques, such as computed tomography, magnetic resonance imaging, ultrasound, and transillumination have been investigated [2], [3], but mammography remains the proven technique. Studies have shown a decrease in both severe breast cancer and mortality in women who undergo regular mammographic screening, due to earlier detection and treatment [4], [5]. However, periodic screening programs present the examining radiologist with an increased caseload, increasing the chances of improper diagnosis. In addition, mammograms are among the most difficult of radiological images to interpret. Mammograms are of low contrast, and features in mammograms indicative of breast disease are often very small. Digital enhancement of mammograms allows a more confident interpretation of difficult cases without resorting to follow-up patient examinations and secondary procedures, as well as allowing quicker diagnoses of routine Manuscript received February 22, 1991; revised February 14, 1992. This work was supported by a postgraduate scholarship and strategic grants from the Natural Sciences and Engineering Research Council of Canada. W. M. Morrow, R. B. Paranjape, and R. M. Rangayyan are with the De- partment of Electrical and Computer Engineering, The University of Calgary, Calgary, Alta. T2N 1N4, Canada. J. E. L. Desautels is with the Department of Radiological Sciences and Diagnostic Imaging. Foothills Hospital, Calgary, Alta. T2N 2T9, Canada. IEEE Log Number 9200409. cases. Also, the large numbers of negative biopsies encoun- tered in current practice [6] can be reduced if an enhanced mammogram provides a more certain diagnosis. If digital im- ages are available, the potential for computer-aided analysis of mammograms also arises. With the advent of high-resolution image digitization hardware, the decreasing cost/performance ratio of computers, and the recent development of digital X-ray image acquisition equipment, computer image enhancement is becoming practical for mammograms. Conventional image processing techniques do not perform well on mammographic images. The large variation in feature size and shape reduces the effectiveness of classical fixed- neighborhood techniques, such as unsharp masking. This paper presents a technique which adapts to image features, and enhances these features with respect to their surroundings, regardless of the feature shape and size [7]-[11]. We call this technique “region-based image processing” [ 121. 11. ENHANCEMENT AND ANALYSIS OF MAMMOGRAMS The fundamental enhancement needed in mammography is an increase in contrast, especially for dense breasts. Contrast between malignant tissue and normal dense tissue may be present on a mammogram, but below the threshold of human perception. As well, calcifications in a sufficiently dense mass may not be readily visible because of low contrast, so that defining the characteristics of calcifications is difficult. Little work has been reported to this point on enhancing mammograms. Photographic unsharp masking [ 131, digital unsharp masking [14], and spatial bandpass filtering [15] have been used to enhance mammograms. More work has been done on analysis of mammograms, for identification of image features associated with cancer. Automated detection of tumors or lesions has been investigated [16]-[20], although few studies [17] have tested their methods on large num- bers of cases. Detection of calcifications has also received considerable attention [15], [21]-[25], with near-acceptable results being reported. Pattern recognition techniques [26], [27] and expert systems [28] have been developed to classify predefined anomalies, with generally good results for the limited test cases presented. Clearly, the emphasis in mam- mogram imaging research has been in pattern recognition for diagnostic purposes using, at best, rudimentary enhancement of the images. With few exceptions [15], [18], images have been acquired at spatial resolutions insufficient to resolve the necessary fine detail in mammograms. The approach taken in this paper is to enhance difficult mammograms to sufficient 0278-0062/92$03,00 0 1992 IEEE

U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

392 IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEPTEMBER 1992

ReEion-Based Contrast Enhancement U

of Mammograms William Mark Morrow, Raman Bhalachandra Paranjape,

Rangaraj M. Rangayyan, Senior Member, IEEE, and Joseph Edward Leo Desautels

Abstract-Diagnostic features in mammograms vary widely in size and shape. Classical image enhancement techniques cannot adapt to the varying characteristics of such features. An adaptive method for enhancing the contrast of mammographic features of varying size and shape is presented in this paper. The method uses each pixel in the image as a seed to grow a region. The extent and shape of the region adapt to local image gray-level variations, corresponding to an image feature. The contrast of each region is calculated with respect to its individual background. Contrast is then enhanced by applying an empirical transformation based on each region’s seed pixel value, its contrast, and its background.

A quantitative measure of image contrast improvement is also defined based on a histogram of region contrast and used for comparison of results. Using mammogram images digitized at high resolution (less than 0.1 mm pixel size), it is shown that the visibility of microcalcification clusters and anatomic details is considerably improved in the processed images.

I. INTRODUCTION ECENT studies show that one in 10 Canadian women R will contract breast cancer in their lifetime, and that

breast cancer is the leading cause of death of women between the ages of 35 and 54 [I]. Early detection is the most successful method of dealing with this epidemic. Currently, the best method for early detection is the use of mammography. Other techniques, such as computed tomography, magnetic resonance imaging, ultrasound, and transillumination have been investigated [2], [3], but mammography remains the proven technique. Studies have shown a decrease in both severe breast cancer and mortality in women who undergo regular mammographic screening, due to earlier detection and treatment [4], [5]. However, periodic screening programs present the examining radiologist with an increased caseload, increasing the chances of improper diagnosis. In addition, mammograms are among the most difficult of radiological images to interpret. Mammograms are of low contrast, and features in mammograms indicative of breast disease are often very small. Digital enhancement of mammograms allows a more confident interpretation of difficult cases without resorting to follow-up patient examinations and secondary procedures, as well as allowing quicker diagnoses of routine

Manuscript received February 22, 1991; revised February 14, 1992. This work was supported by a postgraduate scholarship and strategic grants from the Natural Sciences and Engineering Research Council of Canada.

W. M. Morrow, R. B. Paranjape, and R. M. Rangayyan are with the De- partment of Electrical and Computer Engineering, The University of Calgary, Calgary, Alta. T2N 1N4, Canada.

J. E. L. Desautels is with the Department of Radiological Sciences and Diagnostic Imaging. Foothills Hospital, Calgary, Alta. T2N 2T9, Canada.

IEEE Log Number 9200409.

cases. Also, the large numbers of negative biopsies encoun- tered in current practice [6] can be reduced if an enhanced mammogram provides a more certain diagnosis. If digital im- ages are available, the potential for computer-aided analysis of mammograms also arises. With the advent of high-resolution image digitization hardware, the decreasing cost/performance ratio of computers, and the recent development of digital X-ray image acquisition equipment, computer image enhancement is becoming practical for mammograms.

Conventional image processing techniques do not perform well on mammographic images. The large variation in feature size and shape reduces the effectiveness of classical fixed- neighborhood techniques, such as unsharp masking. This paper presents a technique which adapts to image features, and enhances these features with respect to their surroundings, regardless of the feature shape and size [7]-[11]. We call this technique “region-based image processing” [ 121.

11. ENHANCEMENT AND ANALYSIS OF MAMMOGRAMS The fundamental enhancement needed in mammography is

an increase in contrast, especially for dense breasts. Contrast between malignant tissue and normal dense tissue may be present on a mammogram, but below the threshold of human perception. As well, calcifications in a sufficiently dense mass may not be readily visible because of low contrast, so that defining the characteristics of calcifications is difficult.

Little work has been reported to this point on enhancing mammograms. Photographic unsharp masking [ 131, digital unsharp masking [14], and spatial bandpass filtering [15] have been used to enhance mammograms. More work has been done on analysis of mammograms, for identification of image features associated with cancer. Automated detection of tumors or lesions has been investigated [16]-[20], although few studies [17] have tested their methods on large num- bers of cases. Detection of calcifications has also received considerable attention [15], [21]-[25], with near-acceptable results being reported. Pattern recognition techniques [26], [27] and expert systems [28] have been developed to classify predefined anomalies, with generally good results for the limited test cases presented. Clearly, the emphasis in mam- mogram imaging research has been in pattern recognition for diagnostic purposes using, at best, rudimentary enhancement of the images. With few exceptions [15], [18], images have been acquired at spatial resolutions insufficient to resolve the necessary fine detail in mammograms. The approach taken in this paper is to enhance difficult mammograms to sufficient

0278-0062/92$03,00 0 1992 IEEE

Page 2: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

quality to allow the radiologist to make his diagnosis with more confidence. We employ high-resolution digitization (less than 0.1 mm square pixel size), and maintain high resolution throughout our processing procedures. Further, information is obtained during enhancement which can provide a preliminary quantitative analysis of mammographic features. Our emphasis at this stage is to provide the radiologist with a superior image, not a diagnosis. Further analysis of image features using shape analysis techniques will be taken up later.

111. Ih4AGE CONTRAST

In practice, many definitions of contrast are used [29]. In general terms, contrast refers to the difference in luminance between an object and its surroundings. In psychovisual stud- ies, the contrast C of an object with luminance f against its surroundings of luminance b is defined as follows:

Iv. CONTRAST ENHANCEMENT TECHNIQUES

A. Enhancement by Contrast Stretching

The simplest method of increasing the contrast in an image is to adjust the image histogram so that there is a greater separation between foreground and background gray level distributions. A simple example of contrast stretching is a linear rescaling of the gray level distribution in the image. Denoting the input image gray scale values by x , and the output gray scale values by y, the rescaling transformation is

y = k x + m (4)

where k and m are nonzero. Depending on the specific values of k and m, contrast will be increased or decreased. Alternatively, a nonlinear transformation can be used, such as

y = k X P ( 5 ) e=- f - b b ‘

The optical definition of contrast is

e=- f - b f + b

where f is the maximum luminance in the image and b is the minimum luminance. This definition of contrast has the advantage of being bounded between +1 and - 1.

Consider an object that is just noticeably distinct from a uniform background. If we define the luminance difference between the central area and the overall image luminance as AL and the overall image luminance as L, the ratio between the two is called the Weber ratio W

AL w=- L (3)

The Weber ratio varies strongly with the size and shape of the foreground and the background of an object. However, for simple objects over a brightness range from 1 ft Lambert to lo00 ft Lambert, W may be considered to be approximately 0.02 [30]. A region which differs in luminance from its surroundings by less than 2% is indistinguishable to the human eye. The aim of contrast enhancement schemes is to increase image contrast over this threshold.

This paper will use a version of (2) as the definition of contrast. We deal with gray-level images, and define f as the mean gray-level value of a particular object in the image, called the foreground, and b as the mean gray-level value of a surrounding region called the background. Then, contrast C is defined in (2). This definition of contrast is independent of the actual range of gray levels in the image, and so is well suited to contrast transformation schemes. If we compare (2) with the Weber ratio in (3), we see that we are assuming that the object and its background have equal area and thus we are equating (f + b ) / 2 to L, the total image luminance, and (f - L) = (f - b ) / 2 to AL, the luminance difference. For the human eye then, we need to increase C above 2% or 0.02.

where k is a factor to rescale the output image to the range of the input image, depending on the value of p. hr either case, compression (and possibly removal) of one section of the image gray level histogram is necessary to allow expansion in another section, if the original gray level range is to be maintained. This technique usually requires that an optimal transformation be specified for each given image.

B. Enhancement by Histogram Equalization and Specification

If we consider the image histogram as a probability dis- tribution, then from an information theoretic stand-point, the distribution which conveys the most information is a uniform distribution [31]. Therefore, if we redistribute the gray levels to obtain as uniform a histogram as possible, the imagc information should be maximized, since we are using the available intensity range “optimally.” It can be shown [30] that histogram equalization can be effected by replacing each normalized gray level with the cumulative distribution from the minimum gray level up to that gray level.

Locally adaptive histogram equalization performs histogram equalization independently over different segments of the image. Ideally, a histogram is generated in a window centered on each pixel in the image, equalized, and used to calculate a new value for that pixel. This procedure is computation- ally very intensive, so techniques have been developed to interpolate between a few such histograms equally spaced through the image to obtain the equalized image [32]. Adaptive histogram equalization has been shown to enhance contrast in radiological images, which in general have a large global dynamic range, but small local feature gray-level variations [33]. The area of the image immediately surrounding a given pixel is used to calculate a histogram, which is then equalized to give the new pixel value. The optimal size of the histogram area is difficult to determine, and often varies from one area of the image to another. The often radically different appearance of the image after the equalization may be undesirable in some classes of images, including mammograms.

A variation on histogram equalization is histogram specifi- cation. An empirically derived histogram transformation can

MORROW et al.: REGION-BASED CONTRAST ENHANCEMENT OF MAMMOGRAMS 393

- --

Page 3: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

394 IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEPTEMBER 1992

be applied, with very good results in many cases [30]. The dis- advantage of histogram specification is that the transformation must be designed for each image individually.

C. Fined-Neighborhood Statistical Enhancement

In many classes of images, a slowly varying background contributes little to the interpretation of the image, and can be removed to allow expansion of the gray level variations in local image features, and thus increase contrast. Local enhancement techniques use statistical properties in the neigh- borhood of a pixel to estimate the background, suppress it, and increase local contrast. Lee [34] calculates the local mean and variance, and performs a transformation to a desired local mean and variance. Narendra and Fitch [35] use the global mean, local mean, and local standard deviation to obtain the gray level transformation:

M y = IC-(2 - p ) + p

U

where p and U are the local mean and standard deviation, M is the global mean, and k is an empirically determined scaling factor. As in the methods discussed above, determination of the local neighborhood dimensions is the critical step. A given neighborhood size and shape may not be equally effective in enhancing all areas of an image.

D. Convolution Mask Enhancement

Convolutional masking is one of the most commonly used methods of digital image enhancement. Unsharp masking is an enhancement operation which was originally performed photographically. In this method, a blurred photographic negative is placed in register with a pos- itive image to obtain a difference image containing the details in the image. This “details only image” is then amplified and added to the blurred positive image and a print is obtained. The resulting print is sharper because low-frequency information in the image is reduced in intensity while high-frequency details are amplified. Digital unsharp masking approximates this process using a 3 x 3 mask. An example of such a 3 x 3 unsharp mask H ( i , j ) is

-1/8 -1/8 -1/8

-1/8 -1/8 -1/8 -1/8 2 -1/8). (7)

Rogowska et al. [36] and Sezan et al. [37] have applied digital unsharp masking to digital chest radiographs. Daponte and Fox [38] have used Sobel gradient operators to enhance chest radiographs. These procedures change the appearance of the image too radically to be applicable in mammograms, where the overall subjective appearance of the image is essential for diagnosis.

E. Enhancement by Background Removal

A direct method of reducing the slowly varying portions of an image, to allow increased gray level variation in image details, is background subtraction. It is usually performed by subtracting a low-pass filtered version of the image from

itself. Unsharp masking is a simple version of this procedure. Spline filtering [39] and gray-scale morphological processing [40] are two methods of estimating the image background which have been used successfully for this purpose. The background extraction technique should be adaptive to local image characteristics to truly identify the image background.

F. Region-based Enhancement

The above techniques can all be classified as either fixed- neighborhood or global techniques. They may adapt to local features within a neighborhood, but do not adapt the size of the neighborhood to local properties. Alternatively, they modify the image depending on global properties, such as the image spatial-frequency spectrum, which may not be representative of a small region of interest in the image. Many images, including mammograms, have isolated regions which are the primary features of interest. These features can vary widely in sue and shape, and often cannot be enhanced by fixed- neighborhood or global techniques. Thus there is a need for adaptive-neighborhood techniques [7]-[ 111, [41]-[45]. We have developed adaptive-neighborhood processing techniques which grow regions in a given image and enhance the regions with respect to their local backgrounds.

V. REGION-BASED IMAGE PROCESSING

In adaptive-neighborhood or region-based image processing, a neighborhood is defined about each pixel in the image, the extent of which is dependent on the characteristics of the image feature in which the given pixel is situated. This neighborhood of similar pixels is called a region. In image segmentation, groups of pixels are found that have some property in common (such as similar gray level) and are used to define disjoint image regions called segments. Region-based processing may be performed by initially segmenting the given image and then processing each segment in turn. Alternatively, region- based processing may define possibly overlapping regions for each pixel and process each of these regions indepen- dently. Regions, if properly defined, should correspond to image features. Then, features in the image are processed as units, rather than pixels being processed using arbitrary groups of neighboring pixels (for example, 3 x 3 masks). Image processing procedures can then be applied on an image feature basis, rather than pixel by pixel. Region-based pro- cessing could also be designated as pixel-independent process- ing, feature-based processing, adaptive neighborhood process- ing, or object-oriented processing. The term adaptive region- based image processing, or simply region-based processing is used in this paper.

The fundamental step in a region-based image processing algorithm is defining the extent of regions in the image. Again, we emphasize that there are two classes of regions: nonoverlapping regions, which are obtained using image seg- mentation techniques; and overlapping regions, obtained from region growing techniques. Overlapping regions are used here, because it is felt that disjoint segmentation of an image, with subsequent enhancement of the segments, would result in noticeable edge artifacts and an inferior enhanced image.

Page 4: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW et al.: REGION-BASED CONTRAST ENHANCEMENT OF MAMMOGRAMS 395

Fig. 1. Flowchart of region growing algorithm.

VI. REGION GROWING

A. Seed-Fill Region Growing

The region growing technique used in this paper is based on a simple graphical seed-fill algorithm. It is also known as pixel aggregation [30]. In this method, regions consist of connected pixels that fall within a specified gray-level deviation from the starting or seed pixel. For the high-resolution mammogram images studied in this work, 4-connectedness was found, by visual comparison, to be usually adequate to allow accurate region growing, although small features were better matched with 8-connected regions. Longer processing times result for 8-connectedness7 which was used unless processing became onerous.

The flowchart of Fig. 1 shows the region growing algorithm. The algorithm starts with a given pixel, called the seed pixel, or simply seed. This pixel is placed in an initially empty queue, which holds pixels to be evaluated for inclusion or exclusion from the region being grown. The main loop is then entered. If the queue is empty, the program exits the loop. Otherwise, the first pixel is taken from the queue. This

pixel is called the current pixel. If its gray level value is within the specified deviation form the seed, it is labeled as a foreground pixel. Its immediate neighbors (either 4-connected or %connected, as specified) are possibly foreground pixels, and are added to the queue, if they are not already in the queue from being connected to previously checked pixels. If the current pixel is outside the allowable gray level range, it is marked as a background pixel, and a border pixel of the region has been reached. Regions can have a number of internal borders, in addition to the encompassing external border. Thus, the background may consist of more than one set of pixels, with each such set being disconnected from the others. After all of the current pixel’s neighbors have been checked, control is directed back to the start of the loop, to check the next pixel in the queue. The h a 1 step in finding a region about the seed is completing the background. This is done by starting with the existing background points, as found during foreground growth. The neighbors of this set of pixels are examined to see if they belong to either the foreground or background. If not, they are set to be the next layer of the background. The new layer is then used to grow

Page 5: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

:96 IEEE TR,\NSACTIONS ON MEDICAL IMAGING, VOL 11, NO. 3. SEPTEMBER 1992

another layer, and so on, until the specified background width is achieved. The region-growing procedure as described above does have inefficiencies, in that a given pixel may be checked more than once for placement in the queue. More complicated algorithms can be used to grow regions along line segments. and thereby partially eliminate this inefficiency [46]-[48]. Preliminary testing of a scan-line based algorithm showed minimal improvement for mammogram images, as the type of regions grown in mammograms are usually complex. F,‘g. 2 shows region growing graphically. Note that each pixel in the connected foreground that has the same gray level as the seed will grow the same foreground and background. These pixels are called the region’s redundant seed pixels. Considerable computation can be saved by using this redundancy and obviating the repeated growing of the same region. Further. the same final transformation that is applied to the region’s seed pixel is also applied to the region’s redundant seed pixels. In high-resolution mammogram images, redundant seed pixels were seen to account for over 7.5% of the image pixels. This large percentage is partially due to the dark background in the image off the projection of the breast. Also, the redundant pixel percentage is dependent on the growth tolerance used during region growing. In images with large, uniform regions, the percentage of redundant seed pixels could be even higher.

B. Region Growing Parameters

The crucial parameter in controlling seed-fill region growing is the criterion used to decide whether a pixel is to be included in the region foreground or excluded. This criterion is defined as the growth tolerance, I C . The growth tolerance indicates the deviation (positive or negative) about the seed pixel’s gray level that is allowed within the foreground region. For example, with a growth tolerance of 0.0.5, any pixel with a gray value between 0.95 and 1.05 times the seed pixel’s value, which also satisfies the connectivity criterion, is included in the region. The reason for using this type of growth tolerance is found from a closer examination of the definition of contrast. Seed-fill region growing results in regions having contrast greater (in magnitude) than a certain minimum contrast, Cmin. We require this minimum contrast to be independent of region gray level, so that the results of enhancement will be independent of a multiplicative transformation of the image. A region of minimum positive contrast Crnin will have a mean foreground value of f and a mean background value of (1 - I C ) f . The minimum contrast, Crnin is then, using (2) ,

and we see that the contrast Cmin is independent of the foreground gray level or background gray level. It depends only on the region growth tolerance parameter k , and is in fact approximately one half the growth tolerance, for small I C . Weber’s ratio of 2% for a just-noticeable feature suggests that the growth tolerance should be at the most 4%, to grow regions which are not noticeable prior to enhancement (and are subsequently enhanced to a contrast above the Weber ratio). A lower bound on k may be established empirically.

Fig 2. Two examples showing region growing. Light gray pixels mark the foreground. black pixels mark the seed and redundant seed pixels. dark gray piwls mark the background, and white pixels mark the pixels that are to be chsif ied next. The image used is taken from Fig. 10 and is of a biopsy proven carcinoma. The example of region growing shows how the foreground and hackground are developed when the seed pixel is on a ligament next to the dense mass in the first set of images, and is on a microcalcification inside the dense mass in the second set of images. Note that there are some interior hackground area\ within the foreground regions.

or. depending on the class of images being enhanced, through noise analysis.

C. Contrast Enhancemen1

Equation (2) defined a region’s contrast as a function of the mean gray levels of the foreground f and background b. Contrast can be increased by changing f or b. Rearranging (2). and replacing C with an increased contrast C’ gives

(9)

where f ’ is the new foreground value. In the algorithm developed, only the seed pixel and the redundant seed pixels

BEST COPY AVAILABLE

Page 6: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW et al.: REGION-BASED CONTRAST ENHANCEMENT OF MAMMOGRAMS 391

1

0 9

0.8

0.7

Output 0.6 Contrast o.5

Value c’ 0.4

0.3 0 2

I I I I I I I I / ’

I - /‘

, ,’ - - - /” - / //

- ,I’

1‘’ -

- / 0.1 1 // 4

O’J” I I I 1 1 1 I I I 0 0 1 0 2 0 3 0 1 0 5 O G O i 08 0 9 1

Iupu( Contrast I‘nlirc C

Fig. 3. Contrast transformation curve used in region-based contrast-enhance- ment of digitized mammograms. This plot is equivalent to a look-up table between C’ and C .

in the foreground take this value. The remaining pixels in the foreground (i.e., not the region’s seed or redundant seed pixels) obtain new values when they in turn act as seed pixels and are used to grow different regions. (If all pixels in the foreground were replaced by f’, the output image would depend on the order in which regions were grown, and details within each region would be lost.) The new contrast C’ for the region can be calculated using an analytic function of C or an empirically determined relationship between C‘ and C. Previously, ana- lytic functions (square root, exponential, and logarithm) were used [9], [42], however we have found that an empirically formed chart or plot defining the relationship between C’ and C gives better results. A typical example of such a plot is presented in Fig. 3. This curve was specially designed to boost perceptibility of regions with low-to-moderate contrast while not affecting high-contrast regions. It was selected in consultation with an experienced radiologist (JELD) from a set of contrast enhancement curves (plots of C’ versus C) which produced varying degrees of contrast enhancement.

D. Evaluation of Enhancement

The improvement in images after enhancement is often very difficult to measure. A processed image can be said to be an enhancement over the original image if it allows the observer to better perceive the desirable information in the image. In mammograms, the improved perception is difficult to quantify. Use of statistical measures of gray level distribution as measures of local contrast enhancement (for example, variance or entropy) have not been particularly meaningful for mammogram images. A number of images which clearly showed improved contrast showed no consistency, as a class, using these statistical measurements. A new measure which we propose here, and which has greater consistency than the statistical measures, is the contrast histogram. The contrast histogram is a graph of the distribution of contrast over the image. If we measure the contrast of all regions (as obtained by the region growing procedure described earlier) in the image, prior to enhancement and subsequent to en- hancement, the enhanced image’s contrast histogram should contain more regions at higher contrast levels than the original image’s contrast histogram. Various enhancement methods can be quantitatively compared by measuring the properties of

their respective contrast histograms. The width of a contrast histogram can be quantified by taking the second moment about the zero contrast level. Specifically, for a distribution of contrast values ci, quantized so that there are N bins between -1 and 1, the second moment M2 is

where p ( c ; ) is the normalized number of occurrences of seed pixels (including redundant seed pixels) which grow a region with contrast ci. A low-contrast image, that is one with a narrow contrast histogram, will have a low value for M2, while an image with high contrast will have a broader contrast histogram, and hence a greater value of M2. Image contrast must be measured after the entire image has been enhanced, since the relative contrast between adjacent regions is dependent on the changes made to each of the regions. To measure contrast in an image after enhancement, region growing (using the same parameters as in the enhancement run) is performed on the output enhanced image, and a contrast histogram is generated. The same procedure is performed on images enhanced using other methods for comparison.

In general, the final contrast values in the output image will not match the contrast values specified by the contrast transformation in (9). This is because (9) is applied pixel by pixel to the input image, and the adaptive neighborhood for each pixel will vary. Only if all the pixels in an object have exactly the same gray level value will they all have exactly the same adaptive neighborhood and be transformed in exactly the same way. Thus the contrast enhancement curve is useful for identifying ranges in which contrast enhancement is desired, but not for specifying the final contrast of the regions. The contrast of each region grown in the image is in fact dependent on the value specified by the initial region contrast and the transformation curve as well as the transformation applied to adjacent regions. For example, if two relatively bright regions are adjacent, their enhancement will produce a final contrast lower than that specified due to the transformation of each region. On the other hand, if a dark region and a bright region are adjacent, their enhancement will produce a greater contrast than that specified by the transformation curve. The discrepancy between the contrast transformation curve and the actual contrast values produced is image-dependent, and cannot be calculated during enhancement. A postprocessing analysis by region growing is necessary, and was done to obtain the contrast histograms shown in this paper. Note also that the regions grown at any location in the original image and the same location in the processed image need not be exactly the same even if the same region growing criteria are used.

VII. ACQUISITION, PROCESSING, AND DISPLAY OF DIGITIZED IMAGES

Mammogram films were digitized using an Eikonix 1412 scanner (Eikonix Inc., Bedford MA), which digitizes up to 4096 scanlines, each with 4096 12 bit pixels. Films were illuminated by a Plannar 1417 light box (Gordon Instruments, Orchard Park, NY). Although this light box is constructed to

Page 7: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

398 IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEITEMBER 1992

have a uniform light intensity distribution, it was necessary to correct for nonuniformities in illumination. After correction, pixel gray levels were determined to be accurate to 10 bits, with a dynamic range of approximately 0.02 to 2.52 optical density units [49].

The images were displayed in whole or in windowed sec- tions on either Sun workstation consoles (Sun Microsystems Inc., Mountain View, CA), or on a MegaScan 2111 monitor (Advanced Video Products Inc., Littleton, MA). The Mega- Scan monitor displays 2560 x 2048 8 bit pixel subimages at 72 noninterlaced frames per second from a 4096 x 4096 12 bit pixel frame buffer, with interactive zooming, scaling, and panning.

Image processing was performed on either a Sun worksta- tion for small test images, or on a Myrias SPS-2 supercomputer (Myrias Research Inc., Edmonton, Alta., Canada). The Myrias SPS-2 is a parallel supercomputer which uses 64 Motorola 68020 microprocessors running in parallel. Typical processing speeds were 5 mslpixel on a Sun 31280 workstation, and 0.5 mslpixel on the Myrias SPS-2 [ll].

Processed images were presented in hard-copy form on a Kodak XL7700 (Eastman Kodak Co., Rochester, NY) digital continuous tone printer. This printer can print 1536 x 2048 8 bit pixel images on transparency material with an optical density range from 0.05 to 2.70. Thus, some down-sampling and loss of resolution occurs when printing images. The Kodak XL7700 printer is connected to the network of Sun computers via a Macintosh IIci (Apple Computer Inc., Cuper- tino, CA).

Selection of optimal processing parameters, such as the region growth tolerance and background width, was done using an interactive version of the enhancement program. This version allows intermediate results to be displayed on the MegaScan monitor. Features of interest in the image were selected with crosshairs, and regions were grown using pixels in the selected objects. The foreground gray level tolerance was adjusted until a region was grown that matched the object under study, and then used to process images containing similar objects. Region-based processing could also be observed pixel by pixel using this interactive facility.

VIII. EVALUATION OF IMAGE QUALITY IN THE ENHANCEMENT OF DIGITIZED MAMMOGRAM

IMAGES

A. Case Studies and Evaluation

Enhancement of mammograms digitized at high resolution is presented in this section. The mammograms are from teach- ing case studies in the Foothills Hospital radiology library. Contrast histograms and the second moment of the contrast distribution (M2, as defined in (10)) will be used to quantify the enhancement of images presented here. Three test images selected from the total of ten studied so far are presented in this section. These cases represent typical problems in the diagnosis of mammograms. The initial diagnosis made from each mammogram was subsequently verified by biopsy at the time of the patient’s treatment, prior to this study.

B. Contrast Enhancement of a Microcalcification Cluster

Fig. 4(a) shows a part of the digitized image of a mammo- gram of a 64-year-old female’s right breast. The distinguishing feature in this image is a cluster of calcifications in the upper left portion of the image. These calcifications are linearly distributed, suggesting that they are intraductal. Cancer was suspected because of the irregular shape and size of the individual constituents of the calcification cluster, although hyperdense tissue cannot be clearly seen in this area of the image. A biopsy was subsequently performed on the patient, which confirmed the presence of an invasive intraductal carci- noma. Fig. 4(b) shows the same part of the output image after region-based contrast enhancement was applied to the entire digitized mammogram. The curve shown in Fig. 3 was used as the contrast transformation curve, the growth tolerance was 3%, and a background width of 3 pixels was used. Increased contrast is apparent throughout the image, and subtle details are now visible at higher contrast. The arrows in Fig. 4(a) and @) highlight two features of interest. Note the sharper edges between features as the contrast of the calcifications has been greatly increased in the processed image. A feature of interest in Fig. 4(a) and (b), a small, isolated calcification, highlighted by the black arrow, is more obvious in the enhanced image. Other similar features in the image have been enhanced to the same degree. The feature near the centre of the image highlighted by the white arrow is possibly the cross-sectional projection of a mammary duct. If this interpretation is correct, the distorted geometry (away from the normally circular cross- section) is indicative of intraductal malignancy. This feature is not readily apparent in the original image. Fig. 4(c) and (d) show the contrast histograms of the complete mammograms from which the images in Fig. 4(a) and (b) were taken. The contrast distribution is plotted on a logarithmic scale to em- phasize small features at high-contrast values, corresponding to the regions of interest in the images. The wider distribution and greater occurrence of regions at high contrast values in the histogram of the enhanced image show that it has higher contrast. The second moment M2 for the input image contrast histogram is 3.71 x and the corresponding value for the enhanced image is 6.17 x indicating that the contrast spread is wider in the enhanced image.

The enhancement shown in the above case has little immedi- ate practical value, since the characteristics of the calcification cluster in the original image are sufficient to lead the radi- ologist to recommend biopsy. However, if mammary ducts and other anatomical features become easily visible in the enhanced image, as is suggested here, the extent and degree of disease can be judged more accurately, and the biopsy method and location determined accordingly.

C. Contrast Enhancement of a Dense Mass

Fig. 5(a) shows a portion of a mammogram of a 43- year-old female’s right breast. In the lower right quadrant of the image is a dense mass with diffuse edges and a spiculated appearance (black arrow). Probable presence of calcifications was diagnosed after examination of the film through a hand lens. Fig. 5@) is the corresponding image after region-based contrast enhancement. The second moments

Page 8: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW er al REGION-BASED CONTRAST EWHAVCE\lF\T OF \ I AMMOGRAMS

105

104

103

lo2

10

(a) Original image

1 1 I

105

104 -

- io3 - lo2

-

-

-

10

1

- -

I1 I

(b) Enhanced image

1 1 ' I h

1 cm

-0.2 -0.1 0 0.1 0.2

of the contrast histograms [Fig. 5(c) and (d)] of the two corresponding mammograms are 6.7 x lo-' and 17.0 x lop4, respectively. The interior detail of the mass is much more apparent in the enhanced image, and the bright, irregular details are probably calcifications. Also of interest is the appearance of the dense mass to the left of the spiculated mass (white arrow). It has smooth margins, and a generally benign appearance. After enhancement, bright, irregularly shaped features are apparent in this mass, and may possibly be malignancy-associated calcifications as well. This leads to the diagnosis of a much wider spread in malignancy, which would have affected subsequent patient management.

D. Benign Masses

For comparison with the benign-looking mass in the image discussed in Section VIII-C, an image with a histologically

verified benign mass of a similar appearance was enhanced. Fig. 6(a) shows a close-up of a benign cyst in this image. The brighter regions in the center of this mass do not show the irregular outline as those in the previous image did. These bright features are thought to be the result of superimposition of crossing linear supporting tissues. This can be seen by the linear features ahich cross at the bright points. The corresponding portion from the enhanced image is shown in Fig. 6(b). Few changes are apparent from the original image. The value of for the original image is 7.3 x lo-', and for the enhanced image -112 = 14 x showing that contrast enhancement was accomplished. By examining other areas of the image, the enhancement is apparent. Therefore. since no high-contrast features were indicated in the mass of Fig. 6 after contrast enhancement, we can conclude that the bright, irregular features in the benign-looking mass of Fig. 5 are

Page 9: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

400 IEEE TRANSACTIONS ON MEDICAL IMAGING. VOL. 11, NO. 3, SEPTEMBER 1992

(a)Original image (b)Enhanced image

1 0 4

103

lo2

10

1 -0.2 -0.1 0 0.1 0.2

Contr a t (c)Contrast histogram of original mammogram

-0.2 -0.1 0 0.1 0.2 Contrast

(d)Contrast histogram of enhanced mammogram

Fig. 5 . Region-based contrast enhancement of a mammogram with a dense mass. (a) presents a portion (400 x 400 pixel\) from a digitized mammogram (3000 x 2000 pixels). The portion presented contains a dense mass with some spiculations. (b) presents the same part of the mammogram after region-based contrast enhancement was applied to the complete mammogram. Corresponding contrast histograms of the full mammogram are presented in (c) and (d).

indeed calcifications, and not enhancement artifacts.

E. Comparison with Other Techniques

Nonlinear Rescaling: When diagnosing mammograms, the radiologist's attention is primarily concentrated on the brighter areas of the film. If the brighter gray level range is expanded, then features which consist of pixels in this range will show increased contrast. A simple nonlinear rescaling, as defined in (5 ) with p = 1.5 was applied to the digitized mammogram from which Fig. 4(a) was taken, and the corresponding portion of the resulting image is shown in Fig. 7(a). Contrast in the area of the calcification cluster has been increased, at the cost of decreased contrast in the darker areas of the image. Overall image contrast has been decreased slightly, as h.12 decreases from 3.7 x lop4 for the original image to 3.2 x lop4 for the processed image. While the enhancement here is not as good as with region-based contrast enhancement, the advantage of this

method is its simplicity. It could be implemented as a look-up table in display hardware, allowing real-time enhancement.

2) UnsharpMusking: The 3 x 3 unsharp filter mask pre- sented in (7) was applied to the complete mammogram from which Fig. 4(a) was taken. The portion of the resulting image which corresponds to the microcalcification cluster in Fig. 4(a) is shown in Fig. 8(a). Contrast of the calcification cluster is increased, although not to the degree accomplished in the image generated using region-based contrast enhancement. Also, the overall appearance of the image is altered more from the original image than in the region-based image. M 2

increases from 3.7 x for the original image to 4.4 x l op4 for the processed image. Recall that A!f2 was 6.2 x lo-' for the region-based contrast enhancement image in Fig. 4(a).

3) Global Histogram Equalization: Global histogram equal- ization was applied to the full mammogram from which Fig. 4(a) was taken. Fig. 9(a) presents the portion of the

Page 10: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW E l 01 REGION-BASkD CONTRAST FNHANCFMENT OF MAMMOGRAMS

(a)Original image

1 o6 I I I

105 - -

(b)Enhanced image

104 104

103 103

lo2 lo2

10 10

1 1 -0.2 -0.1 0 0.1 0.2

Contrast -0.2 -0.1 0 0.1 0.2

Contrast (c)Contrast histogram of original mammogram (d)Contrast histogram of enhanced mammogram

Fig. 6. Region-based contrast enhancement of a benign mass. (a) presents a portion (400 x 400 pixel) of a digitized mammogram (3000 x 2000 pixels) and (b) presents the same portion after the complete mammogram was enhanced using region-based contrast enhancement. (c) and (d) show contrast histograms for the corresponding full mammograms

equalized image which corresponds to Fig. 4(a). This portion of the image has poor contrast. Equalizing the gray-level histogram for the complete image compresses the gray-level differences in the bright, small regions of the image (which are of the most interest for diagnostic purposes) and expands the gray-level differences in the large, dark regions. Contrast is thus decreased in the areas where the calcifications lie, although global image contrast, as measured by hf?, has increased to 1.0 x lop3 from 3.71 x lo-'.

Ix. PARAMETER SELECTION FOR MAMMOGRAM IMAGES

Selection of the parameters controlling region growing was performed using the interactive program as indicated in Section VII. Areas of interest in test mammogram images were identified with the aid of an experienced radiologist. Region growing parameters were adjusted until the regions grown corresponded to details in the feature to be enhanced. For

example, when increased contrast in the internal structure of suspicious dense masses was required, the growth tolerance was specified to grow regions that matched internal structures in a given mass which were identifiable on the initial image. Finding a growth tolerance to satisfy this criterion was not always possible. On the other hand, growing regions which corresponded to microcalcifications was staightforward, be- cause of the sharp boundaries of these features. In images which were used to investigate enhancement of microcalci- fications, the growth tolerance was adjusted to prevent the growth of unrealistically large regions in the normal tissues of the breast. A growth tolerance of 3% proved to be suitable in most cases. Background width was increased from the initial background layer found during foreground growing to include a representative sample of pixels surrounding the feature of interest, without including portions of other features of interest. In images where calcifications were the features of

Page 11: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

- 402

(a) Image after nonlinear rescaling

lo6 3 104

103

lo2

10

1 -0.2 -0.1 0 0.1

Contrast (b) Contrast histogram

0.2

Fig. 7. Nonlinear rescaling. The portion of the enhanced mammogram corresponding to Fig. 4(a) is presented in (a). The contrast histogram of the complete enhanced mammogram is presented in (b).

IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEPTEMBER 1992

interest, the background was kept narrow, typically 3 pixels wide. An option is included in the enhancement algorithm to reject enhancement if the background gray level fluctuates be- yond a specified deviation. For mammogram images, regions which correspond to identifiable features typically have highly uniform backgrounds, and this option was rarely invoked.

x. EXAMINATION OF THE DIAGNOSTIC UTILITY OF MAMMOGRAMS ENHANCED USING

REGION-BASED IMAGE PROCESSING

In order to examine the differences in radiological di- agnoses that may result from region-based enhancement of mammograms, eight test cases from the teaching library of the Foothills Hospital (Calgary, Alta., Canada) were studied. For each of these cases the pathology was known due to biopsy or other follow-up procedures. For each case a single mammographic film which presented the abnormality was first digitized as described in Section VII, and the digitized mam- mogram was then enhanced using the region-based contrast enhancement method. For all enhancements, the tolerance for region growing was set at 0.05, the width of the background

105

104

103

lo2

10

1

(a) Image after unsharp masking

I I I

-0.2 -0.1 0 0.1 Contrast

0.2

(b) Contrast histogram

Fig. 8. 3 x 3 unsharp masking. (a) presents the portion of the enhanced mammogram corresponding to Fig. 4(a). (b) presents the contrast histogram of the complete enhanced mammogram.

was set to 3 pixels, and the enhancement curve used was that presented in Fig. 3. The digitized images were decimated for display to approximately 2048 x 1280 with 8 bit pixels. In each case, the original, digitized mammogram was first presented on the MegaScan 2111 monitor. The image occupied about 20 x 15 cm on the screen. An experienced radiologist (JELD), while viewing the digitized original, described the architectural abnormalities which he observed. Subsequently, the enhanced image was added to the display below the original image. While observing both the enhanced mammogram and the original mammogram together, the radiologist described any new details or features which became apparent to him.

Case 1) was that of a 62-year-old patient with a history of diffuse nodularity in both breasts. The mediolateral oblique (MLO) view of the left breast was digitized for assessment. The unenhanced mammogram revealed two separate nodular lesions: one with well-defined boundaries, with some indica- tion of lobular calcium; and the other smaller with poorly defined borders, some spiculation, but no microcalcifications. The unenhanced mammogram suggested that the smaller le- sion was most likely associated with carcinoma, however, there was some question about the origins of the larger

Page 12: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW et al.: REGION-BASED CONTRAST ENHANCEMENT OF MAMMOGRAMS

~

403

(a) Image after histogram equalization

lo6 I I I

105 I- - 104

103

lo2

10

1 -0.2 -0.1 0 0.1 0.2

Contrast (b) Contrast histogram

Fig. 9. Global histogram equalization was applied to the digitized mam- mogram from which Fig. 4(a) was taken. Only the portion corresponding to Fig. 4(a) is presented in (a). The contrast histogram for the complete enhanced mammogram is presented in @).

lesion. An examination of the enhanced mammogram revealed definite calcium deposits in the larger lesion and some indi- cation of microcalcifications in the smaller lesion. This image suggested carcinoma as the origin of both lesions much more strongly than the unenhanced mammogram. The biopsy report for both areas indicated intraductal infiltrating carcinoma, confirming the diagnosis from the enhanced mammogram (see Fig. 10).

Case 2) was that of a 64-year-old patient. The digitized original mammogram was the cranio-caudal (CC) view of the left breast. The unenhanced mammogram contained two lesions. The lesion in the lower outer part of the breast had irregular edges and coarse calcifications while the other lesion appeared to be a cyst. Examination of the unenhanced mam- mogram suggested that both lesions were benign. Examination of the enhanced mammogram revealed no additional details that would suggest a change in the original diagnosis. The appearance of the lesions was not far different from that seen in the unenhanced mammogram, however, the details in the internal architecture of the breast appeared clearer, adding further weight to the diagnosis of benign lesions. Excision

biopsies carried out at both sites confirmed this diagnosis. Case 3) was that of a 44-year-old female patient for

whom the MLO view of the left breast was digitized. The original digitized mammogram revealed multiple benign cysts as well as a spiculated mass in the upper outer quadrant of the breast. There was some evidence of calcium, but it was difficult to see. There was a dense nodule adjacent to the spiculated mass. Examination of the enhanced mammogram revealed that the spiculated mass did contain microcalcifications. The dense nodule appeared to be connected to the spiculated mass, suggesting a much further advanced carcinoma than that suspected from the unenhanced mammogram. Biopsy reports were available only for the spiculated region and indicated lobu- lar carcinoma. No further information was available to further verify the modified diagnosis from the enhanced mammogram.

Case 4) was that of a 40-year-old female patient whose mammograms indicated very dense breasts. Film of the right breast indicated an area of uniform density. The CC view of the right breast was digitized and enhanced. The digitized original mammogram indicated a cluster of microcalcifications, all of approximately uniform density, centrally located above the nipple. The enhanced mammogram indicated a similar finding with a larger number of microcalcifications visible and some irregularity in the density of the calcifications. Both the original and the enhanced mammograms suggested a similar diagnosis of intraductal carcinoma. The biopsy of this area confirmed this diagnosis.

Case 5) was that of a 64-year-old female patient with a history of a benign mass in her right breast. A digitized mammogram of the CC view of her right breast was examined. The unenhanced mammogram clearly showed numerous mi- crocalcifications that were roughly linear in distribution with some variation in density. The original mammogram clearly suggested intraductal carcinoma. The enhanced mammogram showed a greater number of calcifications, indicating a lesion of larger extent. The variation in the density of the calcium was more evident. A biopsy indicated an infiltrating ductal carcinoma.

Case 6) was that of a 59-year-old female patient whose right CC view was digitized. The original mammogram indicated a poorly defined mass with some spiculations. The lesion was irregular in shape and contained some calcium. The unenhanced mammogram suggested intraductal carcinoma. The enhanced mammogram provided stronger evidence of carcinoma with poor margins of the lesion, a greater number of microcalcifications, and inhomongeneity in the density of the calcium. The biopsy confirmed the presence of the carcinoma.

Case 7) involved the same female patient as in Case 6); however, the mammogram was taken one year later. The dig- itized mammogram was the CC view of the right breast. The unenhanced view showed significant architectural distortion due to a segmental mastectomy. The unenhanced mammogram showed an area extending past the scarred region of fairly uniform density with irregular boundaries. The unenhanced mammogram along with the patient’s history suggested the possibility of cancer and biopsy was recommended. The enhanced mammogram suggested a similar finding, with added

Page 13: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

:I I4 ! F L L TR:\SS.ACTIONS O N MEDICAL IMAGING. VOL 1 I. NO. 3. StPTEMBER I9Y2

(a)Original digitized mammogram (b)Enhanced mammogram

Fig. 10. Region-based contrast enhancement of a complete mammogram ( c a w number 1). Thc mammogram contains two dense ma \w\ U hich ‘ire hiops! proven cases of carcinoma. The enhancement allowed the radiologist to see ihc IrGons in more detail. Portions of this mammogram nerc uscd in Fig. 2 to demonstrate region growing. The images presented here were down-sampled io 102.1 x 512 pixels (from an original siLr or 4Wh x 3 1 1 X pixels) for printing with a Kodak XL7700 continuous tone printer

evidence of some small microcalcifications in the uniform area. A biopsy of the region showed that the mass was in fact a benign hematoma.

Case 8) was that of an 86-year-old female patient whose MLO view of the left breast was digitized. In the unenhanced mammogram, a dense region was observed with some spicula- tions. The mammogram suggested the possibility of carcinoma and biopsy was recommended. The enhanced mammogram showed the same detail as the unenhanced mammogram with the additional finding of some microcalcifications. This added to the suspicion of cancer. The biopsy of the region indicated intraductal invasive carcinoma with lymph node metastases present.

In each of these eight cases, the overall contrast in the en- hanced mammogram was significantly improved. This allowed the radiologist to comment that “much better overall anatom- ical detail” was apparent in the enhanced mammograms. He repeatedly observed that “overall detail (internal architecture) is improved” in the enhanced mammogram. In all cases. the radiological diagnosis was confirmed by biopsy. In 7 of the 8 cases, the enhanced mammogram added further weight to the diagnosis made from the unenhanced mammogram and

the diagnosis was confirmed by biopsy. In one case the en- hanced mammogram as well as the unenhanced mammogram suggested the possibility of carcinoma, however. the biopsy report indicated a benign condition. This case was, however, complicated by the fact that the patient history influenced the radiologist significantly. While i t is impossible to make a quantitative assessment of the differences in diagnoses from this type of a qualitative comparison, i t would appear that a clearer indication of the patient’s condition was obtained by examination of the enhanced mammogram. Detailed, objective evaluation of the diagnostic utility of the enhanced mammo- grams (such as receiver operating characteristics-ROC) with at least four views for each case is required. A larger number of mammograms for which the patient condition is known through biopsy must be used is such a study. This type of analysis is currently under way.

XI. CONCLUSION

This paper has shown the validity of using region-based contrast enhancement to process mammogram images. Using images digitized from mammograms in a radiology teaching

BEST COPY AVAILABLE

Page 14: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

MORROW et al.: REGION-BASED CONTRAST ENHANCEMENT OF MAMMOGRAMS 405

library, it has been shown that more anatomical detail is visible in an enhanced image using region-based methods than in the original image, and that no significant processing artifacts are introduced. The method has been shown to provide superior results, as measured by contrast histograms, when compared to other well-known techniques for enhancing IWdical images. The degree of contrast enhancement is easilv controllable.

[I11 W. M. Morrow and R. M. Rangayyan, “Adaptive neighborhood contrast enhancement on a parallel supercomputer,” in Proc. Supercomput. Symp. ’90, Montreal, Canada, June 4-6, 1990, pp. 329-334.

[12] w . M. M ~ ~ ~ w , “Region-based image processing with application to mammography,” M.Sc. thesis, Univ. Calgary, Calgary, Canada, 1990.

mammography,” AJR, vol. 140, pp. 9-14, 1983. [14] H. P. Chan, C. J. Vybomy, H. MacMahon, C. E. Metz, K. Doi, and E. A.

Sickles, “Digital mammography: ROC studies of the effects of pixel

[l31 M.B. McSweeneY, p. SPrawls, and R.L. Egan, ‘‘Enhanced image

Direct contrast enhancement, by keasuring the contrast of a region and then increasing it to form the output

size and unsharp-mask filtering on the detection of subtle microialci- fications,” Investigative Radiology, vol. 22, no. 7, pp. 581-589, July 1987 _ _ _ .

image, was shown to be effective in enhancing images contain- ing features of varying size and shape. A number of region- based analogues to fixed-neighborhood methods for histogram equalization and noise suppression have also been developed a n ~ are presented elsewhere [501. Region-based shape analysis of mammographic features is currently being investigated

[15] R. L. Smathers, E. Bush, J. Drace, M. Stevens, F. G. Sommer, B. W. Brown, and B. Kanas, “Mammographic microcalcifications: Detection with xerography, screen-film and digitized film display,” Radiology, vol. 159, no. 3, pp. 673-677, J~~~ 1986.

1161 F. Winsberg, M. Elkin, Jr. J. M a w V. Bordaz, and W. Weymouth, “De- tection of radiographic abnormalities in mammograms by means of opti- cal scanning and computer analysis,” Radiology, vol. 89, pp. 211-215, 1967.

and has shown some effectiveness in identifying malignancy- associated calcifications in mammogram images. In images of dense breasts, where the contrast between calcifications and breast tissue is low, the method has been shown to identify calcifications more clearly.

Further work is in progress to establish the utility of these techniques by ROC or other analysis of results of enhancement of large populations of mammograms, including the standard complement of four views per subject.

ACKNOWLEDGMENT

We acknowledge the assistance of Academic Computing Services of The University of Calgary. In particular, Dr. D. Phillips suggested the redundant seed pixel concept. The staff of Myrias Research Corporation, Edmonton, Alta., Canada, aided in implementing the algorithm on the Myrias SPS-2, and we thank them for their assistance.

REFERENCES

[ l ] Canadian Cancer Society, Facts on Breast Cancer, Apr. 1989, [2] E. A. Sickles, “Computed tomography scanning, transillumination, and

magnetic resonance imaging of the breast,” Recent Results in Cancer Research, vol. 105, pp. 31-36, 1987.

[3] L. W. Bassett and R. H. Gold, Eds., Mammography, Thermography, and Ultrasound in Breast Cancer Detection. New York: Grune and Stratton, 1982.

141 I. Anderson and B.F. Sigfusson, “Screening for breast cancer in Malmo: A randomized trial,” Recent Results in Cancer Research,

[5] L. Tabar, A. Gad, L. Holmberg, and U. Ljungquist, “Significant re- duction in advanced breast cancer: Results of the first seven years of mammography screening in Kopparberg, Sweden,” Diag. Imaging Clin. Med., vol. 54, pp. 158-164, 1985.

[6] E. A. Sickles, “Breast calcifications: Mammographic evaluation,” Radi-

[7] R. Gordon and R. M. Rangayyan, “Radiographic feature enhancement, information content, and dose reduction in mammography and cardiac angiograohv.” in Proc. IEEE Frontiers E m . Commit. Health Care,

vol. 105, pp. 62-66, 1987.

ology, vol. 160, 289-293, 1981.

- - . pp. 161-165, 1983.

181 R. Gordon and R. M. Rangavvan, “Feature enhancement of film mam- . 1 I ~~

mograms using fixed and adaptive neighborhoods,” Appl. Opt., vol. 23, no. 4, pp. 560-564, Feb. 1984.

[9] R. M. Rangayyan and H. N. Nguyen, “Pixel-independent image process- ing techniques for enhancement of features in mammograms,” in Proc. 8th IEEE Eng. Med. Biol. Conf, 1986, pp. 1113-1117.

[lo] -, “Pixel-independent image processing techniques for noise re- moval and feature enhancement,” in IEEE Pacific Rim Conf Commu., Comput., Signal Processing, IEEE, June 1987, pp. 81-84.

[17] J. L. Semmlow, A. Shadagopappan, L. V. Ackerman, W. Hand, and F. S. Alcorn, “A fully automated system for screening xeromammograms,” Comput. Biomed Res., vol. 13, pp. 350-362, 1980.

[18] C. Kimme, B. J. O’Loughlin, and J. Sklansky, Data Structures, Com- puter Graphics and Pattern Recognition. New York: Academic, 1977, Automatic detection of suspicious abnormalities in breast radiographs,

[19] S. Lai, X. Li, and W. F. Bischof, “On techniques for detecting circum- scribed masses in mammograms,” IEEE Trans. Med. Imaging, vol. 8, pp. 377-386, Dec. 1989.

[20] D. Brzakovic, X. M. Luo, and K. Brzakovic, “An approach to automated detection of tumors in mammograms,” IEEE Trans. Med. Imaging, vol. 9, pp. 233-241, Sept. 1990.

[21] W. Spiesberger, “Mammogram inspection by computer,” IEEE Trans. Biomed. Eng., vol. BME-26, pp. 213-219, Apr. 1979.

[22] W. G. Wee, M. Moskowitz, N. C. Chang, V. C. Ting, and S. Pemmeraju, “Evaluation of mammographic calcification using a computer program,” Radiology, vol. 116, pp. 717-720, 1975.

[23] H.P. Chan, K. Doi, S. Galhotra, C.J. Vybomy, H. MacMahon, and Peter M. Jokich, “Image feature analysis and computer-aided diagnosis in digital radiography. i. Automated detection of microcalcifications in mammography,” Med. Phys., vol. 14, no. 4, pp. 538-548, July/Aug. 1987.

[24] H.P. Chan, K. Doi, C.J. Vyborny, K.L. Lam, and R.A. Schmidt, “Computer-aided detection of microcalcifications in mammograms: Methodology and preliminary clinical study,” Investigative Radiology, vol. 23, no. 9, pp. 664-671, Sept. 1988.

[25] H. P. Chan, K. Doi, C. J. Vyborny, R. A. Schmidt, C. E. Metz, K. L. Lam, T. Ogura, Y. Wu, and H. MacMahon, “Improvement in radiologists’ de- tection of clustered microcalcifications on mammograms,” Investigative Radiology, vol. 25, no. 10, pp. 1102-1110, Oct. 1990.

1261 L. V. Ackerman and E. Gose, “Breast lesion classification by computer and xeroradiography,” Cancer, vol. 30, pp. 1025- 1035, 1972.

[27] L.V. Ackerman, A.N. Mucciardi, E.E. Gose, and F. S. Alcom, “Clas- sification of benign and malignant breast tumors on the basis of 36 radiographic properties,” Cancer, vol. 31, pp. 342-352, 1973.

[28] H. M. Cook and M. D. Fox, “Artificial intelligence applied to mammo- graphic image analysis,” in Electron. Imaging ’87 Con$, Boston, MA, Nov. 1987.

[29] E. L. Hall, Computer Image Processing and Recognition. New York Academic, 1979.

[30] R. C. Gonzalez and P. Wintz, Digital Image Processing. Reading, M A Addison-Wesley, 1987, 2nd ed.

[31] A. Rosenfeld and A.C. Kak, Digital Picture Processing, Volume 1. New York: Academic, 1982.

[32] S. M. Pizer, E. P. Amburn, D. D. Austin, R. Cromartie, A. Geselowitz, T. Geer, B. tar Haar Remeny, J.B. Zimmerman, and K. Zuiderveld, “Adaptive histogram equalization and its variations,’’ Comput. Viion, Graph. Image Processing, vol. 39, pp. 355-368, 1987.

[33] J. B. Zimmerman, S. M. Pizer, E.V. Staab, J. R. Perry, W. McCartney, and B.C. Brenton, “An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement,” IEEE Trans. Med Imaging, vol. 7, pp. 304-312, Dec. 1988.

[34] J.S. Lee, “Digital image enhancement and noise filtering by use of local statistics,’’ IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 165-168, Mar. 1980.

[35] P. M. Narendra and R. C. Fitch, “Real-time adaptive contrast enhancement,” IEEE Trans. Pattern Anal Machine InteII., vol. PAMI-3,

pp. 84-88.

Page 15: U of Mammograms - Computer Engineeringcvl/ese558/s2005/Reports/Tao...Locally adaptive histogram equalization performs histogram equalization independently over different segments of

IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 11, NO. 3, SEPTEMBER 1992

pp. 655-661, November 1981. J. Rogowska, K. Preston, and D. Sashin, “Evaluation of digital unsharp masking and local contrast stretching as applied to chest radiographs,” IEEE Trans. Biomed Eng., vol. 35, pp. 817-827, Oct. 1988. M. I. Sezan, A.M. Tekalp, and R. Schaetzing, “Automatic anatomically selective image enhancement in digital chest radiography,” IEEE Trans. Med Imaging, vol. 8, pp. 154-162, June 1989. J. S . DaPonte and M. D. Fox, “Enhancement of chest radiographs with gradient operators,” IEEE Trans. Med Imaging, vol. 7, pp. 109-117, June 1988. D. H. Ballard and C. M. Brown, Computer Iriion. Englewood Cliffs, NJ: Prentice-Hall, 1982. R. H. Johnson, A. C. Nelson, R. M. Haralick, and M. M. Goodsitt, “Op- timal information retrieval from complex low frequency backgrounds in medical images,” in IEEE Eng. Med Biology Soc. 11th Annu Conf,

A.P. Dhawan, E. Le Royer, and R. Gordon, “Adaptive neighborhood image processing for feature enhancement of mammograms,” in Proc. 8th Annu. Conf IEEE Eng. Med. Biology Soc., 1986, pp. 1096-1100. A. P. Dhawan, G. Buelloni, and R. Gordon, “Enhancement of mammo- graphic features by optimal adaptive neighborhood image processing,” IEEE Trans. Med. Imaging, vol. MI-5, pp. 8-15, Mar. 1986.

IEEE, 1989, pp. 384-385.

A. P. Dhawan and E. LeRoyer, “Mammographic feature enhancement by computerized image processing,” Comput. Methods Programs Biomed, vol. 27, no. 1, pp. 23-35, 1988. A. Beghdadi and A. Le Negate, “Contrast enhancement technique based on local detection of edges,” Comput. Viion, Graph. Image Processing,

W. M. Morrow and R. M. Rangayyan, “Feature-adaptive enhancement and analysis of high-resolution digitized mammograms,” in Proc. 12th IEEE Eng. Med Biology Conf, 1990, pp. 165-166. T. Pavlidis, Algorithms for Graphics andlmage Processing. Rockville, MD: Computer Science, 1982. J. D. Foley, A. van Dam, S . K. Feiner, and J. F. Hughes, Computer Graphics: Principles and Practice. Reading, MA: Addison-Wesley, 1990. P. Heckbert, Graphics Gems. G. R. Kuduvalli and R. M. Rangayyan, “Performance analysis of re- versible image compression techniques for high resolution digital tel- eradiology,” IEEE Trans. Med Imaging, see this issue, pp. Xxx-Xxx. R. B. Paranjape, W. M. Morrow, H. N. Nguyen, and R. M. Rangayyan, “Adaptive neighborhood image processing,” Appl. Opt., submitted for publication.

vol. 46, pp. 162-174, 1989.

New York: Academic, 1990.