5
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 1 Rough Set Based Color Channel Selection Soumyabrata Dev, Student Member, IEEE, Florian M. Savoy, Associate Member, IEEE, Yee Hui Lee, Senior Member, IEEE, and Stefan Winkler, Senior Member, IEEE Abstract—Color channel selection is essential for accurate segmentation of sky and clouds in images obtained from ground- based sky cameras. Most prior works in cloud segmentation use threshold based methods on color channels selected in an ad-hoc manner. In this letter, we propose the use of rough sets for color channel selection in visible-light images. Our proposed approach assesses color channels with respect to their contribution for segmentation, and identifies the most effective ones. Index Terms—Color channel, rough set, Whole Sky Imagers (WSIs), cloud analysis. I. I NTRODUCTION G ROUND-BASED whole sky imagers (WSIs) are be- coming popular among the remote sensing community. They provide instantaneous data of cloud formations and are thus useful in a variety of applications [1]. WSIs complement satellite images with localized data of higher temporal and spatial resolution. They capture images of the sky at regular intervals and archive them for processing. Most WSIs use traditional cameras in the visible-light spectrum [2], while a few models capture the near-infrared range as well [3], [4]. Typical post-processing algorithms include the computation of the fraction of the sky covered by clouds [5], [6], the recognition of cloud types [7], or the estimation of the cloud base height [8]. A prerequisite for these applications is the segmentation of clouds from the sky, with each pixel of the image classified as either sky or cloud. As the sky is pre- dominantly blue because of Rayleigh scattering, most existing approaches use thresholding on an ad-hoc combination of red and blue color channels [9], [10]. Kreuter et al. [9] used a fixed threshold for the blue/red ratio. Calbó and Sabburg [11] use various statistical features (mean, standard deviation, entropy, etc.) obtained from red and blue channels for successful detection and subsequent labeling of pixels. The difference of red and blue channels is exploited in [12], [13]. The saturation channel of the HSV color model is used in [14]. Recently, Li et al. [10] proposed the use of a normalized red/blue ratio for cloud detection. We believe only a structured review of color channels allows us to systematically select the one(s) with the most discrimi- native cues. This helps to efficiently represent the images in a lower-dimensional subspace. Such systematic analysis of color channels for sky/cloud images is important for subsequent Manuscript received 01-Jul-2016; revised 03-Oct-2016; accepted 28-Oct- 2016. S. Dev and Y. H. Lee are with the School of Electrical and Elec- tronic Engineering, Nanyang Technological University, Singapore (e-mail: [email protected], [email protected]). F. M. Savoy and S. Winkler are with the Advanced Digital Sciences Center (ADSC), University of Illinois at Urbana-Champaign, Singapore (e- mail: [email protected], [email protected]). Send correspondence to S. Winkler, E-mail: [email protected]. tasks, such as cloud type recognition or feature matching in cloud base height estimation. An analysis of several color channels for sky/cloud segmentation is provided in our pre- vious works, where we used bimodality [15] and principal component analysis [6] to determine favorable channels. How- ever, these techniques had certain shortcomings with regards to ranking color channels according to their relevance for cloud segmentation, as their correlation with cloud segmentation accuracy is relatively weak. Several other techniques have been used for selecting the most discriminative features in a classi- fication problem. Serrano et al. [16] chose the area under the Receiver Operator Characteristic (ROC) curves [17] for feature selection in a synthetic dataset. Information-theoretic measures like Kullback-Leibler (KL) distance or divergence have been applied to band selection in hyperspectral imaging [18]. Our main contribution in this letter is to determine those color channels that are most discriminative in identifying cloud pixels in traditional visible-light images. We extend the benchmarking done in [15] using a rough set based approach that can accurately assess the efficiency of different color channels for cloud segmentation. 1 Rough set theory, originally introduced by Pawlak [19], is useful for representing uncertain data with a level of approximation, and selecting the most discriminative features from the feature space. Recently, it has been successfully applied to hyperspectral band selection [20]. To the best of our knowledge, our proposed approach is the first that uses rough set theory for color channel selection in visible-light images. The remaining letter is organized as follows. In Section II, we describe the fundamental concepts behind rough set theory and present our proposed color channel selection algorithm. Experimental results are presented in Section III. Finally, Section IV concludes the letter. II. ROUGH SET BASED COLOR CHANNEL SELECTION Classical rough sets [19] are an approximation of conven- tional sets in set theory. In a scenario where it is difficult to define the boundaries of a conventional set, rough set theory provides a set of mathematical tools to define them in a approximate way. It facilitates an objective analysis in a data-driven system which is vague, uncertain and incomplete. Here we first explain the related terminologies of rough sets, and subsequently define the use of rough sets for visible-light images. A. Rough Set Theory In rough sets, information is expressed in the form of a decision table. We define a decision table L such that each row 1 The source code of all simulations in this paper is available online at https://github.com/Soumyabrata/rough-sets. arXiv:1611.00931v1 [cs.CV] 3 Nov 2016

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

  • Upload
    others

  • View
    17

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 1

Rough Set Based Color Channel SelectionSoumyabrata Dev, Student Member, IEEE, Florian M. Savoy, Associate Member, IEEE,

Yee Hui Lee, Senior Member, IEEE, and Stefan Winkler, Senior Member, IEEE

Abstract—Color channel selection is essential for accuratesegmentation of sky and clouds in images obtained from ground-based sky cameras. Most prior works in cloud segmentation usethreshold based methods on color channels selected in an ad-hocmanner. In this letter, we propose the use of rough sets for colorchannel selection in visible-light images. Our proposed approachassesses color channels with respect to their contribution forsegmentation, and identifies the most effective ones.

Index Terms—Color channel, rough set, Whole Sky Imagers(WSIs), cloud analysis.

I. INTRODUCTION

GROUND-BASED whole sky imagers (WSIs) are be-coming popular among the remote sensing community.

They provide instantaneous data of cloud formations and arethus useful in a variety of applications [1]. WSIs complementsatellite images with localized data of higher temporal andspatial resolution. They capture images of the sky at regularintervals and archive them for processing. Most WSIs usetraditional cameras in the visible-light spectrum [2], while afew models capture the near-infrared range as well [3], [4].

Typical post-processing algorithms include the computationof the fraction of the sky covered by clouds [5], [6], therecognition of cloud types [7], or the estimation of the cloudbase height [8]. A prerequisite for these applications is thesegmentation of clouds from the sky, with each pixel of theimage classified as either sky or cloud. As the sky is pre-dominantly blue because of Rayleigh scattering, most existingapproaches use thresholding on an ad-hoc combination of redand blue color channels [9], [10]. Kreuter et al. [9] used a fixedthreshold for the blue/red ratio. Calbó and Sabburg [11] usevarious statistical features (mean, standard deviation, entropy,etc.) obtained from red and blue channels for successfuldetection and subsequent labeling of pixels. The difference ofred and blue channels is exploited in [12], [13]. The saturationchannel of the HSV color model is used in [14]. Recently, Liet al. [10] proposed the use of a normalized red/blue ratio forcloud detection.

We believe only a structured review of color channels allowsus to systematically select the one(s) with the most discrimi-native cues. This helps to efficiently represent the images in alower-dimensional subspace. Such systematic analysis of colorchannels for sky/cloud images is important for subsequent

Manuscript received 01-Jul-2016; revised 03-Oct-2016; accepted 28-Oct-2016.

S. Dev and Y. H. Lee are with the School of Electrical and Elec-tronic Engineering, Nanyang Technological University, Singapore (e-mail:[email protected], [email protected]).

F. M. Savoy and S. Winkler are with the Advanced Digital SciencesCenter (ADSC), University of Illinois at Urbana-Champaign, Singapore (e-mail: [email protected], [email protected]).

Send correspondence to S. Winkler, E-mail: [email protected].

tasks, such as cloud type recognition or feature matching incloud base height estimation. An analysis of several colorchannels for sky/cloud segmentation is provided in our pre-vious works, where we used bimodality [15] and principalcomponent analysis [6] to determine favorable channels. How-ever, these techniques had certain shortcomings with regards toranking color channels according to their relevance for cloudsegmentation, as their correlation with cloud segmentationaccuracy is relatively weak. Several other techniques have beenused for selecting the most discriminative features in a classi-fication problem. Serrano et al. [16] chose the area under theReceiver Operator Characteristic (ROC) curves [17] for featureselection in a synthetic dataset. Information-theoretic measureslike Kullback-Leibler (KL) distance or divergence have beenapplied to band selection in hyperspectral imaging [18].

Our main contribution in this letter is to determine thosecolor channels that are most discriminative in identifyingcloud pixels in traditional visible-light images. We extend thebenchmarking done in [15] using a rough set based approachthat can accurately assess the efficiency of different colorchannels for cloud segmentation.1 Rough set theory, originallyintroduced by Pawlak [19], is useful for representing uncertaindata with a level of approximation, and selecting the mostdiscriminative features from the feature space. Recently, it hasbeen successfully applied to hyperspectral band selection [20].To the best of our knowledge, our proposed approach is thefirst that uses rough set theory for color channel selection invisible-light images.

The remaining letter is organized as follows. In Section II,we describe the fundamental concepts behind rough set theoryand present our proposed color channel selection algorithm.Experimental results are presented in Section III. Finally,Section IV concludes the letter.

II. ROUGH SET BASED COLOR CHANNEL SELECTION

Classical rough sets [19] are an approximation of conven-tional sets in set theory. In a scenario where it is difficultto define the boundaries of a conventional set, rough settheory provides a set of mathematical tools to define themin a approximate way. It facilitates an objective analysis in adata-driven system which is vague, uncertain and incomplete.Here we first explain the related terminologies of rough sets,and subsequently define the use of rough sets for visible-lightimages.

A. Rough Set TheoryIn rough sets, information is expressed in the form of a

decision table. We define a decision table L such that each row1 The source code of all simulations in this paper is available online at

https://github.com/Soumyabrata/rough-sets.

arX

iv:1

611.

0093

1v1

[cs

.CV

] 3

Nov

201

6

Page 2: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 2

represents an observation, and each column is an attribute fromattribute set A. This non-empty set of observations is usuallyreferred to as the universe U . Formally, for each entry in thedecision table, we define the function f that maps attribute Ato value domain V , f : U ×A → V .

Any reduct P from the set of attributes A satisfies theindiscernibility (or equivalence) relation IND(P). For anyreduct P ∈ A, the P-indiscernibility relation is defined as:

IND(P) = {(xm, xn) ∈ U2|∀a ∈ P, f(xm, a) = f(xn, a)},(1)

where xm and xn are two observations from the universe U ,and a is an element from set P . This indicates that xm andxn are indiscernable based on the attribute P , as the valuefunction f assigns both xm and xn to the same value. Thispartition of U generated by IND(P) is denoted as:

U/IND(P) = {[xm]P |xm ∈ U}. (2)

Let X be a set of observations from the universe U .Rough set theory asks the question: how can we express thisconventional set X , using only the information in attributeset P? In general, there is no precise answer, and thereforeapproximations are generated. They are defined by their cor-responding P-lower- and P-upper-approximations as:

P(X ) = ∪{[xm]|[xm] ⊆ X}, (3a)

P(X ) = ∪{[xm]|[xm] ∩ X 6= φ}. (3b)

The observations in the lower approximation set P(X ) arethe definite members of X , also called the positive regionPOS(X ). On the other hand, P(X ) represents the upperapproximation of the set. It denotes the possible members ofX , based on the knowledge in the decision table. We illustratethis in Fig.1.

P(X )

X

P(X )

Fig. 1: Illustration of a typical rough set, which approximatesa conventional set X (depicted in blue). Each individual griddepicts a partition of the universe generated by an equiva-lence relation. The union of all such partitions indicated withsolid green borders (definite members) represents the lowerapproximation P(X ); while the dotted red borders (possiblemembers) represent the upper approximation P(X ).

Let us assume that the attribute set A consists of bothcondition and decision attributes C and D respectively, suchthat A = C ∪ D. The relevance criterion is defined as the

dependence between C and D, and can be expressed as:

γC(D) =|POSC(D)||U|

, (4)

where |·| denotes the cardinality of the set. This dependencevalue is an important measure to identify the most discriminateattribute from set A. The value of γC(D) ranges between 0and 1, where 0 indicates independence and 1 indicates D fullydepends on C.

B. Color Channel Selection Using Rough Sets

We now describe the problem of color channel selectionusing rough set terminology and propose our algorithm forthis purpose. The main benefit of using rough set theory is thatit provides a systematic method to approximate the segmen-tation ground truth, with the highest degree of approximation.Moreover, no prior information about the data is needed forthe analysis.

We consider 16 color channels in our analysis, as shown inTable I and illustrated in Fig. 2. They include RGB, HSV ,Y IQ, CIE L∗a∗b∗ color models, various red-blue combi-nations, and chroma C = max(R,G,B) − min(R,G,B).Several of these color channels are commonly used for thresh-olding in sky/cloud images [10], [14], [15]. We utilize roughset theory to identify the most informative color channel(s)(a.k.a. reducts) from these 16.

c1 R c4 H c7 Y c10 L∗ c13 R/B c16 Cc2 G c5 S c8 I c11 a∗ c14 R−Bc3 B c6 V c9 Q c12 b∗ c15

B−RB+R

TABLE I: Color spaces and components used for analysis.

Suppose that Ui is a non-empty finite universe of pixelobservations for a single sky/cloud image Ii from the imagedataset T = {I1, I2, . . . , IN}. The set of pixels correspondingto the ground-truth observation for an image Ii is Gi. We defineAi as the set of its corresponding vectorized color channels{c1, c2, . . . , c16} for a particular image Ii, along with thevectorized decision attribute gi. These 16 color channels arecalled condition attribute sets, and one ground truth vectorizedimage is the decision attribute set from the family of attributesAi.

We define a decision table Li such that each row representsa pixel, and each column represents an attribute. Thus, for asingle image Ii, the function f assigns a value vkji in the valuedomain to each variable-attribute pair (qk,aj), where qk is thek-th pixel value of the image and aj is the j-th attribute fromthe set Ai. For the sake of brevity, we will drop the index iin the subsequent discussions.

Our objective is to characterize the ground-truth image gfrom the knowledge of the reduct P . We define the reduct Pas the subset of condition attribute sets C.

We are interested in identifying the most discriminativecolor channel that is strongly dependent on the sky/clouddecision attribute g. This dependence on a particular colorchannel is measured by the corresponding relevance criterionof the color channels. Color channels with a high relevancevalue are better candidates for sky/cloud segmentation.

Page 3: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3

Input Image c1 c2 c3 c4 c5 c6 c7 c8

Ground Truth c9 c10 c11 c12 c13 c14 c15 c16

Fig. 2: Sample image and segmentation mask from the HYTA database [10], together with the 16 color channels from Table I(the color maps for c4, c5, c9, c15, and c16 are inverted such that cloud pixels always have a lighter shade than sky pixels).

In analogy to Eq. (4), we define the relevance criterion γjfor each color channel cj , which indicates the dependencebetween ground truth g and color channels:

γj =|POS(g)||U|

. (5)

For image Ii ∈ IRr×s, we generate the decision table Li ∈IRrs×17. Each row of the decision table Li corresponds to apixel. The first 16 columns represent the color channels, andthe 17th column corresponds to the ground truth label. Wegenerate 16 distinct partitions from this decision table usingthe knowledge of the ground truth labels. Subsequently, thecorresponding lower approximations of 16 color channels aregenerated using Eq. (3). In fact, this lower-approximation setis the union of all partitions (generated by the equivalencerelation) that are possible members of the cloud label. Next,we compute the relevance value γj of all color channels forthe image Ii using Eq. (5).

We perform this for all images of dataset T . Finally, wecompute the average relevance γj of each color channel acrossall the images. The color channel with the maximum averagerelevance value γj is the best amongst all color channels underconsideration.

III. EXPERIMENTS

A. Dataset

In order to check the efficacy of our proposed color channelselection algorithm, we conduct experiments on a publiclyavailable sky/cloud image database called HYTA [10]. It con-sists of 32 sky/cloud images with varying sky conditions, alongwith their corresponding segmentation masks (cf. Fig. 2). Theimages were collected by sky cameras located in Beijing andConghua, China.

B. Cloud Classification Performance

In this section, we evaluate the discriminative power of eachof the 16 color channels with respect to the cloud classificationtask. We target a single color channel for sky/cloud imagesegmentation, because in our previous work [6], [15] weobserved that there is no significant improvement when usinga combination of multiple color channels.

We follow a supervised learning approach and train a Sup-port Vector Machine (SVM) to validate our findings. We useeach of the 16 color channels separately as candidate feature

vectors and train 16 different SVMs. The trained SVMs arethen used for sky/cloud pixel classification in order to checkthe efficacy of respective color channels in the classificationtask. We randomly segregate the HYTA dataset into 15 trainingimages and 17 test images.

For an objective evaluation of our algorithm, we reportthe F-score and Accuracy. Suppose TP , FP , TN , and FNdenote the true positives, false positives, true negatives, andfalse negatives, respectively, in this binary classification task.Accuracy is defined as the ratio of pixels that are correctlyclassified, (TP + TN)/(TP + TN + FP + FN). The F-score, a popular metric in a binary classification problems, isdefined as the harmonic mean of Precision = TP/(TP+FP )and Recall = TP/(TP + FN).

Figure 3 shows the binary classification results for eachof the 16 color channels, computed over 50 different randomselections of training and test sets.

We observe from Fig. 3 that color channels c15 (B−RB+R ) andc5 (S) have relatively higher accuracy and smaller variationas compared to the other color channels. Conversely, colorchannels c11 (a∗) and c4 (H) score poorly in terms of accuracy.Therefore, each color channel has different discriminativepower to classify sky and cloud pixels from ground-basedimages. This ranking of color channels in terms of theirclassification performance serves as the ground-truth to verifythe efficacy of different color channel selection algorithms.

C. Benchmarking

In our proposed rough set based method, we measure thedependency of each color channel and report its correspondingaverage relevance value γ across all images of HYTA. Table IIsummarizes the results. We observe that certain color channelsviz. c15 (B−RB+R ), c13 (RB ), c5 (S) have higher relevance scoresas compared to others, making these color channels favorablecandidates for sky/cloud image segmentation. On the otherhand, color channels c11 (a∗) and c4 (H) have low relevancescores, indicating that these color channels contribute lessto the decision attribute for (non-) cloud pixels. Therefore,the latter color channels are not conducive for sky/cloudsegmentation.

We verify this by obtaining the correlation of the individualrelevance values of color channels with the sky/cloud segmen-tation results, and we benchmark our proposed rough set basedalgorithm with prior works on color channel selection [15].

Page 4: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 4

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

c1 c2 c3 c4 c5 c6 c7 c8 c9 c10 c11 c12 c13 c14 c15 c16

(a) Accuracy

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

c1 c2 c3 c4 c5 c6 c7 c8 c9 c10 c11 c12 c13 c14 c15 c16

(b) F-score

Fig. 3: (a) Accuracy and (b) F-scores for 16 color channels forall images in the HYTA database. For each box, the central redline indicates the median, the top and bottom edges correspondto 25th and 75th percentiles, and the whiskers represent theextreme data points.

c1 0.70 c4 0.46 c7 0.72 c10 0.66 c13 0.84 c16 0.66c2 0.66 c5 0.82 c8 0.78 c11 0.33 c14 0.69c3 0.58 c6 0.58 c9 0.69 c12 0.61 c15 0.84

TABLE II: Average relevance value across all images ofthe HYTA database. The most relevant color channels arehighlighted in bold.

As we are interested in a binary segmentation, color chan-nels exhibiting higher bimodal behavior are favorable. Pear-son’s Bimodality Index (PBI) [21] for all 16 color channelsis computed. A PBI value close to unity indicates highestbimodality, and values higher than 1 indicate departure frombimodal behavior.

Principal Component Analysis (PCA) is used to determinethe color channels that capture the highest variance. We

compute the absolute value of the loading factors, defined asthe re-projections of the data point on the principal componentaxes, for the 16 color channels, and consider the component onthe first principal component axis. Those color channels withhigh loading factors on the first eigenvector are consideredfavorable color channels.

We also compute the area under ROC curve individuallyfor the 16 color channels. A higher area under ROC curvefor a particular color channel indicates that its classifierperformance is better than the random classifier.

Lastly, the KL-divergence of the color channels from thebinary ground truth images is computed. This distance can beinterpreted as the amount of dissimilarity of the color channelfrom the ground truth. In other words, a higher distanceindicates an unfavorable color channel for cloud segmentation.

We check the correlation of the average accuracy scores forall the color channels with the normalized scores obtainedfrom different approaches. Table III shows the correlationcoefficients of these approaches with the average classificationaccuracy of the color channels. Our proposed method usingrough sets achieves the highest correlation.

Methods Correlation (r)Proposed approach 0.84 (↑)Bimodality −0.58 (↓)Loading factors 0.57 (↑)ROC curve 0.78 (↑)Kullback-Leibler divergence 0.12 (↓)

TABLE III: Correlation of cloud classification accuracy withranking scores obtained using different methods. The ↑ (or ↓)indicates if higher (or lower) magnitude signifies better per-formance.

Figure 4 shows the respective scatter plots. The correlationcoefficient is highest (r = 0.84) for our proposed algorithm.From Fig. 4(a), we can clearly see that color channels c5 (S)and c15 (B−RB+R ) are better candidates for sky/cloud classifica-tion. Similarly, color channels c11 and c4 with lower relevancescores are poor candidates. Figure 4(b) also reveals that c5and c15 are conducive color channels as their PBI values arecloser to 1. Similar results can be drawn from Fig. 4(c), wherefavorable color channels c5 and c15 have comparatively lowerKL-divergence values, and color channel c4 has the highestKL-distance. However, the order of ranking for the other colorchannels is poor, leading to a low correlation value (r = 0.12).

From these results, we observe that the relevance criterionhas the highest correlation with the cloud segmentation ac-curacy among all methods. Therefore we conclude that ourproposed rough set based color channel selection algorithm isuseful to rank color channels and identify suitable ones forimage segmentation. We also note that certain color channelsviz. c5 and c15 always perform best in all three benchmarkingmethods. Conversely, color channels c4 and c11 rank lowerthan others. Visual inspection of these color channels confirmsthese findings (cf. Fig. 2).

Page 5: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO ... · IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 3 Input Image c 1 2 3 4 5 6 7 8 Ground Truth c

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, VOL. XX, NO. XX, XX 2016 5

0 0.2 0.4 0.6 0.8 10.4

0.5

0.6

0.7

0.8

0.9

c1

c2

c3

c4

c5

c6

c7

c8

c9

c10

c11

c12

c13

c14

c15

c16

Normalized relevance score

Accura

cy [%

]

(a) Relevance

0 0.2 0.4 0.6 0.8 10.4

0.5

0.6

0.7

0.8

0.9

c1

c2

c3

c4

c5

c6

c7

c8 c

9c

10

c11

c12

c13

c14

c15

c16

Normalized bimodality score

Accu

racy [

%]

(b) Bimodality

0 0.2 0.4 0.6 0.8 10.4

0.5

0.6

0.7

0.8

0.9

c1

c2

c3

c4

c5

c6

c7

c8

c9

c10

c11

c12

c13

c14

c15

c16

Normalized Kullback−Leibler distance

Accu

racy [

%]

(c) Kullback-Leibler distance

Fig. 4: Scatter plot between average accuracy and (a) relevance (r = 0.84), (b) bimodality (r = −0.57), and (c) Kullback-Leibler distance (r = 0.12) for all 16 color channels (cf. Table III). Our proposed approach using relevance scores achievesthe highest correlation when ranking the color channels with respect to their segmentation performance.

IV. CONCLUSIONS

Sensing the earth’s atmosphere using ground-based visible-light images is popular because of its low cost and the hightemporal and spatial resolution of the captured images, ascompared to traditional satellite images. In this letter, wehave proposed a color channel selection algorithm based onrough set theory. Experimental results show the efficacy ofour approach in identifying favorable color channels for imagesegmentation. Our proposed approach outperforms other fea-ture selection algorithms. Future work involves the extensionof such rough set based approaches to other applications.

ACKNOWLEDGMENT

This work is supported by a grant from Singapore’s DefenceScience & Technology Agency (DSTA).

REFERENCES

[1] S. Dev, B. Wen, Y. H. Lee, and S. Winkler, “Ground-based imageanalysis: A tutorial on machine-learning techniques and applications,”IEEE Geoscience and Remote Sensing Magazine, vol. 4, no. 2, pp. 79–93, June 2016.

[2] S. Dev, F. M. Savoy, Y. H. Lee, and S. Winkler, “Design of low-cost, compact and weather-proof whole sky imagers for High-Dynamic-Range captures,” in Proc. International Geoscience and Remote SensingSymposium (IGARSS), 2015, pp. 5359–5362.

[3] E. Rumi, D. Kerr, J. M. Coupland, A. P. Sandford, and M. J. Brettle,“Automated cloud classification using a ground based infra-red cameraand texture analysis techniques,” in Proc. SPIE Remote Sensing ofClouds and the Atmosphere XVIII, 2013, vol. 8890.

[4] S. Dev, F. M. Savoy, Y. H. Lee, and S. Winkler, “WAHRSIS: A low-cost, high-resolution whole sky imager with near-infrared capabilities,”in Proc. IS&T/SPIE Infrared Imaging Systems, 2014, vol. 9071.

[5] Q. Li, W. Lu, J. Yang, and J. Z. Wang, “Thin cloud detection of all-skyimages using Markov random fields,” IEEE Geoscience and RemoteSensing Letters, vol. 9, no. 3, pp. 417–421, May 2012.

[6] S. Dev, Y. H. Lee, and S. Winkler, “Color-based segmentation ofsky/cloud images from ground-based cameras,” IEEE Journal ofSelected Topics in Applied Earth Observations and Remote Sensing,vol. PP, no. 99, pp. 1–12, 2016.

[7] S. Dev, Y. H. Lee, and S. Winkler, “Categorization of cloud imagepatches using an improved texton-based approach,” in Proc. Interna-tional Conference on Image Processing (ICIP), 2015, pp. 422–426.

[8] F. M. Savoy, J. Lemaitre, S. Dev, Y. H. Lee, and S. Winkler, “Cloud baseheight estimation using high-resolution whole sky imagers,” in Proc.International Geoscience and Remote Sensing Symposium (IGARSS),2015, pp. 1622–1625.

[9] A. Kreuter, M. Zangerl, M. Schwarzmann, and M. Blumthaler, “All-skyimaging: A simple, versatile system for atmospheric research,” AppliedOptics, vol. 48, no. 6, pp. 1091–1097, Feb. 2009.

[10] Q. Li, W. Lu, and J. Yang, “A hybrid thresholding algorithm for clouddetection on ground-based color images,” Journal of Atmospheric andOceanic Technology, vol. 28, no. 10, pp. 1286–1296, Oct. 2011.

[11] J. Calbó and J. Sabburg, “Feature extraction from whole-sky ground-based images for cloud-type recognition,” Journal of Atmospheric andOceanic Technology, vol. 25, no. 1, pp. 3–14, Jan. 2008.

[12] A. Heinle, A. Macke, and A. Srivastav, “Automatic cloud classificationof whole sky images,” Atmospheric Measurement Techniques, vol. 3,no. 3, pp. 557–567, 2010.

[13] S. Liu, L. Zhang, Z. Zhang, C. Wang, and B. Xiao, “Automatic clouddetection for all-sky images using superpixel segmentation,” IEEEGeoscience and Remote Sensing Letters, vol. 12, no. 2, pp. 354–358,Feb. 2015.

[14] M. P. Souza-Echer, E. B. Pereira, L. S. Bins, and M. A. R. Andrade,“A simple method for the assessment of the cloud cover state inhigh-latitude regions by a ground-based digital camera,” Journal ofAtmospheric and Oceanic Technology, vol. 23, no. 3, pp. 437–447,March 2006.

[15] S. Dev, Y. H. Lee, and S. Winkler, “Systematic study of color spacesand components for the segmentation of sky/cloud images,” in Proc.International Conference on Image Processing (ICIP), 2014, pp. 5102–5106.

[16] A. J. Serrano, E. Soria, J.D. Martin, R. Magdalena, and J. Gomez,“Feature selection using ROC curves on classification problems,” inProc. International Joint Conference on Neural Networks (IJCNN),2010.

[17] J. Kerekes, “Receiver operating characteristic curve confidence intervalsand regions,” IEEE Geoscience and Remote Sensing Letters, vol. 5, no.2, pp. 251–255, April 2008.

[18] A. Martínez-Usó, F. Pla, J. M. Sotoca, and P. García-Sevilla, “Clustering-based hyperspectral band selection using information measures,” IEEETransactions on Geoscience and Remote Sensing, vol. 45, no. 12, pp.4158–4171, Dec. 2007.

[19] Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning About Data,Kluwer Academic Publishers, 1992.

[20] S. Patra, P. Modi, and L. Bruzzone, “Hyperspectral band selection basedon rough set,” IEEE Transactions on Geoscience and Remote Sensing,vol. 53, no. 10, pp. 5495–5503, Oct. 2015.

[21] T. R. Knapp, “Bimodality revisited,” Journal of Modern AppliedStatistical Methods, vol. 6, no. 1, 2007.