13
Color image decomposition and restoration q Jean-Franc ¸ois Aujol a,1 , Sung Ha Kang b, * a Department of Mathematics, UCLA, 405 Hilgard Avenue, Los Angeles, CA 90095-1555, USA b Department of Mathematics, 715 Patterson Office Tower, University of Kentucky, Lexington, KY 40506, USA Received 8 December 2004; accepted 8 February 2005 Available online 30 March 2005 Abstract Meyer has recently introduced an image decomposition model to split an image into two components: a geometrical component and a texture (oscillatory) component. Inspired by his work, numerical models have been developed to carry out the decomposition of gray scale images. In this paper, we propose a decomposition algorithm for color images. We introduce a generaliza- tion of MeyerÕs G norm to RGB vectorial color images, and use Chromaticity and Brightness color model with total variation minimization. We illustrate our approach with numerical examples. Ó 2005 Elsevier Inc. All rights reserved. Keywords: Total variation; Structure; Texture; Color; Image decomposition; Image restoration 1. Introduction In [1], Meyer introduced an image decomposition model based on the Rudin– Osher–FatemiÕs total variation minimization (TV) model [2]. A given image f is sep- arated into f = u + v by minimizing the following functional, www.elsevier.com/locate/jvci J. Vis. Commun. Image R. 17 (2006) 916–928 1047-3203/$ - see front matter Ó 2005 Elsevier Inc. All rights reserved. doi:10.1016/j.jvcir.2005.02.001 q We acknowledge support by grants from the NSF under Contracts DMS-0312223, DMS-9973341, ACI-0072112, INT-0072863, the ONR under Contract N00014-03-1-0888, the NIH under Contract P20 MH65166, and the NIH Roadmap Initiative for Bioinformatics and Computational Biology U54 RR021813 funded by the NCRR, NCBC, and NIGMS. * Corresponding author. E-mail addresses: [email protected], [email protected] (J.-F. Aujol), [email protected] (S.H. Kang). 1 Present address: ENST paris, France.

Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

  • Upload
    vobao

  • View
    215

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

www.elsevier.com/locate/jvci

J. Vis. Commun. Image R. 17 (2006) 916–928

Color image decomposition and restoration q

Jean-Francois Aujol a,1, Sung Ha Kang b,*

a Department of Mathematics, UCLA, 405 Hilgard Avenue, Los Angeles, CA 90095-1555, USAb Department of Mathematics, 715 Patterson Office Tower, University of Kentucky,

Lexington, KY 40506, USA

Received 8 December 2004; accepted 8 February 2005Available online 30 March 2005

Abstract

Meyer has recently introduced an image decomposition model to split an image into twocomponents: a geometrical component and a texture (oscillatory) component. Inspired by hiswork, numerical models have been developed to carry out the decomposition of gray scale images.In this paper, we propose a decomposition algorithm for color images. We introduce a generaliza-tion of Meyer�s G norm to RGB vectorial color images, and use Chromaticity and Brightness colormodel with total variation minimization. We illustrate our approach with numerical examples.� 2005 Elsevier Inc. All rights reserved.

Keywords: Total variation; Structure; Texture; Color; Image decomposition; Image restoration

1. Introduction

In [1], Meyer introduced an image decomposition model based on the Rudin–Osher–Fatemi�s total variation minimization (TV) model [2]. A given image f is sep-arated into f = u + v by minimizing the following functional,

1047-3203/$ - see front matter � 2005 Elsevier Inc. All rights reserved.

doi:10.1016/j.jvcir.2005.02.001

q We acknowledge support by grants from the NSF under Contracts DMS-0312223, DMS-9973341,ACI-0072112, INT-0072863, the ONR under Contract N00014-03-1-0888, the NIH under Contract P20MH65166, and the NIH Roadmap Initiative for Bioinformatics and Computational Biology U54RR021813 funded by the NCRR, NCBC, and NIGMS.

* Corresponding author.E-mail addresses: [email protected], [email protected] (J.-F. Aujol), [email protected] (S.H. Kang).

1 Present address: ENST paris, France.

Page 2: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 917

infðu;vÞ2BV�G=f¼uþv

ZXjruj þ akvkG: ð1Þ

The first term is a TV minimization which reduces u as the bounded variation(BV) component of the original image f. It is well known that BV is well suited tomodel the structure component of f [2], which means the edges of f are in the BVcomponent u. The second term gives the v component containing the oscillatory partof the image, which is textures and noise. The Banach space G contains such signalswith large oscillations. A distribution v belongs to G if v can be written as

v ¼ o1g1 þ o2g2 ¼ DivðgÞ; g1; g2 2 L1:

The G-norm iviG in (1) is defined as the infimum of all kgkL1 ¼ supx2X j gðxÞ j,where v = Div (g) and jgðxÞj ¼

ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffijg1j

2 þ jg2j2

qðxÞ. Any function belonging to the space

G can present strong oscillations, nonetheless have a small norm [1,3].Meyer�s model (1) was first successfully implemented by Vese and Osher [4,5], by

considering the space Gp (X) = {v = Div (g) | g1,g2 2 Lp (X)} with kvkGp¼ inf

kffiffiffiffiffiffiffiffiffiffiffiffiffiffiffig2

1 þ g22

pkp. The authors minimized the energy with respect to u,g1, and g2, and

they solved the associated Euler–Lagrange equations. In [6], the authors used theH�1 norm instead of Meyer�s G norm. In addition, image decomposition modelwas applied to image inpainting problem in [7] to handle texture inpainting. A dif-ferent approach has been proposed in [8,9] by minimizing a convex functional whichdepends on the two variables u and v:

infu2BV ;kvkG6l

ZXjruj þ 1

2kkf � u� vk2

L2 : ð2Þ

In this paper, we follow the image decomposition model of [8]. We review thismethod in Section 2.1. More literature on image decomposition models can be foundin [3,10–14]. These decomposition models are mostly devoted to gray-scale images.In this paper, we propose a decomposition algorithm for color images.

There are various ways to deal with color images. For example, it can be treatedas 3D vectorial functions [15], as tensor products of different color components suchas Chromaticity and Brightness (CB) [15–18] or HSV nonlinear color models [16,19].Many related literature on color image models can be found at [20–23]. In this paper,we use 3D vectorial TV model [15], as well as Chromaticity and Brightness model. In[16], the authors showed that using Chromaticity and Brightness (CB) model gives abetter color control and detail recovery for color image denoising, compared tochannel by channel denoising or vectorial denoising. This CB model also providesa better color recovery compared to denoising HSV color system separately. Typi-cally color images are represented by red, green, and blue (RGB) color system,

u : X! R3þ ¼ fðr; g; bÞ : r; g; b > 0g:

In the CB model, u is separated into the Brightness component ub = iui, and theChromaticity component uc = u/iui = u/ub. The Brightness component ub can be trea-ted as a gray-scale image, while the Chromaticity component uc stores the colorinformation which takes values on the unit sphere S2.

Page 3: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

918 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

The main contribution of the paper is to propose a color image decompositionmodel using TV minimization for color images. This paper is organized as follows.In Section 2, we generalize Meyer�s definition to color textures through the theory ofconvex analysis, following the review of [8] in Section 2.1. We introduce a functionalwhose minimizers correspond to the color image decomposition, and we concludeSection 2 by presenting some mathematical results. In Section 3, we illustrate the de-tails of numerical computations, and present numerical examples. In Section 4, weconclude the paper with some final remarks.

2. Color decomposition model

Meyer has introduced the G norm to capture textures in a noise free image [1]. Theidea is that, while BV is a good space to model piecewise constant images, a space closeto the dual of BV is well suited to model oscillating patterns. However, the dual of BV isnot a separable space, and in [8], the authors considered the polar semi-norm associatedto the total variation semi-norm for such purpose. We first review this approach.

2.1. Review of an image decomposition model for gray-scale images

In [8], the authors introduced the following image decomposition model:

infu2BV ;kvkG6l

J 1DðuÞ þ1

2kkf � u� vk2

L2

� �;

where J1D (u) = �X|$u| is the scalar total variation of u. The parameter k controls theL2-norm of the residual f � u � v. The smaller k is, the smaller the L2-norm of theresidual gets. The bound l controls the G norm of the oscillating component v. Itis shown in [8] that solving (2) is equivalent to computing Meyer�s image decompo-sition (1). Let us denote by

lBG ¼ v 2 G such that kvkG 6 l� �

:

We recall that the Legendre–Fenchel transform of F is given by F �ðvÞ ¼ supu

ðhu; viL2 � F ðuÞÞ, where h:; :iL2 stands for the L2 inner product [24,25]. It is shown in[8] that

J �1D

vl

� �¼ vlBG

ðvÞ ¼0 if v 2 lBG;

þ1 otherwise:

Then, one can rewrite problem (2) above as

infðu;vÞ

J 1DðuÞ þ J �1D

vl

� �þ 1

2kkf � u� vk2

L2

� �: ð3Þ

This functional (3) can be minimized with respect to the two variables u and v

alternatively. First, fix u and solve for v which is the solution of infv2lBGif � u � vi2,

then fix v and solve for u which is the solution of infuðJ 1DðuÞ þ 12k kf � u� vk2Þ. In

[8], the authors use Chambolle�s projection algorithm [24] to compute the solutionof each minimization problem.

Page 4: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 919

2.2. Proposed model for color images

Let us first define J as the total variation for 3D vector

JðuÞ ¼Z

X

ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffij rurj2þ j rugj2þ j rubj2

q;

where r, g, and b stands for RGB channels. Let us denote by J* the Legendre–Fen-chel transform of J [26]. Then, since J is 1-homogeneous (that is J (ku) = kJ (u) forevery u and k > 0), it is a standard fact in convex analysis [24,25] that J* is the indi-cator function of a closed convex set K. We have

J �ðvÞ ¼ vKðvÞ ¼0 if v 2 K;

þ1 otherwise:

�ð4Þ

We define the ~G norm by setting

kvk~G ¼ inf l > 0 j v 2 lKf g ¼ inf l > 0 J �vl

� �¼ 0

� �

:

We use ~G notation for 3D G norm. Notice that in one dimensional, this definitionis exactly the same as Meyer�s original G norm [1], and this new definition is a naturalextension of Meyer�s to the color case. Here, K is quite a complicated set; however,the simplest characterization is that K = {v|J* (v) = 0}.

We now propose a functional to split a color image f into a bounded variationcomponent u and a texture component v

infuþv¼f

JðuÞ þ akvk~G� �

: ð5Þ

To derive a practical numerical scheme, we slightly modify this functional by add-ing a L2 residual

infu;v

JðuÞ þ 1

2kkf � u� vk2 þ J �

vl

� �� �: ð6Þ

We show the details of the relation between Eqs. (5) and (6) in Section 2.3. Here, k isto be small so that the residual f � u � v is negligible, and l controls the k � k~G norm of v.Since the functional (6) is convex, a natural way to handle the problem is to minimizethe functional with respect to each of the variable u and v alternatively, i.e.,

• First v being fixed, we search for u as a solution of:

infu

JðuÞ þ 1

2kkf � u� vk2

� �: ð7Þ

• Then, u being fixed, we search for v as a solution of:

infv2lKkf � u� vk2

: ð8Þ

To solve these two minimization problems, we use the dual approach to the oneused in [8]: we consider the direct total variation minimization approach. This will

Page 5: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

920 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

allow us to use total variation minimization algorithms devoted to color images [16].We cannot use the numerical approach of [8], since the projection algorithm of [24]only works for gray-scale images.

2.3. Mathematical analysis of our color image decomposition model

In this section, we only consider the discrete setting (for the sake of clarity),and present some mathematical results of the proposed functional. First, in thefollowing proposition, we show that (8) can be solved by using direct TVminimization.

Proposition 1. ~v is the solution of (8), if and only if, ~w ¼ f � u� ~v is the solution of:

infw

JðwÞ þ 1

2lkf � u� wk2

� �: ð9Þ

Proof. This is a classical convex analysis result [3,24]. Let us denote oH as the sub-differential of H (see [25,26]), and we recall that:

w 2 oHðuÞ () HðvÞP HðuÞ þ hw; v� uiL2 ; for all v in L2:

Here h:; :iL2 stands for the L2 inner product. First, we remark that ~v is the solution of(8) if and only if it minimizes

infvkf � u� vk2 þ J �

vl

� �� �; ð10Þ

since J* is defined by (4). Let ~v be the solution of (10). Then, as in [24,25], this isequivalent to ~vþ u� f 2 oJ �ð~vlÞ, which means ~v

l 2 oJð~vþ u� f Þ. Since ~w is definedas ~w ¼ f � u� ~v, we get 0 2 oJð~wÞ þ 1

l ð�f þ uþ ~wÞ, i.e., ~w is a solution of (8). h

We just showed that Eq. (8) can be solved by direct computation of TV minimi-zation (9). All the following lemma and propositions can be proved by straightfor-ward generalization of results in [8]; therefore, we refer readers to [8] for moredetails, and we omit the proofs in this paper.

Lemma 2. Problem (6) admits a unique solution ðu; vÞ.Outline of the proof. The existence of a solution comes from the convexity and thecoercivity of the functional [26]. For the uniqueness, we first remark that (6) isstrictly convex on BV · lK, except in the direction (u,�u) . Then, with simple com-putations, it can be shown that if ðu; vÞ is a minimizer of (6), then, for t „ 0,ðuþ tu; v� tuÞ is not a minimizer of (6). h

From Lemma 2, we know that problem (6) has a unique solution. To compute it, weconsider alternatively Eqs. (7) and (8). This means that we consider the following se-quence (un,vn): we set u0 = v0 = 0, define un+1 as the solution of infuðJðuÞ þ 1

2kkf � u� vnk2Þ, and vn+1 as the solution of infv 2 lKif�un+1�vi2. As a consequence ofLemma 2, we get the convergence of (un,vn) to the unique solution ðu; vÞ of (6).

Page 6: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 921

Proposition 3. The sequence (un,vn) converges to ðu; vÞ, the unique solution of problem

(6), when n fi +1.

From this result, we see that solving iteratively (7) and (8) amounts to solving (6).This justify the algorithm that we will propose in Section 3.1.

In Section 2.2, we claimed that solving (6) is a way to solve (5). To explain thisequivalence, we first introduce the following problem:

infuþv¼f

JðuÞ þ J �ðv=lÞð Þ: ð11Þ

The next result states the link between (5) and (11).

Proposition 4. For a fixed a > 0, let ðu; vÞ be a solution of problem (5). Then, if

l ¼ kvk~G in (11),

• ðu; vÞ is also a solution of problem (11).• Conversely, any solution ð~u;~vÞ of (11) (with l ¼ kvk~G) is a solution of (5).

This proposition says that (5) and (11) are equivalent. To close the link between(5) and (6), we check what happens when k goes to zero in problem (6). This is ex-plained in the following result.

Proposition 5. For a fixed a > 0 in (5), let a ¼ kvk~G in (6) and (11). Let ðukn ; vknÞ be the

solution of problem (6) with k = kn. Then, when kn goes to 0, any cluster point ofðukn ; vknÞ is a solution of problem (11).

All these results show that solving (7) and (8) iteratively is a way to solve problem(5): this is the theoretical justification of the decomposition algorithm that we willpropose in Section 3.1. In the following section, we detail the algorithm we use,and we show numerical examples to illustrate its efficiency.

3. Numerical experiments

For numerical computation for color image decomposition (5), we minimize thetwo functionals (7) and (9) alternatively. For the minimization, we compute theassociated Euler–Lagrange equations. Notice that the two functionals (7) and (9)are almost exactly the same as the classical TV minimizing functional [2]. There-fore, we can utilize all the benefits of well-known TV minimization techniques.Since we deal with color images, we use the results in [16] for color image denois-ing. In [16], the authors showed that Chromaticity and Brightness (CB) modelgives the best denoising results, compared to denosing RGB channel by channelseparately, denoising HSV channel by channel separately, or even vectorial colorTV [15].

For solving (7), we use the CB model for the BV component u, and we use colorTV for the texture component v by solving Eq. (9). This u component is the 3D RGBvector which is the structure component of the image. For u, we separate it into

Page 7: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

922 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

Chromaticity uc and Brightness ub components, and we denoise them with TV min-imization separately, i.e., u = uc · ub. We believe this is the best way to keep theedges sharp, and get a good BV component of the image, as in [16]. As for the texturecomponent v, we keep it as 3D RGB color vector and use color TV for denoising[15]. We could use the CB model for this v component as well; however, we keptit as one vector for the following three reasons. First of all, if color texture is onecomponent it is easier to control. Since the BV part u is already well kept by theCB model, the rest will also represents the texture well, and having one vector forv will be good enough and easy to handle. Second, by using color TV instead ofthe CB model, only one iteration is needed unlike two iterations in the CB model.Third, which is the main reason for our choice, it is better to introduce some rela-tions (coupled information) between the Chromaticity and Brightness componentsof u, and this is precisely what we do in the following algorithm.

3.1. Algorithm

(1) Initially we set, f = fo, u = fo, and v = 0 (fo is the original given image).(2) iterate m times:

(a) Separate u to Chromaticity uc and Brightness ub components. (Also, sepa-rate f = fc · fb and v = vc · vb to Chromaticity and Brightness component,respectively.)

(b) For the Chromaticity component uc, solve the Euler–Lagrange equation of(7) with vc and fc, and iterate k times:

unþ1 � un

Dt¼ r � run

jrunjþ 1

kðfc � un � vcÞ: ð12Þ

(c) For the Brightness component ub, solve the 1D version of (12) with vb andfb, and iterate k times.

(d) With updated uc and ub, let new u = uc · ub and w = f�u�v. Solve theEuler–Lagrange equation of (9) for w, and iterate k times

wnþ1 � wn

Dt¼ r � rwn

jrwnjþ 1

lðf � u� wnÞ:

(e) Update v = f � u � w.

(3) Stopping test: we stop if

maxðjunþ1 � unj; jvnþ1 � vnjÞ 6 �:

This algorithm decomposes a color image into f = u + v, where u is the structurecomponent of the image, and v is the color texture component of the image. As anumerical computation, we used digital TV filter [27] type computation for non-flat

TV denoising [16,28] as well as color TV [15] ru j¼ffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiP

a j ua � uj2 þ �2

qis used,

where ua is the four neighborhood of u(i,j) and � is to avoid the singularities. Fornumerical computational details, we refer readers to [16,27].

Page 8: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 923

3.2. Numerical experiments

For typical experiments, image intensity was between 0 and 1. We used totaliteration m = 5 and subiteration k = 30. For k, for Chromaticity we usedkc = 0.04, for Brightness kb = 0.01, and we used l = 0.1. All results are in color;please refer to [29].

The first two figures, Figs. 1 and 2, are image decomposition examples. From theoriginal image f in (A), f is separated into two components u in image (B) and v inimage (C). The texture part of the image, v clearly shows the color texture and thedetails of the images, while the u component captures the BV part of the image.

The second set of examples are applying image decomposition model to imagedenoising problems. In all our restoration examples, we have used a white Gaussiannoise with standard deviation r = 0.8, image values in each channel rank from 0 to 1

Fig. 1. (A) Original image f, (B) BV component u, and (C) texture v component (v + 0.5 plotted). Some ofof the thicker branches are in the BV part u, while the thin and narrow branches in the bottom middle arein the v component. u as well as v are both color images.

Fig. 2. (A) Original image f, (B) BV component u, and (C) texture v component (v + 0.5 plotted). All thedetails of image are in v, while the BV component is well kept in u.

Page 9: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

924 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

(this is equivalent to r = 204 for image intensity ranging from 0 to 255). In the fol-lowing three experiments, Figs. 3–5, we compared image decomposition model withCB denoising model [16] which is one of the best color image denoising models using

Page 10: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

Fig. 5. (a) Noisy original image f. (b) u, (c) CB denoising model [16]. In the second row: (b) v component(v + 0.5 plotted), and (c) is the residual of CB denoising model (f�CB result + 0.5 plotted).

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 925

TV minimization. The denoising results in the top raw are similar; however, in theresidual of the results (the v component), we see that image decomposition modelhave less edge information compared to the residual from CB denoising model. Inall the experiments presented, the parameters have been tuned so that we showthe best numerical results for both our color decomposition model as well as theCB denoising model. Notice that the CB denoising results displaid here are of thesame quality as the ones presented in the original paper [16].

The final example in Fig. 6 compares different numerical implementations of ourcolor image decomposition model (5). When we solve the two coupled Eqs. (7) and(9), we have many options. For example, we can treat both u and v as 3D vectors anduse color TV model (two iterations: one for u and one for v), as in image (a), or wecan treat both u and v with CB model and have four iterations (two sets of iterationsfor u and v each) as in image (c). In Fig. 6, we consider the noisy image displayed in

Fig. 3(a) Noisy original image f. (b) u, (c) CB denoising model [16]. In the second row: (b) v component(v + 0.5 plotted), and (c) is the residual of CB denoising model (f � CB result + 0.5 plotted).

Fig. 4(a) Noisy original image f. (b) u, (c) CB denoising model [16]. In the second row: (b) v component(v + 0.5 plotted), and (c) is the residual of CB denoising model (f � CB result + 0.5 plotted).

b

Page 11: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

Fig. 6. (a) Vectorial TV for both u and v. (b) Our model (CB for u and vectorial TV for v). (c) CB colormodel for both u and v. Top row images are v + 0.5. Second row images are Chromaticity component(vc plotted), and third row images are Brightness component (vb + 0.5 plotted). The original noisy image isdisplaid in Fig. 3.

926 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

Fig. 3. It shows the comparison between (a) using both color TV, (b) our model (CBmodel for u and vectorial TV for v), and (c) CB model for both u and v. The denoisedresults u are quite similar to each other; therefore, we only plot the noise v compo-nents (Top rows). Comparing (a) and (b), using CB model results in better color and

Page 12: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928 927

detail control as in [16], and v component looks better in (b). Comparing (b) and (c),the results are almost similar (top row (b) and (c)); nevertheless, there are some dif-ference. We separated v components to Chromaticity component vc ¼ v

kvk and Bright-ness component vb = ivi in second and third rows for better comparison (for image(c), vc and vb are given from the algorithm). Interesting points to notice are that, sincethe v component is coupled in our model (b), vc for (b) clearly only shows randomcolor noise, while vc for (c) have uniform regions of similar colors. It is more dra-matic for Brightness vb components: vb for (b) hardly contains any edges of the imagecompared to vb for (c).

4. Conclusion

In this paper, we have proposed a color image decomposition algorithm. We gen-eralize Meyer�s G norm [1]: we define the G norm as the polar semi norm associatedto the 3D total variation semi norm. Then we extend the approach of [8] to colorimages. To derive a powerfull algorithm, we use numerical frameworks of [16], theChromaticity and Brightness model, as well as vectorial TV model [15]. We presentmathematical analysis of our model as well as numerical experimental results. Ourmodel has outperformed some other classical approaches.

References

[1] Y. Meyer, Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: TheFifteenth Dean Jacqueline B. Lewis Memorial Lectures, University Lecture Series, vol. 22, AMS,Providence, 2001.

[2] L. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D60 (1992) 259–268.

[3] J.-F. Aujol, A. Chambolle, Dual norms and image decomposition models, Int. J. Comput. Vis. (2005)to appear.

[4] L. Vese, S. Osher, Modeling textures with total variation minimization and oscillating patterns inimage processing, J. Sci. Comput. 19 (1-3) (2003) 553–572.

[5] L. Vese, S. Osher, Image denoising and decomposition with total variation minimization andoscillatory functions, J. Math. Imaging Vis. 20 (2004) 7–18.

[6] S. Osher, A. Sole, L. Vese, Image decomposition and restoration using total variation minimizationand the H�1 norm, SIAM Multiscale Model. Simul. 1 (3) (2003) 349–370.

[7] M. Bertalmio, L. Vese, G. Sapiro, S. Osher, Simultaneous structure and texture image inpainting,IEEE Trans. Image Process. 12 (8) (2003) 882–889.

[8] J.-F. Aujol, G. Aubert, L. Blanc-Feraud, A. Chambolle, Image decomposition into a boundedvariation component and an oscillating component, J. Math. Imaging Vis. 22 (1) (2005).

[9] J.-F. Aujol, G. Aubert, L. Blanc-Feraud, A. Chambolle, Decomposing an image: application to SARimages, in: Scale-Space �03, Lecture Notes in Computer Science, vol. 2695, 2003, pp. 297–312.

[10] J. Bect, G. Aubert, L. Blanc-Feraud, A. Chambolle. A l1 unified variational framework for imagerestoration, in: ECCV 04, vol. 4, 2004, pp. 1–13.

[11] I. Daubechies, G. Teschke, Variational image restoration by means of wavelets: simultaneousdecomposition, deblurring and denoising, Appl. Comput. Harmonic Anal. (2004) submitted.

[12] J-L. Starck, M. ELad, D. Donoho, Image Decomposition Via the Combination of SparseRepresentation and a Variational Approach, IEEE Trans. Image Process. (2005) to appear.

Page 13: Color image decomposition and restoration q - u-bordeaux.frjaujol/HDR/A8.pdf · Color image decomposition and restorationq ... fix u and solve for v which is the solution of inf

928 J.-F. Aujol, S.H. Kang / J. Vis. Commun. Image R. 17 (2006) 916–928

[13] G. Aubert, J.-F. Aujol. Modeling very oscillating signals. Application to image processing, Appl.Math. Optimization. (2005) to appear.

[14] T. Le, L. Vese, Image Decomposition using total variation and dvi(BMO), UCLA CAM Report04-36, 2004.

[15] P.V. Blomgren, T.F. Chan, Color TV: total variation methods for restoration of vector valuedimages, IEEE Trans. Image Process. 7 (1998) 304–309.

[16] T.F. Chan, S.H. Kang, J. Shen, Total variation denoising and enhancement of color images based onthe CB and HSV color models, J. Vis. Commun. Image Rep. 12 (4) (2001) 422–435.

[17] G. Sapiro, Color snakes, Comput. Vis. Image Understand 68 (2) (1997) 247–253.[18] R. Kimmel, N. Sochen, Orientation diffusion or how to comb a porcupine? J. Vis. Commun. Image

Rep. 13 (2001) 238–248.[19] P. Perona, Orientation diffusion, IEEE Trans. Image Process. 7 (3) (1998) 457–467.[20] G. Sapiro, D. Ringach, Anisotropic diffusion of multivalued images with applications to color

filtering, IEEE Trans. Image Process. 5 (1996) 1582–1586.[21] B. Tang, G. Sapiro, V. Caselles, Color image enhancement via chromaticity diffusion, IEEE Trans.

Image Process. 10 (2001) 701–707.[22] P.E. Trahanias, D. Karako, A.N. Venetsanopoulos, Directional processing of color images: theory

and experimental results, IEEE Trans. Image Process. 5 (6) (1996) 868–880.[23] G. Aubert, P. Kornprobst, in: Mathematical Problems in Image Processing, Applied Mathematical

Sciences, vol. 147, Springer, Berlin, 2002.[24] A. Chambolle, An algorithm for total variation minimization and applications, J. Math. Imaging Vis.

20 (2004) 89–97.[25] I. Ekeland, R. Temam, Analyse convexe et problmes variationnels, Etudes Mathematiques, Dunod,

1974.[26] T. Rockafellar, Convex Analysis, Grundlehren der mathematischen Wissenschaften, vol. 224, second

ed., Princeton University Press, Princeton, NJ, 1983.[27] T.F. Chan, S. Osher, J. Shen, The digital TV filter and non-linear denoising, IEEE Trans. Image

Process. 10 (2) (2001) 231–241.[28] T.F. Chan, J. Shen, Variational restoration of non-flat image features: models and algorithms, SIAM

J. Appl. Math. 61 (4) (2000) 1338–1361.[29] J.-F. Aujol, S. Kang, Color image decomposition and restoration, UCLA CAM Report 04-73, 2004.