8
EURASIP Journal on Applied Signal Processing 2003:5, 422–429 c 2003 Hindawi Publishing Corporation CT Image Reconstruction Approaches Applied to Time-Frequency Representation of Signals Jozef P ´ cik Department of Radio and Electronics, Faculty of Electrical Engineering and Information Technology, Slovak University of Technology in Bratislava, Ilkoviˇ cova 3, 81219 Bratislava, Slovak Republic Email: [email protected] Rami Oweis Biomedical Engineering Department, Faculty of Engineering, Jordan University of Science and Technology, Irbid 22110, Jordan Email: [email protected] Received 29 January 2002 and in revised form 22 October 2002 The mathematical formulation used in tomography has been successfully applied to time-frequency analysis, which represents an important “imaging modality” of the structure of signals. Based on the interrelation between CT and time-frequency analysis, new methods have been developed for the latter. In this paper, an original method for constructing the time-frequency representation of signals from the squared magnitudes of their fractional Fourier transforms is presented. The method uses α-norm minimization with α 1 which is motivated by R´ enyi entropy maximization. An iterative optimization method with adaptive estimation of the convergence parameter is elaborated. The proposed method exhibits advantages in the suppression of interference terms for signals with simple time-frequency configurations. Keywords and phrases: Radon-Wigner transform, Wigner distribution, fractional Fourier transform, R´ enyi entropy. 1. INTRODUCTION Time-frequency representation (TFR) [1] is an important tool for nonstationary signals and time-varying systems anal- ysis or synthesis. Constructing such a representation, clearly and accurately describing the energy distribution of the sig- nal over the time-frequency plane, is therefore of fundamen- tal importance. Prior to presenting the mathematical background of the proposed method, the concept of the time-frequency plane and the constrains imposed on the TFR in order to yield a reasonably accurate time-frequency description will be briefly reviewed. Continuous-time complex-valued deter- ministic signals with finite energy will be considered. In the time domain, a signal is completely described by a function s(t ) and its instantaneous power by |s(t )| 2 .A time-varying instantaneous frequency can be associated with the signal at each time t . By analogy, in the frequency do- main, the signal may be described by its Fourier transform (FT), and its energy distribution over frequency given by the Fourier transform squared. A concept dual to the instanta- neous frequency is the group delay, which characterizes the occurrence of a frequency component in time. The time-frequency representation TFR s (t,ω) charac- terizes the energy distribution of a signal over the time- frequency plane. As an energy distribution, this function should be nonnegative everywhere, analogous to the simul- taneous probability density function of a 2-dimensional ran- dom vector. The energy spectrum and the instantaneous power (which represent the marginal densities of the joint time-frequency distribution) should be obtained by integrat- ing the distribution along the time and frequency axes, re- spectively. This property, referred to as the time-frequency marginals, strongly influences the time-frequency resolution. These and many other properties (e.g., the first-order condi- tional moments which represent the instantaneous frequency and group delay) are generally accepted as desirable proper- ties of the TFR [2]. Unfortunately, no distribution can satisfy all these properties simultaneously. Although a notion of “ideal” time-frequency distribution has been mentioned in some works, the situation in time- frequency analysis is controversial and ideal time-frequency distribution cannot exist. Nowadays, various methods for time-frequency analysis are frequently published. Because infinite resolution cannot be achieved in both time and fre- quency simultaneously, various compromises have been pro- posed. The most commonly used techniques are Cohen class distributions which are briefly discussed in Section 2. Instead

CTImageReconstructionApproachesApplied toTime-FrequencyRepresentationofSignals · 2017. 8. 26. · amplitudes exceeding those of actual autocomponents. (In-terference structure of

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

  • EURASIP Journal on Applied Signal Processing 2003:5, 422–429c© 2003 Hindawi Publishing Corporation

    CT Image Reconstruction Approaches Appliedto Time-Frequency Representation of Signals

    Jozef PúčikDepartment of Radio and Electronics, Faculty of Electrical Engineering and Information Technology,Slovak University of Technology in Bratislava, Ilkovičova 3, 81219 Bratislava, Slovak RepublicEmail: [email protected]

    Rami OweisBiomedical Engineering Department, Faculty of Engineering, Jordan University of Science and Technology,Irbid 22110, JordanEmail: [email protected]

    Received 29 January 2002 and in revised form 22 October 2002

    The mathematical formulation used in tomography has been successfully applied to time-frequency analysis, which represents animportant “imaging modality” of the structure of signals. Based on the interrelation between CT and time-frequency analysis, newmethods have been developed for the latter. In this paper, an original method for constructing the time-frequency representationof signals from the squaredmagnitudes of their fractional Fourier transforms is presented. Themethod uses α-normminimizationwith α→ 1 which is motivated by Rényi entropy maximization. An iterative optimization method with adaptive estimation of theconvergence parameter is elaborated. The proposedmethod exhibits advantages in the suppression of interference terms for signalswith simple time-frequency configurations.

    Keywords and phrases: Radon-Wigner transform, Wigner distribution, fractional Fourier transform, Rényi entropy.

    1. INTRODUCTION

    Time-frequency representation (TFR) [1] is an importanttool for nonstationary signals and time-varying systems anal-ysis or synthesis. Constructing such a representation, clearlyand accurately describing the energy distribution of the sig-nal over the time-frequency plane, is therefore of fundamen-tal importance.

    Prior to presenting the mathematical background of theproposed method, the concept of the time-frequency planeand the constrains imposed on the TFR in order to yielda reasonably accurate time-frequency description will bebriefly reviewed. Continuous-time complex-valued deter-ministic signals with finite energy will be considered.

    In the time domain, a signal is completely described bya function s(t) and its instantaneous power by |s(t)|2. Atime-varying instantaneous frequency can be associated withthe signal at each time t. By analogy, in the frequency do-main, the signal may be described by its Fourier transform(FT), and its energy distribution over frequency given by theFourier transform squared. A concept dual to the instanta-neous frequency is the group delay, which characterizes theoccurrence of a frequency component in time.

    The time-frequency representation TFRs(t, ω) charac-

    terizes the energy distribution of a signal over the time-frequency plane. As an energy distribution, this functionshould be nonnegative everywhere, analogous to the simul-taneous probability density function of a 2-dimensional ran-dom vector. The energy spectrum and the instantaneouspower (which represent the marginal densities of the jointtime-frequency distribution) should be obtained by integrat-ing the distribution along the time and frequency axes, re-spectively. This property, referred to as the time-frequencymarginals, strongly influences the time-frequency resolution.These and many other properties (e.g., the first-order condi-tional moments which represent the instantaneous frequencyand group delay) are generally accepted as desirable proper-ties of the TFR [2]. Unfortunately, no distribution can satisfyall these properties simultaneously.

    Although a notion of “ideal” time-frequency distributionhas been mentioned in some works, the situation in time-frequency analysis is controversial and ideal time-frequencydistribution cannot exist. Nowadays, various methods fortime-frequency analysis are frequently published. Becauseinfinite resolution cannot be achieved in both time and fre-quency simultaneously, various compromises have been pro-posed. The most commonly used techniques are Cohen classdistributions which are briefly discussed in Section 2. Instead

    mailto:[email protected]:[email protected]

  • CT Image Reconstruction Approaches Applied to Time-Frequency Representation of Signals 423

    of directly transforming a time-domain function by inte-gration to yield a time-frequency representation, a generaltechnique is proposed to constructTFRs indirectly to satisfycertain predetermined criteria such as maximum entropy.This paper applies this technique to the case of generalizedmarginals (Section 3).

    The main part of this paper (Section 4) is devoted to nu-merical methods for reconstruction of a TFR from an incom-plete set of fractional Fourier transforms (FrFT) by means ofoptimization techniques. Since Shannon entropy maximiza-tionmethod cannot be used generally due to the nonnegativ-ity requirement, Rényi entropy is chosen as an alternative re-construction functional. A gradient-based method (derivedby the technique of Lagrange multipliers) with adaptive esti-mation of a convergence parameter is developed and appliedto various signals (Section 5).

    2. COHEN CLASS

    The Wigner (Wigner-Ville) distribution (WD) [1, 3] is aprincipal representative of distributions which describe thetime-frequency energy distribution; the WD is defined as theFT of the instantaneous autocorrelation function

    rs(t, τ) = s(t +

    τ

    2

    )s∗(t − τ

    2

    )(1)

    (where ∗ denotes complex conjugation), that is,

    WDs(t, ω) =∫rs(t, τ) e− jωτ dτ. (2)

    The WD is a real-valued function, often assuming negativevalues. WD-based analysis results in an intuitive interpreta-tion only for certain types of signals (namely, linear chirpsand Dirac pulses in either the time or frequency domain).The analyzed signal is usually considered to be a composi-tion of signals with simple TFR, called components. In gen-eral, due to the nonlinearity of the WD, interference terms(cross-terms) may result, such as intercomponent interfer-ence and internal interference in the case of nonlinear fre-quency modulation [1]. These undesirable terms can haveamplitudes exceeding those of actual autocomponents. (In-terference structure of WD reflects also phase shift betweencomponents that can be of interest in some application, butphase relations cannot be simply identified in WD image.)Due to these phenomena, a smoothing filter is applied to theresult of the WD in order to suppress interference and noise.

    The WD (possibly followed by linear, time-invariant fil-tering) has two noteworthy features: the order of nonlin-earity is quadratic and the resulting distributions are time-frequency shift covariants. Such distributions have been uni-fied by Cohen. The general form of the shift-covariant distri-butions is given by [4]

    C(φ)s (t, ω) = 1

    ∫ ∫ ∫φ(θ, τ)rs(t′, τ) e− jωτ− jθt+ jθt

    ′dθ dτ dt′,

    (3)where φ denotes the distribution kernel.

    3. RADON-WIGNER TRANSFORM

    3.1. Time-frequencymarginals

    The instantaneous power and the energy spectrum are con-sidered as desired densities over time and frequency, re-spectively. The representation TFRs(t, ω) satisfies the above-mentioned marginal property if the univariate densities de-termined by the integration of a joint density function alongt and ω variables fulfill the following relations:

    12π

    ∫TFRs(t, ω)dω =

    ∣∣s(t)∣∣2,12π

    ∫TFRs(t, ω)dt =

    ∣∣S(ω)∣∣2, (4)where S(ω) denotes the unitary version of the Fourier trans-form

    S(ω) = 1√2π

    ∫s(t) e− jωt dt. (5)

    Cohen and Posch [5] have shown that nonnegative-valued distributions with correct marginals exist; minimiz-ing cross-entropy is an attractive method for constructingnonnegative distributions [6]. This method yields a solu-tion which may be written as a product of three functions,namely, prior distribution function, time-dependent func-tion, and frequency-dependent function. In practical appli-cations, this separability simplifies the mathematical deriva-tion and decreases the computational complexity, but un-fortunately the solution obtained is not sufficiently generalto express complex TFR. This drawback arises mainly in thecase of uniform prior distribution and can be compensatedby imposing additional constraints based on FrFT and lineintegrals along paths not parallel to either the time or fre-quency axes [7].

    3.2. Fractional Fourier transform (FrFT)

    The conventional marginals (4) may be viewed as specificcases (ϕ = 0 or π/2) of the generalized marginals, expressedas [8]

    12πRϕ{TFRs(t, ω)

    }(u) = ∣∣Sϕ(u)∣∣2, (6)

    where Rϕ denotes the Radon transform operator, ϕ is therotation angle of the time-frequency plane, and Sϕ(u) is theFrFT of s(t). The existence of such a TFR satisfying (6) is ob-vious as a consequence of the well-known Fourier-slice the-orem. The geometrical interpretation of the rotation angleϕ depends on the used time and frequency unit. To avoidthis ambiguity, a time-scaled signal sa(x) = a1/2s(ax), as afunction of the dimensionless time-variable x, may be usedinstead of s(t). The FT of sa(x) (with respect to the vari-able x) is Sa(y) = a−1/2S(a−1y), where y is the dimension-less angular frequency. The common choice for the scalingfactor a is a = (tm/ωm)1/2 provided that intervals (−tm, tm)and (−ωm,ωm) represent the time and frequency supports ofthe signal [9]. This particular option reshapes the rectangulartime-frequency support into a square-shaped region.

  • 424 EURASIP Journal on Applied Signal Processing

    The FrFT is a unitary transformation defined as [10]

    Sϕ(u) = Fϕ{s(t)}(u) =

    ∫s(t)Bϕ(t, u)dt, (7)

    where Bϕ(t, u) is the following transform kernel:

    Bϕ(t, u)

    =

    δ(t − u), ϕ = 0,δ(t + u), ϕ = ±π,e j[ϕ/2−(π/4) sgn(ϕ)]√

    2π| sinϕ|e j((u

    2+t2)/2) cotϕ−jut cscϕ, ϕ∈(−π, 0)∪(0, π),

    Bϕ±2nπ(t, u), |ϕ| > π, n ∈ Z.(8)

    Note that the FrFT incorporates the identity (S0(u) = s(u))and the ordinary FT (5) (Sπ/2(u) = S(u)) as specific cases of(7) for ϕ = 0 and ϕ = π/2, respectively. The FrFT effectivelyresults in a rotation of the time-frequency plane; it is easy toshow that the inverse transform kernel B∗ϕ (t, u) is the eigen-function of the time-frequency operator

    û = t̂ cosϕ + ω̂ sinϕ, (9)

    where ω̂ = (1/ j)(∂/∂t) and t̂ = t, likewise, the inverse FTkernel e jωt is the eigenfunction of the frequency operator ω̂.Mean values (first- and second-order moments) of the oper-ator û characterize the average location and the spread of thesignal in the time-frequency plane with respect to the linest cosϕ + ω sinϕ = const. In general, the inverse of the FrFTis a decomposition of a signal using an orthonormal basisof linearly frequency-modulated functions. The linear fre-quency modulation may be recognized in FrFT kernel as aquadratic-phase term; other terms ensure unitarity and an-gle additivity properties of the transform [8].

    3.3. Reconstruction ofWD

    The WD as specific case of TFR satisfies generalised mar-ginals (6) for all angles ϕ ∈ 〈0, π) [8]. Magnitude-squaredFrFT is then referred to as the Radon-Wigner transform ofsignal s(t). As derived originally by J. Radon, a function oftwo variables (such as an image) may be uniquely recon-structed from a full set of its line integrals. Specifically, theWD may be computed from the squared magnitude of theFrFT mWDs(u, ϕ) = 2π|Sϕ(u)|2 of the signal by the followinginversion formula:

    WDs(t, ω) = 14π2∫ π0

    ∫ −∞−∞

    ∫∞−∞

    mWDs(u, ϕ) e− juρ

    × e jρ(t cosϕ+ω sinϕ) |ρ|dudρ dϕ.(10)

    Computation of (10) is usually divided into several steps, thearrangement of which results in various techniques for theTFR construction. One such technique, that is commonlyused, is the filtered back-projection method. In practice, thefiltering, which is equivalent to differentiation followed by

    Hilbert transformation, usually involves additional smooth-ing and spectral limiting. The additional filter transfer func-tion G(ρ, ϕ) can be interpreted as the Cohen class kernelφ(θ, τ) expressed in polar coordinates. This approach is un-suitable in terms of computational efficiency compared toconventional procedures for computation of the Cohen dis-tribution, which use Cartesian time-frequency coordinates.However, using polar coordinate kernels simplifies the for-mulation of generalized marginal consistency conditions.Conditions for other properties can also be reformulatedfor the filter transfer function G(ρ, ϕ) instead of the φ(θ, τ)kernel.

    4. ITERATIVE RECONSTRUCTIONOF THE TFR

    As discussed in Section 3.3, filtered back-projection ap-proach in the time-frequency representation results in Cohenclass distributions. Since these distributions offer a trade-offbetween the cross-terms suppression and the autocompo-nent resolution, we will consider an optimization-based in-version from small number of projections as an alternativeto the direct linear methods. The constraint imposed is thatthe generalized marginals (6) are correct for several anglesϕ1, . . . , ϕM , that is,

    Ri{T(t, ω)

    }(u) = mi(u), i = 1, . . . ,M, (11)

    where T is to be reconstructed andmi(u) = 2π|Sϕi(u)|2.The constraint of correct marginals when combined with

    optimization procedures (e.g., least squares method, entropymaximization, and cross-entropy minimization) provides atool for time-frequency distribution construction [6, 7, 11,12]. In the case of Shannon entropy maximization with gen-eralized marginals as constraints, Lagrange multipliers tech-nique with nonlinear Gauss-Seidel-type iteration proceduremay be advantageously used [13]. In this particular method,Lagrange multipliers are repeatedly and successively updatedfor i = 1, . . . ,M to satisfy (11); only one marginal is assumedto be exactly correct in each iteration. The iteration proce-dure converges provided that a nonnegative solution exists.

    Unfortunately, Shannon-entropy-based methods mayfail because the nonnegative TFR with correct marginals maynot exist. For this reason, the application of an adapted Rényientropy seems to be more suitable for TFR reconstruction.

    4.1. Rényi entropy of TFR

    The Rényi entropy [14] is a generalization of the Shannonentropy, which is defined for the discrete probability functionp = {p1, . . . , pN} as

    H(p) = −N∑i=1

    pi log2 pi. (12)

    Roughly spoken, Shannon entropy is a weighted arithmeticmean of the individual components− log2 pi with weights pi.

  • CT Image Reconstruction Approaches Applied to Time-Frequency Representation of Signals 425

    This arithmetic mean may be further generalized by defininga continuous monotonic function f (x) to give

    f −1( N∑

    i=1pi f(− log2 pi)

    ). (13)

    Choosing f (x) = 2(1−α)x, where α represents the order ofRényi entropy (instead of f (x) = ax + b in the case of anarithmetic mean), corresponds to the Rényi entropy of orderα,

    H(α)R (p) =1

    1− α log2( N∑

    i=1pαi

    ). (14)

    Rényi entropy retains most of the basic properties of Shan-non entropy [14, 15]. Moreover, as α approaches 1, Rényientropy reduces to Shannon entropy. Since in many applica-tions Shannon entropy maximization yields excellent results,this in turn will be of great help in determining the properorder α.

    Extending (14) to bivariate continuous functions yieldsthe Rényi entropy of the TFR, which has the form

    H(α)R(TFRs

    ) = 11− α log2

    (∫ ∫ (TFRs(t, ω)

    2πEs

    )αdt dω

    ),

    (15)

    where the signal energy Es, given by

    Es = 12π∫ ∫

    TFRs(t, ω)dt dω, (16)

    normalizes the TFRs.Regardless of the probability distribution interpretation

    of TFR, negative values for integer orders α may be for-mally accepted in (15) provided that the integral argumentalso in (15) yields positive value. In the context of time-

    frequency analysis,H(α)R (TFRs) has been proposed in [16, 17]to measure signal complexity interpreted as a number of sig-nal components. For this purpose, the order α equal to threehas been preferred in [16] since the argument of the loga-rithm in (15) takes on nonpositive values only exceptionally,and the cross-components contributions to this term asymp-totically vanish. In this paper, a maximization of Rényi en-tropy for a noninteger α close to 1, namely, in the range(1, 2), is considered. Since αth power, as a real-valued func-tion, does not allow negative values, absolute values will beused, consequently, the HR maximization is reduced to α-norm minimization. This simple modification ensures con-vexity of the resulting objective functional. The convexity is avaluable property in optimization procedures, and in the caseof Shannon entropy, it cannot be achieved by replacing neg-ative values with its absolute values. It should be noted thatthe special case of α = 2 is equivalent to the minimum Eu-clidean norm solution, which can be obtained iteratively oranalytically (the latter in the case of circular support [18]).An iterative procedure for α ∈ (1, 2) is presented below.

    4.2. Algorithm description

    Optimization may be formulated as minimization of the fol-lowing convex functional:∫ ∫

    D

    ∣∣T(t, ω)∣∣αdt dω (17)over a predefined area of supportD subject to the generalizedmarginals (11) for a set of angles ϕ1, . . . , ϕM . The constrainedoptimization problem can be solved by the method of theLagrange multipliers. The Lagrangian in this case may thenbe written as

    L(T, λ1, . . . , λM

    )= 1α

    ∫ ∫D

    ∣∣T(t, ω)∣∣αdt dω−

    M∑i=1

    ∫Diλi(u)

    [Ri{T(t, ω)}(u)−mi(u)]du= 1α

    ∫ ∫D

    ∣∣T(t, ω)∣∣α− M∑i=1

    λi(t cosϕi+ω sinϕi

    )T(t, ω)dt dω

    +M∑i=1

    ∫Diλi(u)mi(u)du.

    (18)

    For notational convenience, a back-projection operator Bi,projecting the Lagrange multipliers back to the support ofthe TFR, is introduced. So,

    Bi{λi(u)

    }(t, ω) = λi

    (t cosϕi + ω sinϕi

    ). (19)

    Variation of (18) with respect to T and then setting the resultof variation to be zero yield an expression for TFR in termsof Lagrange multipliers

    T(t, ω)

    =∣∣∣∣∣

    M∑i=1Bi{λi(u)

    }(t, ω)

    ∣∣∣∣∣1/(α−1)

    sgn

    [ M∑i=1Bi{λi(u)

    }(t, ω)

    ].

    (20)

    Substituting (20) into (18) yields the dual Lagrangian

    L̃(λ1, . . . , λM

    ) = 1− αα

    ∫ ∫ ∣∣∣∣∣M∑i=1Biλi

    ∣∣∣∣∣α/(α−1)

    +∫ M∑

    i=1piλi,

    (21)

    where the formal arguments of the functions of t, ω, and uhave been omitted and integration is performed over the cor-responding support regions D and Di.

    This dual Lagrangian is clearly a concave functional (forα > 1). The solution involves finding the nonconstrainedmaximum of the dual Lagrangian as a functional in termsof Lagrange multipliers, for which an iterative algorithm hasbeen developed. In each iteration, the Lagrange multipliersare updated according to the following formula, whichmakesuse of a convergence parameter µn that must be estimated

  • 426 EURASIP Journal on Applied Signal Processing

    separately,

    λ(n+1)(u) = λ(n)(u)− µne(λ(n)(u)

    ), (22)

    where λ(n+1)(u) = [λ(n)1 , . . . , λ(n)M ]T , and

    e = [e1, . . . , eM]T , ei = RiT(n) −mi, (23)represents the error of the marginals of (11) in the nth iter-ation. The convergence parameter µn may be estimated (seethe appendix) as

    µn ≈ 2(α− 1)M

    maxi,u

    Ri∣∣∣∣∣

    M∑j=1B jλ(n)j

    ∣∣∣∣∣(2−α)/(α−1) (u)

    −1

    .

    (24)In the finite-dimensional case, the recursion (22) may beviewed as an adaptive, gradient-based (steepest-ascent) max-imization of the dual Lagrangian (21).

    5. DISCUSSION

    The performance of the method has been characterized forseveral types of signals; results for single-component signal,multicomponent signal, and signal with nonlinear frequencymodulation are presented. Discrete-time signals have beennumerically synthesized; number of samples and samplingfrequency determine the time and frequency supports of sig-nals. With regard to the appropriate time scaling described inSection 3.2, optimization procedure has been performed ona square-shaped support with the well-defined rotation an-gles. Results of the analysis are presented graphically in Fig-ures 1, 2, 3, and 4, where, for convenience, the time axis islabeled in samples and the frequency is normalized, with thevalue one corresponding to half the Nyquist frequency.

    In the case ofmonocomponent signals, no significant dif-ferences were found compared to theWD result. As an exam-ple, a 101-sample linear frequency-modulated signal with aGaussian amplitude envelope (the so-called “time-frequencyatom”) is used. The result of reconstructing a TFR for α = 1.1and α = 1.9 for five uniformly distributed angles (0◦, 36◦,72◦, 108◦, 144◦) is depicted in Figure 1. In this figure, the ef-fect of the Rényi entropy order α can be seen. As α approaches1, the TFR approaches the maximum Shannon entropy solu-tion which in most cases is identical to the WD result.

    Whereas in the case of monocomponent signals, notice-able differences were not expected between the proposedmethod and theWD result, the situation is different for mul-ticomponent signals. The next example demonstrates that,for signals with trivial time-frequency distributions, both thesuppression of interference and retention of the autocompo-nents are possible. In Figure 2, the analyzed signal consistsof two time-frequency components with different frequen-cies and cos2 amplitude envelopes nonoverlapping in time.In Figure 2b, the TFR was constructed using Shannon en-tropy method from four projections (ϕ = 0◦, 90◦, 45◦,−45◦).In Figure 2a, oscillatory interference appearing midway be-tween autocomponents can be clearly observed. As known

    ×10−3T(t, ω)5

    432101

    0.5

    0−0.5

    −1 020

    40

    60

    80

    100

    Frequency(normalized)

    Time(samples)

    (a)

    0.02

    0.01

    0

    T(t, ω)

    1

    0.5

    0

    −0.5−1 0

    20

    40

    60

    80

    100

    Frequency(normalized)

    Time(samples)

    (b)

    0.02

    0.01

    0

    T(t, ω)

    1

    0.5

    0

    −0.5−1 0

    20

    40

    60

    80

    100

    Frequency(normalized)

    Time(samples)

    (c)

    Figure 1: Reconstructed time-frequency atom based on (a) Rényientropy α = 1.9; (b) Shannon entropy; and (c) Rényi entropy α =1.1.

    from [1], sign of such interference does not fluctuate onlines parallel to the line connecting the center points of com-ponents, but interference oscillates with alternating signs inother directions. Based on this interference geometry, onecan conclude that mainly such Radon-Wigner transformsare influenced by the interference, for which the integrationpaths are near parallel to the line connecting center points ofcomponents, whereas interference contributions to other di-rections are attenuated due to integration. Proper choice ofangles then allows obtaining almost interference-free distri-bution.

    The FrFT represents an inner product (correlation) ofthe analyzed signal with a linearly frequency-modulated pro-totype. Thus the performance of the FrFT-based approach

  • CT Image Reconstruction Approaches Applied to Time-Frequency Representation of Signals 427

    0.02

    0.01

    0

    T(t, ω)

    1

    0.5

    0

    −0.5−1 0

    20

    40

    60

    80

    100

    Frequency(normalized)

    Time(samples)

    (a)

    0.02

    0.01

    0

    T(t, ω)

    1

    0.5

    0

    −0.5−1 0

    20

    4060

    80

    100

    Frequency(normalized)

    Time(samples)

    (b)

    Figure 2: Time-frequency representations of two-component sig-nal: (a) WD and (b) maximum entropy reconstruction from fourangles.

    in the case of nonlinear frequency modulation is inferiorto the proposed method. As an example of a frequency-modulated signal with a higher order of nonlinearity, 201-sample complex-valued signal with sinusoidal frequencymodulation has been considered. The result of TFR recon-struction for nine angles 0◦, 20◦, . . . , 160◦ with α = 1.1 isgiven in Figure 3b. In this figure, complicated interferencepatterns along the main sinusoidal frequency modulationcurve may be observed; also in comparison to Figure 2, itmay be observed that interference terms have been redis-tributed from interference regions to autocomponent re-gions. Due to complex interference structure, no simple rulefor choosing optimal set of angles may be found; uniformdistribution of angles seems to be essential in this case. Com-pared to the signal withWD as in Figure 2, more angles mustbe used in order to reasonably characterize the signal struc-ture in the time-frequency plane. However, as the number ofprojections increases, more interference patterns appear inthe resulting distribution.

    This method can be used also for CT originated data, asdemonstrated in Figure 4, where Shepp-Logan phantom hasbeen used to simulate measured projections.

    6. CONCLUSION

    In this paper, it has been explained that mainly limited-angleapproach can contribute to the time-frequency analysis. Theunderlying concept of this novel method based on Rényi en-

    2

    101

    0.5

    0

    −0.5

    −1 050

    100

    150

    200

    ×10−3T(t, ω)

    Frequency(normalized)

    Time(samples)

    (a)

    2

    101

    0.5

    0

    −0.5

    −1 050

    100

    150

    200

    ×10−3T(t, ω)

    Frequency(normalized)

    Time(samples)

    (b)

    Figure 3: Time-frequency representations of a signal with sinu-soidal frequency modulation: (a) WD and (b) the TFR reconstruc-tion from 9 projections for α = 1.1.

    tropy maximization has been described. This method canbe used also for CT image reconstruction. Although thismethod is computationally very expensive, it can exhibitsome advantages when compared to the conventional time-frequency methods. It has also been demonstrated that theproposed method can successfully suppress undesirable in-terference terms in the case of signals with simple time-frequency configurations without unacceptable degradationof time-frequency localization.

    In the conclusion, it is worth noting the differences be-tween the limited-angle approach in time-frequency recon-struction and tomography. Whereas a limited number of an-gles in tomography results from technical constraints, the an-gle limitation in time-frequency analysis has been imposedon purpose in order to increase the degree of freedom forthe suppression of interference components. The aims of theconstruction procedures thus differ for these two fields ofapplication. In tomography, the goal of image reconstruc-tion is to achieve the highest level of detail possible, whereasin constructing the time-frequency distribution, the level ofdetail should not be tried to be arbitrarily small due to theuncertainty principle. Projections of images may not neces-sarily have a clear intuitive interpretation in signal theory;

  • 428 EURASIP Journal on Applied Signal Processing

    ×10−31.51

    0.50

    120

    100

    80

    60

    40

    20

    0 020

    4060

    80100

    120

    y (samples)

    x (samples)

    (a)

    ×10−31.51

    0.50

    120

    100

    80

    60

    40

    20

    0 020

    4060

    80100

    120

    y (samples)

    x (samples)

    (b)

    Figure 4: Shepp-Logan phantom reconstructed from 10 projec-tions (120× 120 pixel) by means of (a) filtered back projection and(b) Rényi entropy maximization, α = 1.1.

    in contrast, time-frequency projections are related directlyto the FrFT. This observation contributes to the theoreticalvalue of the approaches presented.

    APPENDIX

    Iteration formula (22) can be treated as a functional mapping

    λ(n+1) = φ(λ(n)). (A.1)Convergence of the iteration to the solution (λ = φ(λ),e(λ) = 0) can be ensured by contractivity of φ. The mappingφ is said to be contractive if the inequality

    ∥∥φ(λ2)− φ(λ1)∥∥ ≤ q∥∥λ2 − λ1∥∥ (A.2)holds for a number q < 1 and ‖ · ‖ denotes a properly de-fined norm. However, it is not easy to satisfy the contractivitycondition “globally” for unbounded values of λ. In order toestimate the convergence parameter in (22), we consider “lo-cal” contractivity based on linearization with respect to λ(n+1)

    near λ(n). The linearized error term in (22) may be derived

    to obtain

    ei(λ(n+1)

    ) = ei(λ(n)) +Ai(λ(n+1) − λ(n)), (A.3)where the linear operatorAi is defined as

    Aix = 1α− 1

    M∑k=1Ri∣∣∣∣∣

    M∑i=1B jλ(n)j

    ∣∣∣∣∣(2−α)/(α−1)

    Bkxk. (A.4)

    Then (22) and (A.3) yield

    φ(λ(n+1)

    )− φ(λ(n)) = (I − µnA)(λ(n+1) − λ(n)), (A.5)where A = [A1, . . . ,AM]T and I denotes the identity oper-ator. From the definition of the operator norm induced by afunction norm, it is clear that the local contractivity condi-tion can be satisfied by imposing the constraint∥∥I − µnA∥∥ < 1, (A.6)where ‖ · ‖ is a corresponding operator norm.

    In the next derivation, the∞-norm will be used,∥∥x(u)∥∥ = maxi,u

    {∣∣xi(u)∣∣}. (A.7)Taking into account the nonnegativity of the impulse re-sponse of A, one can conclude that (A.6) can be satisfiedby

    ∥∥µnA∥∥ < 2, i.e., µn < 2‖A‖ , (A.8)where the operator norm is

    ‖A‖ sup‖Ax‖‖x‖=1 = maxi

    {sup

    ∥∥Aix∥∥}. (A.9)OperatorAi may be expressed in terms of a nonnegative ker-nel hi,k(u, v) as

    {Aix}(u) = M∑k=1

    ∫hi,k(u, v)xk(v)dv. (A.10)

    Therefore,

    ∣∣{Aix}(u)∣∣ ≤ M∑k=1

    ∫hi,k(u, v)

    ∣∣xk(v)∣∣dv = {Ai∣∣x∣∣}(u)(A.11)

    and xk(u) = 1 corresponds to the worst case of ‖x‖ = 1 withrespect to supremum. Substituting x = [1, . . . , 1]T into (A.4)yields

    Ai[1, . . . , 1]T = M(α− 1)

    Ri∣∣∣∣∣

    M∑j=1B jλ(n)j

    ∣∣∣∣∣(2−α)/(α−1) (u).

    (A.12)

    This result, when combined with (A.8) and (A.9), finally re-sults in the estimate (24).

  • CT Image Reconstruction Approaches Applied to Time-Frequency Representation of Signals 429

    ACKNOWLEDGMENT

    This work was supported by the Ministry of Education of theSlovak Republic under the Grant no. 1/0144/03.

    REFERENCES

    [1] F. Hlawatsch and G. F. Boudreaux Bartels, “Linear and qau-dratic time-frequency signal representations,” IEEE SignalProcessing Magazine, vol. 9, pp. 21–67, April 1992.

    [2] G. F. Boudreaux-Bartels and R. Murray, “Time-frequency sig-nal representation for biomedical signals,” in The BiomedicalEngineering Handbook, J. D. Bronzino, Ed., pp. 866–885, CRCpress, Boca Raton, Fla, USA, 1995.

    [3] W. J. Williams, “Recent advantages in time-frequency repre-sentations: some theoretical foundations,” in Time FrequencyandWavelets in Biomedical Signal Processing, M. Akay, Ed., pp.3–43, IEEE Press, Piscataway, NJ, USA, 1998.

    [4] L. Cohen, “Generalized phase-space distribution functions,”J. Math. Phys., vol. 7, no. 5, pp. 781–786, 1966.

    [5] L. Cohen and T. E. Posch, “Positive time-frequency distribu-tion functions,” IEEE Trans. Acoust. Speech Signal Processing,vol. ASSP-33, no. 1, pp. 31–38, 1985.

    [6] P. Loughlin, J. W. Pitton, and L. Atlas, “Construction of posi-tive time-frequency distributions,” IEEE Trans. Signal Process-ing, vol. 42, no. 10, pp. 2697–2705, 1994.

    [7] J. R. Fonollosa, “Positive time-frequency distributions basedon joint marginal constraints,” IEEE Trans. Signal Processing,vol. 44, no. 8, pp. 2086–2091, 1996.

    [8] H. M. Ozaktas, N. Erkaya, and M. A. Kutay, “Effect of frac-tional Fourier transformation on time-frequency distribu-tions belonging to the Cohen class,” IEEE Signal ProcessingLetters, vol. 3, no. 2, pp. 40–41, 1996.

    [9] H. M. Ozaktas, O. Arikan, M. A. Kutay, and G. Bozdagi, “Dig-ital computation of the fractional Fourier transform,” IEEETrans. Signal Processing, vol. 44, no. 9, pp. 2141–2150, 1996.

    [10] L. B. Almeida, “The fractional Fourier transform and time-frequency representations,” IEEE Trans. Signal Processing, vol.42, no. 11, pp. 3084–3091, 1994.

    [11] D. Groutage, “A fast algorithm for computing minimumcross-entropy positive time-frequency distributions,” IEEETrans. Signal Processing, vol. 45, no. 8, pp. 1954–1970, 1997.

    [12] S. I. Shah, P. Loughlin, L. F. Chaparro, and A. El-Jaroudi, “In-formative priors for minimum cross-entropy positive time-frequency distributions,” IEEE Signal Processing Letters, vol. 4,no. 6, pp. 176–177, 1997.

    [13] G. Minerbo, “MENT: a maximum entropy algorithm forreconstructing a source from projection data,” ComputerGraphics and Image Processing, vol. 10, no. 1, pp. 48–68, 1979.

    [14] A. Rényi, “Onmeasures of entropy and information,” in Proc.4th Berkeley Symp. Math. Statist. Probab., vol. 1, pp. 547–561,University of California Press, Berkeley, Calif, USA, 1961.

    [15] L. L. Campbell, “A coding theorem and Rényi’s entropy,” In-formation and Control, vol. 8, no. 4, pp. 423–429, 1965.

    [16] R. G. Baraniuk, P. Flandrin, A. J. E. M. Janssen, and O. J. J.Michel, “Measuring time-frequency information content us-ing the Rényi entropies,” IEEE Transactions on InformationTheory, vol. 47, no. 4, pp. 1391–1409, 2001.

    [17] W. J. Williams, “Reduced interference distributions: biologi-cal applications and interpretations,” Proceedings of the IEEE,vol. 84, no. 9, pp. 1264–1280, 1996.

    [18] I. Kazantsev, R. Van de Walle, and I. Lemahieu, “Reconstruc-tion frommagnetic resonanse data based on ridge functions,”in Proc. EURASIP International Conference BIOSIGNAL 2000,pp. 216–218, Brno, Czech Republic, June 2000.

    Jozef Púčik was born in Bratislava, Slo-vakia, in 1972. He obtained the M.S. de-gree in 1996 and the Ph.D. degree in 2000in electrical engineering from the SlovakUniversity of Technology in Bratislava. Cur-rently, he is an Assistant Professor at theDepartment of Radio and Electronics, Fac-ulty of Electrical Engineering and Informa-tion Technology of the Slovak University ofTechnology in Bratislava. His main field ofinterest covers theory of time-frequency distributions and their ap-plication to biomedical signal processing.

    RamiOweiswas born in Jordan in 1970. Hereceived the B.S., M.S., and Ph.D. degreesin electronic engineering with the majorbiomedical instrumentation from the Slo-vak University of Technology. From 1994–1995, he worked as an Engineer in the Car-diovascular Department at the children uni-versity hospital with policlinic in Bratislava.From 1999, he is affiliated with the JordanUniversity of Science and Technology at theBiomedical Engineering Department. His research interests arebiomedical electronics, and signal and image processing.

    1. INTRODUCTION2. COHEN CLASS3. RADON-WIGNER TRANSFORM3.1. Time-frequency marginals3.2. Fractional Fourier transform (FrFT)3.3. Reconstruction of WD

    4. ITERATIVE RECONSTRUCTION OF THE TFR4.1. Rényi entropy of TFR4.2. Algorithm description

    5. DISCUSSION6. CONCLUSIONAPPENDIXACKNOWLEDGMENTREFERENCES