57

Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector [email protected]

Embed Size (px)

Citation preview

Page 1: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu
Page 2: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu
Page 3: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Image Reconstructionfrom Projections

J. Anthony Parker, MD PhD

Beth Israel Deaconess Medical Center

Boston, Massachusetts

Caveat Lector

[email protected]

Page 4: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

ProjectionSingle Slice

Axial

Page 5: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Single Axial Slice: 3600

collimator

Ignoring attenuation, SPECT data are projections

Page 6: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Attenuation: 180o = 360o

keV

150

100

80

60

50

x

Tc-99m

htl(140 keV) ≈ 4 cm

Page 7: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Cardiac Perfusion Data Collection Special Case - 180o

AxialCoronal / Sagittal

Multiple simultaneous axial slices

Page 8: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Dual-Head General-Purpose Gamma Camera: 900 “Cardiac” Position

2 heads: 900 rotation = 1800 data

1

2

Page 9: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Inconsistent projections“motion corrected”

Page 10: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Original data

Page 11: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

0

0

0

00

0

0

0

Single Axial Slice: 3600

Page 12: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Sinogram: ProjectionsSingle Axial Slice

0 60

060

pro

ject

ion

an

gle

x

x

x

Page 13: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Uniformity & Motion on Sinogram

1 h

ea

d2

4 m

in

2 h

ea

ds

12

min

12

min

Page 14: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Reconstruction by Backprojection

Backprojection tails

Page 15: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Backprojection2 projections2 objects

Page 16: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

projection tailsmerge resulting

in blurring

Page 17: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Projection -> Backprojection of a Point

(1/r)

backprojectionlines add atthe point

tails spread point out

Page 18: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Projection -> Backprojection

Page 19: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Projection->Backprojection Smooths

Smooths or “blurs” the image

(Low pass filter)

((Convolution with 1/r))

Nuclear Medicine physics

Square law detector adds pixels

-> always blurs

Different from MRI (phase)

Page 20: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

(Projection-Slice Theorem)“k-space (k,)”

detail

lowfrequency

spatial frequency domainspatial domain2D Fouriertransform

Page 21: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Spatial Frequency Basis Functionsf(u,v) ≠ 0, single u,0f(u,v) ≠ 0, single 0,v

f(u,v) ≠ 0, single u = v

Page 22: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Projection -> Backprojection: k-space

1/k

(Density ofslices is 1/k)

(Fourier Transform of 1/r <-> 1/k)

one projectionmultiple projections

Page 23: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Image Reconstruction: Ramp Filter

Projection -> Backprojection

blurs with 1/r in object space

k-space 1/k ( 1/r<-> 1/k)

Ramp filter

sharpen with k

(windowed at Nyquist frequency)k

k

Page 24: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Low Pass Times Ramp Filter

Low pass,Butterworth– noise

Ramp –reconstruct

Page 25: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

What’s Good about FPB

Ramp filter exactly reconstructs projection

Efficient

(Linear shift invariant)

(FFT is order of n log(n)

n = number of pixels)

“Easily” understood

Page 26: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

New Cardiac Cameras

Solid state - CZT: $$$, energy resolution

scatter rejection, dual isotope

Pixelated detector: count rate &

potential high resolution

poorer uniformity

Non-uniform sampling: sensitivity

potential for artifacts

Special purpose design

closer to patient: system resolution

upright: ameliorates diaphragmatic attenuation

Page 27: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu
Page 28: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Collimator Resolution*

Single photon imaging (i.e. not PET)

Collimators: image formation

Sensitivity / resolution trade-off

Resolution recovery hype

“Low resolution, high sensitivity ->

image processing = high resolution”

Reality - ameliorates low resolution

Steve Moore: “Resolution: data = target object”

Can do quick, low resolution image

* not resolution from reduced distance due to design

Page 29: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Dual Head: Non-Uniform Sampling

Page 30: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Activity Measurement: Attenuation

keV

150

100

80

60

50htl(140 keV) ≈ 4 cm

Page 31: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Attenuation Correction: Simultaneous Emission (90%) and Transmission (10%)

Gd-153 rods T1/2 240 d e.c. 100% 97 keV 29% 103 keV 21%

2 heads: 900 rotation = 1800 data

Page 32: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Semi-erect: Ameliorates Attenuation

Page 33: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Leaning Forward, < 500 Pounds

Page 34: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Digirad: Patient RotatesX-ray Attenuation Correction

Page 35: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

CT: Polychromatic Beam -> Dose

keV

150

100

80

60

50

Page 36: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

X-ray Tube Spectra

bremsstrahlung

characteristic X-rays

e- interaction:- ionization- deflection

X-ray tube: electrons on Tungsten or Molybdenum

Page 37: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Digirad X-ray Source: X-rays on Lead

74W

82Pb

X-rays interaction- ionization- no 10 bremsstrahlung

Page 38: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Digirad X-ray Spectrum

Page 39: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

New Cardiac Cameras

D-SPECT CardiArc Digirad GE

Detector CZT* NaI(Tl) CsI(Tl) CZT*

Electronics SS* PMT PD*? SS*

Pixelated Y N Y Y

Collimation holes slits*? holes pinholes

Non-uniform Y* Y* ~N Y*

Limited angle Y Y N ~N

Closer to pt Y Y Y ~N

AC N CT? CT* CT

Position ~semi semi erect supine

Page 40: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Soft Tissue Attenuation: Supine

breast

lung

Page 41: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Soft Tissue Attenuation: Prone

breast

Page 42: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Soft Tissue Attenuation: Digirad Erect

breast

post

Page 43: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Sequential Tidal-Breathing Emission and Average-Transmission Alignment

Page 44: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Sensitivity / Resolution Trade-Off

Non-uniform sampling -> sensitivity

Special purpose design -> resolution

Advantages

Throughput at same noise

Patient motion - Hx: 1 head -> 2 head

Cost

Non-uniform sampling -> artifacts

History: 7-pinhole - failed

180o sampling - success

Sequential emission transmission

Page 45: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

What’s Wrong with FilteredBackprojection, FBP, for SPECT

Can’t model:

Attenuation

Scatter

Depth dependant resolution

New imaging geometries

(Linear shift invariant model)

Page 46: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Solution

Iterative reconstruction

Uses:

Simultaneous linear equations

Matrix algebra

Can model image physics

(Linear model)

Page 47: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Projections as Simultaneous Equations(Linear Model)

But, exact solution for a largenumber of equations isn’t practical

Page 48: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Iterative Backprojection Reconstruction

Af

n

p

fn-1^ pn-1

^ en-1^

fn^

+

- x

+

f0^

r

H

H

A

object data

projection backprojection

estimate

model

error

estimate

estimateddata

estimate +backprojected

error

Page 49: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Reconstruction, H, can be Approximate

Af

n

p

fn-1^ pn-1

^ en-1^

fn^

+

- x

+

f0^

r

H

H

A

Page 50: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Accuracy of Model, A, is Key

Af

n

p

fn-1^ pn-1

^ en-1^

fn^

+

- x

+

f0^

r

H

H

A

^

Page 51: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Model, A, is Well-known PhysicsProblem: Model of the Body

^

Tc-99m half-tissue layer: 4 cm

Page 52: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Attenuation Map Gd-153 Transmission

Map adds noise to reconstructionand can introduce artifacts

Page 53: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Iterative ReconstructionNoise is “Blobby”

Page 54: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

What’s Good About Iterative Reconstruction

Able to model:

Data collection, including new geometries

Attenuation

Scatter

Depth dependant resolution

Fairly efficient given current computers

(Iterative solution, e.g. EM, reasonable)

(OSEM is even better)

((OSEM has about 1/nsubsets of EM iterations))

Page 55: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

What’s Wrong with Iterative Reconstruction

(Complicated by ill conditioned model)

((Estimating projections not object))

Noise character bad for oncology

To model attenuation & scatter

- need to measure attenuation

- adds noise

Page 56: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Conclusions

Filtered backprojection, FBP

Efficient

(Models noise)

“Easy” to understand

Iterative reconstruction, OSEM

Moderately efficient

Models noise, attenuation, scatter,

depth dependant resolution,

and new cameras

Page 57: Image Reconstruction from Projections J. Anthony Parker, MD PhD Beth Israel Deaconess Medical Center Boston, Massachusetts Caveat Lector Tony_Parker@BIDMC.Harvard.edu

Applause