Upload
navsi
View
228
Download
0
Embed Size (px)
Citation preview
8/8/2019 Vessel Linear
1/134
Vessel-basedregistrationwithapplicationtonoduledetection
inthoracicCTscans
ChanghuaWuaandGady
Agamb
aDepartmentofScienceandMathematics,KetteringUniversity,Flint,MI
48504bDepartmentofComputerScience,IllinoisInstituteofTechnology,Chicago,IL
60616
ABSTRACT
Volumeregistrationisfundamentaltomultiplemedical
imagingalgorithms.Speci
8/8/2019 Vessel Linear
2/134
cally,non-rigidregistrationofthoracicCTscans
takenatdierenttimeinstancescanbeusedtodetectnewnodules
morereliablyandassessthegrowthrateofexistingnodules.Voxel-basedregistrationtechniques
aregenerallysensitivetointensityvariationandstructuraldierences,whicharecommoninCTscansduetopartialvolumeeectsandnaturallyoccurringmotionand
deformations.Theapproach
8/8/2019 Vessel Linear
3/134
8/8/2019 Vessel Linear
4/134
8/8/2019 Vessel Linear
5/134
eldusingthinplatesplines.Theproposed
approachisevaluatedonbothrealandsyntheticallydeformedvolumes.Theobtained
resultsarecomparedtoseveralstandardregistrationtechniques.Itisshownthatby
usingvesselstructure,theproposedapproachresultsinimprovedperformance.
1.INTRODUCTIONSuccessfulregistrationisfundamentaltothefusionofmedicalimagesand
thediagnosisof
8/8/2019 Vessel Linear
6/134
abnormalstructuresfromtemporalimages.Computerizedvolumetric
warpingandregistrationof3Dlungimagescanprovideobjective,accurate,
andreproduciblemeasurestotheunderstandingofthelungstructureandfunction.It
isalsoinvaluabletotheassessmentofthepresenceofdiseasesandtheirresponsetotherapies.Intheautomatedcomputerdiagnosisofnodules,thedierence
betweentemporalCT
8/8/2019 Vessel Linear
7/134
scansafterregistrationcanbeusedto
trackthedevelopmentofexistingnodulesanddetectnewones.1,2The
changeinsizeandintensitycanbeusedtotellwhetheranodule
ismalignantorbenign.3Registrationcanbeusedtoestimateregionallungexpansion,4breathingmotion,5,6andstructure-functionrelationships.7,8Itcanalsobeused
toreducethe
8/8/2019 Vessel Linear
8/134
falsepositiveinnoduledetection.9,10
Howeveronlylimitedworkthattargetstheaccurateregistrationoflung
volumeshasbeendone.Somework2usedtheiterativeclosestpoint(ICP)to
registerthecontoursoflungvolumes.ZhangLi11developeda3Dsurface-basedregistrationtechniquetoregisterpulmonaryCTvolumes.Theregistrationincludesaglobal
transformationanda
8/8/2019 Vessel Linear
9/134
localelastictransformationbysubdividingtheimage
andatlasvolumeintosub-imagescalledcubes.Thedisplacementvectorsofeach
cubeareprocessedusingBurr'sdynamicmodeltogiveasmootheddeformationvector
foreachvoxelintheimage.However,thisapproachisentirelydependentontheintensityinformationandmakesnouseofaprioriknowledgeof
thelungstructure
8/8/2019 Vessel Linear
10/134
suchasthevesselnetwork.Someresearchers
trytoestimatethetransformation
8/8/2019 Vessel Linear
11/134
eldby
8/8/2019 Vessel Linear
12/134
ndingmatchesofthejunctionsofvessels
andairwaysinthelungvolume.FanLi12,13proposedaninterpolation
methodforobtainingdensetransformation
8/8/2019 Vessel Linear
13/134
eldfromsparsedisplacementvectorsobtainedby
trackingthebronchialpointsofairways.Thedensetransformation
8/8/2019 Vessel Linear
14/134
eldisobtainedbyminimizinganobject
functionbasedonamodelofcontinuummechanicsandanisotropicsmoothnessconstraints.
Thisapproachassumesthattheintensityofapointinthelungdoes
notchangeinallscans.Howeverthisisnotalwaystrue,especiallyinthickCTscansduetothepartialvolumeeect.Prado14proposeda
sequentialpolynomialregistration
8/8/2019 Vessel Linear
15/134
schemetointeractivelyregisterlungvolumes.The
coecientsofthepolynomialfunctionareupdatedbyaddingcontrolpointsmanually.
Duetothelimiteddegree,thepolynomialfunctionmaynotbecapableof
accuratelydescribingthenon-rigiddeformationbetweenlungvolumes.Moreover,themanual
8/8/2019 Vessel Linear
16/134
interactionmayintroduceerrorinthe
positionofcontrolpointsandalsoreducestheeciency.Shikata15proposeda
lungregistrationmethodbymatchingbifurcationpointsfromareconstructedvessel-tree.However,it
onlyestimatedarigidtransformation
8/8/2019 Vessel Linear
17/134
eldwhiletherealtransformationbetweenlung
volumesisnon-rigid.Finally,BaojunLi7proposedamethodtocombinethe
junctionsofairwaywithintensityconsistency.Inhismethod,thesimilaritybetweenjunctions
andvoxelsaremeasuredbyasetofcostfunctions,whichareminimizedtogetthe
8/8/2019 Vessel Linear
18/134
naltransformation
8/8/2019 Vessel Linear
19/134
eld.However,thematchingbetweenjunctionsis
manuallyestablished,whichreducesitseciencyandmakesitunsuitableforautomated
lungregistration.Furthermore,itishardtoavoidlocalminimuminthe
minimizationofthecostfunctions.
Inthispaper,anautomaticregistrationmethodbasedonthestructureofvesselsisproposed.Thispaperis
organizedasfollows.
8/8/2019 Vessel Linear
20/134
8/8/2019 Vessel Linear
21/134
eld,incorporationofsmoothnessandvessel-basedconstraints
arediscussedinthissection.Section3discussestheevaluationofthe
proposedmethod.Section4presentstheconclusionandoutlinesthefuturework.
2.THEPROPOSEDAPPROACHBloodvesselsareprominentfeaturesinthoracicCTscans.Thenetworkofvesselscoversmostofthevolume,whichmakes
vesselsgoodlandmarks
8/8/2019 Vessel Linear
22/134
intheregistrationoflungvolumes.In
thissection,ageneralregistrationalgorithmthatusesvessel-basedlandmarkstoregister
CTvolumesisproposed.Theproposedregistrationalgorithmusesbothjunctionsandvessels
toestimatethenon-rigidtransformationbetweenvolumes.Falsematchingofjunctionsareremovedbysmoothnessconstraintusingthecurvaturesofthetransformation
8/8/2019 Vessel Linear
23/134
eld.Thentheregistrationisfurtherimproved
byincorporatingthelinearvesselsegmentswhosematchesarefoundbyactively
deformingtheircenterlinestotheirmatches.Thissectionisorganizedasfollows.
Section2.1discussestheinitialalignment.Junctiondetectionisdiscussedinsection2.2.Section2.3introducesthin-platesplines(TPSs),whichareusedintheinterpolation
ofthetransformation
8/8/2019 Vessel Linear
24/134
8/8/2019 Vessel Linear
25/134
eld.Section2.4discussestheenforcementof
smoothnessconstraintsonthetransformation
8/8/2019 Vessel Linear
26/134
eld.Section2.5discussestheincorporationof
vesselconstraints.
2.1.InitialalignmentAtthebeginning,thesource
andthetargetvolumesareinitiallyalignedthroughananetransformation.Thisinitial
alignmentreducesthesearchingspacein
8/8/2019 Vessel Linear
27/134
8/8/2019 Vessel Linear
28/134
centersofboththesourceand
xyz
targetvolumestotheiroriginsrespectivelyaregivenby:
..
I..cI..c.
T=
;T.=(1)
0101
whereIisan33identitymatrix.
Therotationandscalingcomponents
areestimatedfrom
8/8/2019 Vessel Linear
29/134
8/8/2019 Vessel Linear
30/134
8/8/2019 Vessel Linear
31/134
8/8/2019 Vessel Linear
32/134
nedbyPandP.are
givenby
..1..1
p1p2p30
ppp0
R.123
R=,=(3)
0001
0001
8/8/2019 Vessel Linear
33/134
LetE=f1;2;3gTandE.
=f.1;2.;.3gTbetheeigenvaluescorrespondingtothe
eigenvectorsinPandP..ThescalingmatricesSandS.
thattransformboththesourceandtargetvolumestoaunitvolumearegivenby:
23..1..3..1
10
0010
8/8/2019 Vessel Linear
34/134
00.7...02
00000
6.S..27
S=
,=(4)
.00305.00.3
0.00010001
UsingthematricesabovetonormalizethesourcevolumeIsandthetargetvolumeIt,wegetSRTIs
=S0R0T0It.
8/8/2019 Vessel Linear
35/134
SotheanetransformationmatrixMathat
alignsIstoItis:
..1
Ma=(S.R0T
0)SRT(5)
2.2.LandmarkselectionTherearetwogeneralapproachesin
imageregistration,voxel-basedapproachesandlandmark-basedapproaches.Thevoxel-basedapproachesusetheintensityofallvoxelsintheoverlappingarea.Similaritymeasuressuchasmutual
informationandintensity
8/8/2019 Vessel Linear
36/134
8/8/2019 Vessel Linear
37/134
landmarksaremanuallyselected.Voxel-basedapproachestreat
voxelsoftissueandstructuresinthesamewaywhilelandmark-basedapproaches
givehigherweighttostructures.Voxel-basedapproachesarealsomoresensitivetonoise
andintensityvariation.
SincevesselsintheCTscanscanbeeasilyobtainedafterenhancement16,17andwecaremoreabouttheaccurate
registrationofvessels
8/8/2019 Vessel Linear
38/134
8/8/2019 Vessel Linear
39/134
edandmatched.Second,theyshouldbe
spatiallydistributedasuniformlyaspossibletoprovideadequateinformationthroughoutthe
volume.Accordingtothesecriteria,junctionsofvesselsareidealcandidates.Theyhave
beenwidelyusedinimageregistration.15,18Afterenhancement,vesselscanbesegmentedbyasimplethresholding.Linearvesselsegmentscanbeobtainedbytracing
alongvesseldirections
8/8/2019 Vessel Linear
40/134
untiljunctionsaremet.Intheproposed
approach,junctionsaredetectedbycheckingtheeigenvaluesofthegradientcorrelation
matrix.Let1.2betheeigenvaluesofthematrix.Itis
assumedthatforlinearvesselsegments,2isneartozeroand
1ismuchbiggerthan2,therefore2=1isverysmall.Soto
detectjunctions,we
8/8/2019 Vessel Linear
41/134
onlyneedtocheckthevalueof
2=1.Ifitislargerthanathreshold,thenajunctionis
detected.Toensurethattheselectedjunctionsareuniformlydistributedinthevolume,
apost-processisappliedtoremovejunctionsthataretooclosetoeachothersothatthedistancebetweenanytwojunctionsisabovea
minimumdistance(30
8/8/2019 Vessel Linear
42/134
8/8/2019 Vessel Linear
43/134
ndamatch.Thesimilaritybetweenjunctions
ismeasuredbyintensitycorrelationina1010window.To
improvetheaccuracyofregistration,onlythosejunctionpairswithhighcorrelation(top
50%amongallmatchingpairsofjunctions)arekept.Theremainingjunctionpairsarethenusedtogenerateasmoothtransformation
8/8/2019 Vessel Linear
44/134
eldthroughthin-platesplineinterpolation.
2.3.Interpolationofthetransformation
8/8/2019 Vessel Linear
45/134
eldIntheproposedapproach,thetransformation
8/8/2019 Vessel Linear
46/134
eldisinterpolatedusingthin-platesplines(TPSs),
whichbelongtoafamilyofsplinesbasedonradialbasisfunctions.
TPShasbeenformulatedbyDuchon19andMeinguet20forsurfaceinterpolationofscattered
data.TPSmodelsthedeformationofathinmetalplateunderexternalforces.ThesurfaceinterpolatedbyTPSpassesthroughthecontrolpoints.Eachcontrol
pointhasglobal
8/8/2019 Vessel Linear
47/134
inuenceontheshapeoftheinterpolated
surface.InrecentyearsTPShasbeenwidelyusedinimageregistration.21{23
Thede
8/8/2019 Vessel Linear
48/134
nitionofTPSisalinearcombination
ofnradialbasisfunctions(s):
n
t(x,
y,z)=a1+a2x+a3y+a4z+bj(jj-(x,
y,z)j)(6)j=1
8/8/2019 Vessel Linear
49/134
De
8/8/2019 Vessel Linear
50/134
ningthetransformationasthreeseparatethin-plate
splinefunctionsT=(t1;t2;t3)Tyieldsamappingbetweenimagesinwhichthe
coecientsa1,a2,a3anda4characterizetheanepartofthetransformation
whilethecoecientsfbjgj=1:::ncharacterizethenon-anepartofthetransformation.Thencontrolpointsformasetof3nlinearequations.Todeterminethe
3(n+4)
8/8/2019 Vessel Linear
51/134
coecientsuniquely,twelveadditionalequationsarerequired.
Thesetwelveequationsguaranteethatthenon-anecoecientsfbjgj=1:::nsumtozero
andthattheircrossproductswiththex,yandzcoordinatesofthe
controlpointsarelikewisezero.Inmatrixformthiscanbeexpressedas
.
.
.
.
.
.
.
.b.
=(7)T
8/8/2019 Vessel Linear
52/134
0a0
Herea
isa43matrixoftheanecoecientsa1,a2,a3
anda4,bisan3matrixofthenon-anecoecientsfbjgj=1:::n,
and.isthekernelmatrixwithij=(ji-jj).Solvingforaandbusingstandardalgebrayieldsathin-platespline
transformationthatwill
8/8/2019 Vessel Linear
53/134
interpolatethetranslationatthecontrolpoints.
Theradialbasisfunctionofthin-platesplinesisde
8/8/2019 Vessel Linear
54/134
8/8/2019 Vessel Linear
55/134
eldEventhoughstrictcriteriaisused
inselectingmatchingjunctions,therecanstillbefalsematchingdueto
variousreasons,suchasnoiseandthepartialvolumeeect.Thereareseveral
commonwaystoremovefalsematching.Oneway24isto
8/8/2019 Vessel Linear
56/134
ndmultiplematchesforeachcontrolpoint
inthesourcevolumeandthentryallthepossiblecombinationsof
thematchingrelationsto
8/8/2019 Vessel Linear
57/134
ndthetransformationthatminimizesthedierence
betweenthesourceandtargetvolumes.Thismethodisapplicabletoboth
rigidandnon-rigidregistration.Theshortcomingisthatitiscomputationallyexpensive.A
secondmethodistoestimateatransformation
8/8/2019 Vessel Linear
58/134
eld,i.e.arigidtransformation,andthen
checktheregistrationerrorateachjunction.Iftheerroristoo
big,thenitisafalsematch.HoweverthesurfaceinterpolatedbyTPS
passesthroughthecontrolpoints,whichmakesthismethodnotsuitable.Athirdwayistocheckthelocalfeaturesoftheestimatedtransformation
8/8/2019 Vessel Linear
59/134
eldateachjunction,andremovethose
withlocalfeaturesdeviatingtoomuchfromtheaverage.Intheproposed
approach,thethirdmethodisusedandthelocalfeatureischosento
bethecurvaturesofthetransformation
8/8/2019 Vessel Linear
60/134
eld.Thecurvaturesofthetransformation
8/8/2019 Vessel Linear
61/134
eldinbothhorizontalandverticaldirections
arecomputedusingLaplacianoperator,seeEquation9-10.
O2Tx(x,y,
z)=Tx(x+1,y,z)+Tx(x-1,y,z)+Tx(x,y+1;z)+(9)
Tx(x,y-1;z)-4Tx(x,y,z)
O2Ty(x,y,z)=Ty(x+1,y,z)+Ty(x-1,y,z)+Ty(x,y+1;z)+(10)
Ty(x,y-
8/8/2019 Vessel Linear
62/134
1;z)-4Ty(x,y,z)
whereTx(x,y,z)isthehorizontalcomponentofthedisplacementvector
at(x,y,z)andTy(x,y,z)istheverticalcomponent.Due
totheanisotropicnatureofthickCTscansonwhichtheexperimentsarecarriedout,thedisplacementvectorsintheneighboringslicesarenotused.
Thecurvaturein
8/8/2019 Vessel Linear
63/134
thezdirectionisnotcomputedeither.
Itisassumedthattherealtransformation
8/8/2019 Vessel Linear
64/134
8/8/2019 Vessel Linear
65/134
isremoved.Thisprocessisrepeatediteratively
untilnojunctionsareremoved.
2.5.Enforcementofvesselconstraints
Inlandmark-basedregistration,itisdesirabletohaveaslessfalsematchesas
possible,whichoftenleadstoastrictcriteriainselectingthematchingpairsoflandmarks.Ontheotherhand,itisalsoimportanttohave
enoughmatchinglandmarks
8/8/2019 Vessel Linear
66/134
togetanaccurateestimateofthe
transformation.Thismeansthecriteriashould
8/8/2019 Vessel Linear
67/134
8/8/2019 Vessel Linear
68/134
segmentB.doesnotshowup.The
vesselsegmentABismatchedtoA.B.,resultinginan
inaccuratetransformationvectorAA..Howeverthetranslationcomponentinthedirectionof
AA0.isaccurate.(b)Adjustmenttothetransformation
8/8/2019 Vessel Linear
69/134
eld.visavesselandl
isthenormaldirectionofv.pisthemiddlelocationof
vesselv.Whenj(t-t.)lj,shownasjabj,is
largerthan0.5,anadditional
pairofcontrolpointsisaddedtotheTPSinterpolationsuchthatvectortwillbemovedtot.
Theprojectionof
8/8/2019 Vessel Linear
70/134
8/8/2019 Vessel Linear
71/134
morereliablethanthatbetweenjunctions.In
theexperiments,thetop50%ofvesselsareselectedaccordingtothe
intensitycorrelation.Howeverthereisanapertureproblemwhenusingthematchingbetween
vesselstoestimatethedisplacementvectorsduetothelinearnatureofthevesselsegmentsandthepartialvolumeeect.Itissimilartothe
apertureproblemin
8/8/2019 Vessel Linear
72/134
opticalow.Intheproposedapproach,we
onlytracethelinearvesselsegmentswithinasingleplane.Howevera
realvesselmayshowupintwoormoresliceswitheachslice
showingapartofit.Thissituationmayleadtoinaccuracyinmatching,seeFigure1-(a).ABisavesselsegmentinthesourcevolume.
A.B.is
8/8/2019 Vessel Linear
73/134
thevesselsegmentshowninthetarget
volume.ThematchingsegmentB0B0.doesnotshowup,thereforevesselsegment
ABismatchedtoA.B0,resultinginaninaccuratedisplacementvectorAA.
.HoweverthetranslationcomponentinthedirectionofAA0.isaccurate,whichcanbeusedtoimprovetheregistration.
Toimprovethe
robustnessofvessel
8/8/2019 Vessel Linear
74/134
matching,onlythosevesselsthatsatisfythe
constraintsinwidth,lengthandintensityareselected.Intheexperiments,those
segmentswithwidthlargerthanonevoxel,lengthlongerthan20voxels,and
meanintensityhigherthan40areselected.Comparedwithjunctions,vesselsegmentsareeasiertodetect(theycanbeeasilytracedalongvesseldirections16).By
usinglinearvessel
8/8/2019 Vessel Linear
75/134
segments,thematchingrelationisnotbased
onasmalllocalregionasthecaseofjunctions,butbased
onthematchingofthewholevesselsthusimprovingtherobustnessofthe
matching.Toimprovethespeedandrobustnessofthesearchformatchingvessels,pyramidsofboththesourceandtargetvolumesarecreated.Thesearch
startsonthe
8/8/2019 Vessel Linear
76/134
topandgoesdowntothebottom
ofthepyramids.
Asdiscussedearlier,thetranslationinthe
normaldirectionofvesselscanbeusedtoimprovetheregistration.Thisis
donebyaddingadditionalcontrolpointstotheTPSinterpolationifthereisabigdierenceintheprojectionontothenormaldirectionofvessels
betweenthedisplacement
8/8/2019 Vessel Linear
77/134
8/8/2019 Vessel Linear
78/134
fromjunctions.Whenj(t.-t)
lj,seeFigure1-(b),islarger
than0.5,apair
ofcontrolpoints(p,p0)isaddedintothesetofjunctionpairs.
pisde
8/8/2019 Vessel Linear
79/134
nedas
p=p
+t.+((t-t0)l)l(11)
where
tisthetranslationvectorestimatedfromvesselmatching.Afteraddingadditionalcontrol
points,asimilariterativeprocessasdiscussedinsection2.4isappliedtofurtherremovethefalsematching.
8/8/2019 Vessel Linear
80/134
(a)(b)Figure2.Theleft
8/8/2019 Vessel Linear
81/134
8/8/2019 Vessel Linear
82/134
gureshowstheirmatchesinatarget
slice.Duetothefactthatthesourcevesselsandtheirmatches
arenotnecessarilyonthesameslice,thematchofsomevesselsin
(a)isnotshownin(b),viceversa.
3.RESULTSTheregistrationschemewastriedon6pairsoftemporalCTscans.We
usethenormalized
8/8/2019 Vessel Linear
83/134
sumofabsolutedistance(NSAD)betweenthe
transformedsourcevolumeandthetargetvolumetomeasuretheregistrationerror.
TheNSADisde
8/8/2019 Vessel Linear
84/134
nedbythefollowingequation:
1
NSAD=j(I.(x,y,z)-1)-
(It(x,y,z)-2)(12)
s
N
(x;y;z)2W
whereWisalocalwindowcenteredat(x,y,z),NisthenumberofvoxelsinW,1and2
arethemean
8/8/2019 Vessel Linear
85/134
intensityofI.andItinW
.I.andItarethetransformedsourcevolumeandthetarget
volumerespectively.Sincethe
ss
intensityofthesame
structuremaybeondierentlevelsinthesourceandtargetvolumes,byusingthisdistancemeasure,theinuenceofthemeanintensityiseliminated.
Toevaluatethe
8/8/2019 Vessel Linear
86/134
performance,theproposedalgorithmiscomparedwith
threeotherregistrationalgorithms.Thethreealgorithmsare3Dsurface-basedregistration,253D
voxel-basedregistration,263Dnon-rigidregistrationbasedonnormalizedmutualinformation.27,28
Inordertoevaluatehowwelltheproposedregistrationalgorithmrecoversthetransformation
8/8/2019 Vessel Linear
87/134
8/8/2019 Vessel Linear
88/134
eldusedintheexperimentshouldbe
closetothetransformation
8/8/2019 Vessel Linear
89/134
eldthathappensintherealsituation
tomaketheexperimentvalid,thesynthetictransformation
8/8/2019 Vessel Linear
90/134
eldisestimatedbyregisteringthesix
pairsofrealtemporalCTscans.Table1showsthequantitativeevaluation
oftheproposedalgorithm.Itcanbeseenfromthe
8/8/2019 Vessel Linear
91/134
rstpartofTable1thatNSAD
measurebetweenthesourceandtargetvolumesafterregistrationbytheproposed
algorithmiswithinrangeof[0:932:87],whichismuchsmallerthanthe
distanceobtainedusingthethreeotherregistrationmethods.ThesecondpartofTable1showsthedierencebetweentheestimatedtransformation
8/8/2019 Vessel Linear
92/134
eldandtheknownone.Itshows
themeanlengthdierence(measuredinvoxels),thedeviationofthelength
dierence,therelativedierencewhichisthedierenceinlengthdividedbythe
lengthofvectorsintheknowntransformation
8/8/2019 Vessel Linear
93/134
eld,thedeviationoftherelativedierence,
orientationdierenceinradian,andthedeviationoforientationdierencerespectively.We
canseethemeanlengthdierenceislessthanhalfvoxel,themean
relativedierenceislessthan6percents,andthemeanorientationdierenceislessthan0.16radiansor10degrees.Therefore,theresultsdemonstratethe
accuracyofthe
8/8/2019 Vessel Linear
94/134
proposedapproach.Figure3showsboththe
synthetictransformation
8/8/2019 Vessel Linear
95/134
elds(rigidandradial)andtheestimated
ones.Wecanseethattheestimatedtransformation
8/8/2019 Vessel Linear
96/134
eldsarealmostidenticaltotheknown
ones.Inordertoevaluatetherobustnessoftheregistrationmethodagainst
noisemore
8/8/2019 Vessel Linear
97/134
NormalizedSumofAbsoluteDistancecase
1case2case3case4case5case6Initial
alignment12.93593410.1846024.0380314.59260610.81813012.540091Ourmethod2.8742461.7595470.9330381.105014
2.1995411.6177453Dsurface12.2641078.2869623.6247273.9547608.64555710.4357953Dvoxel10.8507078.8791893.4118764.1106118.32550611.2126773DNMI10.9701947.5256862.9425833.6689758.144775
8.570295
8/8/2019 Vessel Linear
98/134
DierenceofTransformationVectorscase1case
2case3case4case5case6Lengthdierence(mean)
0.3753670.4286000.3498460.3254190.3832610.250679Lengthdierence(dev)0.5332790.4612560.4737730.344143
0.4033070.225654Ralativedierence(mean)0.0495370.0566070.0543910.0496500.0568970.045490Ralativedi
erence
(dev)0.0648170.0847360.0986900.0695910.0744860.066269Orientationdierence(mean)0.0792090.075370
0.0834420.0714920.087357
8/8/2019 Vessel Linear
99/134
0.060312Orientationdierence(dev)0.1085360.1177590.143446
0.1597500.1209570.105408
Table1.Resultsofevaluatingtheproposed
approachinrecoveringknowntransformation
8/8/2019 Vessel Linear
100/134
eld.Itcanbeseenfromthe
8/8/2019 Vessel Linear
101/134
rstpartthatdistancebetweenthesource
andtargetvolumesafterregistrationbyouralgorithmsiswithinrangeof
[0:932:87],whichismuchsmallerthanthedistanceobtainedusing
theotherthreeregistrationmethods.Fromthesecondpartofthistable,Wecanseethemeandierenceinlengthislessthanhalfvoxel,
themeanrelative
8/8/2019 Vessel Linear
102/134
errorinlengthislessthan6
percents,andthemeanorientationerrorislessthan0.16radiansor
10degrees.(a)(b)Figure3.Theresultofregistrationonimagedeformed
bysynthetictransformation
8/8/2019 Vessel Linear
103/134
eld.(a)knownnon-rigidtransformation
8/8/2019 Vessel Linear
104/134
eld.(b)estimatednon-rigid
8/8/2019 Vessel Linear
105/134
eld.
comprehensively,additivezero-meanGaussian
noiseatmultiplelevelsisaddedtothesyntheticdeformedvolumes.Figure
4showsthemeananddeviationofthemagnitudedierenceofthedisplacement
vectors.Itcanbeseenthattheregistrationalgorithmisquiterobustupto10dB(signaltonoiseratio).
4.CONCLUSIONIn
thispaper,a
8/8/2019 Vessel Linear
106/134
generalregistrationframeworkthatusesbothjunctions
andvesselsareproposed.Thelandmarks(junctionsandlinearvesselsegments)are
obtainedfromthevesselnetworkafterenhancement.Weusethevesselenhancement
8/8/2019 Vessel Linear
107/134
lterproposedinourpreviouswork,16which
candistinguishbetweenjunctionsandnodules,thus
8/8/2019 Vessel Linear
108/134
2
1.61.81.41.6
1.20 5 10 15 20
0 5 10 15 20
Mean normal of difference vector
1.41.21
Angle of difference vector
1
0.80.80.60.60.40.40.20.2Signal to noise ratio (SNR)Signal to noise ratio (SNR)(a)
(b)Figure4.Evaluationoftheregistrationalgorithmwithrespecttonoise.(a)meanmagnitudeofdierencevectorbetweenthetransformation
8/8/2019 Vessel Linear
109/134
elds.(d)thestandarddeviationofthe
magnitudeofthedierencevectorsbetweenthetransformation
8/8/2019 Vessel Linear
110/134
elds.Itcanbeseenthatthe
registrationalgorithmisquiterobustupto10dB.
the
negativeimpactofnewnodulesaresuppressed.Inthesegmentedvesselnetwork,junctions
areselectedbycheckingtheratioofeigenvaluesofthegradientcorrelationmatrix.Thematchingbetweenjunctionsisbuiltbysearchinginthetargetvolume
withinalocal
8/8/2019 Vessel Linear
111/134
windowafterinitialalignmentofthesource
andtargetvolumes.Thefalsematchingofjunctionsareiterativelyremovedusing
thelocalfeatureofthetransformation
8/8/2019 Vessel Linear
112/134
eld.Besidesjunctions,additionalconstraintsfromvessels
areincorporatedtoimprovetheregistration.Thematchingbetweenvesselsareobtained
bydeformingthecontourofvesselstotheirmatchesundertheguidanceof
anenergyfunction.Thetransformation
8/8/2019 Vessel Linear
113/134
eldisinterpolatedusingthinplatesplines.
Variousexperimentsshowthetheproposedalgorithmisaccurateinestimatingthe
non-rigidtransformation
8/8/2019 Vessel Linear
114/134
eldbetweentemporalCTscansandalso
robustagainstnoise.Theexperimentwithsyntheticnodulesdemonstratestherobustnessof
theproposedmethodagainstnewnodules.Futureworkwouldbetoevaluatethe
registrationonhigh-resolutionCTscansandcheckitsapplicationinthediagnosisoflungdiseasesuchasdetectionofnewnodulesandotherbloodvessel
relateddiseases.
8/8/2019 Vessel Linear
115/134
REFERENCES
1.C.L.
Novak,H.Shen,B.L.Odry,J.P.Ko,andD.P.
Naidich,\Systemforautomaticdetectionoflungnodulesexhibitinggrowth,inProc.of
SPIEMedicalImaging:ImageProcessing,J.M.FitzpatrickandM.Sonka,eds.,5370,pp.10{21,May2004.2.S.-C.B.Lo,J.J.Lin,L.-Y.
Hsu,Y.M.
8/8/2019 Vessel Linear
116/134
F.Lure,M.T.F.M.D.,R.
Li,andH.Zhao,\Enhancementoflungnoduledetectionintemporalthoracic
CT,inProc.ofSPIEMedicalImaging:ImageProcessing,J.M.Fitzpatrickand
M.Sonka,eds.,5370,pp.1139{1144,2004.3.N.Takagi,Y.Kawata,N.Niki,K.Mori,H.Ohmatsu,R.Kakinuma,K.Eguchi,M.Kusumoto,M.
Kaneko,andN.
8/8/2019 Vessel Linear
117/134
8/8/2019 Vessel Linear
118/134
registration,inProc.ofSPIEMedicalImaging:
Physiology,Function,andStructurefromMedicalImages,A.A.AminiandA.
Manduca,eds.,5746,pp.453{464,April2005.5.M.UrschlerandH.Bischof,
\Assessingbreathingmotionbyshapematchingoflunganddiaphragmsurfaces,inProc.ofSPIEMedicalImaging:Physiology,Function,andStructurefromMedicalImages,
A.A.Amini
8/8/2019 Vessel Linear
119/134
andA.Manduca,eds.,5746,pp.440{452,
2005.
8/8/2019 Vessel Linear
120/134
6.J.R.McClelland,A.G.
Chandler,J.M.Blackall,S.Ahmad,D.B.Landau,andD.J.
Hawkes,\4Dmotionmodelsovertherespiratorycycleforuseinlungcancer
radiotherapyplanning,inProc.ofSPIEMedicalImaging:Visualization,Image-GuidedProcedures,andDisplay,R.L.G.Jr.andK.R.Cleary,eds.,5744,pp.173{183,
April2005.7.
8/8/2019 Vessel Linear
121/134
8/8/2019 Vessel Linear
122/134
E.A.Homan,\Evaluationandapplicationof
3DlungwarpingandregistrationmodelusingHRCTimages,inProc.of
SPIEMedicalImaging:PhysiologyandFunctionfromMultidimensionalImages,C.-T.ChenandA.
V.Clough,eds.,4321,pp.234{243,May2001.9.H.Yoshida,\Localcontralateralsubtractionbasedonbilateralsymmetryoflungforreductionoffalseposi
tivesincomputerized
8/8/2019 Vessel Linear
123/134
8/8/2019 Vessel Linear
124/134
CTimageregistrationwithastandardlung
atlas,inProc.ofSPIEMedicalImaging:PhysiologyandFunctionfromMultidimensional
Images,C.-T.ChenandA.V.Clough,eds.,3978,pp.67{77,April2000.
12.L.FanandC.W.Chen,\3Dwarpingandregistrationfromlungimages,inProc.ofSPIEMedicalImaging:PhysiologyandFunctionfromMultidimensional
Images,C.-T.Chen
8/8/2019 Vessel Linear
125/134
8/8/2019 Vessel Linear
126/134
polynomialregistration,inXIVBrazilianSymposiumon
ComputerGraphicsandImageProcessing,pp.258{265,2001.15.H.Shikata,Geometrical
AnalysisofTreeStructureinThree-DimensionalImages.PhDthesis,DivisionofSoftwareScience,
DepartmentofInformaticsandMathematicalScience,GraduateSchoolofEngineeringScience,OsakaUniversity,2002.16.C.Wu,G.Agam,andS.ArmatoIII,\Vessel-treereconstruction
inthoracicCT
8/8/2019 Vessel Linear
127/134
8/8/2019 Vessel Linear
128/134
evaluationstudy,IEEETransactionsonMedicalImaging
22,pp.661{673,May2003.19.J.Duchon,\Interpolationdesfonctionsde
deuxvariablessuivantlesprincipesdelaexiondesplaquesminces,RAIROAnalyse
Numerique10,pp.5{12,1976.20.J.Meinguet,\Multivariateinterpolationatarbitrarypointsmadesimple,ZeitschriftfurangewandteMathematikundPhysik30,pp.292{304,1979.
21.H.Wang,
8/8/2019 Vessel Linear
129/134
B.Zheng,W.Good,andT.-G.Zhuang,
\Thin-platesplinebasedautomaticalignmentofdynamicMRbreastimages,inProc.
ofthe22ndAnnualInternationalConferenceoftheIEEEEngineeringinMedicineand
BiologySociety,4,pp.2850{2853,23-28July2000.22.F.L.Bookstein,\Thin-platesplinesandtheatlasproblemforbiomedicalimages,inProc.of12th
InternationalConferenceInformationProcessing
8/8/2019 Vessel Linear
130/134
inMedicalImaging,pp.326{342,1991.23.
K.Rohr,H.Stiehl,R.Sprengel,T.Buzug,J.Weese,andM.
Kuhn,\Landmark-basedelasticregistrationusingapproximatingthin-platesplines,IEEETransactionsonMedicalImaging
20,pp.526{534,June2001.24.F.ZanaandJ.Klein,\Amultimodalregistrationalgorithmofeyefundusimagesusingvesselsdetectionandhoughtransform,
IEEETransactionson
8/8/2019 Vessel Linear
131/134
MedicalImaging18,pp.419{428,May1999.
25.E.Guest,M.Fidrich,S.Kelly,andE.Berry,\Robustsurface
matchingforregistration,inSecondInternationalConferenceon3-DDigitalImagingandModeling,
pp.169{177,Oct.1999.
8/8/2019 Vessel Linear
132/134
26.S.C,H.DL,and
H.DJ,\Automated3-DregistrationofMRandCTimagesofthe,
MedicalImageAnalysis1(2),pp.163{175,1996.27.C.Studholme,D.Hawkes,and
D.Hill,\Anormalizedentropymeasureformultimodalityimagealignment,inProc.ofSPIEMedicalImaging,3338,pp.132{143,(SanDiego,CA),Feb.23-261998.
28.J.Camp
8/8/2019 Vessel Linear
133/134
andR.Robb,\Anovelbinningmethod
forimprovedaccuracyandspeedofvolumeimagecoregistrationusingnormalized
mutualinformation,inProc.ofSPIEMedicalImaging:ImageProcessing,K.M.Hanson,
ed.,3661,pp.24{31,1999.
8/8/2019 Vessel Linear
134/134