40
Progressive extraction of neural models from high-resolution 3D images of brain CAD’16 Vancouver, Canada

Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Progressiveextractionofneuralmodelsfromhigh-resolution3Dimagesofbrain

CAD’16 Vancouver, Canada

Page 2: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Contents

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 2

• Motivation• Background• Firstexperiments• Methodformulation• Conclusion

Page 3: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Motivation

Page 4: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Marching-cubes(Siggraph,1987)

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 4

Findthe0-surface(oranyiso-surface)ofadiscrete3Dfield

Page 5: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Progressofhigh-resolutionimagingtechnology

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 5

WilliamE.Lorensen&HarveyE.Cline,"MarchingCubes:aHighResolution3DSurfaceConstructionAlgorithm",Siggraph,1987

Page 6: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Progressofhigh-resolutionimagingtechnology

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 6

NobelPrizeinChemistry2014awardedtoBetzig,Moerner&Hellfor"developmentofsuper-resolvedfluorescencemicroscopy,"whichbrings"opticalmicroscopyintothenanodimension"

Page 7: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Progressofhigh-resolutionimagingtechnology

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 7

Source:FeiChen,PaulW.Tillberg,EdwardS.Boyden.Expansionmicroscopy.Science,January152015;DOI:10.1126/science.1260088

Page 8: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Progressofhigh-resolutionimagingtechnology

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 8

TheViSUSsoftwareframeworkwasdesignedtoallowtheinteractiveexplorationofmassivescientificmodelsonavarietyofhardware,evengeographicallydistributed

NeuroscientistAlessandraMichelucci(Utah)withViSUSpowerwallandneuronesimage

Page 9: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

“Houston:We’vehadaproblem”

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 9

Searchfordetailedgeometricmodelsfromhi-resimaging

Page 10: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

“Apollo13:Wehaveasolution”

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 10

Lookforgeometricmodelsusingextremehi-resimaging

Page 11: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Andcontinuingthetravel...

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 11

Page 12: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Background

Page 13: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

LAR:noveltopologicalrepresentationscheme

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 13

Page 14: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

LinearAlgebraicRepresentation:

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 14

fromcellularmodelstosparsebinarymatrices

Page 15: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Sparsematrices:COO,CSRandCSCformats

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 15

aaaaaa

Page 16: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

LARexamples(1/2)

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 16

Page 17: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

LARexamples(2/2)

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 17

Page 18: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:matrixof∂2operator

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 18

Forasurface(topologicalspace)madeofallquads(2-cells)

Page 19: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Topologicalincidenceoperators

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 19

BinarytopologicalrelationsbetweenLARcells

andcorrespondingtopologicaloperatorson∂◦chains

Page 20: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Goal:integratingLARwithViSUS

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 20

Page 21: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Firstexperiments

Page 22: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Firstexperiments

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 22

STEP1:surfaceextraction(512×512×128)

TestDataSet:B-repofthechainofvoxelsabovealuminancethreshold

B-repmodel,includingnoise

Page 23: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Firstexperiments

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 23

STEP1:surfaceextraction(512×512×128)

TestDataSet:B-repofthechainofvoxelsabovealuminancethreshold

modelafternoisefiltering

Page 24: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Firstexperiments

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 24

STEP1:surfaceextraction(512×512×128)

TestDataSet:B-repofthechainofvoxelsabovealuminancethreshold

modelafterclosingandopeningmathematicalmorphologyoperators

Page 25: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Surfaceextraction(512×512×128)

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 25

interiorviewofaclosedshell(portionofdatachain)

TestDataSet:B-repofthechainofvoxelsabovealuminancethreshold

Page 26: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Methodformulation

Page 27: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

IDEA:computeafamilyofintrinsiccurves

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 27

ForeachVolinablock-partitionofa3-image:

Page 28: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Somethingwronghere?

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 28

Page 29: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:map_image_2_b-rep

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 29

Extractboundarymodelsfrom3D"bricks"ofvoxels

Page 30: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:simplify-B-Rep

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 30

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 31: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example1

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 31

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 32: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example1

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 32

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 33: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example2

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 33

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 34: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example2

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 34

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 35: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example3

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 35

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 36: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Algorithm:example3

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 36

Extract"intrinsic"curvesandGeneratehomologicallyequivalent&stronglyreducedmodels

Page 37: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Nextsteps

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 37

Page 38: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Conclusion

Page 39: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

(Partial)resultsobtainedandfurtheradvances

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 39

Page 40: Progressive extraction of neural models CAD’16 from high ...paoluzzi.dia.uniroma3.it/web/pao/doc/CAD16_Presentation.pdf · Progressive extraction of neural models from high-resolution

Thanksforyourattention

CAD'16Vancouver,Canada GiuliaClementi;DaniloSalvati;GiorgioScorzelli;AlbertoPaoluzzi;ValerioPascucci 40

QUESTIONS?