26
Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method • Compute descriptors of each mesh vertex •From these descriptors, learn areas that may be related to certain landmarks • cluster learned areas for a given landmark find pairs of clusters for landmarks that appear on both sides of the center (e.g. eye corners, mouth corners) • find clusters that appear in the 1

Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

Embed Size (px)

Citation preview

Page 1: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

1

Finding “Lines” of Symmetry on 3D Craniofacial Meshes

Method• Compute descriptors of each mesh vertex•From these descriptors, learn areas that may be related to certain landmarks• cluster learned areas for a given landmark• find pairs of clusters for landmarks that appear on both sides of the center (e.g. eye corners, mouth corners)• find clusters that appear in the middle• evaluate goodness of such clusters• choose the best ones and use to find the symmetry line

Page 2: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

2

We learned the en areas and symmetry

Page 3: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

3

Now we try 10 separate landmarks.

• 10 areas learned– Ten models– Nose: acal (nose side), prn, sn,se– Eyes: en, ex– Mouth: lils, ch, sto– Chin: slab

Page 4: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

4

acal

prn

Page 5: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

5

se

sn

Page 6: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

6

en

ex

Page 7: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

7

lils

sto

Page 8: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

8

Ch

slab

Page 9: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

9

• Cluster on selected areas based on position

acal prn se

sn en

Page 10: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

10

• Cluster on selected areas based on position

ex slab lils

ch sto

Page 11: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

11

Using landmarks given by doctors as a standard to define D_plane

• For 22qDS data, we have doctor marked points. From their landmarks, computer the symmetrical plane

Page 12: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

12

How to define “good” symmetric clusters

• A “good” pair of clusters should be symmetric to the plane

• A “good” single cluster should have the center on the plane

Page 13: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

13

• Select a “good” symmetry pair (or single area)

acal prn se

sn en

Page 14: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

14

• Select a “good” symmetry pair (or single area)

ex slab lils

ch sto

Page 15: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

15

Procedure for New Images

• Select possible landmark areas (from learning)• Clustering• Pair clusters• Classify “good symmetry”• Get center and draw a plane using learned

centers

Page 16: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

16

Select possible landmark areas

acal prn se

sn en

Page 17: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

17

Select possible landmark areas

ex slab lils

ch sto

Page 18: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

18

Cluster and Pair clusters

acal prn se

sn en

Page 19: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

19

Cluster and Pair clusters

ex slab lils

ch sto

Page 20: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

20

Classify “good symmetry”

acal prn se

sn en

Page 21: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

21

Classify “good symmetry”

ex slab lils

ch sto

Page 22: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

22

Get all the centers for good pairs and single ones

Page 23: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

23

Using only the “inliers” to get the symmetry plane

Page 24: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

24

Final result: pre-op 4days female unilateral CL

Page 25: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

25

Result: pre-op 3 wks female CLP

Page 26: Finding “Lines” of Symmetry on 3D Craniofacial Meshes Method Compute descriptors of each mesh vertex From these descriptors, learn areas that may be related

26

Result: pre-op 3m female CLP