45
1 Symmetry Transforms 1

Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

1

Symmetry Transforms

1

Page 2: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

2

Motivation

Symmetry is everywhere

Page 3: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

3

Motivation

Symmetry is everywhere

Perfect Symmetry[Blum ’64, ’67]

[Wolter ’85][Minovic ’97] [Martinet ’05]

Page 4: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

4

Motivation

Symmetry is everywhere

Local Symmetry[Blum ’78][Thrun ‘05] [Simari ’06]

Page 5: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

5

Motivation

Symmetry is everywhere

Partial Symmetry[Zabrodsky ’95][Kazhdan ’03]

Page 6: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

6

Goal

A computational representation that describes all planar symmetries of a shape

?

Page 7: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

7

Symmetry Transform

A computational representation that describesall planar symmetries of a shape

?

Page 8: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

8

Symmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 1.0Perfect Symmetry

Page 9: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

9

Symmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 0.3Local Symmetry

Page 10: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

10

Symmetry Transform

A computational representation that describesall planar symmetries of a shape

?Symmetry = 0.2Partial Symmetry

Page 11: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

11

Symmetry Measure

Symmetry of a shape is measured by correlation with its reflection

Page 12: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

12

Symmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD γγ ⋅= Symmetry = 0.7)(),( fffD γγ ⋅=

Page 13: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

13

Symmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD γγ ⋅= Symmetry = 0.3)(),( fffD γγ ⋅=

Page 14: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

14

Symmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD γγ ⋅=

)(),( fffD γγ ⋅=

Page 15: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

15

Symmetry Measure

Symmetry of a shape is measured by correlation with its reflection

)(),( fffD γγ ⋅= Symmetry = 0.1

Page 16: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

16

Previous Work

Zabrodsky ‘95

Kazhdan ‘03

Thrun ‘05

Martinet ‘05

Page 17: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

17

Symmetry Distance

Define the Symmetry Distance of a function f with respect to any transformation γ as the L2

distance between f and the nearest function invariant to γ

Can show that Symmetry Measureis related to symmetry distance by

ggggffSD

=

−=)(|

min),(γ

γ)(),( fffD γγ ⋅=

222),( fSDfD +−=γ

Presenter
Presentation Notes
It can be proven that the nearest function invariant to reflection is the average of the function itself and its reflection. Thus the symmetry distance is half the distance between the function is its reflection
Page 18: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

18

Previous Work

Zabrodsky ‘95

Kazhdan ‘03

Thrun ‘05

Martinet ‘05

Page 19: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

19

Previous Work

Zabrodsky ‘95

Kazhdan ‘03

Thrun ‘05

Martinet ‘05

Page 20: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

20

Previous Work

Zabrodsky ‘95

Kazhdan ‘03

Thrun ‘05

Martinet ‘05

Page 21: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

21

Computing Discrete Transform

Brute Force O(n6)ConvolutionMonte-Carlo

O(n3) planes

X

O(n3) dot product

Page 22: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

22

Computing Discrete Transform

Brute Force O(n6)Convolution O(n5Log n)Monte-Carlo

O(n2) normal directions

X

O(n3 log n) per direction

Page 23: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

23

Computing Discrete Transform

Brute Force O(n6)Convolution O(n5Log n)Monte-Carlo O(n4) For 3D meshes

• Most of the dot product contains zeros.

• Use Monte-Carlo Importance Sampling.

Page 24: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

24

Monte Carlo

Offs

et

Angle

Page 25: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

25

Monte Carlo

Monte Carlo Sample for single plane

Offs

et

Angle

Page 26: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

26

Monte Carlo

Offs

et

Angle

Page 27: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

27

Monte Carlo

Offs

et

Angle

Page 28: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

28

Monte Carlo

Offs

et

Angle

Page 29: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

29

Monte Carlo

Offs

et

Angle

Page 30: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

30

Monte Carlo

Offs

et

Angle

Page 31: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

31

Weighting Samples

Need to weight sample pairs by the inverse of the distance between them

P1

P2

d

Page 32: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

32

Weighting Samples

Need to weight sample pairs by the inverse of the distance between them

Two planes of (equal) perfect

symmetry

Page 33: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

33

Weighting Samples

Need to weight sample pairs by the inverse of the distance between them

Vertical votesconcentrated…

Page 34: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

34

Weighting Samples

Need to weight sample pairs by the inverse of the distance between them

Horizontal votesdiffused…

Page 35: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

35

Application: Alignment

Motivation:Composition of range scansMorphing

PCA Alignment

Page 36: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

36

Application: Alignment

Approach:Perpendicular planes with the greatest symmetries create a symmetry-based coordinate system.

Presenter
Presentation Notes
The model used here is a 5-sided tube. The exact method for choosing the principal symmetries is to find the plane with highest symmetry. The second plane is the one with highest symmetry that is perpendicular to the first. Similarly, the third plane must be perpendicular to the first two. Note that the center of mass slice has 10 “spokes”. This is because there are 10(12) directions of perfect symmetry
Page 37: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

37

Application: Alignment

Approach:Perpendicular planes with the greatest symmetries create a symmetry-based coordinate system.

Presenter
Presentation Notes
The model used here is a 5-sided tube. The exact method for choosing the principal symmetries is to find the plane with highest symmetry. The second plane is the one with highest symmetry that is perpendicular to the first. Similarly, the third plane must be perpendicular to the first two. Note that the center of mass slice has 10 “spokes”. This is because there are 10(12) directions of perfect symmetry
Page 38: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

38

Application: Alignment

Approach:Perpendicular planes with the greatest symmetries create a symmetry-based coordinate system.

Presenter
Presentation Notes
The model used here is a 5-sided tube. The exact method for choosing the principal symmetries is to find the plane with highest symmetry. The second plane is the one with highest symmetry that is perpendicular to the first. Similarly, the third plane must be perpendicular to the first two. Note that the center of mass slice has 10 “spokes”. This is because there are 10(12) directions of perfect symmetry
Page 39: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

39

Application: Alignment

Approach:Perpendicular planes with the greatest symmetries create a symmetry-based coordinate system.

Presenter
Presentation Notes
The model used here is a 5-sided tube. The exact method for choosing the principal symmetries is to find the plane with highest symmetry. The second plane is the one with highest symmetry that is perpendicular to the first. Similarly, the third plane must be perpendicular to the first two. Note that the center of mass slice has 10 “spokes”. This is because there are 10(12) directions of perfect symmetry
Page 40: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

40

Application: Alignment

Symmetry Alignment

PCA Alignment

Results:

Page 41: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

41

Application: Matching

Motivation:Database searching

Database ResultQuery

=

Presenter
Presentation Notes
We used the RST as a shape descriptor using the Princeton Shape Benchmark. As can be shown in the graph on the left, we improve upon previous work that used symmetry around the center of mass as a shape descriptor. Further work is being done to augment existing shape descriptors with symmetry information.
Page 42: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

42

Application: Matching

Observation:All chairs display similar principal symmetries

Presenter
Presentation Notes
We used the RST as a shape descriptor using the Princeton Shape Benchmark. As can be shown in the graph on the left, we improve upon previous work that used symmetry around the center of mass as a shape descriptor. Further work is being done to augment existing shape descriptors with symmetry information.
Page 43: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

43

Application: Matching

Approach:Use Symmetry transform as shape descriptor

Database ResultQuery

=

Transform

Presenter
Presentation Notes
We used the RST as a shape descriptor using the Princeton Shape Benchmark. As can be shown in the graph on the left, we improve upon previous work that used symmetry around the center of mass as a shape descriptor. Further work is being done to augment existing shape descriptors with symmetry information.
Page 44: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

44

Application: Matching

Results: Symmetry provides orthogonal informationabout models and can therefore becombined with other descriptors

Presenter
Presentation Notes
We used the RST as a shape descriptor using the Princeton Shape Benchmark. As can be shown in the graph on the left, we improve upon previous work that used symmetry around the center of mass as a shape descriptor. Further work is being done to augment existing shape descriptors with symmetry information.
Page 45: Symmetry Transforms - Max Planck Societyresources.mpi-inf.mpg.de/deformableShapeMatching/EG2011_Tutori… · 9 Symmetry Transform. A computational representation that describes all

45

Summary

Planar-Reflective Symmetry Transform

Captures degree of reflectional symmetry about all planes

Monte Carlo computation

Applications: alignment, search, completion,segmentation, canonical viewpoints, …