1
Automatic Alignment of Shape Collections Melinos Averkiou and Niloy Mitra {m.averkiou,n.mitra}@cs.ucl.ac.uk Figure 1: Our algorithm. We start from a collection of similar shapes in arbitrary poses and align them using deformation information. (a) Input: S i (black) will be aligned to S 0 (blue). (b) Extract a template shape S 0 (red) from S 0 and a proxy shape S i (green) from S i . (c) Deform S 0 to match shape S i . (d) Align S 0 and S i using PCA. (e) Correct misalignments. (f) Output: S i is aligned to S 0 . 1. Motivation Shape collections have become ubiquitous. Many interesting applications, ranging from shape search engines to assembly-based 3D modeling [FKS * 04] depend on such collections. These applications typically assume the input shapes to be in alignment. Manually aligning these shapes is tedious and often produces imprecise results. Some previous approaches for aligning pairs of shapes have relied on normalization of shape poses, typically by using Principal Component Analysis (PCA) [ETA02], or on exhaustive search over the space of rotations. None of these were designed for aligning shape collections. We present a method for the automatic alignment of a collection of similar shapes. Similar means they belong to the same semantic class, for example a class of cars. Figure 2: Alignment results for three pairs of shapes from the synthetic dataset we used. 2. Method Our method takes as input a collection S of similar shapes. One shape S 0 is chosen so that all other shapes are aligned to it. The main steps are (see Figure 1): Step 1: Template shape extraction. We extract a deformation model that describes the variability of the shape collec- tion [OLGM11]. We then extract a template shape S 0 from shape S 0 and a proxy shape S i for any other shape S i , i 1 ... N where N is the size of the shape col- lection, using connected component analysis. Each template shape is essentially a collection of bounding boxes. Step 2: Template shape deformation. We use the extracted deformation model to deform the template shape S 0 so that it matches shape S i . In the example of Figure 1, the template’s component corre- sponding to the wings of the aeroplane moves along the fuselage. Step 3: PCA alignment. We use PCA to recover the eigenvectors of the covariance matrix for template shape S 0 and proxy shape S i . We align these eigenvectors, thus aligning S 0 and S i . Step 4: Misalignment correction. Due to eigenvector ambiguity, it is possible that S 0 and S i are aligned wrongly in step 3. We go through the 24 possible alignments and select the one that gives the smallest distance between S 0 and S i . The resulting transformation aligns S i to S 0 . Figure 3: The synthetic dataset we used for testing our approach. 3. Results We created 100 synthetic aeroplanes by moving the wings of an aeroplane S 0 along the fuselage and to its side (for examples of aeroplanes see Figure 3). Each model was then randomly rotated and translated. The rotations were stored as ground truth. The original aeroplane S 0 was chosen so that all other aeroplanes were aligned to it. We tested the accuracy of the following approaches: 1. Our method 2. Direct PCA alignment 3. Best PCA alignment, i.e., the same as direct PCA alignment, but while aligning the eigenvectors, go through the 24 possible alignments and choose the best one Figure 4 illustrates the Frobernius distance to the ground truth for each pair of shapes S 0 and S i , i 1 ... 99. As illustrated in the plot, our method clearly outper- forms the other two methods, providing alignments very near the ground truth for all shape pairs. 0 10 20 30 40 50 60 70 80 90 100 0 0.5 1 1.5 2 2.5 3 Aeroplane number Frobernious distance Our method Best PCA alignment Direct PCA alignment Figure 4: Accuracy comparison of the three methods in terms of Frobernius distance to the ground truth. Our method gives near ground truth alignments. 4. Conclusions and Future Work Our alignment method for collections of similar shapes gives near ground truth alignments, without incurring a high computational cost. Next, we would like to test our approach with real shapes from repositories to validate our initial results on this synthetic dataset. References [ETA02] E LAD M., T AL A., A R S.: Content based retrieval of vrml objects: an iterative and interactive approach. In Proceedings of the 6th Eurographics workshop on Multimedia 2001 (2002), pp. 107–118. [FKS * 04] F UNKHOUSER T., K AZHDAN M., S HILANE P., M IN P., K IEFER W., T AL A., RUSINKIEWICZ S., D OBKIN D.: Modeling by example. ACM Trans. Graph. 23 (2004), 652–663. [OLGM11] OVSJANIKOV M., L I W., G UIBAS L., M ITRA N. J.: Exploration of continuous vari- ability in collections of 3d shapes. ACM Trans. Graph. 30 (2011), 33:1–33:10.

Automatic Alignment of Shape Collections

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Automatic Alignment of Shape Collections

Automatic Alignment of Shape Collections

Melinos Averkiou and Niloy Mitra{m.averkiou,n.mitra}@cs.ucl.ac.uk

Figure 1: Our algorithm. We start from a collection of similar shapes in arbitrary poses and align them using deformation information.

(a) Input: Si (black) willbe aligned to S0 (blue).

(b) Extract a template shape S0 (red) from S0 anda proxy shape Si (green) from Si.

(c) Deform S0 to matchshape Si.

(d) Align S0 and Si usingPCA.

(e) Correctmisalignments.

(f) Output: Si isaligned to S0.

1. Motivation

Shape collections have become ubiquitous. Many interesting applications, rangingfrom shape search engines to assembly-based 3D modeling [FKS∗04] depend onsuch collections. These applications typically assume the input shapes to be inalignment. Manually aligning these shapes is tedious and often produces impreciseresults.

Some previous approaches for aligning pairs of shapes have relied on normalizationof shape poses, typically by using Principal Component Analysis (PCA) [ETA02],or on exhaustive search over the space of rotations. None of these were designedfor aligning shape collections.

We present a method for the automatic alignment of a collection of similar shapes.Similar means they belong to the same semantic class, for example a class of cars.

Figure 2: Alignment results for three pairs of shapes from the synthetic dataset we used.

2. Method

Our method takes as input a collection S of similar shapes. One shape S0 is chosenso that all other shapes are aligned to it. The main steps are (see Figure 1):

Step 1: Template shape extraction.We extract a deformation model that describes the variability of the shape collec-tion [OLGM11]. We then extract a template shape S0 from shape S0 and a proxyshape Si for any other shape Si, i ∈ 1 . . .N where N is the size of the shape col-lection, using connected component analysis. Each template shape is essentially acollection of bounding boxes.

Step 2: Template shape deformation.We use the extracted deformation model to deform the template shape S0 so thatit matches shape Si. In the example of Figure 1, the template’s component corre-sponding to the wings of the aeroplane moves along the fuselage.

Step 3: PCA alignment.We use PCA to recover the eigenvectors of the covariance matrix for template shapeS0 and proxy shape Si. We align these eigenvectors, thus aligning S0 and Si.

Step 4: Misalignment correction.Due to eigenvector ambiguity, it is possible that S0 and Si are aligned wrongly instep 3. We go through the 24 possible alignments and select the one that gives thesmallest distance between S0 and Si. The resulting transformation aligns Si to S0.

... ...Figure 3: The synthetic dataset we used for testing our approach.

3. Results

We created 100 synthetic aeroplanes by moving the wings of an aeroplane S0 alongthe fuselage and to its side (for examples of aeroplanes see Figure 3). Each modelwas then randomly rotated and translated. The rotations were stored as groundtruth. The original aeroplane S0 was chosen so that all other aeroplanes werealigned to it. We tested the accuracy of the following approaches:

1. Our method

2. Direct PCA alignment

3. Best PCA alignment, i.e., the same as direct PCA alignment, but while aligningthe eigenvectors, go through the 24 possible alignments and choose the best one

Figure 4 illustrates the Frobernius distance to the ground truth for each pair ofshapes S0 and Si, i ∈ 1 . . . 99. As illustrated in the plot, our method clearly outper-forms the other two methods, providing alignments very near the ground truth forall shape pairs.

0 10 20 30 40 50 60 70 80 90 1000

0.5

1

1.5

2

2.5

3

Aeroplane number

Frob

erni

ous

dist

ance

Our methodBest PCA alignmentDirect PCA alignment

Figure 4: Accuracy comparison of the three methods in terms of Frobernius distance to theground truth. Our method gives near ground truth alignments.

4. Conclusions and Future Work

Our alignment method for collections of similar shapes gives near ground truthalignments, without incurring a high computational cost. Next, we would like totest our approach with real shapes from repositories to validate our initial resultson this synthetic dataset.

References

[ETA02] ELAD M., TAL A., AR S.: Content based retrieval of vrml objects: an iterative andinteractive approach. In Proceedings of the 6th Eurographics workshop on Multimedia2001 (2002), pp. 107–118.

[FKS∗04] FUNKHOUSER T., KAZHDAN M., SHILANE P., MIN P., KIEFER W., TAL A.,RUSINKIEWICZ S., DOBKIN D.: Modeling by example. ACM Trans. Graph. 23 (2004),652–663.

[OLGM11] OVSJANIKOV M., LI W., GUIBAS L., MITRA N. J.: Exploration of continuous vari-ability in collections of 3d shapes. ACM Trans. Graph. 30 (2011), 33:1–33:10.