56
Pattern Detection Computer Vision Some slides are from Yanxi Liu, CSE PennState Univ.

Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Pattern Detection

Computer Vision

Some slides are from Yanxi Liu, CSE PennState Univ.

Page 2: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Correspondence Problem & Keypoint

Image Filters, Gradients, Image Processing

Blob Detectors, Edge, Corner, Key Points

Matching, Tracking, Homography

Shapes, Patterns (2D, 3D, Spatiotemporal)

Recognitions (Object, Face, Gesture, Instance, Scene)

Page 3: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Pattern Detection

Page 4: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Symmetry Pattern Detection

Page 5: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

s

Page 6: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 7: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 8: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 9: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 10: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 11: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 12: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 13: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 14: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 15: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 16: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 17: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 18: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 19: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 20: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 21: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 22: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 23: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 24: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 25: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 26: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 27: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 28: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 29: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 30: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

30

Four Types of Primitive Symmetries

in 2D Euclidean Space [H. Weyl, 1952]

Rotation symmetry Translation symmetry Reflection symmetry

Glide-reflection symmetry

translation reflection

Page 31: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 32: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 33: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 34: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 35: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 36: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 37: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 38: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 39: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Reflection Symmetry Pattern Detection

Page 40: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 41: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 42: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection
Page 43: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

43

Curved Symmetry Axes are Everywhere!

Lizards & snakes

Leaves

Spines

Page 44: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

44

Related Work

Medial axis detection 2

Medial axis is not designed to find

(glide) reflection symmetries of the

pattern

[Peng et. al., Bioinformatics 08]

[Bonnassie et. al., ICIP 01]

Medial axis is not designed to find a

symmetry axis given discrete subparts

Page 45: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

45

Curved Glide-Reflection

Special cases of curved

glide-reflection symmetry

1. Reflection 2. Glide-reflection 4. Curved reflection 3. Non-Uniform

glide-reflection

Curved glide-reflection

Page 46: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

46

Axes Grouping

46

Feature point

extraction

Matching point

pair selection

Curve fitting

Axes grouping

Axes grouping based

on the distance in 2D

density space

3D parameter

space

2d projection

Algorithm

Page 47: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

47

Curve Fitting

47

Feature point

extraction

3D parameter

space

Axes grouping

Curve fitting -Fit 1~5 degree polynomial curves

Matching point

pair selection

Algorithm

Page 48: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

48

Curve Fitting With RANSAC

48

Feature point

extraction

3D parameter

space

Axes grouping

Curve fitting

Matching point

pair selection

Algorithm

Page 49: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

49

Experimental Results

49 Zebra fish

Lizard

Leaves

Spine

Caterpillar

Page 50: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

50

Curved axis rectification

50

Curved axis detection and rectification improves classification rate.

Quercus robur

Tilia

Sorbus aucuparia

Page 51: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

Rotation Symmetry Pattern Detection

Page 52: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

52

Rotation Symmetry Groups

Cyclic group

Dihedral group Orthogonal group

[ 5 properties ] 1. Center of rotation

2. Affine deformation

3. Symmetry type

4. Cardinality

5. Supporting region

Page 53: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

53

Frieze-Expansion

Page 54: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

54

Frequency Analysis

54

RSS

Affine

rectification

SSD LF

Frequency

analysis

Frieze-expansion

Merging &

elimination

Page 55: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

55

Experimental Results

55

Real single-center images

Page 56: Pattern Detection - khu.ac.krcvlab.khu.ac.kr/CVLecture17.pdf[Bonnassie et. al., ICIP 01] Medial axis is not designed to find a symmetry axis given discrete subparts 45 Curved Glide-Reflection

56

Experimental Results

56

Real multi-center images