40
Kernel Methods on Manifolds Richard Hartley, Sadeep Jayasumana, Mehrtash Harandi, Mathieu Salzmann Hongdong Li, Khurrum Aftab, Fatih Porikli Conrad Sanderson CVPR-2017

Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Kernel Methods on Manifolds

Richard Hartley, Sadeep Jayasumana, Mehrtash Harandi, Mathieu Salzmann

Hongdong Li, Khurrum Aftab, Fatih Porikli Conrad Sanderson

CVPR-2017

Page 2: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Optimization methods on Manifolds. • Rotation averaging (SO3) • Weiszfeld Algorithm on Riemannian

manifolds • General IRLS algorithms on manifolds

Page 3: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Kernel SVM

Linear and Kernel SVM

Page 4: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 5: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 6: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 7: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 8: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 9: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Flatten out the meridians

(longitude lines)

Azimuthal Equidistant Projection

Angle-axis representation of Rotations

Page 10: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Azimuthal Equidistant Projection

Page 11: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Tissot Indicatrix – shows distortion

Page 12: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 13: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 14: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 15: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 16: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Kernels on Positive Definite Matrices

Page 17: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 18: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 19: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 20: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 21: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 22: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 23: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 24: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 25: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Atul Kanaujia

Guillaume Charpiat

Shape Manifold. Captures the configuration of a set of points, allowing for rotation, translation and scaling.

Page 26: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 27: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 28: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 29: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Leaf Database

Page 30: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!
Page 31: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Radial kernels on n-sphere

Page 32: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Schoenberg’s result

Page 33: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Radial kernels on n-sphere

• As i increases ki rapidly approaches either k-1 or k-2. • Therefore, the infinite series can be closely approximated with

a finite sum. • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Page 34: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Extending to other manifolds • Grassmann manifold with Projection

distance

• Shape manifold with full Procrustes distance

Page 35: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Hand sketch recognition

Page 36: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Face & action recognition

Page 37: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Shape recognition

Page 38: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

Acknowledgements. This talk deals with work done by myself and my collaborators, particularly

• Mehrtash Harandi • Sadeep Jayasumana • Mathieu Salzmann • Hongdong Li • Brian Lovell • Fatih Porikli

Page 39: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

NICTA : 9 Maryland : 7 Florida state : 6 University of Florida : 6 John Hopkins : 2 INRIA : 1

Papers in the last 3 years at top 3 vision conferences on Riemannian manifolds.

Page 40: Kernel Methods on Manifolds - Australian National Universityusers.cecs.anu.edu.au/~koniusz/tensors-cvpr17/... · • Readily fits in to a Multiple Kernel Learning (MKL) framework!

The End