53

homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective
Page 2: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••

Page 3: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 4: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 5: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 6: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

http://www.iryoku.com/skincolor/downloads/A-Practical-Appearance-Model-for-Dynamic-Facial-Color.mp4

Page 7: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Video:http://www.iryoku.com/skincolor/downloads/A-Practical-Appearance-Model-for-Dynamic-Facial-Color.mp4

Paper:http://www.iryoku.com/skincolor/downloads/A-Practical-Appearance-Model-for-Dynamic-Facial-Color.pdf

Jimenez et. al., ACM Transactions on Graphics, Vol. 29 (5), 2010

Page 8: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••

Page 9: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 10: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••

• …

Page 12: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

https://www.youtube.com/watch?v=6lSrgPeOZsA

Around 3:45

Page 14: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••

Page 15: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 16: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••

→ J is the matrix for the linear constraints→ A is the positive definite matrix of the objective function→ d are the constants of linear constraints

Page 17: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective
Page 18: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 19: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

What we want

What we get

Page 20: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 21: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

https://www.youtube.com/watch?v=lvuV3A09_5g

https://www.youtube.com/watch?v=pqf4wxgl938

Page 22: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••

Page 23: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

https://www.youtube.com/watch?v=KPDfMpuK2fQ

Page 24: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 26: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••

Page 27: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••

http://www.youtube.com/watch?v=GBgURIUQ700

Page 29: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

1.

2.→

3.→

4.5.

Page 30: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective
Page 31: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••

Page 32: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

+ =

Diffuse(directional)

Specular(highlights)

Page 33: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

•Light reflected to all directions● considers the angle of incidence of light on

surface ● The light is subscattered under the skin, before

emerging at the surface again● Reflected to a random direction

Object

N

L

I

No dependence on camera angle!

Example: sphere(lit from left)

Page 34: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

•Direct reflections of light source off shiny object● specular intensity n = shiny

reflectance of object● Result: specular highlight on

object

Object

N

Ip: light intensityI : output colorR: reflection vector S : direction towards the cameraα : angle between R and S

R (Reflection)

S

No dependence on object colour.

αL

Page 35: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

•●

Page 36: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 37: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 38: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 39: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••

••

Page 40: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 41: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective
Page 42: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

•••

Page 43: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Pixel brightness

So

: source brightness

: surface albedo (reflectance)

Page 44: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Three light source:

Page 45: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 46: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective
Page 47: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 48: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 49: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 50: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Page 51: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

Use pairs of polarized projectors and provide each viewer with inexpensive polarized glassesThese glasses have lenses polarized differently for the right and left eyesEach eye sees the image component of the stereo pair with matching polarization

Page 52: homepages.inf.ed.ac.ukhomepages.inf.ed.ac.uk/tkomura/cav/presentation7_2020.pdf · → J is the matrix for the linear constraints → A is the positive definite matrix of the objective

••••