Generalized MosaicsYoav Y. Schechner,Shree Nayar

Department of Computer ScienceColumbia University

Mosaics

Redundant MeasurementsGeneralized Mosaicing: Yoav Schechner and Shree Nayar

Scanning with Less RedundancyDifferent rows = Different optical characteristics

Generalized MosaicingcameraSpatially varying filterSchechner, Nayar, Generalized mosaics

Mosaic + High Dynamic Range

Fusion of MeasurementsMaximum-Likelihood SolutionSchechner, Nayar, Generalized mosaics

Generalized Mosaicing: Yoav Schechner and Shree NayarLog of the mask

Mask Self-CalibrationUnknown filter (vignetting)Schechner, Nayar, Generalized mosaics

Image RegistrationSchechner, Nayar, Generalized mosaics

Bias towards no motionSchechner, Nayar, Generalized mosaicsImage Registration

Schechner, Nayar, Generalized mosaicsImage Registration

Registration: Standard Coarse to Fine Schechner, Nayar, Generalized mosaics

Maximum-Likelihood Pyramid At each level L , for each pixelSchechner, Nayar, Generalized mosaics

Max-Likelihood PyramidGaussian Pyramid

xMosaicSchechner, Nayar, Generalized mosaics

Generalized Mosaicing: Yoav Schechner and Shree NayarVariable Spectral Filter

Generalized Mosaicing: Yoav Schechner and Shree Nayar

Generalized Mosaicing: Yoav Schechner and Shree NayarRendering : Any Illumination

Illumination at a Glance

Spatially Varying PolarizerPolarization Mosaicing: Yoav Schechner and Shree Nayar

Polarization Mosaicing: Yoav Schechner and Shree NayarSpatially Varying Polarizer

Raw imagesPolarization Mosaicing: Yoav Schechner and Shree Nayar

Polarization Mosaic

Spatially Varying FocusGeneralized Mosaicing: Yoav Schechner and Shree Nayar

All Focused MosaicGeneralized Mosaicing: Yoav Schechner and Shree Nayar and a Depth Map

What else?Generalized Mosaicing: Yoav Schechner and Shree NayarDynamic Range & Spectrum & Polarization etc.

Sampling CriteriaGeneralized Mosaicing: Yoav Schechner and Shree NayarNumber of samples per scene point1011100101

Wide field of view