20
Tour Into the Picture [TIP]

Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Embed Size (px)

Citation preview

Page 1: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Tour Into the Picture [TIP]

Page 2: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

OutlineIntroductionTIPMulti-Perspective Modeling

Page 3: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MotivationImpressive results using the TIP technique

TIP

By Hoi Ng 1982

Page 4: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

The TIP Technique

Page 5: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling
Page 6: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Background Foreground

Page 7: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling
Page 8: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling
Page 9: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Background Model Foreground with meshes

Page 10: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling
Page 11: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Motivation (cont.)

Chinese landscape paintings

Horizontal or vertical scrolls

from Mustard Seed Garden Painting Manual, revised version by Ch’ao Hsun, 1887

Page 12: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Multiple Perspectives in Chinese Landscape Paintings

Eye locations

Page 13: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Motivation (cont.)Panorama

Compact representationEasy to produceCost effective for virtual reality (VR)

Page 14: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Multi-Perspective Modeling (MPM)

Solution: introduce local and global models; switch them smoothly

TIP is not applicable for multi-perspective images:

horizons at different levels multiple cavities

Sub-scene 1Sub-scene 1Sub-scene

2Sub-scene 2

Page 15: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MPM: Global Modeling

Global model

Rectangle Cylinder

Sphere

Page 16: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MPM: Sub-scene Modeling

Local model for a sub-scene

A box model as in TIP

Foreground objects as “billboards”

Page 17: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MPM: System Overview

Rendering

Record animation

key-frames

Render & output

animation

Generate smooth camera

path

Modeling

Build billboards for foreground

objects from mask

Model back-ground using TIP interface

Select a global model

Pre-processing

Prepare: Foreground mask Background image

Digitize the input image

Identify sub-scenes

For each sub-scene

Page 18: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MPM: Model Switching

Scene entry points

Page 19: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

Panorama as Input

Sub-scene 2Sub-scene 2

Sub-scene 1Sub-scene 1

Page 20: Tour Into the Picture [TIP]. Outline Introduction TIP Multi-Perspective Modeling

MPM: Model Switching