34
Bridging the Gap to the Real Wojciech Matusik Adobe Systems, Inc.

Bridging the Gap to the Real

  • Upload
    yoko

  • View
    22

  • Download
    0

Embed Size (px)

DESCRIPTION

Bridging the Gap to the Real. Wojciech Matusik Adobe Systems, Inc. Computer Graphics: Past, Present, Future. Goal of this Talk Look at Trends Extrapolate New Challenges Disclaimer: My personal (very biased) view - PowerPoint PPT Presentation

Citation preview

Page 1: Bridging the Gap to the Real

Bridging the Gap to the Real

Wojciech MatusikAdobe Systems, Inc.

Page 2: Bridging the Gap to the Real

Computer Graphics: Past, Present, Future

• Goal of this Talk– Look at Trends– Extrapolate– New Challenges

Disclaimer: My personal (very biased) view I have not even taken a cg course.

TimeM

ilest

ones

Page 3: Bridging the Gap to the Real

TimeM

ilest

ones

Computer Graphics: Past, Present, Future

• Goal of this Talk– Look at Trends– Extrapolate– New Challenges

Disclaimer:I will present my own biased view.

Page 4: Bridging the Gap to the Real

A Simulation to Generate Images or Videos

Simulation

Lights

Shading

Motion

Geometry

Page 5: Bridging the Gap to the Real

Traditional Computer Graphics

Simulation

Lights

Shading

Motion

Geometry

• Components– Hand Modeled– Procedurally

Defined– Analytical

Formulas

Courtesy of Wikimedia

Page 6: Bridging the Gap to the Real

Traditional Computer Graphics: Geometry

Simulation

Lights

Shading

Motion

Geometry

axiom = Fproduction rule F -> FF-[-F+F+F]+[+F-F-F]

L-Systems

Fractals

Perlin Noise, Hypertextures

Courtesy of Wikimedia

Courtesy of Ken Perlin

Courtesy of Wikimedia

Page 7: Bridging the Gap to the Real

Traditional Computer Graphics: Lights

Simulation

Lights

Shading

Motion

Geometry

Directional

Point

Spot

Courtesy of Wikimedia

Page 8: Bridging the Gap to the Real

Traditional Computer Graphics: Shading

Simulation

Lights

Shading

Motion

Geometry

Cook’s Shade Trees

Phong

Blinn-Phong

Cook-Torrance

Courtesy of Rob Cook

Page 9: Bridging the Gap to the Real

Traditional Computer Graphics: Animation

Simulation

Lights

Shading

Motion

Geometry

Animation Controllers

Keyframing

Courtesy of Jessica Hodgins

Page 10: Bridging the Gap to the Real

Traditional Computer Graphics

Real WorldLights,

Geometry, Shading, Motion,

Simulations

Editing and User

Input

Computer Graphics

Page 11: Bridging the Gap to the Real

Data-driven Computer Graphics: 90s - now

Real WorldLights,

Geometry, Shading, Motion,

Simulations

Input Devices

• Progress in development of sensors• Cheap storage and computation power for data

processing

Page 12: Bridging the Gap to the Real

Data-driven Computer Graphics: Geometry

Simulation

Lights

Shading

Motion

Geometry

3D Scanning

Courtesy of Marc Levoy

Page 13: Bridging the Gap to the Real

Data-driven Computer Graphics: Lights

Simulation

Lights

Shading

Motion

Geometry

Environment MappingHDR Imaging

Courtesy of Paul DebevecCourtesy of Wikimedia

Page 14: Bridging the Gap to the Real

Data-driven Computer Graphics: Shading

Simulation

Lights

Shading

Motion

Geometry

Measured Appearance

Courtesy of Kristin DanaCourtesy of Wikimedia

Page 15: Bridging the Gap to the Real

Data-driven Computer Graphics: Animation

Simulation

Lights

Shading

Motion

Geometry

Motion Capture

Courtesy of Wikimedia

Page 16: Bridging the Gap to the Real

Data-driven Computer Graphics

Real WorldLights,

Geometry, Shading, Motion,

Simulations

Input Devices

Page 17: Bridging the Gap to the Real

Data-driven Modeling and Editing

Real WorldLights,

Geometry, Shading, Motion,

Simulations

Input Devices

Editing and User

Input

Page 18: Bridging the Gap to the Real

Data-driven Modeling and Editing: Geometry

Simulation

Lights

Shading

Motion

Geometry

Modeling by Example, 2004Funkhouser et al.

Page 19: Bridging the Gap to the Real

Data-driven Modeling and Editing: Lights

Simulation

Lights

Shading

Motion

Geometry

Skyfinder : Attribute-based Sky Image Search, 2009Tao et al.

Page 20: Bridging the Gap to the Real

Data-driven Modeling and Editing: Shading

Simulation

Lights

Shading

Motion

Geometry

Data-driven Reflectance Model, 2003Matusik et al.

Page 21: Bridging the Gap to the Real

Data-driven Modeling and Editing: Animation

Simulation

Lights

Shading

Motion

Geometry

Motion Graphs, 2002Kovar et al., Lee et al., Arikan & Forsyth

Page 22: Bridging the Gap to the Real

Data-driven Computer Graphics: 90s - now

Real WorldRepresentatio

ns AbstractionsSimulations

Input Devices

Editing and User

Input

Page 23: Bridging the Gap to the Real

Computer Graphics: Future

Real WorldRepresentatio

ns AbstractionsSimulations

Input Devices

Output Devices

Editing and User

Input

Page 24: Bridging the Gap to the Real

Shape Capture, Modeling, and Fabrication

Real Object 3D Model3D Scanning 3D Printing Output

User Edits

Courtesy of Wikimedia

Page 25: Bridging the Gap to the Real

Motion Capture, Modeling, and Robotics

Human Motion Motion ModelMocap ControllerDesign

HumanoidRobot

User Edits

Courtesy of WikimediaCourtesy of Wikimedia

Page 26: Bridging the Gap to the Real

Light Field Capture, Modeling, and Display

3D Scene Light FieldCameraArray

AutostereoscopicDisplay

Light Out

User Edits

Courtesy of M.Levoy

Courtesy of F. Durand

Page 27: Bridging the Gap to the Real

Appearance Capture, Modeling, and Fabrication

Real Material Data-drivenModel

Measurement Fabrication Output

User Edits

Page 28: Bridging the Gap to the Real

Challenges: Output Mapping

Data Abstraction

Device Capabilities Device

Capabilities

Data Abstraction

Page 29: Bridging the Gap to the Real

Output Mapping Examples– Gamut Mapping

– Tone Mapping

– Image Retargeting

Courtesy of Wikimedia

Courtesy of Shai Avidan

Courtesy of Wikimedia

Page 30: Bridging the Gap to the Real

• Different Phenomena– Reflectance, Scattering, Deformations, Motion

• Rules– Linear vs. Perceptually-Based– Global vs. Local

Generalized Output Mapping Algorithms

Page 31: Bridging the Gap to the Real

• Complex aggregates from base materials with known properties

Future Printers, Displays, and Output Devices

Page 32: Bridging the Gap to the Real

Future Output Devices

Future Printers, Displays, and Output Devices

Data-drivenRepresentatio

nsand

Abstractions

Output Mapping

Page 33: Bridging the Gap to the Real

Computer Graphics: Closing the Loop

Real WorldRepresentatio

ns AbstractionsSimulations

Input Devices

Output Devices

Editing and User

Input

Page 34: Bridging the Gap to the Real

My Vision Statement

The future of Computer Graphics and Interactive Techniques lies in novel input and output devices that operate in real-world environments and are accessible to everyone.