Embed Size (px)
Citation preview
8/16/99
Experiments in Motion (Capture)Experiments in Motion (Capture)
8/16/99
Experiments in Motion CaptureExperiments in Motion Capture
• Project Course• Week 3-5: Motion Capture Pipeline Assignments• Then start group project (lots of experimenting)• In parallel lectures on other art / science projects• Everybody also does a 20min presentation on paper/project
8/16/99
SyllabusSyllabus
• 01-26: Beliz on Dance / Mocap / Jitter• 02-02 / 02-09 /02-16: Mocap Pipeline Assignments• 02-23: More Project Examples• 03-02: Project Brainstorming (maybe Salie Lecture)• 03-09: Project Proposal due (+ Luke lecture / Chris gone)• 03-16: Spring Break• 03-23: Gaming + Mocap• 03-30: Vison based Mocap• 04-06: Progress Reports• 04-13: Art + Mocap• 04-20: Special Effects + Mocap• 04-27: Facial Capture• Final Slot: Project Presentations
8/16/99
Motion Capture Based PuppetryMotion Capture Based Puppetry
Virtual Actor System by SimGraphics Popovic
8/16/99
Characters to AnimateCharacters to Animate
Paul Kaiser / Merce Cunningham © Electronic Arts
8/16/99
Visual TrackingVisual Tracking
Visual Tracking: Unsolved for general settings
8/16/99
The Graphics ProblemThe Graphics Problem
8/16/99
The Vision ProblemThe Vision Problem
8/16/99
The Motion Capture ProblemThe Motion Capture Problem
ComputerModel
8/16/99
Motion Capture: Standard PipelineMotion Capture: Standard Pipeline
Multi-View High-Speed Recording Image Feature Tracking
View 1 View 2
3
1 2
4
2D -> 3D Reconstruction
Camera 1 Camera 1
3D
Kinematic Model Fitting
8/16/99
Expressive mocap shoot Expressive mocap shoot
8/16/99
Motion Analysis Corp + Electronic ArtsMotion Analysis Corp + Electronic Arts
8/16/99
The quest for RealismThe quest for Realism
© Warner Bros & DreamWorks© Warner Bros & DreamWorks
Pass the Turing Test ???Pass the Turing Test ??? Final Fantasy -- Final Fantasy -- Create Illusion on ScreenCreate Illusion on Screen
© Square© Square
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
Performance-Capture:Mocap / Rotoscoping
Traditional:Hand-Animated
Pixar Electronic Arts
8/16/99
Most Characters are not realMost Characters are not real
8/16/99
Disney: Expressive MotionDisney: Expressive Motion
8/16/99
Motion ReferenceMotion Reference
8/16/99
Motion ReferenceMotion Reference
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
8/16/99
"Artistic Fact or Optical Delusion? Culture: David Hockney claims many famous paintings were traced using camera-like devices"
8/16/99
Rotoscoping is everywhereRotoscoping is everywhere
• Disney:
Step-Mother Eleanor Audley
8/16/99
““Satan’s Rotoscope” ControversySatan’s Rotoscope” Controversy
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
Computer Computer VisionVision
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
Computer Computer GraphicsGraphics
++
ArtArt
8/16/99
Vision Based TrackingVision Based Tracking
8/16/99
Tracking + Acquistion of KinematicsTracking + Acquistion of Kinematics
- Acquire Kinematic Chains.
Kathy Pullen
8/16/99
Humans have no fixed axisHumans have no fixed axis
8/16/99
Nonrigid ExamplesNonrigid Examples
Constrain
8/16/99
Motion Capture
Modeling
Synthesis
From Pixels to 3D Blend Shapes From Pixels to 3D Blend Shapes (Torresani et al 2001)(Torresani et al 2001)
8/16/99
Motion Capture
Modeling
Synthesis
From Pixels to 3D Blend Shapes From Pixels to 3D Blend Shapes (Torresani et al 2001)(Torresani et al 2001)
8/16/99
Video Rewrite Video Rewrite (Bregler, Covell, Slaney, Interval)(Bregler, Covell, Slaney, Interval)
Pure Data
Learning Controller Sample Based
Pure Model
8/16/99
Variations in Full-Body non-cyclic MotionsVariations in Full-Body non-cyclic Motions
Kathy Pullen
Motion Capture
Modeling
Synthesis
Example Motion-Capture
8/16/99
Motion Texturing Key-Framed AnimationsMotion Texturing Key-Framed Animations
Kathy Pullen
Motion Capture
Modeling
Synthesis
Different Motion-Textured Paths
8/16/99
Motion Capture Based Animation PipelineMotion Capture Based Animation Pipeline
ExpressiveExpressiveAnimationAnimation
8/16/99
Turning to the Masters:Turning to the Masters:
Motion Capturing CartoonsMotion Capturing Cartoons
Chris Bregler, Lorie Loeb, Erika Chuang, Hrishi DeshpandeChris Bregler, Lorie Loeb, Erika Chuang, Hrishi Deshpande
Stanford UniversityStanford University
[CB: Other picture coming]
8/16/99
Realm of Cartoon CaptureRealm of Cartoon Capture
8/16/99
Turning to the Masters:Turning to the Masters:
Expressive AnimationsExpressive Animations
8/16/99
Capture Cartoon MotionsCapture Cartoon Motions
Example
© Disney
8/16/99
Retarget Cartoon MotionsRetarget Cartoon Motions
© Disney
8/16/99
ExamplesExamples
© Disney
8/16/99
ExamplesExamples
8/16/99
ExamplesExamples
8/16/99
Realm of Cartoon CaptureRealm of Cartoon Capture
8/16/99
ExamplesExamples
© Disney
8/16/99
ExamplesExamples
© Warner Bros.
8/16/99
Cartoon Capture ChallengesCartoon Capture Challenges1. Can’t put optical markers on a cartoon2. Low frame rate (24-30 fps) + animating on 2’s = large changes between frames3. Often difficult to identify joint locations/large deformations
8/16/99
Performance Capture based AnimationPerformance Capture based Animation
8/16/99
Rotoscope / Mocap: HistoryRotoscope / Mocap: History
• Rebecca Allen / Twyla Tharp: The Catherine Wheel• Paul Kaiser / Merce Cunningham: “Biped”
8/16/99
ProjectProject
• Start thinking about it now
• In-class brainstorming session
• Proposal with 2 Milestones
• Group work
