53
Rick Parent - CIS68 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction Bone Muscle Skin Other Motions Facial Expression Gestures Idiosyncratic Secondary Motion Intelligent behavior

Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Embed Size (px)

Citation preview

Page 1: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Human Figure - Overview

Reactionary MotionsClothesHair

TasksReaching & GraspingWalkingTalkingMotor Skills

Layered ConstructionBoneMuscleSkin

Other MotionsFacial ExpressionGesturesIdiosyncraticSecondary Motion

Intelligent behavior

Page 2: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Modeling the Human Form

Artistic AnatomyAnatomy related to surface appearanceversus Medical AnatomyWell-developed literature

Forensic ScienceFacial Reconstruction

Plastic SurgerySurface Appearance Reconstruction

Page 3: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Layered: Bone-Muscle-Skin

Bone

Muscle &Tendons

Skin

Fatty Tissue

Page 4: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Modeling - Layered

FFD muslces

John Chadwick, ABD

Page 5: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Modeling - Thalmann, EPFL

From http://ligwww.epfl.ch/

Implicit surfaces

Page 6: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Modeling

Embed polyhedra in implicit surfaceImplicits used for approx. collision detect & respondPolyhedra used for display

Use M.-P. Cani technique to distort implicits based on collisions

Karan Singh, PhD

Page 7: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Human Figure

Use artistic anatomy to design muscles

Ferdi Scheepers, PhD

Page 8: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Human Figure

Page 9: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Human Figure

Page 10: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Figures - Wilhelms, UCSB

http://www.cse.ucsc.edu/~wilhelms/fauna/Monkeys/5monk_parts.gif

Page 11: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Reaching & Grasping

Inverse Kinematics

What is ‘human-like’ motion?

Path planning

Holding and manipulating tools

Page 12: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Reaching

Shoulder: 3 DoF

Elbow: 1 DoF

Wrist: 3 DoF

Arm - 7 DoF Or 2 at elbow, 2 at wrist

Or 1 at elbow, 2 at wrist,add one at mid-forearm

Page 13: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Reaching - heuristic

Decide on ‘reasonable’ plane for arm based on task

Reduce problem to 2D arm position + hand configuration

Page 14: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Reaching

Joint limits are a function of joint position

Collision avoidance with body, other limbs

Strength a function of joint position

Page 15: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

What’s ‘human-like’ ?

Depends on orientation and task

straight-line path

Minimize total torque

Minimize maximum velocity, acceleration, jerk

Maximize ‘comfort’

Page 16: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

In obstacle-filled environment

Dave Miller PhD

Page 17: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Grasping

Standard methods of grasping

By handle

Two finger

Wrap around

Two hand

Page 18: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Walking

Hip: 3 DoF

Knee: 1 DoF

Ankle: 3 DoF

Toes: 1 ‘DoF’

but usually not independent (free)

Gravity

Maintain balance (static)Simplify dynamicsDecouplereduce DoFs

Page 19: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Walking

Page 20: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Walk Cycle

Page 21: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Run Cycle

Page 22: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Walking - Hip Angles v. Time

Page 23: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Walking - Jessica Hodgins, CMU

Page 24: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation

Complex surface

Very familiar structure

Deformable surface

Very important - Principal means of communication

Facial expressions, lip-synch, prosodic facial animation

Page 25: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation by Texture Maps

Ebert - from Getting Into Art

Page 26: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation

http://mambo.ucsc.edu/psl/sig97/siggraph97-panel.html

Page 27: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Action Units (FACs)

From Eckman and Friesen

Page 28: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation

http://mambo.ucsc.edu/psl/sig97/siggraph97-panel.html

Fred Parke model

Page 29: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Digitizing Faces

Page 30: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Modeling - Surface Springs

Page 31: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation - Structural

Page 32: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation

http://mambo.ucsc.edu/psl/sig97/siggraph97-panel.html

Terzopolous, NYU

Page 33: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Facial Animation

www.cis.ohio-state.edu/research/graphics/research/FacialAnimation/

Scott King, PhD

Page 34: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Behavior

Intelligent interaction with user

Engage in conversation w/gestures

Cooperation w/ other agents

AI, Spatial reasoning, human-like reaction

Page 35: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Behavior

Daniel Thalmann, LIG, EPFL

Page 36: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth and Clothes

Texture maps

Full collision detection and response

draping

flowing

Page 37: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Simulate at what level?

Fold level - catenary curves between points of support

Weave level - warp and weft

Patch level - triangles or higher order patches

Thread level - property and structure of thread

Page 38: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Tight Fitting Clothes

Daniel Thalmann, EPFL

Page 39: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 40: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 41: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 42: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 43: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 44: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth

Page 45: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Cloth Nadia Magnenat-Thalmann, MIRALab

Page 46: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Clothes

http://cs-people.bu.edu/jingbinw/Clothsim_Submit.PDF

Page 47: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Hair

Rigid object

Model each strand

Model by clumps

Rigid underlayment w/ strands over top

Texture map

Page 48: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Hair

Page 49: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

Standards & Resources

MPEG-4 - Moving Pictures Expert Group http://mpeg.telecomitalialab.com/standards/mpeg-4/mpeg-4.htmhttp://ligwww.epfl.ch/mpeg4/

H-anim - human animation working group http://www.h-anim.org/

The Visible Human Projecthttp://plum.ia.polsl.gliwice.pl/~DIP/visible/visible_human.html

Page 50: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

The Major Players

Nadia Thalmann - MIRALab research group at the University of Geneva http://www.miralab.unige.ch/MIRAhtml/mirahome.htm

Daniel Thalmann - The Computer Graphics Lab (LIG) at the Swiss Federal Institute of Technology (EPFL) in Lausanne: http://ligwww.epfl.ch/

Norm Badler - Center for Human Modeling and Simulation athe University of Pennsylvaniahttp://www.cis.upenn.edu/~hms/

Page 51: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

The Major Players

Demitri Terzopolous - NYUmrl.nyu.edu/~dt/

Michiel van de Panne - Vancouver, B.C.www.dgp.utoronto.ca/people/van/van.html

Jane Wilhelms - UCSCwww.cse.ucsc.edu/~wilhelms/

Page 52: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

The Major Players

Tom Calvert - Simon Fraserwww.cs.sfu.ca/people/Faculty/Calvert/index.html

Michael Cohen - MicroSoft Researchwww.research.microsoft.com/~cohen/

Marie-Paule Cani - iMAGISwww-imagis.imag.fr/Membres/Marie-Paule.Cani/index.gb.html

Page 53: Rick Parent - CIS682 Human Figure - Overview Reactionary Motions Clothes Hair Tasks Reaching & Grasping Walking Talking Motor Skills Layered Construction

Rick Parent - CIS682

The Major Players

Jessica Hodgins - CMUwww.ri.cmu.edu/people/hodgins_jessica.htmlwww.cc.gatech.edu/gvu/animation/Areas/humanMotion/humanMotion.html

Michael Gleicher - Wisconsinwww.cs.wisc.edu/~gleicher/