52
Perceptual and Artistic Principles for Effective Computer Depiction Fredo Durand MIT- Lab for Computer Science Gestalt and Picture Organization

Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

  • Upload
    lamminh

  • View
    253

  • Download
    4

Embed Size (px)

Citation preview

Page 1: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Perceptual and Artistic Principles for Effective Computer Depiction

Fredo DurandMIT- Lab for Computer Science

Gestalt and Picture Organization

Page 2: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by colorGeorgia O’Keeffe

Page 3: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping, illusory contour & fig/gndAbsolut

Page 4: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Context: Gestalt psychology• [Palmer 99]• Early 20th century• Inspired by field theory in physics• Holistic philosophy of vision

– “Spontaneous” organization– Opposed to unconscious inference

• Has been integrated recentlyinto modern framework

Page 5: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Context: Gestalt psychology• Early 20th century• Arnheim had a Gestalt

psychology background• Very popular in design• Advertisement vs. art

Page 6: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Prägnanz• Cornerstone of Gestalt• “Goodness”• “Simplest” possible figure or organization• Things are organized spontaneously and assumed

to be in the simplest configuration

• Has recently been related to information theory(simple in terms of amount of information required to encode it)

Page 7: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Plan• Grouping• Figure-ground• Completion and illusory contours

Page 8: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping• “Similar” or “close” objects are perceived to

belong to groups• Spontaneous and powerful perceptual effect

Page 9: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping• By Proximity

• By Color

• By size

Page 10: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping• By Region

• By connectedness

Page 11: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by synchronicity

Page 12: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by synchronicity

Page 13: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by synchronicity

Page 14: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by synchronicity II

Page 15: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping by synchronicity II

Page 16: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping conflict• Proximity is overweighed by region

• Proximity is overweighed by connectedness

Page 17: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping effect• Task: Detect repetition of a shape in a sequence• The repetition can be inside or across a group• Slower when between groups (~0.7 vs. ~1.1s)Repetition within group

Repetition across group

Repetition in neutral sequence

Redrawn after [Palmer 99]

Page 18: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping effect• Task: Detect repetition of a shape in a sequence• The repetition can be inside or across a group• Slower when between groups (~0.7 vs. ~1.1s)Repetition within group

Repetition across group

Repetition in neutral sequence

Redrawn after [Palmer 99]

Page 19: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping conflict• Faster when within small oval

Redrawn after [Palmer 99]

Page 20: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping in complex situations• No quantitative rule yet!• Very complex problem• Too many parameters

Page 21: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping and photoEdward

Weston

Page 22: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping• Grouping by proximity tells story

Page 23: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping & Map Making• Grouping provides efficient analysis

Page 24: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Grouping and ornament• Repetition, rhythm

Page 25: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Plan• Grouping• Figure-ground• Completion and illusory contours

Page 26: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground• What is in front (figure), and behind (ground)?• There has to be one figure and one ground• Related to occlusion and thus to depth• Less attention is dedicated to the ground

Picture Dark=figure Light=figureRedrawn after [Palmer 99]

Page 27: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground• The shape with the best “Prägnanz” is the figure • Can be bimodal: we switch from one

interpretation to the other– Visible on brain imagery

• But only one at a time

PictureRedrawn after [Palmer 99]

Page 28: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground• Effect of geometric properties on the “Prägnanz”

Redrawn after [Palmer 99]

symmetry Convexity vs. parallelism

parallelism

Page 29: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground & familiarity• Familiarity helps: We recognize a horse

Redrawn after [Palmer 99]

Page 30: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground pun• Rubin vase

Page 31: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground transition• +grouping

Page 32: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Enhancing depth through contrast• Occluding edges

Page 33: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Negative space• The ground defines the negative space• Usually overlooked• Fundamental for balance

– Also for typography

picture figure negative space

Page 34: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Closure & Negative space• George Seurat• Negative space are enclosed in the picture frame

Page 35: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Plan• Grouping• Figure-ground• Completion and illusory contours

Page 36: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Continuation• Lines are continued after junctions

• And after gapsPicture good “Prägnanz” not so good “Prägnanz”

Page 37: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Continuation and Map-Making

Page 38: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Continuation and design• El Lissitzky, Self Portrait: The Constructor 1924

Page 39: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Continuation

Page 40: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Closure• Closed shapes have better “Prägnanz”• + continuation• + illusory lines

Page 41: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Closure• Matisse

Page 42: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Illusory contour• An illusory contour is implied by continuation of

the lines• Related to figure ground

Page 43: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Illusory contours• Kanisza

Page 44: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Illusory contour• Can be more effective

Page 45: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Illusory contour• Familiarity helps

Page 46: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Illusory contour• Matisse

Page 47: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Figure-ground and illusory contour

Page 48: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Visual completion• We complete the occluded part

with the simplest shape (best “Prägnanz”)• Related to continuation and closure

Picture Other possible interpretationsSimplest interpretations

Redrawn after [Palmer 99]

Page 49: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Completion• Magritte

Page 50: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Completion• Marc Riboud• Completion is challenged

Page 51: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

Summary• Prägnanz (goodness, simple in terms of

information)

• Grouping• Figure-ground• Completion

• As usual pictures can– Simplify– Challenge

Page 52: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory

Picture Organization & Gestalt

History of science• Initially, strong opposition between Gestalt and

other theories• Lack of experimental data• Has been applied beyond its scope• Has been taken too literally

• Now, has been integrated with other theories• Experiments• Computational models