54
The Science of Visual Analysis PRESENTED BY Jock D. Mackinlay Senior Director, Visual Analysis Tableau Software

The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

The Science of Visual Analysis

PRESENTED BY

Jock D. Mackinlay

Senior Director, Visual Analysis

Tableau Software

Page 2: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Dedicated to Jacques Bertin

• French cartographer

• July 27, 1918 to May 3, 2010

• Semiologie Graphique (Semiology of Graphics), University of

Wisconsin Press, 1967

Page 3: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Rich Gold’s 4 hats of creativity

Page 4: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Humans are slow at mental math

34

X 72 ------------------

Page 5: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Humans are faster when they use the world

34

X 72 ------------------

68

23180

------------------

2448

Page 6: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

People use the world: Asking for directions

Page 7: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

People use the world: Asking for directions

Page 8: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

People use the world: Asking for directions

Page 9: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Interruptions can make people slow

From Rensink: http://www2.psych.ubc.ca/~rensink/flicker/download/

Page 10: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Interruptions can make people slow

Page 11: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

The human visual system

Eye Brain

From the Texas School for the Blind and Visually Impaired

Page 12: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

This is not a camera

Page 13: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

The human visual system is powerful

How many 9s?

Page 14: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

The human visual system is powerful

Page 15: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Accountants exploit pop-out

Page 16: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

The human visual system is powerful

Page 17: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Lesson:

Exploit the power of the

human visual system

Page 18: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

You have to look

to see

Pattern of eye motions when asked to identify the age of the people in the painting “An Unexpected Visitor,” by I.E. Repin. From Yarbus, 1967

Eyes move continuously, directed by task and attention (saccades)

Page 19: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Where you look depends on task

Page 20: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Visual processing is bi-directional

Based on Information Visualization: Perception for Design, 2nd Ed, 2004 By Colin Ware

Features Patterns Objects

Bottom-up: build patterns

Top-down: directs and reinforces

Page 21: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Bertin’s 3 levels of reading: Simple

Page 22: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Bertin’s 3 levels of reading: Intermediate

Page 23: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Bertin’s 3 levels of reading: Global

Page 24: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Lesson:

There is no single view:

iterate, explore, and

experiment

Page 25: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

The Cycle of Visual Analysis

Page 26: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Reference model for Information Visualization

From

Readings in Information Visualization:

Using Vision to Think

Card, Mackinlay, Shneiderman, 1999

Data

Transformations

Data

Raw

Data

Data

Tables

Human Interaction (controls)

Visual

Mappings

View

Transformations

View Task

Visual

Structures Views

Page 27: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Graphical Vocabulary

Marks

Points

Lines

Areas

Position

Retinal

Color

Size

Shape

Gray

Orientation

Texture

x x x x x

x

x

x

x

x x

x

x x

x x

From

Semiology of Graphics, 1967 Jacques Bertin

Page 28: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Length

Position More accurate

Less accurate

Angle Slope

Size

Color Density

From Graphical perception: theory, experimentation and application to the development of graphical methods Cleveland & McGill, Journal of the American Statistical Association, 1984

Effectiveness

Quantitative Data

Page 29: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Quantitative:

Position > Length

Page 30: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Quantitative:

Position > Size > Color

Good Bad

Page 31: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Quantitative:

Encode from zero

Good Bad

Page 32: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Quantitative:

People see area rather than height

Good Bad

Page 33: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

S. Stevens’ theory of scale measurement

• Quantitative

• Ratio: Kelvin

• Interval: Celsius

• Ordinal: Monday, Tuesday, Wednesday, …

• Nominal: Apple, Orange, Banana, …

From

On the theory of scales of measurement S. Stevens, Science, 1946 http://en.wikipedia.org/wiki/Level_of_measurement

Page 34: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Nominal & Ordinal:

Position

Page 35: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Nominal & Ordinal:

Size encodings

Bad Good

Page 36: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Nominal & Ordinal:

Color encodings

Good OK

Page 37: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Effectiveness depends on the data type

• Data type

• Quantitative: 2.4, 5.98, 10.1, …

• Ordinal: Monday, Tuesday, Wednesday, …

• Nominal: Apple, Orange, Banana,…

• Size encoding

• Quantitative:

• Ordinal:

• Nominal: Conveys an ordering

• Color encoding

• Quantitative:

• Ordinal:

• Nominal:

Page 38: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Use shape for large cardinalities

• Color encoding

• Nominal:

• Ordinal:

• Shape:

From:

Beautiful Evidence (based on Carl Sagan’s graph)

Edward R. Tufte, Graphics Press, 2006

Page 39: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Nominal

Position

Shape

Color hue

Gray ramp

Color ramp

Length

Angle

Size

Ranking of encodings by data type

Ordinal

Position

Gray ramp

Color ramp

Color hue

Length

Angle

Size

Shape

Quantitative

Position

Length

Angle

Size

Gray ramp

Color ramp

Color hue

Shape

Page 40: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Lessons:

Use Position for the

most important data

Use Color for

nominal data <= 20

Use Shape for

nominal data > 20

Page 41: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Warning: Interactions Small size hides color, and shape

Bad Bad

Page 42: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Bad Bad Good

Expressiveness: Communicate all of the relevant data

Page 43: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Human Perception is Limited: Bertin’s Barrier

Page 44: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

3D Graphics Does Not Break the Barrier

• Only adds a single dimension

• Creates occlusions

• Adds orientation complexities

• Easy to get lost

• Suggests a physical metaphor

Page 45: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Interactivity: Bertin’s Sorting of Data Views

Page 46: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Bertin’s permutation matrix (1977)

• Analysis by sorting visual tables

• Technology

Page 47: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

©2012 Tableau Software Inc. All rights reserved.

Lesson:

The human visual system is limited:

Each data view should be

focused

Use interactivity and

multiple views

Page 48: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Composition: Small Multiples

See:

The Visual Display of Quantitative Information Edward R. Tufte, Graphics Press, 1983

Page 49: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Composition:

Napoleon march to Moscow by Minard

• Two images:

Page 50: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Composition: Dashboards

Page 51: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Interactivity: Links and Filtering

Page 52: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Visual Analysis

• Human visual system

• Fast, intuitive interaction

click click

Page 53: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Summary

• Exploit the power of the human visual system

• There is no single view: iterate, explore, and experiment

• Use position for the most important data

• Use color for nominal data <= 20

• Use shape for nominal data > 20

• Human visual system is limited: each view should be focused

• For multidimensional data, use interactivity and multiple views

Page 54: The Science of Visual Analysis - cdnl.tblsft.comcdnl.tblsft.com/.../science_of_visual_analysis.pdf · Readings in Information Visualization. Morgan Kaufmann, 1999 • Jacques Bertin

Resources

• Card, Mackinlay, Shneiderman ([email protected])

Readings in Information Visualization. Morgan Kaufmann, 1999

• Jacques Bertin

Semiology of Graphics. University of Wisconsin Press, 1967

• Colin Ware

Information Visualization, Perception for Design. Morgan Kaufmann, 2ed, 2004

• Edward Tufte

The Visual Display of Quantitative Information. Graphics Press, 1983

• William S Cleveland

The Elements of Graphing Data. Hobart Press, 1994

• Stephen Few

Show Me The Numbers. Analytics Press, 2004