52
Yunhai Wang Shandong University

Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Yunhai Wang

Shandong University

Page 2: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

DataVisualization

Page 3: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Tamara Munzner 2011:

“Computer‐based visualization systems provide visual 

representations of datasets intended to help people carry out 

some tasksmore effectively”

Why are we using Visualization?

Page 4: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

[1]

Ask which visualization is best suited to pursue a given taskon given input data

[1] H.‐J. Schulz, T. Nocke, M. Heitzler, and H. Schumann. A design space of visualizationtasks. Visualization and Computer Graphics, IEEE Transactions on, 19(12):2366–2375, 2013.

Page 5: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Domain Tasks

Infinite numbers of domain tasks!

Page 6: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Genome

Weather E‐transactions

Mizbee, Infovis’10

Visual voting, Scivis 2015 VAST 2014

Page 7: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Too many methods!

Page 8: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Too many parameters!

Page 9: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

A tedious procedure!

Page 10: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Unfortunately, our community pays little attention on this! 

Page 11: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Complicated Visual Design!

Page 12: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Application orientated!

Page 13: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Gaps!

Most users have few experience in visual design but we have many different applications.

[1] Sukwon Lee, Sung‐Hee Kim, Ya‐Hsin Hung, Heidi Lam, Youn‐Ah Kang, Ji Soo Yi: How do People Make Sense of Unfamiliar Visualizations?: A Grounded Model of Novice's Information Visualization Sensemaking. IEEE Trans. Vis. Comput. Graph. 22(1): 499‐508 (2016)

It is not easy to make sense of unfamiliar visualization[1];

Page 14: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Our solution

Task‐driven AutomatedData Visualization

Page 15: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Visualization method Visual EncodingData Transform

Interaction

Traditional Visualization Pipeline

Manually!

Page 16: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Abstract tasks

Trend Outlier

Distribution

Correlation

Clusters Similarity

Page 17: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Representation Selection Visual EncodingData Transform

Interaction

+

Task‐driven Automated Visualization Design

Perceptual AutomatedAutomated

Automated

Page 18: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

18

Perceptual Data Transform

Page 19: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

19

Automated Visualization Selectionlittle noise Outlier Heavy noise Aspect ratio

Page 20: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Under Minor Revision

20

Automated Visual Encoding

Page 21: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

21

Aspect ratio strongly impacts graphical perception

Page 22: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Many aspect ratio selection methods!

Page 23: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Our Contribution I

Why some methods are parameterization invariant? 

Line integral

min∈ ,

∆, ∆

min∈ ,

1∆ , ∆

min1

Arc-length (AL)

Page 24: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Our Contribution II

Page 25: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Our Contribution III: dual‐scale banking

Page 26: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

26

IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE InfoVis 2017)

Automated Visual Interaction

Try EdWordle at www.edwordle.net

Page 27: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,
Page 28: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,
Page 29: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,
Page 30: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Our System: www.edwordle.net

Consistency‐Preserving Wordle Editing!6/37

Page 31: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,
Page 32: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,
Page 33: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

33

Automated Visual Interaction

IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE InfoVis 2017)

Page 34: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Revisiting Stress Majorization as a Unified Framework for 

Interactive Constrained Graph Visualization 

Yunhai Wang1, Yanyan Wang1, Yinqi Sun1, Lifeng Zhu2, Kecheng Lu1

Chi‐Wing Fu3, Michael Sedlmair4, Oliver Deussen5, and Baoquan Chen1

1 Shandong University 2 Southeast University 3 The Chinese University of HongKong

4 University of Vienna 5 Konstanz University and VCC SIAT

Page 35: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Graphs are everywhere!

The Internet [2005]

Social Networks [2010]

Human Disease Network[Barabasi 2007]

Gene Regulatory Graph[Decourty 2008]

35

Page 36: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

(d)(c)(b)

Node‐link Graph Visualization• Stress model:

i,j ∈ Vmin∑ wij(|| xi - xj || - dij)2

The energy minimization process[Kamada et al. 1989]

|| xi ‐ xj || ≈ dCA = 3

(a)

dij is the shortest path[Kamada et al. 1989]

36

Page 37: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Task‐driven Graph Layout: User constraints

Constrained Layout produced from our framework

Directed Edges+ all above

Design various constraints to help explore the structures of interest.

• Minimizing cluster overlapping

• Maximizing the minimum angle between 

edges leaving a node (star)

• Circles are salient structures

• Maximizing edge orthogonality

• Minimizing edge crossing

• Maximizing symmetry

• ……

Aesthetic Criteria:

[H. C. Purchase et al. 2002]

37

Stress Model Layout

ClustersCirclesStars

Page 38: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Core Idea

38

dCA = 3

Stress model: scalar

dCA = 3

Ours: vector

Introducing edge vector in the “stress model” (reformulating stress majorization) to provide inherent (unified) support to general layout constraints. 

» Classical stress model: distance only

» We: distance + angle (i.e. vector)

Page 39: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

• Given a graph G(V,E)

Stress Model

min S(X) = min ∑ wij(|| xi - xj || - dij)2

i<j

• Stress model:

39

Page 40: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

S(X) = ∑ wij dij2 + ∑ wij || xi - xj || 2 - 2 ∑ wijdij|| xi - xj ||

i<ji<j i<j

Stress Majorization

-2∑ wijdij|| zi - zj ||

(xi - xj)T(zi - zj)

i<jS(X) ≤ ∑ wij dij 2 + ∑ wij || xi - xj ||2

i<ji<j

40

Page 41: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

S(X) = ∑ wij dij2 + ∑ wij || xi - xj || 2 - 2 ∑ wijdij|| xi - xj ||

i<ji<j i<j

Reformulation in Vector Form

-2∑ wijdij|| zi - zj ||

(xi - xj)T(zi - zj)i<j

S(X) ≤ ∑ wij dij 2 + ∑ wij || xi - xj ||2

i<ji<j

dij = dij|| zi - zj ||(zi - zj)

41

Edge vectors

Page 42: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

= ∑ wij || xi - xj - dij||2

i<j

Reformulation in Vector Form

-2∑ wiji<j

S(X) ≤ ∑ wij dij 2 + ∑ wij || xi - xj ||2

i<ji<j(xi - xj)Tdij

|| zi - zj ||(xi - xj)T(zi - zj)

dij

42

dij = dij|| zi - zj ||(zi - zj)

dCA = 3

Stress model: scalar

dCA = 3

Ours: vector

∑ wij (|| xi - xj || - dij)2

i<jStress model:

Page 43: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Incorporating User Constraints

distance constraints between node pairs

• Define d'ij — target edge vectors for constraints

• || d’ij ||

direction constraints between node pairs• d’ij

43

Page 44: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

User Constraints 

1. Direct Constraint

2. Metrics-based Constraint

3. Shape-based Constraint

44

Page 45: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

1. Direct Constraint

• Edge Length / Direction Constraint

(Unconstrained)Layout at time t+1

(Constrained)Layout at time t+1

Layout at time t

Direction

Constraint

• Temporal Coherent Dynamic Graph Visualization

45

Page 46: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

2. Metrics‐based Constraint

Non-overlap Constraint Minimizing Edge Crossings

Cluster Non‐overlap 

Constraint

Minimizing Edge 

Crossings

(Minimal Penetration Depth)

Result

46

Page 47: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

ICP

fit

Reference shape

Circle Constraint

ResultReference shape

Iterative Closest 

Point (ICP) fit

Star Constraint

ResultIterative Closest Point(ICP) fittingICP fitting

3. Shape‐based Constraint

47

Page 48: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

3. Shape‐based Constraint

Symmetry Constraint

Symmetry axis

fit

Mirroring ICP fitting

48

Page 49: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

3. Shape‐based Constraint

Symmetry Constraint

Symmetry axis

Result

49

Page 50: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Constraint‐based Graph Exploration

(a) Cluster non-overlap constraints

+ Circle constraints

star constraints(b)

+ Path

constraints(c)

Facebook4039 Graph4039 nodes, 88234 edges

50

Page 51: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

More details can be found from:http://www.yunhaiwang.org/infovis17/vectormds/index.htmlCode, system, and data are available at: https://github.com/Yanyan-Wang/vectorized_stress_majorization

dCA = 3

Stress model: scalar

dCA = 3

Ours: vector

Page 52: Yunhai Wang Shandong University - slides.games-cn.org±ª云海.pdf · Ask which visualization is best suited to pursue a given task on given input data [1] H.‐J. Schulz, T. Nocke,

Thanks!

http://www. yunhaiwang.org/