24
Brendan Stubbs Department of Computer Science Amar Das Stanford Center for Biomedical Informatics Research Sim•TwentyFive: An Interactive Visualization System for Data-Driven Decision Support David Kale University of Southern California Virtual PICU Children’s Hospital LA [email protected]

An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Brendan Stubbs Department of Computer Science

Amar Das Stanford Center for

Biomedical Informatics Research

Sim•TwentyFive: An Interactive Visualization System for

Data-Driven Decision Support

David Kale University of Southern California

Virtual PICU Children’s Hospital LA [email protected]

Page 2: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Pediatric intensive (critical) care

Page 3: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

•  High-dimensional (~100’s variables), sparse

•  Episodic (begins at admission, ends at discharge)

•  Large number of individual patients

•  Manually entered or verified by clinical staff

HR

RR

Admit Discharge

PICU observational time series

Page 4: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Typical EHR ICU interface

* Not real patient data; screenshot from advertisement

Page 5: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

The paper flowsheet’s legacy

Image from Health Care Renewal blog http://hcrenewal.blogspot.com/2012/01/anecdotal-complaint-about-icu-ehr.html

Page 6: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Interactivity: Google search

Page 7: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Transparency: Netflix recommendations

Page 8: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Visual summary: Nightingale’s Rose

Page 9: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Data visualization goals

Reduce the cognitive burden of querying, exploring, analyzing and comparing current patient to similar past patient episodes •  Enable perceptual inference •  Enhance patterns •  Encode information in a manipulation medium

Page 10: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Objectives

Interactivity Ability to search, filter, refine, sort, query, etc.

Responsiveness (i.e., fast) Amazon (2006): 100ms speedup ==> 1% revenue increase

Transparency Clinical users (heck, everybody) hates black boxes

Emphasize visual exploration, not prediction Make searching EHR data as easy as searching web

“Bootstrap” experience with “similar patients” Complement “reasoning by anecdote/analogy” approach

Page 11: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Related work

• SweetINFO • Patientslikeme.com

• Tufte • Lifelines2

Page 12: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Distribution of diagnostic categories across clusters: Respiratory

Cluster

Pro

porti

on in

clu

ster

37 2712

168

91

163

114128

57

8

157133

152

111

151

84

117

473

53 49

0100

200

300

400

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

Respiratory diagnoses

See Marlin, Kale, Wetzel, and Khemani, ACM IHI 2012

Page 13: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Distribution of diagnostic categories across clusters: Neurologic

Cluster

Pro

porti

on in

clu

ster

75

100

55

25

73

395

19 27

62

25

57 52

1938

19

117

208

183

147

70

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

0100

200

300

400

Neurologic diagnoses

See Marlin, Kale, Wetzel, and Khemani, ACM IHI 2012

Page 14: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Derived similarity scores

Page 15: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25- Visualization Overview

Page 16: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: design decisions

• Flexibility • Consistency • Responsiveness • Parsimony Hypothesis Generation Cycle

Visual Querying

Page 17: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: implementation

• Web/HTML5 • D3/SVG • JSON/AJAX

Page 18: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: functionality • Query any patient.

• Sort by categorical or continuous attributes. • Select by individual (any line or circle) or category. • Scale similarity axis by rank, relative or absolute similarity.

Page 19: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: functionality

• Optimize aspect ratios of line graphs individually or collectively. • Superimpose aggregate (entire population mean +/- one standard deviation).

Page 20: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: implementation

• Web/HTML5 • D3/SVG • JSON/AJAX

Page 21: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Sim 25: results

Question

Response counts St rong ly Disagree

Disagree Neutral Agree St rong ly Agree

Information is presented in a clear and logical manner.

0 0 0 3 3

The interface is intuitive and easy to use.

0 0 0 2 4

In my experience, Sim•TwentyFive is better than current EMR patient data visualizations.

0 0 0 1 4

Sim•TwentyFive will be useful for learning about a given query patient from similar patients.

0 0 1 2 3

Sim•TwentyFive will be useful for physician education and treatment planning.

0 0 1 2 2

Page 22: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Future work

•  Increase flexibility of query specification. •  Support dynamic similarity scoring based on input

criteria. •  Host on a secure CHLA environment and include

more detailed patient information. •  Apply rule-based domain expert knowledge against

the query patient's attributes to indicate abnormalities and/or normal ranges.

•  Arrange physiologic variables in an ontologically-meaningful layout.

•  Integrate with traditional clinical interfaces

Page 23: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Closing remarks •  Data Driven Documents (http://d3js.org/) •  Demo: http://brendanstubbs.com/sim25/ •  Share data and collaborate! •  Designers (UX, UI, etc.) are worth their

weight in gold (see April 2012 Reuters article) •  Meaningful Use of Complex Medical Data

annual symposium (http://mucmd.org) •  Diana Maclean: tomorrow, 9:30am, Will. B

•  Email me: [email protected]

Page 24: An Interactive Visualization System for Data-Driven ... › ~dkale › talks › kale-amia2012-sim25-talk.pdf · Data-Driven Decision Support David Kale University of Southern California

Thanks to our extended team!

Randall Wetzel, M.D. Roby Khemani, M.D., MSCI Paul Vee, MBA Ricky Nguyen, MS Sheryl John, MS Francisco Cai, MS Yael Peled Nesbert Hidalgo

Dan Crichton, M.S. Chris Mattmann, Ph.D. Andrew Hart, M.S.

Christian Shelton, Ph.D. Busra Celikkaya

Benjamin Marlin, Ph.D.

Yan Liu, Ph.D. Jeffrey Heer, Ph.D. Diana Maclean