45
Sensing, Inference, and Intervention in Support of Mental Health Eric Horvitz Microsoft Research CHI Workshop on Computing in Mental Health May 2016

Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Sensing, Inference, and Intervention in Support of Mental Health

Eric Horvitz

Microsoft Research

CHI Workshop on Computing in Mental HealthMay 2016

Page 2: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Data & computation

Learning, inference, representation

Causal inference

Perception

NLP

*

CATECHOLAMINE

ANESTHESIA

INSUFFICIENT

HYPOVOL

CARDIAC

OUTPUT

STROKE

VOLUME

HR BP HR EKG HR SAT

LV FAIL

PCWP

HEART

RATE

ERROR

LOW OUTPUT

ERROR

CAUTER

TPR

BLOOD

PRESSURE

ANAPHYLAXIS

SAO2

ARTERIAL

CO2

DISCONNECTIONKINKED TUBEINTUBATION

PRESSURE

VENT

TUBEVENT LUNG

FIO2

EXPIRED

CO2

PA SAT

SHUNT

MINUTE

VENTILATION

PAP

PULMONARY EMBOLUS

VENT MACHINE

MV SETTING

HISTORY

LV FAILURE

CVP

LVED

VOLUME

VENT ALV

HCI + AI: Growth in Resources & Competencies

Page 3: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Data & computation

Learning, inference, representation

Causal inference

Perception

NLP

*

CATECHOLAMINE

ANESTHESIA

INSUFFICIENT

HYPOVOL

CARDIAC

OUTPUT

STROKE

VOLUME

HR BP HR EKG HR SAT

LV FAIL

PCWP

HEART

RATE

ERROR

LOW OUTPUT

ERROR

CAUTER

TPR

BLOOD

PRESSURE

ANAPHYLAXIS

SAO2

ARTERIAL

CO2

DISCONNECTIONKINKED TUBEINTUBATION

PRESSURE

VENT

TUBEVENT LUNG

FIO2

EXPIRED

CO2

PA SAT

SHUNT

MINUTE

VENTILATION

PAP

PULMONARY EMBOLUS

VENT MACHINE

MV SETTING

HISTORY

LV FAILURE

CVP

LVED

VOLUME

VENT ALV

HCI + AI: Growth in Resources & Competencies

Tools & platforms

Page 4: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Data to Predictions to Interventions

Decision model

Actions

Predictive model

Sensed data

Predictions

Page 5: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Data to Predictions to Interventions

Decision model

Actions

Predictive model

Sensed data

Predictions

Active learningExperience samplingIdeal experimentation

Page 6: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Revolution Brewing

Computational social science

Data

Devices

Life-centricity of web

Representations & models

Learning & inference

Perception, predictions, decisions

Page 7: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Revolutions Brewing

Computational social science

Public health & epidemiology

Data

Devices

Life-centricity of web

Representations & models

Learning & inference

Perception, predictions, decisions

Page 8: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Revolutions Brewing

Computational social science

Public health & epidemiology

Social psychology & personality

Clinical psychology & psychiatry

Data

Devices

Life-centricity of web

Representations & models

Learning & inference

Perception, predictions, decisions

Page 9: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Revolution Brewing

Mental health & wellbeing

Data

Devices

Life-centricity of web

Representations & models

Learning & inference

Perception, predictions, decisions

Page 10: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Health insights & diagnosis

Mental health & wellness

e.g., Search, Twitter, Facebook, Reddit, TalkLife, Crisis Txt Line, Apps

Evidential Streams & Inferences from Populations

Page 11: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Supervised learning: experts, crowd, participants

Unsupervised learning: clustering, topic modeling

Causal modeling: propensity, Neyman-Rubin

Wrestling with (the Wild West of) Population Data

Page 12: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Sensitivity, robustness, error modeling

Statistics of rare events

Sequence alignment

NL psych models: LIWC, ANEW, etc.

NL topics/sentiment: Emolex, SentiWordNet, Empath

Wrestling with (the Wild West of) Population Data

Page 13: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Experimental design

Matched sets for studies

- Control

- Test/intervention

Example:

Rare serious adverse effects of medications

Wrestling with Large-Scale Population Data

Page 14: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

S

DFirst DLast

C C C C CS S

DFirst + 𝜃DFirst – 𝜃

𝛽𝛽

αα

S

γγ

D

Query Timeline

DD

S S

D: query for drug of interestC: query for condition of interestS: query for symptom of C ignored C or S

surveillance window post DFirst

surveillance window pre DFirst

α = DLast – DFirst

𝛽 = 7 daysγ = 60 days𝜃 = (α + 𝛽 + γ)

Self-controlled studyQuery rate ratio

Detect rare adverse effects of drugs

White, Harpaz, Shah, DuMouchel, Horvitz, Nature CPT, 2014

Page 15: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

White, Harpaz, Shah, DuMouchel, Horvitz, Nature CPT, 2014

Page 16: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

Fourney, White, Horvitz, CHI 2015

Example:

Pregnancy info needs

Alignment

Machine learning to align

Page 17: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

A. Fourney, R. White, E. Horvitz, CHI 2015

Example:

Pregnancy info needs

Alignment

Machine learning to align

Fourney, White, Horvitz, CHI 2015

Page 18: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

A. Fourney, R. White, E. Horvitz, CHI 2015

Example:

Pregnancy info needs

Alignment

Machine learning to align

Fourney, White, Horvitz, CHI 2015

Page 19: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

Paul, White, Horvitz, TWEB 2016

Example:

Breast cancer

Alignment

Episodic structure

Synthetic (per privacy), yet representative set of queries

Page 20: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Key pivot points

Diagnosis date ScreeningSurgery Chemotherapy

Wrestling with Large-Scale Population Data

Paul, White, Horvitz, TWEB 2016

Example:

Breast cancer

Alignment

Episodic structure

Page 21: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Wrestling with Large-Scale Population Data

Paul, White, Horvitz, TWEB 2016

Example:

Breast cancer

Alignment

Episodic structure

Page 22: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Key pivot points

Diagnosis date ScreeningSurgery Chemotherapy

Wrestling with Large-Scale Population Data

Paul, White, Horvitz, TWEB 2016

Example:

Breast cancer

Alignment

Episodic structure

Page 23: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Key pivot points

Diagnosis date ScreeningSurgery Chemotherapy

Wrestling with Large-Scale Population Data

Paul, White, Horvitz, TWEB 2016

Example:

Breast cancer

Alignment

Episodic structure

Page 24: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

u1 timeline

u2

u3

Learning outcome of action

Kiciman and Richardson, KDD 2015

Propensity: Normalizing cohorts to understand influences

Page 25: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

timeline

Propensity: Normalizing cohorts to understand influences

Kiciman and Richardson, KDD 2015

Page 26: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

timeline

Propensity: Normalizing cohorts to understand influences

Page 27: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

timeline

p

p

Propensity: Normalizing cohorts to understand influences

Page 29: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Example: Birth of child

Postpartum depression (PPD)

CDC: ~15%

50% cases unreported

De Choudhury, Counts, Horvitz. CSCW 2013, CHI 2013

Opportunity: Major Life Changes

Understand, support through difficult life changes

Major illnessLossDeathDivorceBirth

Page 30: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Identify tweets about births: Twitter Firehose

2,929 new mother candidates

Gender classifier

10 tweets per candidate & profile

376 new mothers

+ 3 months-3 months

*

Birth!

1st person pronoun

Identifying Multiple Dimensions of a Life Change

Page 31: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Structure & Dynamics of Engagement on Social Graph

Engagement. Volume: mean normalized number of posts per day

Replies, retweets, questions, shared links

Ego network

#inlinks; #outlinks

De Choudhury, Counts, Horvitz. CSCW 2013, CHI 2013

Page 32: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

De Choudhury, Counts, Horvitz. CSCW 2013, CHI 2013

Linguistic Analysis

Page 33: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Linguistic analysis

1o

3o

Neg.

Affect

Page 34: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Patterns and Outcomes

~15% of new mothers: severe changes

- Activity level down,

- Language usage: 1st person up, 3rd person down,

- Negative affect up, positive affect down

Page 35: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Exciting family of results

Human subjects + online:

New mothers w/ FB timeline, Twitter

Major depressive episodes

Predicting postpartum changes with data drawn before birth.

De Choudhury, Counts, Horvitz, Hoff. ICWSM 2014

De Choudhury, Gamon, Counts, Horvitz. ICWSM 2013

Predicting Postnatal Outcomes

Page 36: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Grappling with diagnosis & treatment

Queries before & after inferred breast CA diagnoses

Major Life Challenges: Major Illness

Paul, White, Horvitz, WWW 2015

Paul, White, Horvitz, TWEB 2016

Proxy for understanding if, how, and when life may return to normal?

Page 37: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Major Life Challenges: Grieving

Page 38: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

It is remarkable that this painful unpleasure

is taken as a matter of course by us.

Major Life Challenges: Grieving

Page 39: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

It is remarkable that this painful unpleasure

is taken as a matter of course by us.

Normally, respect for reality gains the day.

Major Life Challenges: Grieving

Page 40: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

It is remarkable that this painful unpleasure

is taken as a matter of course by us.

Normally, respect for reality gains the day.

In reality, however, this presentation is

made up of innumerable single impressions

(or unconscious traces of them) , and this

withdrawal of libido is not a process that

can be accomplished in a moment, but most

certainly, as in mourning, be one in which

progress is long-drawn-out and gradual.

Major Life Challenges: Grieving

Page 41: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

N Engl J Med 2015;372:153-60.

Unusually severe & prolonged grieving that impairs function

2 to 3% of population worldwide

Death: Child or life partner, sudden violent death

High rates of suicidal ideation, risk-taking

Value of psychotherapy

Opportunity: Assist with Complicated Grief

Page 42: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Opportunity: Assist with Complicated Grief

Page 43: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Opportunity: Assist with Complicated Grief

Page 44: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

Yom-Tov, White, Horvitz. JMIR, 2014.

On Sensitivity, Ethics, Disclosure

Page 45: Sensing, Prediction, Interaction in Support of Mental Health · Data to Predictions to Interventions Decision model Actions Predictive model Sensed data ... Pregnancy info needs Alignment

On Sensitivity, Ethics, Disclosure

Horvitz & Mulligan, Science 2015