41
Lessons Learned: Examining the Association of My HealtheVet, Healthcare Utilization, and Costs Bridget Smith, MA, PhD Center of Innovation for Complex Chronic Healthcare April 17, 2018

Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Lessons Learned Examining the Association of My HealtheVet Healthcare Utilization and Costs

Bridget Smith MA PhD

Center of Innovation for Complex Chronic Healthcare

April 17 2018

Funding

bull VA HSRampD IIR 14-401 ldquoImpact of My HealtheVet Use on Healthcare Utilization and Costsrdquo

The views expressed in this presentation are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government

VETERANS HEALTH ADMINISTRATION

Overview

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 3

Poll 1 What is your role in the VA

bull Research investigatorPI

bull Data manager analyst or programmer

bull Project coordinator

bull Clinical or operations staff

bull Other ndash please describe via the QampA function

4VETERANS HEALTH ADMINISTRATION

Poll 2 How would you describe your level of experience with MyHealtheVet

bull 1- Not worked with it at all

bull 2

bull 3

bull 4

bull 5- Very experienced with MHV

5VETERANS HEALTH ADMINISTRATION

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 2: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Funding

bull VA HSRampD IIR 14-401 ldquoImpact of My HealtheVet Use on Healthcare Utilization and Costsrdquo

The views expressed in this presentation are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government

VETERANS HEALTH ADMINISTRATION

Overview

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 3

Poll 1 What is your role in the VA

bull Research investigatorPI

bull Data manager analyst or programmer

bull Project coordinator

bull Clinical or operations staff

bull Other ndash please describe via the QampA function

4VETERANS HEALTH ADMINISTRATION

Poll 2 How would you describe your level of experience with MyHealtheVet

bull 1- Not worked with it at all

bull 2

bull 3

bull 4

bull 5- Very experienced with MHV

5VETERANS HEALTH ADMINISTRATION

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 3: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Overview

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 3

Poll 1 What is your role in the VA

bull Research investigatorPI

bull Data manager analyst or programmer

bull Project coordinator

bull Clinical or operations staff

bull Other ndash please describe via the QampA function

4VETERANS HEALTH ADMINISTRATION

Poll 2 How would you describe your level of experience with MyHealtheVet

bull 1- Not worked with it at all

bull 2

bull 3

bull 4

bull 5- Very experienced with MHV

5VETERANS HEALTH ADMINISTRATION

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 4: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Poll 1 What is your role in the VA

bull Research investigatorPI

bull Data manager analyst or programmer

bull Project coordinator

bull Clinical or operations staff

bull Other ndash please describe via the QampA function

4VETERANS HEALTH ADMINISTRATION

Poll 2 How would you describe your level of experience with MyHealtheVet

bull 1- Not worked with it at all

bull 2

bull 3

bull 4

bull 5- Very experienced with MHV

5VETERANS HEALTH ADMINISTRATION

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 5: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Poll 2 How would you describe your level of experience with MyHealtheVet

bull 1- Not worked with it at all

bull 2

bull 3

bull 4

bull 5- Very experienced with MHV

5VETERANS HEALTH ADMINISTRATION

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 6: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 6

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 7: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

My HealtheVet Background

The MHV patient portal is tethered to VArsquos electronic health record (EHR) and provides a suite of online tools to help Veterans engage in and manage their health

Self-enter and track personal health information

Conduct transactions with the VA healthcare system

Communicate (asynchronously with VA healthcare team members)

Access content from the VA EHR

7VETERANS HEALTH ADMINISTRATION

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 8: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Access to My HealtheVet Portal

MHV follows a tiered access model

Visitors to the portal

Registrants

Basic accounts or advanced accounts for VA patients correlated with the Master Veteran Index

Authenticated Users

Premium accounts for VA patients who complete a one-time process of identity authentication

VETERANS HEALTH ADMINISTRATION 8

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 9: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

My HealtheVet ndash Portal Layout

VETERANS HEALTH ADMINISTRATION 9

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 10: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

My HealtheVet ndash Compelling Statistics

As of January 2018

42M+ registered users

25M+ identity-proofed

VA patients

Users

114M+ VA prescription

refills

(since 2005)

57M+ secure messages

exchanged

(since 2008)

27M+ Blue Button files

downloaded

(since 2010)

Use

VETERANS HEALTH ADMINISTRATION Available from httpvawwvagovMYHEALTHEVETstatisticsasp 10

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 11: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 11

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 12: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

My HealtheVet DART Request Process for NDS Managed Data Access

VETERANS HEALTH ADMINISTRATION 12

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 13: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

MyHealtheVet DART Request Process for NDS Managed Data Access Lessons

bull Pre-request consultation with the MHV program office is a requirement

ndash Because of the complexity of the data this is extremely helpful

ndash Plan ahead

bull Note that some tables include other CDW data and were created to address specific requests

VETERANS HEALTH ADMINISTRATION 13

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 14: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 14

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 15: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VA MHV Data Catalog

VETERANS HEALTH ADMINISTRATION 15

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 16: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VA MHV Data Catalog

MHV Tables Examples

VETERANS HEALTH ADMINISTRATION 16

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 17: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VA MHV Data Catalog

MHV Activity Table

VETERANS HEALTH ADMINISTRATION 17

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 18: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VETERANS HEALTH ADMINISTRATION 18

VA MHV Data Catalog

MHV Activity Table Master List Example

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 19: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VA MHV Data Catalog

MHV Activity Table Lessons Learned

bull Important to use Activity_Type and Action variables as some values for Activity_Type are associated with multiple values of action

ndash Example

VETERANS HEALTH ADMINISTRATION 19

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 20: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

MHV Activity Table More Lessons Learned

bull Be careful with dates See handy timeline in data catalog

VETERANS HEALTH ADMINISTRATION 20

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 21: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VA MHV Data Catalog

MHV SEI Tables

bull SEI tables include a flag to indicate a user entered data The actual data entered is not in these tables

bull Important note for many of these tables they do not always use the same column name to identify users

bull Each type of SEI (allergies blood pressure blood sugar etc)

has own table

VETERANS HEALTH ADMINISTRATION 21

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 22: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 22

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 23: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

HSRampD Project Impact of My HealtheVet on Healthcare Use and Costs

Significance bull My HealtheVet may increase access to healthcare by providing patients access

to their providers through secure messaging

bull Providing specific estimates on the association between the use of My HealtheVet and outcomes such as missed appointments VA utilization and costs will inform strategies regarding directions for development and implementation of features of My HealtheVet

bull While the number of Veterans who use My HealtheVet continues to increase little is known about the impact My HealtheVet use has on healthcare utilization and cost and the duplication of services and medications between VA and Medicare

Study Aim Assess the impact of My HealtheVet use on VA healthcare utilization and costs

VETERANS HEALTH ADMINISTRATION 23

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 24: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Conceptual Framework

Quality

Outcomes

VETERANS HEALTH ADMINISTRATION 24

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 25: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Methods

Time Period October 1 2012 - September 30 2016 (FY2013 - FY2016)

MHV Cohort Veterans who were new users during FY2013

Comparison Cohort

Those who never used MHV

VETERANS HEALTH ADMINISTRATION 25

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 26: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements Information on dates of registration authentication and

CDW My HealtheVet type of feature used

CDW Inpatient Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization CDW Outpatient

and telephone encounters CDW Pharmacy BCMA Pharmacy Outpatient Information on dates of prescriptions types of NonVA Meds Unit Dose prescriptions

CDW Appointment Dates of missed appointments

Medical SAS Inpatient Datasets Demographics clinical diagnoses inpatient utilization

Demographics clinical diagnoses outpatient utilization Medical SAS Outpatient Care Datasets

and telephone encounters Priority category (as an indicator of whether Veterans

Patient Enrollment Database have a copayment for all some or no medications and service connection status)

VETERANS HEALTH ADMINISTRATION 26

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 27: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Methods Data Sources

Data source Data elements

Vital Status File

US Census Data

MCA Files

Medicare Part D Denominator Database

Medicare Denominator File

Date of death

Zip code level socioeconomic status

Cost data for VA healthcare use

Enrollment status in Medicare Part D

Demographics

Medicare claims data (Medicare Provider Analysis Healthcare utilization costs and comorbid

and Review [MedPAR] files Outpatient files conditions Medicare pharmacy data

Carrier files) Part D Utilization Database

PSSG Geocode Enrollee Data Geographic information

VETERANS HEALTH ADMINISTRATION 27

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 28: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Cohort Diagram

VETERANS HEALTH ADMINISTRATION 28

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 29: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

VETERANS HEALTH ADMINISTRATION

Impact of My HealtheVet on Healthcare Use and Costs

Demographics

Characteristic MHV Users Non-Users p-value

18-24 36 15 lt0001

25-49 448 230

50-64 305 369 AGE

65-74 170 258

75-84 33 97

85-105 08 31

Male 826 915 lt0001 GENDER

Female 174 85

Not Married 400 422 00013 MARITAL

Married 600 578

White 764 791 lt0001

RACE Black 207 184

Other 29 25 29

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 30: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Results T-tests

Characteristic n Mean SD p

Age

MHV-Users 30831 5679 1570 lt 0001

Non-Users 204298 6633 1379

Distance to nearest Medicare

MHV-Users 30831 882 2188 lt 0001

Non-Users 204298 926 1701

Score Community

MHV-Users 30831 039 041 lt 0001

Non-Users 204298 052 046

Median household income

MHV-Users 30831 518878 134032 lt 0001

Non-Users 204298 505734 127003

VETERANS HEALTH ADMINISTRATION 30

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 31: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 18-64 VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 31

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 32: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Costs after Propensity Score Weighting and Adjustment for Covariates

0

5

10

15

20

25

30

Pre Post Yr2a Yr3a

Tho

usa

nd

s o

f D

olla

rs

Age 65+ VA Cost Full Model

Comparison User

VETERANS HEALTH ADMINISTRATION 32

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 33: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Blue Button Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

Secure Messaging Total Inpatient Full Model

7500000

7000000

6500000

6000000

5500000

5000000

4500000

4000000 4000000 Post Yr2a Yr3a Post Yr2a Yr3a

No BB Used BB No SMS Used SMS

VETERANS HEALTH ADMINISTRATION 33

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 34: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Results Predicted Inpatient Costs by MHV Activity

Rx Refill Total Inpatient Full Model View App Total Inpatient Full Model

7500000 7500000

7000000 7000000

6500000 6500000

6000000 6000000

5500000 5500000

5000000 5000000

4500000 4500000

4000000 Post Yr2a Yr3a

4000000 Post Yr2a Yr3a

No RxRefill Used RxRefill No ViewApp Used ViewApp

VETERANS HEALTH ADMINISTRATION 34

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 35: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Impact of My HealtheVet on Healthcare Use and Costs

Lessons Learned

bull Engage operational stakeholders (eg MHV Program Office of Connected

Care) in your research What is the ldquorightrdquo level of engagement given the goals of a particular study

bull Communicate with those stakeholders early and often

bull Strive to balance your needs as a researcher with those of the operational

stakeholder What are the short-term and long-term research and evaluation priorities

bull Manage expectations for what can be accomplished in a given study Consider outcomes claims timelines

bull Be flexible

VETERANS HEALTH ADMINISTRATION 35

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 36: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Outline

bull What is My HealtheVet (MHV)

bull MHV DART Request Process

bull Structure of MHV Data

bull HSRampD Project ndash Impact of MHV on Costs

bull Resources

VETERANS HEALTH ADMINISTRATION 36

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 37: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Resources

VIReC Cyberseminar Veteran Engagement and Access to Health Information Collaboration in the Evaluation of the Blue Button Feature of My HealtheVet Presented by Carolyn Turvey httpswwwhsrdresearchvagovfor_researcherscyber_seminarsarchivesvideo_archivecfmSessionID=22 77

For more information about MHV visit the My HealtheVet website at wwwmyhealthvagov

For information about using secure messaging in researchldquoGuidance for VA Researchers on the Use of My HealtheVet Secure Messaging This document been placed on the ORD Policies and Guidance webpage at httpswwwresearchvagovresourcespolicieshuman_researchcfm

A few references Hogan TP Luger TM Volkman JE Rocheleau M Mueller N Barker AM Nazi KM Houston TK Bokhour BG Patient Centeredness in Electronic Communication Evaluation of Patient-to-Health Care Team Secure Messaging J Med Internet Res 2018 Mar 820(3)

Hogan TP Nazi KM Luger TM Amante DJ Smith BM Barker A Shimada SL Volkman JE Garvin L Simon SR Houston TK Technology-assisted patient access to clinical information an evaluation framework for blue button JMIR Res Protoc 2014 Mar 273(1)e18

Turvey CL Klein DM Witry M Klutts JS Hill EL Alexander B Nazi KM Patient Education for Consumer-Mediated HIE A Pilot Randomized Controlled Trial of the Department of Veterans Affairs Blue Button Appl Clin Inform 2016 Aug 37(3)765-76

Keith McInnes D Shimada SL Rao SR Quill A Duggal M Gifford AL Brandt CA Houston TK Ohl ME Gordon KS Mattocks KM Kazis LE Justice AC Personal health record use and its association with antiretroviral adherence survey and medical record data from 1871 US veterans infected with HIV AIDS Behav 2013 Nov17(9)3091-100 doi 101007s10461-012-0399-3 PubMed PMID 23334359

Shimada SL Allison JJ Rosen AK Feng H Houston TK Sustained Use of Patient Portal Features and Improvements in Diabetes Physiological Measures J Med Internet Res 2016 Jul 118(7)e179 doi 102196jmir5663

Haun JN Lind JD Shimada SL Martin TL Gosline RM Antinori N Stewart M Simon SR Evaluating user experiences of the secure messaging tool on the Veterans Affairs patient portal system J Med Internet Res 2014 Mar 616(3)e75

VETERANS HEALTH ADMINISTRATION 37

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 38: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Acknowledgements and Thank you tohellip

bull Hira Khan for her support and comments

bull Linda Kok and her team for their assistance with developing the data request process

bull Our study team Hines Bridget Smith Kevin Stroupe Frances Weaver Rachael Martinez Linda Poggensee Lishan Cao Jenny Huo Dawn Irwin Swetha Ramanathan Bella Etingen

Iowa City Bonnie Wakefield PhD

Bedford Timothy Hogan Stephanie Shimada Sam Connolly Tom Houston

Indianapolis David Haggstrom

Veterans and Consumers Health Informatics Office Kim Nazi PhD (now retired) Theresa Hancock MHV Data Analytics Team

CDW Team

VETERANS HEALTH ADMINISTRATION 38

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 39: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Contact Information

Bridget Smith MA PhD Investigator Center of Innovation for Complex

Chronic Healthcare (CINCCH)

Research Associate Professor Northwestern University

BridgetSmithvagov

VA Information Resource Center

Hines VA Hospital

virecvagov

708-202-2413

39VETERANS HEALTH ADMINISTRATION

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 40: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Questions

VETERANS HEALTH ADMINISTRATION 40

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41

Page 41: Lessons Learned: Examining the Association of My ... · of features of My Health. e. Vet • While the number of Veterans who use My Health. e. Vet continues to increase, little is

Next Session Tuesday May 15th at 12pm Eastern

Using Data amp Information Systems

in Partnered Research Cyberseminar Series

Survey Data Collection Using VA REDCap

Bonnie Paris PhD

VA Information Resource Center

VETERANS HEALTH ADMINISTRATION 41