15
MHSC Program Evaluation Mental Health Service Corps Dana Collins, Social Work Intern Jessica Neufeld, MPH Virna Little, PsyD, LCSW-r, MBA, CCM, SAP

MHSC Program Evaluation

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: MHSC Program Evaluation

MHSC Program

Evaluation Mental Health Service Corps

Dana Collins, Social Work Intern

Jessica Neufeld, MPH

Virna Little, PsyD, LCSW-r, MBA, CCM, SAP

Page 2: MHSC Program Evaluation

Background & Rationale & Goals

• The Mental Health Service Corps (MHSC) is a program aimed to promote and protect the wellbeing of all New Yorkers.

• A program evaluation was conducted by the Institute for Family Health to identify the impact of MHSC’s social workers on their assigned client base, centers, providers, and the utilization of MHSC in community health centers.

• The goal of this evaluation was to determine the impact of MHSC in an FQHC placement.

Page 3: MHSC Program Evaluation

Project Details

Setting: Walton Family Health Center, Urban Horizons Family Health Center, Stevenson Family Health Center, Sidney Hillman/Phillips Family Practice, Family Health Center of Harlem (one MHSC social worker was placed in each of these sites)

Method: Continuous Quality Improvement Project (CQI)

Timeline: September 2016 – January 2017

Subjects: Four social workers from the MHSC program and their patients

Page 4: MHSC Program Evaluation

Methods

The MHSC social workers and their patients were examined based on factors such as patient demographics, patients clinical outcomes, types of appointments/outreach, and social worker capacity and productivity.

Page 5: MHSC Program Evaluation

Programs & Tools Used

• EPIC ▫ Database of all patients that includes all interactions between the Institute and patients,

current and past conditions, treatment plans • Productivity & Capacity Data Book (2016)

▫ Monthly report about productivity and capacity for each mental health clinician ▫ Used to compare the MHSC social workers with the IFH social workers and staff

• Patients Health Questionnaire (PHQ-9) ▫ A multipurpose instrument for screening, diagnosing, monitoring and measuring the

severity of depression ▫ Done multiple times (every visit), which can reflect if the patient is improving in regards

to their depression due to their treatment plan ▫ Used to examine the changes in PHQ-9 scores since the MHSC social workers started

working with their patients • Columbia-Suicide Severity Rating Scale (CSSRS)

▫ A suicide risk assessment that helps identify whether someone is at risk for suicide, assess the severity and immediacy of that risk, and gauge the level of support that the person needs

▫ Used to record the number of CSSRS and safety plans were conducted since the MHSC social workers started

• MHSC SW & IFH Staff Survey ▫ To explore the relationship between IFH staff and MHSC social workers

Page 6: MHSC Program Evaluation

IFH Regional Performance Measures (NYC)

0

500

1000

1500

2000

2500

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

110%

120%

130%

140%

150%

Dec-15 Jan-16 Feb-16 Mar-16 Apr-16 May-16 Jun-16 Jul-16 Aug-16 Sep-16 Oct-16 Nov-16 Dec-16

Pe

rce

nta

ges

for

vari

ou

s p

erf

orm

ance

me

asu

res

Performance by month

Productivity [ActualVisits Completed /Visit Projection]

Capacity [Visit TimeSpent / Availability]

AppointmentConversion Rate[Actual VisitsCompleted/IntendedVisits]Availability [Hours]

Actual VisitsCompleted

Page 7: MHSC Program Evaluation

0% 0%

47%

36%

82%

64%

84%

62%

30%

2%

40%

33%

44%

36%

50%

40%

0% 0%

26% 21%

55%

48%

76%

68%

0% 0% 0% 0% 0% 0%

88% 91%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Productivity Capacity Productivity Capacity Productivity Capacity Productivity Capacity

September October November December

Pr

od

uc

tiv

ity

an

d C

ap

ac

ity

Le

ve

ls (

%)

SW 1 SW 2 SW 3 SW 4

MHSC Productivity & Capacity

Capacity Level

Page 8: MHSC Program Evaluation

Types of Visits/Encounters

199

108

107

110

236

34

139

85

69

29

402

47

180

104

85

37

180

25

1

3

20

6

45

2

0 50 100 150 200 250 300 350 400 450

In Person/Completed Visit

Canceled

No show

Non-Visit

Telephone

Email/Letter

Ty

pe

s o

f V

isit

s/E

nc

ou

nte

rs

SW 1 SW 2 SW 4 SW 4

Page 9: MHSC Program Evaluation

Most Common Items on Patient

Problem List

Depression, 35%

Suicidal Ideation, 15%

Generalized Anxiety

Disorder/Anxiety, 15%

Substance Abuse, 6%

Adjustment Disorder, 5%

Post-Traumatic Stress Disorder, 4%

Pre-Diabete

s, 3%

Type 2 Diabetes

, 3%

Insomnia, 3% Suicide

Attempt, 3% Other, 12%

Depression Suicidal IdeationGeneralized Anxiety Disorder/Anxiety Substance AbuseAdjustment Disorder Post-Traumatic Stress DisorderPre-Diabetes Type 2 DiabetesInsomnia Suicide Attempt

*The conditions shown here are only based on the total number of patients from all four of the MHSC social workers

Page 10: MHSC Program Evaluation

Depression Metric

October November December January

SW 1 12 11 12 12

SW 2 8 7 7 7

SW 3 12 12 13 14

SW 4 0 0 16 14

12 11 12 12

8

7 7 7

12 12

13

14

0 0

16

14

0

2

4

6

8

10

12

14

16

18

Av

er

ag

e L

as

t P

HQ

-9 S

co

re

P

er

Mo

nth

Depression Scores Per Month

Page 11: MHSC Program Evaluation

Safety Plan and C-SSRS Rates

Safety Plan C-SSRS Total Patients

SW 1 17 9 18

SW 2 12 6 16

SW 3 15 11 18

SW 4 9 4 9

Note: This table only includes patients who had suicide on their problem list.

Page 12: MHSC Program Evaluation

Discussion

• MHSC social workers met with a variety of clients, though most came with a history of depression

• Productivity and capacity varied among the MHSC social workers and slowly improved over time

• Safety plan and C-SSRs need to be addressed and conducted more with clients

Page 13: MHSC Program Evaluation

Limitations

• Data for this evaluation was very preliminary; the MSHC social workers had been working with IFH for roughly 5 months at the time of this evaluation was done

• Sample size is very small; there were only four MHSC social workers examined for this program evaluation

• Also, one of the MHSC social workers was on leave for a few months and had only returned for one month (her data was included in this evaluation)

Page 14: MHSC Program Evaluation

Recommendations

• To conduct monthly program evaluations examining the same variables and characteristics past evaluations have looked at

• To continually meet with the MHSC team to discuss gaps and how to improve collaboration between MHSC and IFH

Page 15: MHSC Program Evaluation

Contact Information

• Dana Collins Social Work Intern

Psychosocial Services

[email protected]

• Jessica Neufeld, MPH

Special Projects Coordinator

Psychosocial Services

[email protected]

• Virna Little, PsyD, LCSW-r, MBA, CCM, SAP

Senior Vice President Psychosocial Services/Community Affairs

[email protected]