1
Background Identifying Supervisory Strategies to Improve Provider Adoption of Person-Centered Care Planning in Behavioral Health Services: A Mixed Methods Study Mimi Choy-Brown University of Minnesota – Twin Cities Study Context Multisite randomized controlled trial testing the effectiveness of Person-Centered Care Planning in 14 research sites in two Northeastern States. Research participants (N=273) were employed in these behavioral health service settings providing primarily mental health services. Implementation Strategy included 2-day training for supervisors, ongoing technical assistance for 12-months that included two phone calls a month with supervisors and their teams. Supervisors were expected to train their staff members. Methods Results & Conclusions I want to acknowledge the participating mental health providers and the Person-Centered Care Planning Study Team. This work was supported by NIMH F31MH110120-01A1 Examining Supervision as an Implementation Strategy to Improve Provider Adoption of Evidence- Based Practice and NIMH R01MH099012 Person-Centered Care Planning and Service Engagement Acknowledgements Only 33% of patients received minimally adequate mental health treatment Only 27% of studies reported adequate rates of adherence to established clinical practice guidelines Limited service user access to quality care, service disengagement, and disparities in treatment outcomes (Institute of Medicine, 2001; 2006; 2015; Glasgow et al., 2012; Drake et al, 2001) Behavioral health service supervisors have the great responsibility and opportunity to influence quality of care Direct care providers are gatekeepers to health care and service coordinators for people seeking services in these settings (Eack et al., 2012) Primarily on-the-job learning with organizations often tasked with training staff (SAMHSA, 2013) Direct supervisors oversee direct care provider learning and practice and the administration of the programs (Bogo & Knight, 2006) Educational Supportive Administrative Normalization Process Theory posits mechanisms of the embedding process Direct Supervisors Coherence How do people make sense of the intervention? Cognitive Participation How do people get involved and stay committed? Collective Action How do people make it work in practice? Reflexive Monitoring How do people assess whether it is worth the effort? Adoption www.normalizationprocess.org Critical Gap in Knowledge Primary aim of this research was to understand supervision as an implementation strategy to improve provider adoption of a recovery-oriented, evidence- based practice within real world community mental health services settings Life worth living & Equitable access to health Quality Services Clinical Supervision Kadushin & Harkness, 2002 Person-centered care is considered central to the delivery of quality behavioral health services. Person-centered care planning (PCCP) operationalized person-centered care for behavioral health services. PCCP has a growing evidence base and has already been implemented across mental health systems. Explanatory Sequential Mixed Methods Design [quant → QUAL] Quant Data Collection Phase 2: QUAL Phase 1: Quant Quant Data Analysis QUAL Data Analysis Integration & Interpretation QUAL Data Collection Quantitative Findings Qualitative Inquiry Overestimating Supervisors Aligned Low Underestimating Supervisors Aligned High Qualitative Data Collection Interview Guide Items What is supervision like here? Supervisors What helps and what makes it hard to provide clinical supervision to staff? How do you see your role as a supervisor? Supervisees What would be useful to you in supervision? Is there anything that is NOT useful? Who or what do you rely on for help at work? Interviews were audio recorded and transcribed verbatim. Atlas.ti was used to separate and sort coded material. Semi-Structured Supervisor Interviews (N=12) Supervisee Interviews (N=22) Direct Observation (65 Hours) Analytic Strategy Phase 1 Initial Thematic Analysis - All data were co-coded independently by researchers with experience as supervisors in community mental health (Boyatzis, 1998) Phase 2 Code book development through consensus of iterative codes arising from data and codes related to “sensitizing” theory Phase 3 Codes relevant to research questions (strategies) extracted from data set, focused coding (Charmaz, 2006) Phase 4 Constant Comparative Analysis including case study matrices & triangulation of observation data Strategies for Rigor (Padgett, 2016) Peer debriefing Independent co- coding Memo-writing Prolonged engagement Participants (N=34) were from four research sites in one NE state Participants were from community support services (N=13), young adult services (N=6), residential (N=9), and outpatient therapy (N=6) 11 out of the 12 programs met an acceptable PCCP fidelity Majority of sample was female (88.2%), white (66.6%), and held bachelor’s degrees (88.2%) On average, participants were 41 years old and had worked at their agencies for 8 years Sample demographics Adopti on Coherence “the what” Meaning Cognitive Participation “the who” Commitment Collective Action “the how” Effort Reflexive Monitoring “the why” Appraisal • Infusing Reminders • Staying Vigilant • Making Sense Knowing Your Audience Chipping Away Practicing Together • In Vivo Supervision • Modeling • Shared Experiences • Attuning to Staff • Motivating • Calibrating Feedback Filling the Gap: Supervisory Strategies to Improve Adoption Provider Adoption Conclusions Frontline supervision is a complex multi-component implementation strategy encompassing social and technical learning elements consistent with NPT. A conceptual model detailing critical supervisory mechanisms and potential opportunities to facilitate EBP scale-up and sustainability efforts in routine settings. Targeting these supervisory activities holds promise as an effective implementation strategy to build provider buy-in and adoption of new efficacious practices. Improve the effectiveness and efficiency of this already embedded, cost-neutral strategy for ongoing quality improvement and workforce development and retention. References 1. IOM (Institute of Medicine). (2015). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence- based standards. Washington, DC: The National Academies Press. 2. IOM (Institute of Medicine). (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington DC: National Academies Press. 3. IOM (Institute of Medicine). (2006). Improving the quality of health care for mental and substance-use conditions. Washington D.C.: National Academies Press. 4. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. (2012). National Institutes of Health Approaches to Dissemination and Implementation Science: Current and Future Directions. American Journal of Public Health, 102(7),1274-81. 5. Drake, R.E., Goldman, H.H., Leff, H.S., Lehman, A.F., Dixon, L.B., Mueser, K.T., et al. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52, 179-92. 6. Eack, S. M., Anderson, C. A., & Greeno, C. G. (2012). Mental health case management: A practical guide. Thousand Oaks, CA: Sage. 7. Substance Abuse and Mental Health Services Administration (2013). Report to congress on the nation’s substance abuse and mental health workforce issues. Rockville, MD: Substance Abuse and Mental Health Services Administration. 8. Bogo, M. & Knight, K. (2006). Clinical supervision in social work. The Clinical Supervisor, 24(1), 49-67. 9. Kadushin, A. & Harkness, D. (2002). Supervision in social work (4th ed.). New York, NY: Columbia University Press. 10. May, C., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., . . . Montori, V. M. (2009). Development of a theory of implementation and integration: Normalization Process Theory. Implementation Science, 4, 29. 11. Boyatzis, R.E. (1998). Transforming qualitative information: Thematic analysis and code development. Thousand Oaks, CA: Sage. 12. Charmaz, K. (2006). Constructing grounded theory. Thousand Oaks, CA: Sage. 13. Padgett, D.K. (2016). Qualitative methods in social work research (3 rd ed.). Thousand Oaks, CA: Sage Publications.

Background Methods Results & ConclusionsMethods Design [quant → QUAL] Quant Data Collection. Phase 1: Quant. Phase 2: QUAL . Quant Data Analysis. QUAL Data Analysis . Integration

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Background Methods Results & ConclusionsMethods Design [quant → QUAL] Quant Data Collection. Phase 1: Quant. Phase 2: QUAL . Quant Data Analysis. QUAL Data Analysis . Integration

Background

Identifying Supervisory Strategies to Improve Provider Adoption of Person-Centered Care Planning in Behavioral Health Services: A Mixed Methods Study

Mimi Choy-Brown

University of Minnesota – Twin Cities

Study ContextMultisite randomized controlled trial testing the effectiveness of Person-Centered Care Planning in 14 research sites in two Northeastern States. Research participants (N=273) were employed in these behavioral health service settings providing primarily mental health services.

Implementation Strategy included 2-day training for supervisors, ongoing technical assistance for 12-months that included two phone calls a month with supervisors and their teams. Supervisors were expected to train their staff members.

Methods Results & Conclusions

I want to acknowledge the participating mental health providers and the Person-Centered Care Planning Study Team. This work was supported by NIMH F31MH110120-01A1 Examining Supervision as an Implementation Strategy to Improve Provider Adoption of Evidence-Based Practice and NIMH R01MH099012 Person-Centered Care Planning and Service Engagement

Acknowledgements

Only 33% of patients received minimally adequate mental health treatment Only 27% of studies reported adequate rates of adherence to established clinical practice

guidelines Limited service user access to quality care, service disengagement, and disparities in

treatment outcomes (Institute of Medicine, 2001; 2006; 2015; Glasgow et al., 2012; Drake et al, 2001)

Behavioral health service supervisors have the great responsibility and opportunity to influence quality of care

Direct care providers are gatekeepers to health care and service coordinators for people seeking services in these settings (Eack et al., 2012)

Primarily on-the-job learning with organizations often tasked with training staff (SAMHSA, 2013)

Direct supervisors oversee direct care provider learning and practice and the administration of the programs (Bogo

& Knight, 2006)

Educational

Supportive

Administrative

Normalization Process Theory posits mechanisms of the embedding process

Direct Supervisors

CoherenceHow do people make

sense of the intervention?

Cognitive Participation

How do people get involved and stay

committed?

Collective ActionHow do people make

it work in practice?

Reflexive MonitoringHow do people assess whether it is worth the

effort?

Adoption

www.normalizationprocess.org

Critical Gap in Knowledge

Primary aim of this research was to understand supervision as an implementation strategy to improve provider adoption of a recovery-oriented, evidence-based practice within real world community mental health services settings

Life worth living & Equitable access

to health

Quality Services

Clinical Supervision

Kadushin & Harkness, 2002

Person-centered care is considered central to the delivery of quality behavioral health services.

Person-centered care planning (PCCP) operationalized person-centered care for behavioral health services.

PCCP has a growing evidence base and has already been implemented across mental health systems.

Explanatory Sequential Mixed Methods Design [quant → QUAL]

Quant Data Collection

Phase 2: QUAL Phase 1: Quant

Quant Data

Analysis

QUAL Data

Analysis Integration & Interpretation

QUAL Data Collection

Quantitative Findings Qualitative Inquiry

Overestimating Supervisors

Aligned LowUnderestimating

Supervisors

Aligned High

Qualitative Data CollectionInterview Guide ItemsWhat is supervision like here?

SupervisorsWhat helps and what makes it hard to provide clinical supervision to staff? How do you see your role as a supervisor?

SuperviseesWhat would be useful to you in supervision? Is there anything that is NOT

useful? Who or what do you rely on for help at work?

Interviews were audio recorded and transcribed verbatim. Atlas.ti was used to separate and sort coded material.

Semi-Structured Supervisor Interviews

(N=12)

Supervisee Interviews

(N=22)

DirectObservation (65 Hours)

Analytic Strategy

Phase 1

• Initial Thematic Analysis - All data were co-coded independently by researchers with experience as supervisors in community mental health (Boyatzis, 1998)

Phase 2• Code book development through consensus of iterative codes

arising from data and codes related to “sensitizing” theory

Phase 3• Codes relevant to research questions (strategies) extracted from

data set, focused coding (Charmaz, 2006)

Phase 4• Constant Comparative Analysis including case study matrices &

triangulation of observation data

Strategies for Rigor (Padgett, 2016)

• Peer debriefing• Independent co-

coding• Memo-writing• Prolonged

engagement

Participants (N=34) were from four research sites in one NE state

Participants were from community support services (N=13), young adult services (N=6), residential

(N=9), and outpatient therapy (N=6)

11 out of the 12 programs met an acceptable PCCP fidelity

Majority of sample was female (88.2%), white (66.6%), and held bachelor’s degrees (88.2%)

On average, participants were 41 years old and had worked at their agencies for 8 years

Sample demographics

Adoption

Coherence“the what”

Meaning

Cognitive Participation

“the who”Commitment

Collective Action

“the how”Effort

Reflexive Monitoring“the why”Appraisal

• Infusing Reminders• Staying Vigilant• Making Sense

Knowing Your

Audience

Chipping Away

Practicing Together

• In Vivo Supervision• Modeling

• Shared Experiences

• Attuning to Staff• Motivating

• Calibrating Feedback

Filling the Gap: Supervisory Strategies to Improve Adoption

Provider Adoption

Conclusions Frontline supervision is a complex multi-component implementation strategy encompassing

social and technical learning elements consistent with NPT.

A conceptual model detailing critical supervisory mechanisms and potential opportunities to facilitate EBP scale-up and sustainability efforts in routine settings.

Targeting these supervisory activities holds promise as an effective implementation strategy to build provider buy-in and adoption of new efficacious practices.

Improve the effectiveness and efficiency of this already embedded, cost-neutral strategy for ongoing quality improvement and workforce development and retention.

References•1. IOM (Institute of Medicine). (2015). Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence- based standards. Washington, DC: The National Academies Press. •2. IOM (Institute of Medicine). (2001). Crossing the quality chasm: A new health system for the 21st Century. Washington DC: National Academies Press.•3. IOM (Institute of Medicine). (2006). Improving the quality of health care for mental and substance-use conditions. Washington D.C.: National Academies Press. •4. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. (2012). National Institutes of Health Approaches to Dissemination and Implementation Science: Current and Future Directions. American Journal of Public Health, 102(7),1274-81.•5. Drake, R.E., Goldman, H.H., Leff, H.S., Lehman, A.F., Dixon, L.B., Mueser, K.T., et al. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52, 179-92.•6. Eack, S. M., Anderson, C. A., & Greeno, C. G. (2012). Mental health case management: A practical guide. Thousand Oaks, CA: Sage. •7. Substance Abuse and Mental Health Services Administration (2013). Report to congress on the nation’s substance abuse and mental health workforce issues. Rockville, MD: Substance Abuse and Mental Health Services Administration. •8. Bogo, M. & Knight, K. (2006). Clinical supervision in social work. The Clinical Supervisor, 24(1), 49-67.•9. Kadushin, A. & Harkness, D. (2002). Supervision in social work (4th ed.). New York, NY: Columbia University Press. •10. May, C., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S., . . . Montori, V. M. (2009). Development of a theory of implementation and integration: Normalization Process Theory. Implementation Science, 4, 29. •11. Boyatzis, R.E. (1998). Transforming qualitative information: Thematic analysis and code development. Thousand Oaks, CA: Sage.•12. Charmaz, K. (2006). Constructing grounded theory. Thousand Oaks, CA: Sage. • 13. Padgett, D.K. (2016). Qualitative methods in social work research (3rd ed.). Thousand Oaks, CA: Sage Publications.