39
www.cebc4cw.org September 2014

Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Embed Size (px)

Citation preview

Page 1: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

www.cebc4cw.org

September 2014

Page 2: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

The California Evidence-Based Clearinghouse

for Child Welfare (CEBC)In 2004, the California Department of Social Services, Office of Child Abuse Prevention contracted with the Chadwick Center for Children and Families, Rady Children’s Hospital-San Diego in cooperation with the Child and Adolescent Services Research Center to create the CEBC.

The CEBC website was launched on 6/15/06.

The mission of the California Evidence-Based Clearinghouse for Child Welfare (CEBC) is to advance the effective implementation of evidence-based practices for children and families involved with the child welfare system.

September 2014

Page 3: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

The CEBC Website:

A searchable database of programs that can be utilized by professionals that serve children and families involved with the child welfare system. Each program description contains easily accessible and vital information, including, at a minimum, a CEBC Scientific Rating, citations and summaries of relevant published peer-reviewed research studies conducted on the program, a brief description of the program, and training and contact information.

September 2014

Page 4: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Technical Assistance to advance the use of EBPs that address the needs of California Counties

Informal consultation to those outside of California to help advance the use of EBPs that address the needs of their systems (additional web-based resources to be available in 2015)

CEBC Beyond the Website

September 2014

Page 5: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,
Page 6: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Advisory Committee

California DSS - Child and Family Services Division

County Child Welfare Departments

County Welfare Directors Association of California

California Child Welfare Training Organizations

Public & Private Community Partners

National Child Welfare Consultants

Guidance for the CEBC

September 2014

Page 7: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Implementation Science Panel

Greg Aarons, PhD-University of California, San Diego

Mark Chaffin, PhD-University of Oklahoma Health Sciences Center

Patti Chamberlain, PhD-Oregon Social Learning Center

Larry Palinkas, PhD-University of Southern California, School of Social Work

Sonja Schoenwald, PhD-Medical University of South Carolina

Guidance for the CEBC

September 2014

Page 8: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Scientific Panel

Richard P. Barth, PhD - University of Maryland

Lucy Berliner, MSW - Harborview Clinic for Sexual Assault & Traumatic Stress

Mark Chaffin, PhD - University of Oklahoma Health Sciences

Stan Huey, Jr., PhD University of Southern California

Laurel Leslie, MD, MPH - Tufts University School of Medicine

Benjamin E. Saunders, PhD - Medical University South Carolina

Haluk Soydan, PhD - University of Southern California

September 2014

Page 9: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

CEBC Team

Chadwick Center for Children and FamiliesRady Children's Hospital-San Diego

Charles Wilson, MSSWProject Director

Cambria Rose Walsh, LCSW

Project Manager

Jennifer Demaree, MSContent and Design

Specialist

Chris PerkinsProject Analyst

John Landsverk, PhDScientific Director

Jennifer Rolls Reutz, MPHResearch Program Specialist

Rhonda Williams, MAResearch Associate

Molly RobbProject Coordinator

September 2014

Page 10: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

What is Evidence-Based Practice(EBP)?

September 2014

Page 11: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

CEBC’s Definition of EBP for Child Welfare

& Consistent with Family Client

Values

Best Clinical Experience

Best Research Evidence

EBP

[Institute of Medicine (IOM), 2001]

September 2014

Page 12: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

The CEBC Review Process

September 2014

Page 13: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

CEBC Process

Identify topic areas

Review research on each program

Narrow down program list

Work with program representative to gather information

Rate program, if applicable

September 2014

Page 14: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Scientific Rating Process

The Scientific Rating Scale

September 2014

Page 15: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Scientific Rating Scale [**Based on a Continuum**]

NR

September 2014

Page 16: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Best Research Evidence

September 2014

Page 17: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Important Concepts

Randomized Controlled Trial

Peer-Reviewed

September 2014

Page 18: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

• 2+ rigorous randomized controlled trials (RCTs)

• One RCT has shown practice to have sustained effect of at least one year beyond the end of treatment

1 = Well-Supported by Research Evidence

September 2014

Page 19: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

• 1+ RCTs

• One RCT has shown practice to have a sustained effect of at least six months beyond the end of treatment

2 = Supported by Research Evidence

September 2014

Page 20: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

• At least one study utilizing some form of control (e.g., untreated group, placebo group, matched wait list study) has established the practice's benefit over the control, or found it to be comparable to a practice rated a 1, 2, or 3 on this rating scale or superior to an appropriate comparison practice

3 = Promising Research Evidence

September 2014

Page 21: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

• Two or more randomized controlled trials (RCTs) have found the practice has not resulted in improved outcomes, when compared to usual care

• Preponderance of evidence does not support the efficacy of the practice

4 = Evidence Fails to Demonstrate Effect

September 2014

Page 22: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

If multiple outcome studies have been conducted, the overall weight of evidence suggests the intervention has a negative effect upon clients served.

and/or

There is case data suggesting a risk of harm that:  a) was probably caused by the treatment; andb) the harm was severe and/or frequent

and/or

There is a legal or empirical basis suggesting that, compared to its likely benefits, the practice constitutes a risk of harm to those receiving it.

5 = Concerning Practice

September 2014

Page 23: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

There is no case data suggesting a risk of harm that:  a) was probably caused by the treatment; and b) the harm was severe and/or frequent

There is no legal or empirical basis suggesting that, compared to its likely benefits, the practice constitutes a risk of harm to those receiving it.

The practice does not have any published, peer-reviewed study utilizing some form of control that has established the practice's benefit over the control, or found it to be comparable to a practice rated 3 or higher on the CEBC or superior to an appropriate comparison practice.

The practice does not meet criteria for any other level on the CEBC Scientific Rating Scale.

NR = Not able to be Rated

September 2014

Page 24: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Strengths & Limitations

• Rating scale is clear cut• Numbering system is easy to follow

• May miss high quality research and null studies by relying on published, peer- reviewed research

September 2014

Page 25: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Medium:

Designed or is commonly used for populations similar to child welfare clients.

Child Welfare System Relevance Level

High:Designed or commonly used for child welfare clients.

  

Low: Designed for populations with little apparent similarity

to the child welfare services population.

September 2014

Page 26: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

CEBC ProcessIdentify topic areas

Review research on each program

Narrow down program list

Work with program representative to gather information

Review each program and rate, if applicable

Post program information

September 2014

Page 27: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Total= 339 programs as of September 30, 2014

Number of Programs by Rating

September 2014

Page 28: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

We also examined whether programs had included outcomes from the Child and Family Services Reviews in their published, peer-reviewed research:

Safety

Permanency

Well-Being

*In order to determine whether the program addressed a particular Child Welfare Outcome, the research evidence must include studies evaluating measures relevant to that Child Welfare

Outcome.

Child Welfare Outcomes

September 2014

Page 29: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

What You Can Find on the CEBC Website

September 2014

Page 30: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Topics Currently on the Website

41 topics are clustered in the following areas:

• Anger Management, Domestic Violence, and Substance Abuse

• Behavior Management including Parent Training

• Core Child Welfare Services including Placement and Reunification

• Engagement and Parent Partnering Programs

• Mental Health• Prevention and Early Intervention• Support Services for Youth in the

Child Welfare System

September 2014

Page 31: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Other Resources on the CEBC Website

September 2014

Page 32: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Implementation Tools- Selection Guide• Selecting a practice that is a good fit with one's

organization goes beyond choosing a practice that is scientifically rated a "1" on the website.

• The Selection Guide is based on the work of Trisha Greenhalgh and her colleagues (2004).

• Greenhalgh conducted a systematic literature review that addressed the question: "How can we spread and sustain innovations in health service delivery and organization?"

• Using the key findings of this review, we have designed the Selection Guide which is posted on the CEBC website.

• This guide is designed to assist child welfare professionals in selecting which practices highlighted on the CEBC website to implement in their agency.

September 2014

Page 33: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Online Trainings

Recordings of Webinars• Approaches and Outcomes for Implementing Evidence-

Based Practices in Child Welfare • Assessing Evidence-Based Practices in Child Welfare: A

Benefit-Cost Approach• Evidence-Based Treatments (EBTs) for Ethnic Minority

Youth: What We Know and What We Don’t Know• Integrating Evidence-Based Practice into Strategic

Planning: Building an Evidence-Based Continuum of Services

• Knowing the Best of What’s Out There: Understanding and Identifying Evidence-Based Practices in Child Welfare

• Parenting Programs for Children Birth-8: What is the Evidence and What Seem to be the Common Components?

• "So Much Trauma, So Many Interventions: How Do We Choose?“ (Parts 1 and 2)September 2014

Page 34: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Practical Application of the CEBC Website

September 2014

Page 35: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Using the Website

• Basic information is provided in the brief outline

• More detailed information allows a user to drill down to get further information:

Research Information that helps plan implementation strategy

(Training, Identified Resources, Minimum Provider Qualifications)

September 2014

Page 36: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Finding Information Fast

• Using the Search Tools

– Aside from searching by program name, the website allows one to quickly identify programs by:

• Topic Area• Scientific Rating• Child Welfare System Relevance Level• Child Welfare Outcomes• Age of Child

September 2014

Page 37: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

Information for Students and Professors

• Sample Lesson Plan for using the CEBC in the classroom

• How to Conduct a Literature Review

• Other information on how the CEBC can be helpful for students and professors

September 2014

Page 38: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

For More Information about the CEBC:

Sign up for Email Alerts of new programs and content:

www.cebc4cw.org/email-alerts

Visit the Website: www.cebc4cw.org

Contact Us – [email protected]

38September 2014

Page 39: Www.cebc4cw.org September 2014. The California Evidence-Based Clearinghouse for Child Welfare (CEBC) In 2004, the California Department of Social Services,

For More Information:

Cambria Rose Walsh, LCSW, Project ManagerChadwick Center- Rady Children’s Hospital-San Diego

CEBC E-Mail: [email protected]

CEBC Website: www.cebc4cw.org

September 2014