34
Oakhill Boys Ranch Outcomes Report 2013-2014

Outcomes Report - Oak Hill Boys Ranch · Web viewOutcomes Report ... Behavioral measures are completed in the school setting by the educational staff with the Short Form Assessment

Embed Size (px)

Citation preview

Oakhill Boys Ranch Outcomes Report 2013-

2014

Oakhill Boys RanchOutcomes Report 2013-2014

Table of Contents

INTRODUCTION.....................................................................................................1

I. NUMBER OF CLIENTS (n=60)......................................................................3

II. CULTURAL/ETHNIC ORIGIN (N=60).........................................................3

III. CHILD WELFARE STATUS (N=60).............................................................3

IV. OTHER STATUS (N=13)................................................................................4

V. AGE AT INTAKE (N=32)...............................................................................4

VI. AGE AT DISCHARGE (N=28).......................................................................4

VII. LENGTH OF STAY (N=28)............................................................................4

VIII. EDUCATION (N=60)......................................................................................4

IX. DSM DIAGNOSIS (N=48)..............................................................................6

X. FASD (N=48)...................................................................................................7

XI. PLACEMENT PRIOR TO INTAKE 2013-14 (N=32)....................................7

XII. PLACEMENT AT DISCHARGE 2013-14 (N=28).........................................7

XIII. PLACEMENTS TOWARDS PERMANENCE...............................................8

XIV. CHILREN’S GLOBAL ASSESSMENT SCALE (CGAS) SCORES (N=18).8

XV. BEHAVIORAL OUTCOMES (N=23)............................................................9

XVI. PROGRAM OBJECTIVES............................................................................10

XVII. OTHER INITIATIVES...........................................................................13

XVIII. CASE WORKER FEEDBACK (N=4)....................................................21

Oakhill Boys RanchOutcomes Report 2013-2014

INTRODUCTION

The following report is a collection of information gathered for the period of April 1, 2013 to March 31, 2014. The information provides a general overview in client demographics and service outcomes that are both quantitative and qualitative. Most of the data has not been empirically tested (other than the standardized test) and therefore statistical significance varies throughout.

Over the fiscal period we have experienced slight changes in our client population and significant service outcomes.

1. Summary of Changes in Client Demographics

A slight decrease in age at intake from 12 years and 8 months to 12 years and 4 months.

A decrease in age at discharge; from 14 years and 3 months to 13 years and 5 months, a difference of 10 months

Overall behavioral scores at intake remain very high in the 99.3 percentile in the home setting and 99.4% in the school setting when compared to the general population.

2. Summary of General Service Outcomes

Statistically significant improvement in some domains of Organizational Social Context surveys. Improvement noted in nearly all areas measuring organizational culture, climate and morale of the organization.

Significantly positive scores on the CARE surveys conducted by Cornell University in Staff knowledge and beliefs, Current practice and Youth perception.

Cornell University ranked Oakhill as one of their top performers in respect to the implementation of the CARE program.

Seventy-nine (79%) of the young people discharged from Oakhill Boys Ranch were planned discharges and were placed in similar or less intensive placements in the community or family.

Fifty four percent (54%) of all discharges were placed in a family setting. Young people attended at Oak Hill School and community schools on a

consistent and regular basis with a 33% improvement from their previous school. Academic performance in reading scores of 2.16 grade levels in a one year

period. Provincial achievement tests scores for the five participating grade nine students

are above the provincial norm. Significant positive change in child functioning as indicated by CGAS scores. Significant behavioral change as indicated on SAC scores.

1

Oakhill Boys RanchOutcomes Report 2013-2014

Positive results in Case Worker Feedback although the number of responses was limited.

The Ranch will continue its pursuit for excellence in achieving strong outcomes for young people and their families in the upcoming year. In addition to maintaining strong outcomes in the areas reported above, Oakhill Boys Ranch will put a strong emphasis on the following areas for the upcoming year:

The continued focus on the implementation and sustainability of CARE resulting in:

o Strengthening the CARE principles and congruence of practice in the school setting and the home setting, and

o Continue to develop attachment and trauma practices in Cavell Lodge.

Continue to Review and further of our clinical supports; specifically assessment activities for new admissions along with a stronger emphasis on congruence with CARE.

Strengthening of our special components such as: Equine program, Animal Assisted Therapy Program, High and Low Ropes Course and our Aboriginal services.

The specific data collections regarding each of the variables and achievements are further detailed in the body of the report.

2

Oakhill Boys RanchOutcomes Report 2013-2014

I. NUMBER OF CLIENTS (n=60)

Number of Clients Served: 60

(3 less than the previous year)

Number of Clients Admitted: 32

All admissions were identified as requiring specialized treatment services (physically aggressive /dual diagnosis)

(This decreased by 1 from the previous year)

Number of Clients Discharged: 28 22 were consistent with treatment planning. 6 were discharged for emergent circumstances (required secure services

or ran away).

(This decreased by 8 from the previous year)

II. CULTURAL/ETHNIC ORIGIN (N=60)

Aboriginal: 29 (48%)

Caucasian: 28 (47%)

Other: 3 (5%)

(No significant change from previous year)

III. CHILD WELFARE STATUS (N=60)

Custody Agreement (CA): 35 (58%)

Permanent Guardian Status (PGO): 17 (28%)

Temporary Guardian Status (TGO): 8 (13%)

(No significant change).

3

Oakhill Boys RanchOutcomes Report 2013-2014

IV. OTHER STATUS (N=13)

Family Support for Children with Disabilities (FSCD) = 5

Outcome Based Service Delivery (OBSD) = 7

V. AGE AT INTAKE (N=32)

The mean age at intake is 12 years and 4 months. This is a slight decrease in age by 4 months from the previous year. The range of age at intake is 9 years and 6 months to 15 years.

VI. AGE AT DISCHARGE (N=28)

The mean age at discharge is 13 years and 5 months, a decrease of 10 months from the previous year. The range of age at discharge is 10 years and 2 months to 16 years and 8 months.

VII. LENGTH OF STAY (N=28)The mean length of stay is 367 days (12 months). This is a 79 day increase from the year prior. The range of length of stay is 33 days to 1229 days.

Post Placement # of Children % of Children Length of StayFamily Care 12 43% 346 days

Substitute Family Care 3 11% 334 daysGroup Home 5 18% 470 days

Residential Treatment 4 14% 196 daysEYOC/RCMP 2 7% 51 days

Hospital 1 3% 1229 daysRunaway 1 3% 136 days

Over the last five years, the data indicates the longer the length of stay (334 days or more) the better post placement outcomes. We have also seen longer length of stays when young people require more intensive post placement supports. This is primarily based on the increased complexity of client population and the availability of specialized placements.

VIII. EDUCATION (N=60)

Oak Hill School recognizes that many of the young people in the care of Oak Hill Boys Ranch have experienced many difficulties in school and often require additional

4

Oakhill Boys RanchOutcomes Report 2013-2014

academic and behavioral supports to reconnect and remain encouraged about their educational potential. Those young people who have reached the potential to be able to be successful in community school attend schools in our local community.

School Attended Number of Young People (n=60)Oak Hill School 56Sturgeon Composite 2Gibbons Junior High 1Gibbons Fresh Start 1

Attendance at Oak Hill School is regular for all the young people attending there. The young people attend school everyday regardless of behavior. Only when there are severe behavioral situations they may receive a maximum of a 2-day suspension. Absences at Oak Hill School generally are due to young people being absent from the ranch. Examples of absences are full day appointments, sick days, family visits, suspensions and young people who have runaway.

Student prior to admission to Oakhill demonstrated a combined absence and late attendance at a rate of 45%. When attending Oak Hill School the combined absence and late attendance rate is significantly reduced to 12%.

Academic performance

Oak Hill School measures part of academic performance based on standardized testing in reading. In the upcoming year the school with also measure performance in math utilizing the Stanford diagnostic for math. Below is a summary of the reading scores from June 2013.

Test Renaissance Reading, Star Reading Test (n=16)Group High Group Low Mean

Sept 2012 11.5 2.2 5.0June/Oct 2013 12.6 2.6 6.5

Difference +1.1 +0.4 +1.5

NOTE: Group high, Group Low and Mean scores are grade level based on student performance per testing period. Only those tested in the spring 2012 are included in the fall 2013

In the 2013-14 school year there has been a strong focus on literacy. Efforts have

included: 1 on 1 support - Fountas & Pinnell, Accelerated Reading - Star Reading Test,Global Strategies - Frayer Model, Word Walls, Alphabet, Decoding and Evening Reading Initiative at Ranch.

The RESULT = 2.16 Grade Level Improvement on the Star reading test.

5

Oakhill Boys RanchOutcomes Report 2013-2014

Provincial Achievement Tests (June 2013)

Five (5) grade nine students participated in the provincial achievement test. There performance is summarized below.

Oak Hill School – Provincial Achievement Tests Scores (n=5)Science Math LA (B) Social

Oak Hill School 81.0 63.0 73.8 74Provincial 66.2 63.2 64.7 66.6

Overall School Average: 72.95

The five (5) students who participated in the PAT(s) scored extremely well when compared to the provincial average.

Behavioral Scores for School Setting

Behavioral measures are completed in the school setting by the educational staff with the Short Form Assessment checklist developed by the University of Tennessee. The summary of these results are as follows:

Initial SAC Completed (n=20) Last SAC Completed or March 2014(n=20)Internalized Behavioral

Score

Externalized Behavioral

Score

Overall Behavioral

Score

Internalized Behavioral

Score

Externalized Behavioral

Score

Overall Behavioral

ScoreM= 18.9 M=30.15 M=49.05 M=11.07 M=19.03 M=30.1098.6% 99.2% 99.4% 91.9% 93.3% 91.9%Clinical Clinical Clinical Clinical Clinical Clinical

The young people placed at Oak Hill School learn to experience positive academic and behavioral growth.

IX. DSM DIAGNOSIS (N=48)

The young people placed in the care of Oak Hill Boys Ranch typically are diagnosed by the DSM IV/V before intake and often have multiple diagnoses.

6

Oakhill Boys RanchOutcomes Report 2013-2014

X.

FASD (N=48)

In a sample of 48 (n=48), 13 (31%) of the young people were diagnosed with FASD or there was a strong clinical opinion noted. This is 5% decrease with the year prior.

XI. PLACEMENT PRIOR TO INTAKE 2013-14 (N=32)

XII. PLACEMENT AT DISCHARGE 2013-14 (N=28)There were 25 (74%) planned discharges and 9 (26%) unplanned discharges. Planned discharges only include situations where the permanency plan or concurrent plan is followed as specified in the child’s Service Plan. Unplanned discharges include crisis or emergent discharges. Below is a sample table of placements following discharge.

Post Placement # of Children

% of Children

Less restrictive/Intrusive 20 71%

Equally restrictive/intrusive 4 14%

7

Diagnosis Number of Children (n=48)

% of Children

ADHD 39 81%Oppositional Defiance Disorder 31 65%Reactive Attachment Disorder 16 33%

Conduct Disorder 15 31%Learning/cognitive Disability/Disorder 13 31%

FASD 13 27%Post Traumatic Stress Disorder 6 13%

Other (n=10) 10 21%

Type of Placement # of Children % of childrenFamily Care 13 40%Group Care 10 31%

Substitute Family Care 5 16%Residential Treatment 2 6%

Secure Treatment 1 3%EYOC 1 3%

Oakhill Boys RanchOutcomes Report 2013-2014

More restrictive/intrusive 3 11%

Runaway 1 3%

Planned/Unplanned Number PercentagePlanned 22 79%

Unplanned 6 21%

In respect to the 22 planned discharges, 20 (91%) of the young people were placed in a less intrusive setting. 15 (68%) of the planned discharges were placed in family based care and 5 (23%) went to community based group care.

XIII. PLACEMENTS TOWARDS PERMANENCEGenerally speaking, it is fair to state that young people who are admitted to Oakhill Boys Ranch should return to placements that are minimally of the same intensity as prior to admission. Oakhill Boys Ranch has provided services to young people and returned fifty four percent (54%) back to family based care and eighteen percent (18%) back to community group care. Fourteen percent (14%) were discharged to residential treatment setting and 6 (21%) did not successfully complete Oakhill Boys Ranch program due to unplanned discharged. Oakhill performs extremely well when we view placement needs at admission and then again at discharge.

XIV. CHILREN’S GLOBAL ASSESSMENT SCALE (CGAS) SCORES (N=18)

The CGAS is a clinical measure for client functioning and is based on two or more scores over the period from initial score to last score taken. There were 18 useable scores. The data is consistent with the last two years, with overall improvements from moderate degree of functioning to variable degree of functioning. The greatest positive increase being 33 to 66 and the highest negative change was from 60 to 45.

INITIAL CGAS SCORE LAST CGAS SCORE OR MARCH 2011M= 47 M = 56

RANGELow Score: 31 High Score: 70

.CGAS: Score Interpretation

70-61 Some difficulty in a single area but generally functioning well (e.g., sporadic or isolated antisocial acts, such as occasionally playing hooky or petty theft; consistent minor difficulties with school work; mood changes of brief duration; fears and anxieties which do not lead to gross avoidance behaviour; self-doubts); has some meaningful interpersonal relationships; most people who do not know the child well would not consider him/her deviant but those who do know him/her well might express concern.

8

Oakhill Boys RanchOutcomes Report 2013-2014

60-51 Variable functioning with sporadic difficulties or symptoms in several but not all social areas; disturbance would be apparent to those who encounter the child in a dysfunctional setting or time but not to those who see the child in other settings.

50-41 Moderate degree of interference in functioning in most social areas or severe impairment of functioning in one area, such as might result from, for example, suicidal preoccupations and ruminations, school refusal and other forms of anxiety, obsessive rituals, major conversion symptoms, frequent anxiety attacks, poor to inappropriate social skills, frequent episodes of aggressive or other antisocial behaviour with some preservation of meaningful social relationships.

40-31 Major impairment of functioning in several areas and unable to function in one of these areas i.e., disturbed at home, at school, with peers, or in society at large, e.g., persistent aggression without clear instigation; markedly withdrawn and isolated behaviour due to either mood or thought disturbance, suicidal attempts with clear lethal intent; such children are likely to require special schooling and/or hospitalization or withdrawal from school (but this is not a sufficient criterion for inclusion in this category)

The CGAS score is also a good measure of the overall level of functioning of the population of young people served by the Ranch.

XV. BEHAVIORAL OUTCOMES (N=23)

The following behavioral outcomes are measured by Short-form Assessment Check List (SAC) designed and developed by the University of Tennessee, Children’s Mental Health Services Research Centre (2004).

Initial SAC Completed (n=29) Last SAC Completed or March 2014 (n=29)

Internalized Behavioral

Score

Externalized Behavioral

Score

Overall Behavioral

Score

Internalized Behavioral

Score

Externalized Behavioral

Score

Overall Behavioral

ScoreM= 17.62 M=30.45 M=47.72 M=15.34 M=20.90 M=36.24

98.4% 99.4% 99.3% 95.5 % 95.5% 98.2%Clinical Clinical Clinical Clinical Clinical Clinical

NOTE: Young people are functioning below the percentile as compared to the general population of males between ages of 12 to 18 years.

The significance of the above scores clearly demonstrates that Oakhill continues to work with young people who score very high on these behavior scales. Compared to last year’s population, behavioral scores are slightly higher, indicating that the population is more complex.

Even with a more complex population, Oakhill demonstrates improvements over time on the Short Form Assessment checklist.

9

Oakhill Boys RanchOutcomes Report 2013-2014

XVI. PROGRAM OBJECTIVES

The therapeutic services offered by Oakhill Boys Ranch provide a process and a vehicle to meet very specific service objective and outcomes. Oakhill Boys Ranch has achieved significant success in meeting the needs of young people with intense problem situations and successfully transitioning them to less intrusive placement resources (71% in 2013-14) of the time. Fifteen (54%) of all discharges and 68% of planned discharges were placed in family settings. We attribute these successes to our approach, the scope and depth of services and to our ability to provide continuity of care that supports children and families through their most intensive situations. The objectives and outcomes identified below are designed under this premise.

Goal Outcome Performance Measures Target

1. Care and SafetyYoung people will remain safe.

Young people are protected from harm and abuse.

Review of Critical Incident reports and analysis of any harm and abuse.

100%

Progress: In the period of April 1, 2013 to March 31, 2014 there were zero incidents from mistreatment or maltreatment.

An incident occurred where one young person sexually assaulted another young person. The investigation determined that a lack of supervision was unsubstantiated.

Young people will have a stable placement

Young people will remain at Oak Hill Boys Ranch until their treatment goals are met.

Discharge data analysis of planned and unplanned discharges

100%

Progress: An analysis of discharge data (n=28) show a 22 (79%) young people discharged from Oak Hill Boys Ranch were planned discharges where the young people had achieved their treatment objectives. There were 6 (21%) discharges from the program due to emergent situations.

Young people remain healthy.

The young person is normally well.The young person’s weight is in the normal range for his height.Preventative health measures are being taken. (medical, dental & optical)The young person does not put their health at risk.

Review of health care data forms.

100%

Progress: All (100%) young people who attended Oakhill Boys Ranch remain in a normal and healthy range for physical health and preventative medical appointments were scheduled and

10

Oakhill Boys RanchOutcomes Report 2013-2014

Goal Outcome Performance Measures Target

attended. Some young people suffer from acute and chronic medical conditions were also supported in a manner where their needs were met and monitored.Young people will receive a strong provision of basic care services.

Living environment will be attractive and comfortable.Food will be enjoyable and follow the Canada Health GuideYoung people will maintain appropriate hygiene. Young people will receive appropriate living supports.

Self reports.

Menu report.

Self care records.

Client and Case worker satisfaction survey.

100%

Progress: Client satisfaction surveys were not completed as the young people have over participated in surveys. There was a minimal return on caseworker surveys N=4. All CW survey stated they were satisfied with the basic care. Menu planning is appropriate and facilities meet licensing & health care standards.2. Treatment and ProgrammingYoung people will receive emotional supports and nurturance.

Young people will show an improvement in emotional health.

Short form assessment.Psychological reportsSelf reports

100%

Progress: Short form assessment scores indicate a significant improvement of internalized, externalized and overall scores in both the home setting (29) and the school setting (20). In the eighteen young people sampled the mean improvement on the clinical measure (CGAS) was 9 points.

Young people will demonstrate appropriate pro social behavior that is acceptable to community norms.

Externalized behavioral scores will be in the normal range.Internalized behavioral scores will be in the normal range

Short Form assessment Measures

100%

Progress: In a Sample of 29, improvement on the internalized, externalized and overall behavioral scores and demonstrated improvements in the young people’s behavior in the home setting.

Twenty (20) showed an improvement in the internalized, externalized and overall behavioral in the school setting.

Eighteen (18) demonstrated improvement a mean improvement in functioning as indicated on the Children’s Global Assessment Scale (CGAS).

Young people who resided at Oakhill Boys Ranch and completed the program were involved in a formal community activity. Activities included: no hit hockey league in Edmonton, work at Prairie Gardens, 4H Beef Club in Bon Accord and on Ranch, as well as other youth events in Edmonton, Bon Accord, and Gibbons.Young people will have access and support to participate in recreational activities.

Young people will participate in recreational activities.

Self reportsCare records

100%

Progress: All the young people (100%) participated in recreation activities. In addition to the recreation mentioned above, the young people have been involved in almost daily recreation on ranch which has included: football, soccer, basketball, baseball, ice, hockey, community floor hockey, volleyball, badminton, floor hockey etc. The young people also participate in many outdoor adventure activities including: camping, canoeing, hiking, fishing, equine programming, nordic

11

Oakhill Boys RanchOutcomes Report 2013-2014

Goal Outcome Performance Measures Target

skiing, alpine skiing, swimming, skateboarding and biking.Young people will have access and participate in cultural activities.

The young person identifies with and is proud of his ethnic, cultural or racial background

Self reports

Service plan

100%

Progress: Oakhill has increased our weekly onsite Aboriginal Programming through an elder to twice weekly and has increased the services of an Aboriginal Liaison Worker from half time to full time. Oakhill continues the development of an Aboriginal Interpretive area. Oakhill also offers a Christian youth group named Lighthouse.Young people will achieve success behaviorally in school.

Young people will attend school daily.Young people will demonstrate behavioral improvements in school.

Short Form Assessment measuresAttendance RecordsSelf Reports

100%

Progress: In a sample of 20 young people they achieved significant improvements on internalized, externalized and overall behavior scores.Young people will achieve educationally in school.

The young person’s educational performance matches his ability.Adequate attention is being given to planning the young persons education.

School reports.

Individual Program Plans in place for every child

100%

100%

Progress: Educational reading test indicate a tracking of 2.16 grade levels improvement in literacy. Provincial Achievement tests score for five students are above the provincial average.Services will achieve identified permanency plan.

Young people will have an identified permanency plan at intake.Young people will be discharged to a permanent placement or planned placement.

Intake reports

Discharge Data

100%

Progress: Of the twenty eight young people (n=28) discharged from Oakhill Boys Ranch 22 (79%) were discharged to planned placements.

Young people will increase self esteem, demonstrate self direction and hope.

The young person has a good level of self esteem.The young person has knowledge of his current situation and preferred future.

Short Assessment MeasuresService Plan MeasuresPsychological reports

100%

Progress: Youth perception survey completed by Cornell University demonstrates the young person’s perception above the norm when compared to other CARE agencies.

3. DischargeYoung People will be positively reunited with their families.

Young people with return to live with their families.

Discharge data

3 month follow up

50%

Progress: This year, 43% of the young people were discharged to family or kin. When we combine family and substitute family care 54% of the children discharged moved to a family setting.

Young people will be positively prepared and placed in foster/adoptive

Young people will be placed in substitute family care.

Discharge data

3 month follow up

40%

12

Oakhill Boys RanchOutcomes Report 2013-2014

Goal Outcome Performance Measures Target

care.Progress: Three (11%) young people were discharged to substitute family care.

Young people develop competencies for independent living.

Young people will be prepared for and placed for independent living.

Service PlansDischarge data3 month follow up

10%

Progress: 18% young people were discharged to community based group care. No young people were discharged directly to SIL.Young people will be enrolled, attend and be successful behaviorally in a community school.

Young people will achieve in school.

Discharge data

3 month follow up

100%

Progress: Transitional planning was in place for three months following discharge.Young people will actively participate in community initiatives.

Young people will have at least one community activity or community organization at Discharge.

Service plans 100%

Progress: No measures implemented

XVII. OTHER INITIATIVES

1. CHILDREN AND RESIDENTIAL EXPERIENCES (CARE)

Early in 2009 Oakhill Boys Ranch had been exploring a Service Delivery model developed by Cornell University’s Residential Child Care Project. In January 2010, Oak Hill Boys Ranch made a commitment to the implementation of Children and Residential Experiences (CARE): Creating Conditions for Change practice model. This was initially, a two year committed relationship with Cornell University. This year we have agreed to extend this commitment to a three-year term.

This residential care practice model will enable Oakhill Boys Ranch to organize and deliver quality care of children according to evidence informed principles based on the “best interest of the child”. The project has a process and outcome based evaluation component to measure the effectiveness of the model on reported critical incidents, staff’s intention to use CARE principles in their work, and aspects of facility climate and culture.

Background

The CARE practice model is founded on six research and standards-informed principles designed to guide residential child care staff’s practice and interactions with children in

13

Oakhill Boys RanchOutcomes Report 2013-2014

order to create the conditions for change in children’s lives. The research-informed principles support care and treatment that is:

1. Developmentally focused,2. Family involved,3. Relationship based,4. Competency centered,5. Trauma informed, and 6. Ecologically oriented.

These best practices principles are grounded in theory, in evidence-based practices, in practice wisdom, and in child care standards. The principles were established after a comprehensive literature review, surveys of experienced child care workers and supervisors, and standards review.

Project Activities:

This process began in January 2010 with the formation of a CARE work group responsible for the coordination and monitoring of CARE activities. Cornell personnel scheduled quarterly visits to provide support and technical assistance with the implementation of CARE. The first years activities included: completing assessments, training the leadership and direct service staff, and aligning organizational systems with the CARE principles.

Project Outcomes:

Oakhill has been working with Cornell in tracking our progress throughout the implementation of CARE. The measures have 2 focuses; the first is the organizational social context which measures organizational culture and climate and is completed every 3 years. The second measure is specific dimension for the CARE program.

Organizational Social Context:

The organizational Social Context is a survey that measures the general health of the organization through measuring the culture and climate of the organization. This survey is normed against 1200 units of human and health service organizations in North America.

The pre-test was taken in 2010 and the post-test was taken in 2013. It was expected to see results in the climate; however cultural shifts typically take place between three and five years. Below are the measures and the results.

14

Oakhill Boys RanchOutcomes Report 2013-2014

15

Oakhill Boys RanchOutcomes Report 2013-2014

16

Oakhill Boys RanchOutcomes Report 2013-2014

Oakhill Boys Ranch was pleased with the results of these surveys. First the measures are going in the correct direction and secondly the organization is performing above the norms.

Culture: There is a statistically significant improvement with the proficiency of the organization, whereas no change with the rigidity or resistance.

Climate: There is statically significant positive change in all three dimensions (engagement, functionality and Stress).

Morale: The general morale of the organization has improved from the initial test results.

CARE Surveys:

Pre surveys were taken with all staff specifically in the areas of Knowledge and Beliefs (KB) as well as the Current Practice (CP) in relation to the CARE program. We also completed Youth Perception Surveys with the young people receiving services. The domains survey included: a) Listening and Understanding, b) demonstrating Investment, c) Inclusion, d) flexibility, e) building competence and f) rules and consequences.

1. Knowledge and Beliefs Survey: An increase in staff knowledge of CARE principles as measured through knowledge based testing. (pre, post, 1 year and 3 years and 4 years). The organization scored very well demonstrating improvements in all six domains. We have seen a significant spike in the fourth year. In addition when compared to other CARE agencies Oak Hill scored better than the norm in all areas measured.

17

Oakhill Boys RanchOutcomes Report 2013-2014

18

Oakhill Boys RanchOutcomes Report 2013-2014

2. Current Practice Survey: The intention of staff to use the CARE principles in their practice. (Measured through current practice and post training intention surveys, 1 year follow up surveys, 3 year follow up, 4 year follow-up, observation, and supervision). The result demonstrated improvement in most areas noted above and again when compared to other CARE agencies Oakhill scored better than the norm when compared to other CARE agencies in all measures.

19

Oakhill Boys RanchOutcomes Report 2013-2014

3. Youth Perceptions Survey: Youth perception measures were taken in the same areas at 6 months, 1 year, 3 years and 4 years. The results for all three surveys were similar and were above the norm (3) in all areas.

The focus on this change process is to create a real cultural change that will assimilate program staff and their practice, not simply accommodating the language and new protocols for practice. Oakhill is pleased with the progress and excited about further implementation of the CARE program. We estimate we are about 80% through the implementation and will be looking at organizational practices for sustainability of the CARE program in the upcoming years. The CARE program will be soon established under promising practices in the California Clearing House for evidence-based practice. This is the highest achievement for any Residential based program.

20

Oakhill Boys RanchOutcomes Report 2013-2014

XVIII. CASE WORKER FEEDBACK (N=4)

Y= Yes, N = No N/A = Not Applicable.

Child Safety

Y N N/AI am satisfied that the children I place with Oak Hill Boys Ranch will be treated with care and remain free from child maltreatment. 4 0 0

I am satisfied that Oak Hill Boys Ranch will attend to any emergent medical needs in an appropriate and timely manner. 4 0 0

I am satisfied that Oak Hill Boys Ranch will ensure children’s basic care needs are met in a manner that supports their healthy development. (Living environment, food, clothing, self care, etc)

4 0 0

All Above was completed in a very timely manner

Child Wellbeing

Y N N/AI am satisfied with the therapeutic environment provided to children by Oak Hill Boys Ranch. 4 0 0

I am satisfied that Oak Hill Boys Ranch is providing the support and interventions that promote continued development of the children’s behavioural functioning 4 0 0

I am satisfied that Oak Hill Boys Ranch is providing the support and interventions that promote continued development of the children’s emotional health. 4 0 0

I am satisfied that Oak Hill Boys Ranch provides supports and interventions that facilitate regular attendance at school. 3 1 0

I am satisfied that Oak Hill Boys Ranch provides access to educational support and interventions that facilitate academic growth. 3 1 0

Supportive Comments: Oak Hills has surpassed all expectations.

Permanence and Continuity

Y N N/AI am satisfied that Oak Hill Boys Ranch provides support and interventions that promote continuity of care. 4 0 0

I am satisfied that Oak Hill Boys Ranch is provides supports and interventions consistent with the child(rens) permanency plan. 4 0 0

I am satisfied that Oak Hill Boys Ranch prepares children to be placed in a less intensive placement in a realistic time frame. 4 0 0

I am satisfied that Oak Hill Boy s Ranch provides supports and interventions that prevent unplanned discharges. (such as AWOL). 4 0 0

I am satisfied that Oak Hill Boys Ranch provides follow up services that support post placement stability. 4 0 0

Supportive Comments: The staff are incredible and support family reunification.

21

Oakhill Boys RanchOutcomes Report 2013-2014

Family and Community Support

Y N N/AI am satisfied that Oak Hill Boys Ranch provides family support and family intervention services that serve to optimize family relationships. 4 0 0

I am satisfied that Oak Hill Boys Ranch provides access and opportunity for children to be involved in structured community activities. 4 0 0

I am satisfied that Oak Hill Boys Ranch provides support and interventions that meets children’s cultural needs. 4 0 0

I am satisfied that Oak Hill Boys Ranch adequately prepares children to live in a family and or community setting. 4 0 0

Supportive Comments: Oak Hill is a miracle worker

Programming:

Please rate the following services as:

Excellent Good Fair Poor N/A

Excellent Good Fair Poor N/ATherapeutic Living 3 1 0 0 0Therapy Services 3 1 0 0 0Family Services 3 1 0 0 0Oak Hill School 3 0 1 0 0Recreational Services 3 1 0 0 0Adventure Based Activities 3 1 0 0 1Aboriginal Programming 4 0 0 0 0Equine Programming 3 0 0 0 1

General Feedback, Comments and Recommendations:Supportive Comments:

Oak hill has wonderful communication between CW and have made a huge impact on my clients life.

The child I have placed there has so much positive feedback about being there.

22