Creating After School Partnerships to Focus on Results: An Innovative Community-Wide Approach to...

Creating After School Partnerships to Focus on Results:

An Innovative Community-Wide Approach to Using a Data Warehouse to

Enhance Student AchievementMartin Bell

Deputy to SuperintendentCommunity Development and Governmental Relations

Dr. Robert RodoskyExecutive Director

Accountability, Research, and Planning

Darrell AnitonDivision Director

Louisville Metro Office of Youth Development

Don ShawExecutive Director

Salvation Army Boys and Girls Clubs of Louisville

Jefferson County Public SchoolsLouisville, Kentucky

• 26th largest school district in U.S.

• 13,000+ full-time employees

• 2,840 business partnerships

• 97,600 students

(1/7 of all students in KY)

• 34.7% African-American

• 57.6% White

• 7.7% Other

• 150 Schools

• 3- and 4- year-olds preschool

• K-5 (Elementary) 86 schools

• 6-8 (Middle) 22 schools

• 9-12 (High) 19 schools

• Special Education 3 schools

• Alternative/Other 20 schools

APlaceFor

EveryChild

Alternative Programs: A Place for Every Child

Breckinridge Metropolitan

Kennedy Metropolitan

Jefferson County High School

Positive Outreach Program (POP)

Suspension Truancy Off-site Program (STOP) middle and high suspensions

Buechel Metropolitan

Great Onyx

Liberty High School

Teenage Pregnancy Program (TAPP)

State Agency Schools

grades 9-12 (drugs, weapons, assaults)

grades 6-8 (drugs, weapons, assaults)

high school dropouts

grades 8-12 (high school alternative instruction)

post-adjudicated youth

adjudicated youth

Job Corps center

elementary student suspensions

N O E X P U L S I O N S

Vision

• Collect participation data on students in programs targeted and assess the impact of the program on identified student indicators

• ie: Does “Stephen” participation in the Community School program impact his attendance in school, discipline referrals in school, grades, etc.

Jefferson CountyCommunity of Collaboration

Neighborhood Place

Every 1 Reads

Community Schools

KidTrax Partnership

Louisville Education and Employment Partnership

{

Hours in Community, Home, and School

33.3%

13%

8.79%

157,680

8,760

5,840

105,120

13,860990

0

20,000

40,000

60,000

80,000

100,000

120,000

140,000

160,000

180,000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18

Age

Hours

Hours Lived Hours Awake Hours in School

Then and Now

14

3538

57

89

8

1823

34

65

0

10

20

30

40

50

60

70

80

90

2002 2003 2004 2005 2006

Sites Partners

Process for Partnership

Partner Contacts JCPS

Signs Confidentiality Agreements

KIDTRAX Purchased

KIDTRAX Installed

Parent Confidentiality Agreement

Upload

CASCADE Training

How CASCADE and KidTrax Work Together.

Outcomes - Attendance

8687888990919293949596

Posttest

Treatment (N=901)Comparison (N=764)

F = 13.60, p < .01, ES = .21

Outcomes - Suspensions

0

50

100

150

200

250

Posttest

TreatmentComparison

Outcomes - Reading

0

510

1520

2530

3540

4550

Pretest-%PD Posttest-%PD Gain

TreatmentComparison

Outcomes - Mathematics

0

5

10

15

20

25

30

35

40

45

Pretest-%PD Posttest-%PD Loss

TreatmentComparison

After School Impact Summary

• Attendance: Statistically significant impact – (F = 13.60, p < .01, ES= .21)

• Suspensions: No statistical significance– (chi-square = 5.59, P > .05)

• Reading:– Statistically significant impact

– (chi-square = 12.34, p < .01, Cramer V=.06)

• Mathematics:– Statistically significant impact

– (chi-square = 10.31, p < .01, Cramer V=.06)

24.0%

76.0%

31.4%

68.6%

0.0%

20.0%

40.0%

60.0%

80.0%

Control Treatment

JEFFERSON COUNTY PUBLIC SCHOOLSNCLB Educational Supplementary Services

Reading 2005-2006At-Risk

Paid

Free/Reduced

62

123

269196

35.3%

64.7%

37.2%

62.8%

0.0%

20.0%

40.0%

60.0%

80.0%

Control Treatment

JEFFERSON COUNTY PUBLIC SCHOOLSNCLB Educational Supplementary Services

Reading 2005-2006Race

Non-Minority

Minority

91

167

146

246

30.6%

34.5% 34.9%

28.3%

34.7%37.0%

0.0%

20.0%

40.0%

Control Treatment

JEFFERSON COUNTY PUBLIC SCHOOLSNCLB Educational Supplementary Services

Reading 2005-2006KCCT Baseline

Novice

Apprentice

Proficient/Distinguished

89

79

90

111

136

145

16.7%

43.4%39.9%

15.6%

44.6%

39.8%

0.0%

20.0%

40.0%

60.0%

Control Treatment

JEFFERSON COUNTY PUBLIC SCHOOLSNCLB Educational Supplementary Services

Reading 2005-2006

Novice

Apprentice

Proficient/Distinguished

43

112103

61

175

156

NCLB SES Impact Summary

• Reading:– Treatment and control group were similar in previous

achievement (chi-square = .48, p = .79)

– Treatment and control group were similar in posttest (chi-square = .17, p = .92)…

• Mathematics:– Treatment and control group were somewhat similar in

previous achievement (chi-square = 2.63, p = .27)

– Treatment and control group were not similar in posttest (chi-square = 6.50, p = .04)

Collaboration

In Louisville, collaboration is the key. The first thought is always to come together to determine how we can develop and establish partnerships to build assets for youth.

Funding Organizations

• Alliance for Youth (state funds)• Office of Youth Development (local)

• Metro United Way (non-profit)• Human Services Department (local)

• Federal Funding• Local Foundations (private)

Goal/Purpose

Build capacity for community-based and faith-based organizations to meet the challenging needs of local young people and create a mechanism to allow these organizations to share information with schools.

Capacity Building

Training– Youth Service Worker Training– Youth Agency Roundtable Discussion– Advancing Youth Development (AED)– Afternoon of Youth Development – Outcomes Measurement (mandatory)– Organizational Sustainability– KidTrax (implementation & training)

KidTrax System

Local government has mandated (and funded) many youth organizations to utilize KidTrax as a method of sharing information with the JCPS district to assist these agencies to measure outcomes of their programs.

Community-wide Initiative

KidTrax is also utilized to assist our community to measure the progress of our community-wide Every 1 Reads Initiative, which has a goal of ensuring that every child within the JCPS district is reading on grade level by the year 2008.

Community Based Organizations Impact on Student Achievement

The Salvation Army Boys & Girls Clubs of Louisville

Pre KIDTRAX / JCPS School Connectivity

• Data Collection on club members, and multiple sites. Paper reports, Excel Sheets resulting in time consuming

process, self reports, subject to human error. Rely on parent providing membership info, tend to not provide family income, legal guardianship, and number in household.

• Student performance indicators Report card collection, meetings with teachers, attendance

clerks, relying on other professionals, excel sheets. Again time consuming, subject to human error and difficulty in understanding individual club member needs.

• Historical data difficult to validate Observations and self reports of risk taking behaviors, poor

school attendance, academic performance, graduations, school enrollment

Evidence

• Increase attendance in school• Reduction in Suspension behaviors• Improved Standardized Test Scores• Improved PAS Scores• Reduction in Tardy Behaviors• Increase in family participation in clubs

Today KIDTRAX / JCPS School Connectivity

• Data Collection Multiple sites connected, data integrity, tracking membership

and attendance of club members electronically.• Connectivity View student performance indicators including suspensions,

behavioral referral data, unexcused absences, tardy, percent attendance, standardized test scores.

Accurate family information including Free & Reduced Lunch status, Guardianship, number in household, and who child lives with, emergency contacts.

• Historical Data Demonstrates changes in population, provides programming

needs, integrity in data collection and demonstrating outcomes, demonstrates effective fiscal management of resources.

Policy Implications

1. No Child Left Behind - Supplemental Services- Accountability

2. Ear Marks and School- Accountability

3. Community Schools- 21st Century Grants and School accountability

4. Technology Interoperability- SIF