8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 1/12
Evaluation of Citizen
Schools¶ Expanded
Learning Time
Initiative
Study Overview
July 16, 2011
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 2/12
AbtA
ssociates | pg 2
Overview
Purpose
Research Questions
Key Study Features (Design, Data Collection
Strategies, Schedule)
Approach to Analysis
Implications
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 3/12
AbtA
ssociates | pg 3
Purpose
Expanded Learning Time (ELT) is gaining traction as
a potentially powerful School Reform strategy.
Prior research has indicated that Citizen Schools¶
programs have positive impacts on participants.
(PSA2009)
Citizen Schools¶ ELT program plays a key role in the
organization¶s growth strategy.
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 4/12
AbtA
ssociates | pg 4
Research Questions
Implementation
� How are schools implementing and integrating expanded
learning time opportunities into their school days?
Outcomes
� What is the impact of participating in Citizen Schools¶ELT
program for middle grades students ± in terms of academic
as well as behavioral and aspirational outcomes?
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 5/12
AbtA
ssociates | pg 5
Key Study Features: Design
Interrupted Time Series: Quasi-Experimental Design
Compares Citizen Schools program sites to a group of carefully
selected comparison schools (1 Citizens School ELT campus, 4
comparison schools).
Analysis of Pre- and Post- ELT student performance data.
Analysis of student and teacher surveys from Citizen School ELT
campuses and matched comparison sites.
Qualitative analysis of interviews with key informants at both groupsof schools.
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 6/12
AbtA
ssociates | pg 6
Key Study Features: Data Collection
Strategies
Surveys (Teachers, Students )
Interviews (Citizen Schools staff, School
Administrators)
Academic performance of students
Student demographic, attendance, discipline
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 7/12
AbtA
ssociates | pg 7
Key Study Features: Instruments
Student Survey
� Attitudes about school, teachers/staff, length of day
� Activities in and out of school
Teacher Survey
� Perceptions of the school environment/culture/communication/policies
� Instructional methods, teacher resources & support
� Level of satisfaction (in general and ELT-specific)
Interviews with Stakeholders
� Historical/contextual information
� Goals and expectations
� Implementation (communication, response to ELT, operations)
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 8/12
AbtA
ssociates | pg 8
Key Study Features: Schedule
YEAR 1
� Late summer/early fall: begin district IRB submissions
� Late fall/early winter: site visits to new ELT sites
� Winter/spring: collection of student extant data from state/district
� Spring: selection of matched comparison sites interviews with principals
YEAR 2
� Fall: student and teacher surveys
THEREAFTER
�A
nnual student and teacher surveys� Bi-annual site visits
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 9/12
AbtA
ssociates | pg 9
Analysis
Comparisons between Citizen Schools and Matched
Comparison Schools
� Student outcomes (achievement, attendance, and discipline)
� Student perceptions/experiences on survey items
� Teacher perceptions/experiences on survey items
Descriptions of ELT implementation� Administrator interviews
� Citizen Schools staff interviews
� Site visits
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 10/12
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 11/12
Abt Associates | pg 11
Questions?
Alyssa Rulf Fountain
Project Director
Beth Gamse
Principal Investigator
8/6/2019 Abt Associates Presentation
http://slidepdf.com/reader/full/abt-associates-presentation 12/12