COMPREHENSIVE SCHOOL REFORM PROGRAM

(Obey-Porter)

CSRProgram Overview

January 2002

CSR PurposeCSR Purpose

•To help schools undertake comprehensive reforms - grounded in scientifically based research and effective practices, including an emphasis on basic academics and parental involvement . . . so that all children can meet challenging State academic content and achievement standards.

•To leverage systemic improvements in student achievement throughout the Title I program

CSR Program OverviewCSR Program Overview

Established in FY 1998 Appropriations ActEstablished in FY 1998 Appropriations Act

Authorized in No Child Left Behind Act of 2001Authorized in No Child Left Behind Act of 2001

$308 million program in FY2003 ($310 million in $308 million program in FY2003 ($310 million in FY2002; $260 million in FY2001; $220 million in FY2002; $260 million in FY2001; $220 million in FY2000; $145 million in FY 1998FY2000; $145 million in FY 1998))

About 75% of funds are limited to Title I-eligible About 75% of funds are limited to Title I-eligible schoolsschools

Minimum $50,000 per school each year for three Minimum $50,000 per school each year for three years awarded through state competitionsyears awarded through state competitions

The Process of The Process of Comprehensive School ReformComprehensive School Reform

Identify needs through a rigorous needs assessmentIdentify needs through a rigorous needs assessment

Investigate research-based solutionsInvestigate research-based solutions

Gain support from everyone involvedGain support from everyone involved

Develop a comprehensive program that integrates the Develop a comprehensive program that integrates the eleven components eleven components

Commit the time and resources necessary Commit the time and resources necessary

Plan to evaluatePlan to evaluate and strengthen the school’s efforts and strengthen the school’s efforts regularlyregularly

The Eleven ComponentsThe Eleven Components1.1. Employs proven methods and strategies that are grounded in scientifically based Employs proven methods and strategies that are grounded in scientifically based

researchresearch2.2. Integrates a comprehensive design with aligned componentsIntegrates a comprehensive design with aligned components3.3. Provides ongoing, high-quality professional development for teachers and staff Provides ongoing, high-quality professional development for teachers and staff 4.4. Includes measurable goals and benchmarks for student achievementIncludes measurable goals and benchmarks for student achievement5.5. Is supported within the school by teachers, administrators and staffIs supported within the school by teachers, administrators and staff6.6. Provides support for teachers, administrators and staff Provides support for teachers, administrators and staff 7.7. Provides for meaningful parent and community involvement in planning, Provides for meaningful parent and community involvement in planning,

implementing and evaluating school improvement activitiesimplementing and evaluating school improvement activities8.8. Uses high-quality external technical support and assistance from an external Uses high-quality external technical support and assistance from an external

partner with experience and expertise in school-wide reform and improvementpartner with experience and expertise in school-wide reform and improvement9.9. Annually evaluates strategies for the implementation of school reforms and for Annually evaluates strategies for the implementation of school reforms and for

student results achievement student results achievement 10.10. Identifies resources to support and sustain the school's comprehensive reform Identifies resources to support and sustain the school's comprehensive reform

efforteffort11.11. Has been found to result in or has demonstrated strong evidence that it Has been found to result in or has demonstrated strong evidence that it

significantly improves the academic achievement of studentssignificantly improves the academic achievement of students

More About the Eleven More About the Eleven ComponentsComponents

1. 1. Employs proven methods and strategies that are Employs proven methods and strategies that are grounded in scientifically based researchgrounded in scientifically based research

• Uses proven methods and proven strategies for Uses proven methods and proven strategies for student learning, teaching and school managementstudent learning, teaching and school management

• Is based on scientifically based research and Is based on scientifically based research and effective practiceseffective practices

• Has been replicated successfully in schoolsHas been replicated successfully in schools

More About the Eleven Components (cont’d)More About the Eleven Components (cont’d)2. Integrates a comprehensive design with aligned 2. Integrates a comprehensive design with aligned

componentscomponents• Provides a comprehensive design for effective school Provides a comprehensive design for effective school

functioning, including instruction, assessment, classroom functioning, including instruction, assessment, classroom management, professional development, parental involvement management, professional development, parental involvement and school managementand school management

• Aligns curriculum, technology and professional development Aligns curriculum, technology and professional development into a comprehensive school reform plan for schoolwide changeinto a comprehensive school reform plan for schoolwide change

• Addresses identified school needsAddresses identified school needs

• Enables all students - including children from low-income Enables all students - including children from low-income families, children with limited English proficiency and children families, children with limited English proficiency and children with disabilities - to meet challenging state standardswith disabilities - to meet challenging state standards

More About the Eleven Components (cont’d)More About the Eleven Components (cont’d)3. Provides ongoing, high-quality professional 3. Provides ongoing, high-quality professional

development for teachers and staffdevelopment for teachers and staff

4. Includes measurable goals and benchmarks for 4. Includes measurable goals and benchmarks for student achievementstudent achievement

5. Is supported within the school by teachers, 5. Is supported within the school by teachers, administrators and staffadministrators and staff

6. Provides support for teachers, administrators and 6. Provides support for teachers, administrators and staffstaff

7. Provides for meaningful parent and community 7. Provides for meaningful parent and community involvement in planning, implementing and involvement in planning, implementing and evaluating school improvement activitiesevaluating school improvement activities

More About the Eleven Components (cont’d)More About the Eleven Components (cont’d)

8. Uses high-quality external technical support and 8. Uses high-quality external technical support and assistance from an external partner with experience assistance from an external partner with experience and expertise in school-wide reform and and expertise in school-wide reform and improvement improvement

9. Annually evaluates strategies for the implementation of 9. Annually evaluates strategies for the implementation of school reforms and for student results achievementschool reforms and for student results achievement

10. Identifies resources to support and sustain the school's 10. Identifies resources to support and sustain the school's comprehensive reform effortcomprehensive reform effort

11. Has been found to result in or has demonstrated strong 11. Has been found to result in or has demonstrated strong evidence that it significantly improves the academic evidence that it significantly improves the academic achievement of studentsachievement of students

Scientifically Based ResearchScientifically Based Research

Research that involves the application of Research that involves the application of rigorous, systematic, and objective rigorous, systematic, and objective procedures to obtain reliable and valid procedures to obtain reliable and valid knowledge relevant to education activities knowledge relevant to education activities and programsand programs

Characteristics of Characteristics of Scientifically Based ResearchScientifically Based Research

Employs systematic, empirical methodsEmploys systematic, empirical methods that that draw on observation and experimentdraw on observation and experiment

Involves rigorous data analysesInvolves rigorous data analyses that are that are adequate to test the stated hypotheses and justify adequate to test the stated hypotheses and justify the general conclusions drawnthe general conclusions drawn

Relies on measurements or observational Relies on measurements or observational methods that provide reliable and valid datamethods that provide reliable and valid data across evaluators and observers, across multiple across evaluators and observers, across multiple measurements and observations, and across measurements and observations, and across studies by the same or different investigatorsstudies by the same or different investigators

Characteristics of Scientifically Based Research (cont’d)Characteristics of Scientifically Based Research (cont’d)

– Be evaluated using experimental or quasi-experimental Be evaluated using experimental or quasi-experimental designsdesigns in which individuals, entities, programs or activities are in which individuals, entities, programs or activities are assigned to different conditions and with appropriate controls to assigned to different conditions and with appropriate controls to evaluate the effects of the condition of interest, with a preference evaluate the effects of the condition of interest, with a preference for random-assignment experiments, or other designs to the for random-assignment experiments, or other designs to the extent that those designs contain within-condition or across-extent that those designs contain within-condition or across-condition controlscondition controls

– Ensures that experimental studies are presented in sufficient Ensures that experimental studies are presented in sufficient detail and clarity to allow for replicationdetail and clarity to allow for replication or, at a minimum, or, at a minimum, offer the opportunity to build systematically on their findingsoffer the opportunity to build systematically on their findings

– Has been accepted by a peer-reviewed journalHas been accepted by a peer-reviewed journal or approved by or approved by a panel of independent experts through a comparably rigorous, a panel of independent experts through a comparably rigorous, objective and scientific reviewobjective and scientific review

What’s truly comprehensive?What’s truly comprehensive?

Addressing all students in the schoolAddressing all students in the school

Affecting all core subjects at all grade levels, with Affecting all core subjects at all grade levels, with particular emphasis on reading and mathparticular emphasis on reading and math

Improving professional development for every Improving professional development for every teacher in the school, which includes meaningful, teacher in the school, which includes meaningful, ongoing activityongoing activity

Establishing specific benchmarks and a credible Establishing specific benchmarks and a credible plan for evaluationplan for evaluation

Key Issues in Key Issues in Comprehensive School ReformComprehensive School Reform

Models, if used, should be integrated into Models, if used, should be integrated into the school’s comprehensive program.the school’s comprehensive program.

Reform efforts must be connected, not Reform efforts must be connected, not layered on top of everything else.layered on top of everything else.

Faithful implementation is critical.Faithful implementation is critical.

Strong support from district is crucial.Strong support from district is crucial.

District Support forDistrict Support forComprehensive School ReformComprehensive School Reform

Build infrastructure to support reformBuild infrastructure to support reform

Assist in reallocation of resourcesAssist in reallocation of resources

Help schools implement district curriculum Help schools implement district curriculum aligned with State content standardsaligned with State content standards

Provide flexibility in professional developmentProvide flexibility in professional development

Help schools to evaluate programsHelp schools to evaluate programs

How CSR Builds on How CSR Builds on Title I Schoolwide ProgramsTitle I Schoolwide Programs

Clear focus on the use of effective methods and Clear focus on the use of effective methods and strategies that are grounded in scientifically based strategies that are grounded in scientifically based research to strengthen core academic program research to strengthen core academic program

Emphasizes ongoing professional development and Emphasizes ongoing professional development and full buy-in by school stafffull buy-in by school staff

Requires ongoing assistance from an external Requires ongoing assistance from an external partnerpartner

Stresses evaluation as a tool for continuous Stresses evaluation as a tool for continuous improvementimprovement

CSR SchoolsCSR Schools

Over 1,800 schools in all 50 states, DC, Puerto Over 1,800 schools in all 50 states, DC, Puerto Rico & BIA received CSR grants as part of the Rico & BIA received CSR grants as part of the original FY1998 cohort.original FY1998 cohort.

An additional 1,000 schools were funded through An additional 1,000 schools were funded through the FY2000 increase. the FY2000 increase.

About 3,000 schools are expected to receive grants About 3,000 schools are expected to receive grants through the FY2001 and FY 2002 funds.through the FY2001 and FY 2002 funds.

About CSR SchoolsAbout CSR Schools Over 60% are Title I Schoolwide Programs.Over 60% are Title I Schoolwide Programs.

Over one-third identified for improvement under Title Over one-third identified for improvement under Title I.I.

About two-thirds are elementary schools; the other About two-thirds are elementary schools; the other third are middle and high schools.third are middle and high schools.

CSR schools are using both nationally available and CSR schools are using both nationally available and locally developed models.locally developed models.

Southwest Lab (SEDL) National Database of CSR Southwest Lab (SEDL) National Database of CSR schools: http://www.sedl.org/csrd/awards.htmlschools: http://www.sedl.org/csrd/awards.html

National Evaluation of CSRNational Evaluation of CSRNational Evaluations of CSRNational Evaluations of CSR Completed StudiesCompleted Studies

– Field Focused StudyField Focused Study» Provided an in-depth examination of implementation of CSRD Provided an in-depth examination of implementation of CSRD

funded reformsfunded reforms» Sample included 18 schools randomly drawn from the first two Sample included 18 schools randomly drawn from the first two

annual rounds of CSRD awardsannual rounds of CSRD awards» Field data were collected through four site visits to each school, Field data were collected through four site visits to each school,

conducted during 2000-02conducted during 2000-02– National Longitudinal Survey of SchoolsNational Longitudinal Survey of Schools

» Provided documentation of the initial implementation of the Provided documentation of the initial implementation of the CSRD programCSRD program

» Sample included a nationally representative sample of schools Sample included a nationally representative sample of schools receiving CSRD fundsreceiving CSRD funds

» Methodology included telephone surveys and a document Methodology included telephone surveys and a document review from small sub-sample schools A large scale sample review from small sub-sample schools A large scale sample survey of CSR schools over three years survey of CSR schools over three years

National Evaluations of CSRNational Evaluations of CSR

New/Ongoing StudiesNew/Ongoing Studies– Longitudinal Assessment of Implementation and Longitudinal Assessment of Implementation and

OutcomesOutcomes» Will examine program implementation and student achievement Will examine program implementation and student achievement

trends in schools receiving federal CSR grants authorized under trends in schools receiving federal CSR grants authorized under the NCLB Act of 2001the NCLB Act of 2001

» Sample includes a nationally representative sample of new CSR Sample includes a nationally representative sample of new CSR grantees with comparison groupgrantees with comparison group

» Methodology includes surveys, interviews, and case studies over a Methodology includes surveys, interviews, and case studies over a 3-year period: the 2002-03 through 2004-05 school years3-year period: the 2002-03 through 2004-05 school years

» Southwest Educational Development Laboratory (SEDL) Southwest Educational Development Laboratory (SEDL) DatabaseDatabase

Collects descriptive information on all CSRD granteesCollects descriptive information on all CSRD grantees All grantees are included in this databaseAll grantees are included in this database Data collection has been ongoing since 1998Data collection has been ongoing since 1998

Reports from the Field –Reports from the Field –Emerging ChallengesEmerging Challenges

Effective evaluation and Effective evaluation and using data to continuously using data to continuously improve reform programsimprove reform programs

Finding Finding adequate timeadequate time for professional for professional developmentdevelopment

Strengthening alignmentStrengthening alignment between school reforms between school reforms and state and district standards and assessmentsand state and district standards and assessments

New kind of leadershipNew kind of leadership required required

Integrating efforts & activities into a Integrating efforts & activities into a coherent coherent programprogram

More Emerging ChallengesMore Emerging Challenges Meeting the needs of all studentsMeeting the needs of all students, including special , including special

education and English language learnerseducation and English language learners

Using Using allall of the school’s resources of the school’s resources

Developing Developing benchmarks for measuring progressbenchmarks for measuring progress in in implementing reform efforts and achievementimplementing reform efforts and achievement

Involving parents meaningfullyInvolving parents meaningfully in the development in the development and implementation of school reform plansand implementation of school reform plans

Incorporating new teachersIncorporating new teachers into the reform effort into the reform effort

CSR Early Implementation ReportCSR Early Implementation ReportFine Tuning for the FutureFine Tuning for the Future

There is a need for more rigorous research There is a need for more rigorous research and evaluation of models and effective and evaluation of models and effective comprehensive school reform strategiescomprehensive school reform strategies

States and districts need to play an active States and districts need to play an active role in assessing the alignment of reform role in assessing the alignment of reform programs with State and district standards programs with State and district standards and prioritiesand priorities

CSR Early Implementation ReportCSR Early Implementation ReportFine Tuning for the Future (cont’d)Fine Tuning for the Future (cont’d)

Many schools still need reinforcement in Many schools still need reinforcement in understanding that CSR is not an “add-on” understanding that CSR is not an “add-on” programprogram

Schools need adequate time to prepare for whole Schools need adequate time to prepare for whole school changeschool change

It is imperative for all school staff to participate in It is imperative for all school staff to participate in ongoing, high-quality professional development ongoing, high-quality professional development activitiesactivities

Comprehensive Comprehensive School ReformSchool Reform

ProgramProgram

Web Site Address:Web Site Address:

www.ed.gov/offices/OESE/compreformwww.ed.gov/offices/OESE/compreform

e-mail Address:e-mail Address:

compreform@ed.govcompreform@ed.gov