Embed Size (px)
Citation preview
2018 © Region One Education Service Center
Title I, Part A and ESSAProgram Evaluation
Region One Education Service CenterOffice of School Improvement, Accountability and Compliance
2018 © Region One Education Service Center
Program Evaluation: What to Evaluate
StrategiesAnd
ActivitiesTo address
Needs
EvaluationRecommendations and Readjust the
Plan
2018 © Region One Education Service Center
Program Evaluation: The Audience
Your audience is anyone with an investmentIn your campus, who is interested in whether Or not the goals of the CIP were met (including TEA)
Source: TEA
2018 © Region One Education Service Center
Program Evaluation: What to Include
Percentage of students who reach proficiency on state assessments
Success of your campus’s specific Instructional strategies
Participation of Stakeholders
Degree of Parental Involvement
Source: TEA
2018 © Region One Education Service Center
Program Evaluation: Things to Consider
Inputs: what resources did the schoolwide program identify and to what degree were they used?Activities: Did planned events, such as professional development, parental involvement activities, and schoolwide instructional units, take place as scheduled?Short-term effects: What were the short-term results of implementing a particular strategy in the CIP? Did the campus provide training for the targeted number of campus staff? Did the training affect subsequent instructional decisions?Longer-term effects: Can we evaluate information that tracks outcomes over time? For example, a schoolwide program might begin a dropout prevention program for sixth-grade students with the goal of a reduced dropout rate when those students are in ninth grade. Each year, the evaluation should determine if the campus reaches the goal
2018 © Region One Education Service Center
Program Evaluation: The Report
The evaluation can:Inform internal program management and help campus leaders make informed decisions to improve the quality of their program.Answer stakeholder questions and help them better understand how effectively the campus is meeting its stated goals.Increase understanding of specific strategies and help the campus determine the usefulness of the activities it has undertaken to increase student achievement.Promote interest in and support of a program or activity by illustrating certain strategies and how they can improve student achievement.
Source: TEA
2018 © Region One Education Service Center
Campus Improvement Plans-Keep in Mind…
Evaluation
Were we successful in addressing our needs and focus areas?
Campus Improvement Plan
What strategies and activities will help us meet the needs?
Comprehensive Needs Assessment
What are our needs and where do we focus our efforts?
2018 © Region One Education Service Center
Campus Improvement Plans
REQUIRED/ MUSTS
Evaluate the Plan: A schoolwide program shall develop a comprehensive plan that "remains in effect for the duration of the school's participation, except the plan and its implementation shall be regularly monitored and revised as necessary based on student needs to ensure all students are provided opportunities to meet the challenging state academic standards"
2018 © Region One Education Service Center
Evaluate the PlanEvaluation and annual review…
5) Evaluate impact and make recommendations for
continuation or modification of strategy
3) Identify amount of funds expended
on strategies
1) List Identified Needs from CNA
2) Identify Strategies from
DIP/CIP to address needs
4) Review data to measure fidelity of implementation and impact on students outcomes
2018 © Region One Education Service Center
Evaluation ProcessStep 1: List Needs- List the needs identified within the comprehensive needs assessment.
Step 2: Identify Strategies- Using the district and/or campus improvement plan, identify strategies or initiatives that address these program needs and were connected to this federal program.
Step 3: Identify Funds- Identify the amount of funds expended to implement the strategy or initiative, if applicable.
Step 4: Review Data- Review data identified to measure fidelity of implementation and impact of the strategy or initiative on student outcomes.
Step 5: Evaluate Impact- Evaluate the impact and make recommendations for continuation or modification of the strategy or initiative.
2018 © Region One Education Service Center
Evaluate the Plan
Identifying questions to ask…
Two types of Questions to Consider:1. Is the program strategy or activity being implemented as the planning group intended?2. Did the achievement of students in meeting the State’s academic standards increase to the desired level,
particularly for those students who had been furthest from achieving the standards?3. How is the use of your Title I, Part A funding assisting your students in achieving the goals? And how is it
making an impact?4. Do you have a system for monitoring progress toward meeting your goal on the PS3001?
2018 © Region One Education Service Center
Evaluate the Plan
Consider…
➢ Collaboration between schools and the district➢ Availability of resources and staff➢ Outcomes of prior reviews➢ Experience of the school with implementing schoolwide programs
2018 © Region One Education Service Center
Evaluate the Plan
Accountability for results/continuous improvement➢Present results to staff in the school, parents and
other community members➢Results are not a sign the school should start
over again with a new plan➢ School should revise existing plan incorporating
revisions and reflect a revitalization of the school’s commitment to implementing a schoolwide program which helps all students achieve at high levels
2018 © Region One Education Service Center
Putting all the Pieces Together
2018 © Region One Education Service Center
Title I, Part A —CNA and CIP Best PracticesSchedule PS3001: Embedded Improvement Planning Best Practices
#1 Inventory LEA and school plans and planning resources.
#2 Convene planning teams that adequately represent stakeholders.
#3 Provide training, materials, and time for team preparation.
#4 Collect and analyze student outcome data.
#5 Draft problem statements and identify root causes.
2018 © Region One Education Service Center
Title I, Part A —CNA and CIP Best PracticesSchedule PS3001: Embedded Improvement Planning Best Practices
#6 Mixed method analysis: Add qualitative to quantitative data.
#7 Research and select effective programs and activities with greatestpotential to improve student outcomes.
#8 List all activities required to implement each program or activity.
#9 Identify a specific person who will ensure each activity is completed.
#10 Estimate when each activity will be completed.
2018 © Region One Education Service Center
Title I, Part A —CNA and CIP Best Practices
Schedule PS3001: Embedded Improvement Planning Best Practices
#11 Draft SMART performance measures.
#12 Identify all available—State, local, and federal— funding sources for each program or activity.
#13 School site-based improvement planning teams are documenting this work plan in the CIP.
#14 Establish a process for regularly monitoring progress throughout the year.
#15 Annually evaluate how effective the implemented programs and activities were for improving your student outcomes.
2018 © Region One Education Service Center
Celebrate successesEstablish processes and procedures for monitoring against attainment of goals and objectivesProvide progress updates to staff and districtAdjust the plan accordinglyTrack and communicate changes
2018 © Region One Education Service Center
Compare summative outcomes to goals and objectivesIdentify changes in outcomes for specific student populationsCritically evaluate the systemIdentify where the system is getting resultsIdentify new insights in the planning process to refine the new cycle
2018 © Region One Education Service Center
Program Evaluation: Questions to Ask
1. Is your campus implementing the schoolwide program as it was intended?
2. Did your campus improve student achievement in meeting the state’s academic standards to the desired level, particularly for those students who had been furthest from achieving the standards?
Source: TEA
2018 © Region One Education Service Center
Program Evaluation
2018 © Region One Education Service Center
Program Evaluation
2018 © Region One Education Service Center
TEA Strategic Priority
23
Each Strategic Priority page offers ESSA resources for continuous improvement planning, instructional best practices aligned to the State Consolidated Plan and TEA Strategic Priorities, and monitoring student outcomes.
2018 © Region One Education Service Center
Dr. Belinda S. Gorena, Administrator956-984-6173
Ruben Degollado, Coordinator956-984-6185
Barbara Gonzales, Specialist986-984-6145
Benjamin Macias, Specialist 956-984-6234
