4
Climate Survey Plan/Program Continuous Improvement Focus 2016-2017 Program Evaluation Plan Report Evaluation Results Purpose of Program Evaluation § Understand the impact of each program’s services on students and stakeholders § Improve the program’s efficiency and effectiveness § Provide information that can be used to determine which services or programs should be continued § Develop consistency and evidence improvement What is the status of the program’s progress toward achieving the goals? Goal 1: Student perception of a safe and caring environment Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Baseline year (the SJSD student survey was replaced by the Gallup Student Poll in Fall of 2016 which was not accounted for when this PEP was written in January 2016). Goal 2: Staff perception of work satisfaction, engaged, and supported through professional development, level of care Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Overall results exceeded goal of 3% at an average of 6.5% Goal 3: Annual improvement of parents’ perception of district good ROI (CCR preparedness), communication, partner with district for education. Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Overall results met the goal of 3%

Climate Survey Plan/Program Continuous …esbpublic.sjsd.k12.mo.us/attachments/f68804fb-767d-4a05...Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation

Embed Size (px)

Citation preview

Page 1: Climate Survey Plan/Program Continuous …esbpublic.sjsd.k12.mo.us/attachments/f68804fb-767d-4a05...Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation

Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation Plan Report Evaluation Results Purpose of Program Evaluation

§ Understand the impact of each program’s services on students and stakeholders § Improve the program’s efficiency and effectiveness § Provide information that can be used to determine which services or programs should be continued § Develop consistency and evidence improvement

What is the status of the program’s progress toward achieving the goals? Goal 1: Student perception of a safe and caring environment Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Baseline year (the SJSD student survey was replaced by the Gallup Student Poll in Fall of

2016 which was not accounted for when this PEP was written in January 2016).

Goal 2: Staff perception of work satisfaction, engaged, and supported through professional development, level of care Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Overall results exceeded goal of 3% at an average of 6.5%

Goal 3: Annual improvement of parents’ perception of district good ROI (CCR preparedness), communication, partner with district for education. Measureable Objective 1: Increase to 3% score range on the perception data trend scorecard Results: Overall results met the goal of 3%

Page 2: Climate Survey Plan/Program Continuous …esbpublic.sjsd.k12.mo.us/attachments/f68804fb-767d-4a05...Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation

Figure 1. 2016 SJSD Perception Data Scorecard

Page 3: Climate Survey Plan/Program Continuous …esbpublic.sjsd.k12.mo.us/attachments/f68804fb-767d-4a05...Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation

What do key stakeholders consider to be the strengths and OFIs (Opportunities for Improvement) of the program? Strengths

• Parents appreciate the information and ability to provide input • Students believe climate is important to academics and their own

leadership significantly impacts this more so than other stakeholders.

OFIs

• Parents would like more communication about this data per their child’s school (results) and understand more about how this is used to shape strategies

• Bus safety a concern • Include Student Gallup Poll data about student’s involvement in

extracurricular activities in next scorecard • Increase parent participation rate and consider how to expand to taxpayer

base (non-parent).

What do the program’s staff consider to be the strengths and OFIs of the program? • Strengths

• Teachers appreciate use of data in conjunction with academic data (in buildings led through data analysis this way)

• Good use of data that was once collected but not used to leverage continuous improvement (or even awareness) as to climate/perceptions

OFIs

• Lack of specific actions plans or inclusion within CSIP to address climate, engagement or work place satisfaction

• Governance, ethics and senior leadership metrics (survey items) to be further developed

• Add item about chronic absenteeism knowledge • Individual buildings do not have or use perception data scorecards

How well aligned are the program’s priorities and processes with the goals of the program? Overall, the survey items meet the requirements the program evaluation staff and stakeholders consider

key indicators that best inform climate and perceptions. OFI’s will be included in future scorecards by adding and developing survey items, focus group questions and/or interview questions.

Deployment Level of Program Services:

• Little or no deployment of systemic approach • The approach is in the early stages of deployment in most areas inhibiting the progress in achieving the

basic requirements of the program • The approach is deployed, although some areas are in early stages of deployment • The approach is well deployed with no significant gaps • The approach is fully deployed without significant weaknesses or gaps in areas

Page 4: Climate Survey Plan/Program Continuous …esbpublic.sjsd.k12.mo.us/attachments/f68804fb-767d-4a05...Climate Survey Plan/Program – Continuous Improvement Focus 2016-2017 Program Evaluation

Evaluation Implications General Recommendation Resulting from the Evaluation Select from the following possible recommendations resulting from the evaluation:

Continue the program as is. It is meeting or exceeding all expected outcomes. Expand the program, replicating effective components. Streamline, refine, or consolidate elements of the program. Redesign the program. Reevaluate the purpose and/or goals of the program. Discontinue ineffective or nonessential program components. Discontinue the program. Other (Specify.)

Action Plan Add bus safety item, extracurricular involvement item (Student Gallup Poll*), add item about knowledge of chronic absenteeism, increase participation, encourage building level administrators to utilize quality tools like data perception scorecard. *I am involved in at least one activity, such as a club, music, sports or volunteering – 73% Strongly Agree Cost and Funding Source (of Action Plan) No additional cost anticipated with sustained use of Survey Monkey @ $299 per year (all surveys are deployed using the anonymous services provided by Survey Monkey such that IP addresses cannot be known to ensure comfort and anonymity of participants).