Evaluation Plan forNew State Standards for Mathematics and Problem-based Learning A Grant Funded Project

December 2, 2014

Brittney BentleyVanessa ChoateShannon MooreRana PowellAimee Vickers

Implementation Evaluation

The project is designed to help teachers prepare authentic mathematics learning experiences. Based on the project proposal, the following questions represent the most important aspects of the program that can be examined at this time. Various data sources will be used to determine the effectiveness of the program and if the program has been implemented as planned.

Evaluation FocusData Sources

Were the initial experience and follow up activities implemented as planned? Participant attendance logs for summer workshop, mid-implementation meeting, and project debrief meeting Classroom observations Random interviews with students and teachers Surveys completed by program participants

What is the quality of the initial program activities? Pre-project surveys completed by the teachers Leaders from Great Southern University and Braxton County Schools collaborate to plan workshop activities

Who are the program participants and how were they recruited? Participants:Sixteen Braxton County Mathematics teachers with the majority teaching 6th, 7th, or 8th grade, and administrators Recruited through email and paper mailing advertisements

What is the quality of follow up and support activities? Post-project survey completed by teachers Student work samples from lessons

Summative Evaluation

The summative evaluation will use focused data sources to measure final outcomes against project goals and objectives. Changes that have occurred over time will be identified and analyzed to determine whether the program is effective for students and teachers. ObjectiveIndicatorData Source

1.Create PBL Modules based on local businesses and industriesModules draw on content and processes from local businesses and industriesAttendance Log - Participants will have the local businesses they visit sign-off on their attendance.PBL Lesson Plans - Participants will submit completed NSSM aligned plans from the initial session and continue to re-submit as refining takes place.Meeting Minutes - Participants will interact with Great Southern University staff electronically.Expert Review - Experts from local businesses and industries will review PBL modules using a rubric developed in consultation with the project implementation team to ensure content and processes are relevant.

2.Create PBL Modules addressing NSSMModule content, tasks, and assessments are aligned with appropriate NSSMAttendance Log - Participants will sign-in to the introduction & standards review session.PBL Lesson Plans - Participants will submit completed NSSM aligned plans from the initial session and continue to re-submit as refining takes place.Meeting Minutes - Participants will interact with Great Southern University staff electronically.

3.Integrate technology into PBL experiencesPBL modules contain activities that effectively use technologyTechnology Self-Evaluation - The Braxton County Technology Specialist will support teachers to ensure that technology is effectively integrated into PBL experiences by creating a rubric for teachers to self-evaluate their technology integration as pre and post measures.PBL Lesson Plans - Participants will submit completed NSSM aligned plans from the initial session and continue to re-submit as refining takes place.Observation Notes - Observations will be conducted throughout the 2015-2016 school year on a provided template. Meeting Minutes - Participants will interact with Great Southern University staff electronically.

4.Implement and evaluate PBL ModulesRecord of implementationRecord of self-evaluationObservation Notes - Observations will be conducted throughout the 2015-2016 school year.Meeting Minutes - Participants will interact with Great Southern University staff electronically.Online Journal - Participants will use the Wiki site to self-evaluate themselves throughout the implementation of the PBL Modules.Rubric - Experts from the evaluation team will review the modules that are developed. Evaluators will use a rubric developed in consultation with the project implementation team to judge these elements.

DATA COLLECTION SCHEDULE

Evaluation Plan Form

Project Director: Carlos Hedges, Ph.D.

Title of Project Proposal: New State Standards for Mathematics and Problem-based LearningData setDate of collectionInstruments already developed?Data collected by:

Attendance LogJune 25th YesProject Director

Attendance LogJune 26th Yes - Given to participants on initial day of workshopTeacher participants during visitation

PBL Lesson PlansJune 28th - July 20th No - To be developed during workshopTeacher participants, GSU Staff, External consultants

Meeting MinutesJuly 2nd- July 20th No - To be developed during refining stageTeacher participants & GSU Staff

RubricJuly 2nd - July 20th No - To be developed during consultationProject Experts

Expert ReviewJuly 2nd - July 20thYes - Given to participants on June 28th Local Businesses and Industries

Pre Technology Self-Evaluation RubricJune 28th - July 20th Yes - Given to participants on June 28thTeacher participants

Observation NotesSchool year of 2015-2016Yes - Blank template to be provided GSU project staff & School Administration

Online Journal for self-evaluationSchool year of 2015-2016No - To be developed throughout school yearTeacher participants

Student Work SamplesSchool year of 2015-2016No - To be developed throughout school yearStudents completing the PBL Modules

Student SurveySpring 2016Yes - Questions developed prior to implementationStudents completing the PBL Modules

Post Technology Self-Evaluation RubricSpring 2016Yes - Given to participants on June 28thTeacher participants