Lodi Unified School District Program Improvement Update:Assessment, Research and Evaluation Department (AR&E)

Board of EducationApril 15, 2008

2

Executive Summary

Since the November 2006 review, the district has: Changed the department’s name and focus Increased the resources allocated to AR&E Provided additional training to AR&E staff

As a result, the department: Consistently produces accurate data/reports Consistently meets report deadlines Conducts program evaluations Provides valuable technical assistance to

schools and other departments

3

Purpose

To provide the Board of Education an update in response to the assessment and evaluation review conducted in November 2006.

AR&E (formerly A/E) continues to provide quality monitoring.

AR&E is still dedicated to promoting a culture of program improvement.

4

Historical Background

In November 2006, a review found that AR&E: Was a small and undervalued department. Had a dedicated staff working near capacity.

Administering mandated assessments were noted as the department’s strengths.

Weaknesses were noted as follows: Not consistently producing accurate data/reports, Not consistently meeting ongoing data requirements, Not performing program evaluations were noted as

weaknesses.

5

Historical Background (continued)

Causes for the department’s weaknesses were noted as follows: Department was not well understood

(valued). Small staff (limited capacity). Limited resources to conduct program

evaluation and research. Inadequate information system. Flawed student information system.

6

Corrective Action #1 – Department Name & Focus Change

Department’s name was changed from Assessment and Evaluation (A/E) to Assessment, Research, and Evaluation (AR&E) to reflect the new emphasis to be given to program evaluation studies. In addition to conducting mandated

assessments, AR&E would now provide enhanced services related to producing internal evaluation reports and assisting in the production of external evaluation reports.

7

Corrective Action #2 – Additional resources allocated to reflect the departments value in improving academic achievement

Full time equivalent positions increased from 3.75 positions to 6 positions

A long term secured materials processing area was established

A partnership was established with Business Services to provide for transportation of assessment materials throughout the district

8

Corrective Action #3 – Training

AR&E staff received training on generating, accessing, manipulating, and producing data reports for sites and district office departments

9

Corrective Action Results #1 – Data Quality Control

There have not been any district wide data errors included in any of the data reports produced by AR&E since July 2007 AR&E has used the additional staff

allocated to this function to establish and implement quality control procedures over AR&E produced internal and external data reports

10

Corrective Action Results #2 – Deadlines

Since July 2007, AR&E has met every state and district imposed reports deadline, including the following: STAR Apportionment report CAHSEE Apportionment report CELDT Apportionment report CAHSEE Waiver and Exemption reports CAHSEE Intensive Instruction and Services

Application CST and CAHSEE Results report Accountability Progress Report

11

Corrective Action Results #3 – Program Evaluations

Since July 2007, AR&E has undertaken the following program evaluations which are scheduled to be completed for the 2007-08 school year: Monitoring and Accountability College and Career Preparation Equity Status Indicators Administrative Coaching Program

12

Corrective Action Results #4 – Increased Technical Assistance

As a result of the district’s corrective actions, AR&E has been able to provide increased technical assistance to schools and departments in regards to:

Calculating and reporting the drop-out and graduation rates Training staff on using Dataquest Understanding the Adequate Yearly Progress (AYP) and

Academic Performance Index (API) accountability measures Assisting in the preparation of Distinguished School Award

applications Assisting in the selection of a replacement student

information system Assisting in the selection of a replacement student data

management system (Data Director) that will promote data-driven instructional decisions for teachers and administrators

13

Conclusion

The district’s adoption and implementation of its corrective actions has increased AR&E’s capacity to promote data-driven decision making that increases academic achievement for all students.

Going forward, it is the department’s goal to continue providing quality services that lead to high academic performance for all students and the elimination of the achievement gap.