Upload
selia
View
20
Download
0
Embed Size (px)
DESCRIPTION
GRANT PERFORMANCE REPORT FOR CONTINUATION FUNDING FY 2010. Office of Special Education Programs U.S. Department of Education With thanks to NECTAC & Christy Kavulic. Annual Grant Performance Report. - PowerPoint PPT Presentation
Citation preview
Office of Special Education Programs
U.S. Department of EducationWith thanks to NECTAC & Christy Kavulic
GRANT PERFORMANCE REPORT
FOR
CONTINUATION FUNDING
FY 2010
O S
E P
Annual Grant Performance Report
An annual report of your activities and performance in meeting the approved objectives of the project
Required for all active grants, including those in no cost extension
OSEP reviews the report to determine if substantial progress has been in order to receive continued funding
O S
E P
Overview
Recognize strong project objectives that can be associated with high quality performance measures
Develop high-quality, measurable performance measures that maximize the potential for meaningful data reporting
Complete the ED Grant Performance Report (ED 524B)
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Why Is This Important?
High quality objectives and measures …
Make it easier for you to measure your progress
Allow you to report progress easily and quantitatively
Allow OSEP staff to gather evidence of program effectiveness
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Goal – Objectives - Measures
Perform ance M easuresH o w yo u m e a su re yo u r p ro g ress tow a rd m ee tin g yo u r o b jec tives
(P ro g ra m /G P R A , P ro je c t)
Project ObjectivesW h at you r p ro je ct is d o ing to su pp o rt th e o ve ra ll p ro g ra m g o a l
(F o u nd in yo u r ap p lica tio n )
Program Goal
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
High Quality Project Objectives
Relevance
How relevant is the project objective to the overall goal of the program and/or the goal of your project?
Applicability
How applicable is the project objective to the specific activities that are being conducted through your particular project?
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
High Quality Project Objectives
FocusHow focused is the project objective?
MeasurabilityAre there concepts in the project objective that
lend themselves to measurement? If so, is measurement feasible?
O S
E P
Project Objectives -- ExamplesEstablish a licensure program which will
recruit, enroll, support, and assist paraprofessionals currently employed in an urban school district to meet state certification requirements in special education
Implement a high-quality professional development program to help LEAs implement a multi-tiered system for behavior and academics
O S
E P
Project Objectives - Examples
Provide training that enables personnel to work with and involve parents in their child’s education, including parents of low income and limited English proficient children with disabilities
O S
E P
Performance Measures
How are you measuring your progress in meeting your
objectives?
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Performance Measures
Measurable indicator used to determine how well objectives are being met.
How will progress be assessed?
How much progress will constitute success?
How will it be known if an objective or part of an objective has been achieved?
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Performance Measures
Perform ance M easure1a
Perform ance M easure1b
Perform ance M easure1c
Project Objective1
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Types of Performance Measures
ProgramMeasures established by OSEP for the
SPDG program. These include measures established for reporting to Congress under the Government Performance and Results Act
SPDG PROGRAM Performance Measures
• Measure 1.1 – Evidence-Based Practices (Personnel): The percent of personnel receiving professional development through the SPDG based on scientific- or evidence-based instructional practices.
• Measure 1.2 – State Performance Plan (SPP) Alignment: The percent of SPDG projects that implement personnel development/training activities that are aligned with improvement strategies identified in their SPP.
• Measure 2.1 – Evidence-Based Practices (Training): The percentage of professional development/training activities provided through the SPDG based on scientific- or evidence-based instructional/behavioral practices.
O S
E P
• Measure 2.2 – Sustained Practices: The percentage of professional development/training activities based on scientific- or evidence-based instructional/behavioral practices, provided through the SPDG program, that are sustained through on-going and comprehensive practices. (Long-term)
• Measure 3.1 – Teacher Retention: In states with SPDG projects that have special education teacher retention as a goal, the statewide percentage of highly qualified special education teachers in state identified professional disciplines (e.g., teachers of children with emotional disturbance, deafness, etc.) who remain teaching after the first two years of employment.
• Measure 4.1 – Scale-up Scientific- or Evidence-Based Practices: The percentage of SPDG projects that successfully replicate the use of scientific- or evidence-based instructional/behavioral practice in schools. (Long-term)
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Types of Performance Measures
ProjectMeasures that the grantee establishes to
meet their project objectives
Project performance measures can address both the process of working towards an objective and the outcome related to meeting the objective
Ensure a mix of both process and outcome measures
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
High Quality Performance Measures
High quality performance measures show
What will change
How much change you expect
Who will achieve the change
When the change will take place
O S
E P
Project Performance Measure Examples
Process measure (e.g.)
Project staff (who) will hold 4 (how much) training sessions with mentors (what ) during the first and third years of the grant (when)
O S
E P
Project Performance Measure Examples
Outcome measure (e.g.)
Inquiries from potential special education teachers (who) about teaching in our state (what) will increase 20% from the number recorded in 2006 (how much) by the third year of the grant (when)
O S
E P
Project Performance Measure Examples
Outcome measure (e.g.)
At the end of their third year of training (when), 90% of partner schools (who) will have implemented tertiary-level literacy supports (what) by meeting benchmark (80%) on an implementation fidelity measure (how much)
O S
E P
Project Performance Measure Example
Outcome measure
Of the 200 schools implementing SWPBIS (who) assessed each spring (when), 80% (how much) of them will implement with fidelity (what).
O S
E P
Project Performance Measure Example
Outcome measure (e.g.)
100% (how much) of paraprofessionals supported by the SPDG in a certification program (who) will become highly qualified special education teachers in an urban school district (what) by the completion of the grant performance period (when).
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Common Problems Activities are NOT performance
measures
If the best response is “Yes, we did that,” it is likely an activity (not a performance measure)
Activities:
Establish a mentoring program
Hold an advisory board meeting
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Common Problems
Performance measures need to be measurable
Not measurable
Collaborative partnerships will be maintained
Evaluation will gauge students’ content proficiency and project effectiveness
To increase the sustainability of the professional development model
O S
E P
Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University
Summary
Projects should have a few clear objectives that explain what the project is doing to support the overall goal
Each objective should have a few, specific performance measures to demonstrate how progress toward meeting the objective will be measured
O S
E P
Completing the 524B
The ED 524B is a required reporting form with specific instructions.
The form is used by all ED grants and has been approved by the Office of Management and Budget (OMB). Project Directors must follow the directions listed in the Dear Colleague letter and ED 524B Instructions provided by OSEP
Reporting Period:
For first year grants, the date is the beginning of the project year to 30 days before the due date.
For grants in years 2-4, it is the date from the end of the previous reporting period to 30 days before the due date.
ANNUAL PERFORMANCE REPORTS
ANNUAL PERFORMANCE REPORTS
Budget Expenditures:
Report the expenditures during the “Reporting Period.” Must be data or
information from the business or grants office.
Signatory must have authority to sign on behalf of the institution since the grant is from the Department to the institution and not to an individual.
Performance Measure Status:
This will be checked “No” since OSEP is asking for data for the reporting period, not for the budget period.
The date entered here will be the due date for your Final Performance Report; which is 90 days after the end of the grant.
ANNUAL PERFORMANCE REPORTS
OMB No. 1890-0004Exp. 10-31-2007
U.S. Department of Education
Grant Performance Report (ED 524B)Executive Summary
(See Instructions)
*** Provide highlights of the project's activities and the extent to which the expected outcomes and performance measures were achieved during the reporting period. Do NOT include the project abstract.
PR/ Number # (11 characters)_______
ED 524BPage 2 of 11
EXECUTIVE SUMMARY SHEET
PROJECT STATUS CHART
Enter one of the project’s objectives; on subsequent pages, you will enter additional project objectives as submitted in your grant application.
PROJECT STATUS CHART
Enter your PROJECT performance measures that show you are measuring progress toward meeting the objective.
In addition, enter PROGRAM performance measures that align with the objective.
PROJECT STATUS CHART
Here you identify if the performance measure is a project measure, “PROJ,” or a program measure, “PRGM.”
Note:
Program Measures refer to OSEP Measures required in all personnel development grants. Project Measures are unique to your grant.
PROJECT STATUS CHART
Depending on your measure, enter either a raw number or a ratio and percentage.
PROJECT STATUS CHART
QUANTITATIVE DATA
In this area of the page, enter information to explain the quantitative data, as well as activities the project engaged in to meet the objective.
QUALITATIVE DATA
If measure requires the collection of qualitative data, then enter “N/A” under the Raw Number and Percentage columns.
N/A N/A N/A N/A
In this area of the page, report qualitative data along with other information you wish to report regarding the identified objective.
PROJECT STATUS CHART
1.a. Performance Measure Measure Type Quantitative Data
The percentage of professional development/training activities provided through the SPDG based on scientific- or evidence-based instructional/behavioral practices.
PROG Target Actual Performance Data
Raw Number Ratio %
Raw Number Ratio %
/
25/25 100
1.b. Performance Measure Measure Type Quantitative Data
90 % of low performing schools receiving training in PBIS will meet the benchmark for a positive school climate, as demonstrated by the Climate Staff Survey, by year 3 of their PBIS training.
PROJ Target Actual Performance Data
Raw Number Ratio %
Raw Number Ratio %
18 /20
90 12/20 60
1.c. Performance Measure Measure Type Quantitative Data
90% of low performing schools receiving training in PBIS will decrease the number of suspensions of students with disabilities by 20% or more by year 3 of their PBIS training.
PROJ Target Actual Performance Data
Raw Number
Ratio %
Raw Number
Ratio %
18/20 90 10/20 80%
Implement a high-quality professional development program to help LEAs implement a multi-tiered system for behavior /academics.
Explanation of Progress (Include Qualitative Data and Data Collection Information)
(1a) The multi-tiered models of support trainings have been based on the best research available regarding (1) evidence-based practices in professional development and follow-up activities (e.g., coaching) (provide citations), (2) evidence-based practices in school-wide positive behavior support (provide citations), (3) evidence-based practices in intensive behavior support (provide citations), (4) evidence-based practices in school-wide literacy and math instruction, assessment, and decision making (provide citations), and (5) evidence-based practices in intensive literacy and math support (provide citations). The 25 activities (describe more fully) have all been built based on these evidence bases.
(1b) There is a promising evidence base that links improvements in school climate with the full implementation of PBIS (citations). Although this is only the second year of implementation for the low performing schools, for the 8 schools that did not meet the benchmark set for the climate measure, interviews have been set up with one or more of the school staff to determine greater levels of assistance that may be needed from project staff.
(1c) The is a moderate evidence base that links the full implementation of PBIS with decreases in the number of students with disabilities who are suspended. The 10 schools that have not decreased suspension by 20% will participate in interviews to help determine support needs.
Implement a high-quality professional development program to help LEAs implement a multi-tiered system for behavior /academics
Final Page of the Report
Section B: Refer to the instructions for Section B in the ED 524B Instructions
Section C: Include additional information (recruitment material, syllabi, evaluation instruments, journal articles)
O S
E P
Section B – Budget Information
A. Actual Expenditures for Reporting Period (e.g., May 1, 2009 – March 31, 2010: $836,750.
B. Provide explanation if you are not expending funds at the expected rate: A final cohort of paraprofessionals was not added due to withdrawal of one of the participating LEAs. This means that $100,000 was not spent that was planned to be spent during this period. We will have twice the number of paraprofessionals than had been planned in the next cohort. Accordingly we plan to spend these funds in the next year of the project.
O S
E P
Section B – Budget Information
C. Describe any changes to your budget that affected your ability to achieve your approved project activities and/or project objectives. The DOE has decided to use IDEA Part B funds to support ---- activity, thus we will spend $90,000 for the activity, instead of $180,000. However, we will be able to reach the objectives set out in our grant application for this activity.
D. Describe any significant changes to your budget resulting from modifications of project activities. We have added 5 new facilitators to the professional development team that serves 5 LEAs. We are using $90,000 to pay for these facilitators*.
O S
E P
Section B – Budget Information
E. Do you expect to have any unexpended funds at the end of the current budget period? (Explain why, provide an estimate, and indicate how you plan to use the unexpended funds (carryover) in the next budget period.) As explained above, we will be carrying over $100,000 which we will spend on our paraprofessional activities next year.
F. Describe any anticipated changes in your budget for the next budget period that require prior approval from the Department. All of the changes described above have been discussed and approved by our Project Officer.
O S
E P
Section C – Additional Informaiton
• If applicable, please provide a list of current partners on your grant and indicate if any partners changed during the reporting period. Please indicate if you anticipate any change in partners during the next budget period. If any of your partners changed during the reporting period, please describe whether this impacted your ability to achieve your approved project objectives and/or project activities.
• If instructed by your program office, please report on any statutory reporting requirements for this grant program.
O S
E P
• Describe any changes that you wish to make in the grant’s activities for the next budget period that are consistent with the scope and objectives of your approved application.
• If you are requesting changes to the approved Project Director listed in Block 3 of your GAN and/or to other approved key personnel listed in Block 4 with a proposed effective date during the remainder of the current budget period or the next budget period, please indicate the name, title and percentage of time of the requested key personnel. Please indicate whether the proposed Project Director or other key personnel change would be effective during the current or next budget period. Additionally, please attach a resume or curriculum vitae for the proposed key personnel when you submit your performance report.
Note: Do not report on any key personnel changes that were already made during the current or previous budget period(s). Departmental approval must be requested and received prior to making key personnel changes.
•
O S
E P
• Provide any other appropriate information about the status of your project including any unanticipated outcomes or benefits from your project.
O S
E P
Submitting the 524B
Submit the 524B at http://e-Grants.ed.gov
Signed ED 524B Cover Sheet must be faxed to Kimberly Savoy-Brown at 202-245-7635
Two conditions require hard copy or email submission rather than submission through e-Grants –
Grants in no-cost extension
Grants that have been forward funded
O S
E P
Submitting the 524B
Regular postal service:
U.S. Department of Education, Office of Special Education Programs
Attn: Kimberly Savoy-Brown, PCP – Room 5060
400 Maryland Avenue, SW
Washington, DC 20202
Hand delivery or parcel service:
U.S. Department of Education
Attn: Kimberly Savoy-Brown, Mail Stop 255
LBJ Basement Level 1
400 Maryland Avenue, SW
Washington, DC 20202
O S
E P
Program Measures: Things to Think about
Measure 1.1 – Evidence-Based Practices (Personnel): The percent of personnel receiving professional development through the SPDG based on scientific- or evidence-based instructional practices.
• Describe the PD activities conducted by the project and the number of personnel trained in each activity.
• Provide evidence through citations and explanations.
• Metric: # of personnel who received SPDG PD based on EBPs divided by the total # of personnel who received PD from the SPDG
O S
E P
Measure 1.2 – State Performance Plan (SPP) Alignment: The percent of SPDG projects that implement personnel development/training activities that are aligned with improvement strategies identified in their SPP.
• Provide a description of each professional development activity provided by the SPDG that is aligned with SPP improvement strategies.
• The reviewers will make the decision as a result of what is available in your continuation report.
• You do not need to connect to every indicator.
O S
E P
Measure 2.1 – Evidence-Based Practices (Training): The percentage of professional development/training activities provided through the SPDG based on scientific- or evidence-based instructional/behavioral practices.
• Provide descriptions of your professional development activities.
• Provide evidence that these are evidence-based practices (EBPs)
• Metric: # of PD activities that are based on scientific or EBPs divided by the Total # of PD training activities provided by the SPDG project.
O S
E P
Measure 2.2 – Sustained Practices: The percentage of professional development/training activities based on scientific- or evidence-based instructional/behavioral practices, provided through the SPDG program, that are sustained through on-going and comprehensive practices. (Long-term)
• Taken from the final performance report.
• The final report must provide detailed documentation on how PD provided by the project was sustained, including a description of on-going and comprehensive practices being conducted by the project (e.g., mentoring, coaching, structured guidance).
• Metric: # of PD initiatives based on scientific or evidence-based instructional practices that have been sustained divided by the Total # of PD training initiatives provided by the SPDG program.
O S
E P
Measure 3.1 – Teacher Retention: In states with SPDG projects that have special education teacher retention as a goal, the statewide percentage of highly qualified special education teachers in state identified professional disciplines (e.g., teachers of children with emotional disturbance, deafness, etc.) who remain teaching after the first two years of employment.
• State identified professional disciplines
O S
E P
•
•
Measure 4.1 – Scale-up Scientific- or Evidence-Based Practices: The percentage of SPDG projects that successfully replicate the use of scientific- or evidence-based instructional/behavioral practice in schools. (Long-term)
• Taken from your final performance report.
• Choose one or more of your initiatives/evidence-based practices
• Provide the number of schools where the practice has been implemented with fidelity as a result of the SPDG activities
Contact your OSEP Project Officer with any questions!Contact your OSEP Project Officer with any questions!
Due Date: April 30, 2010
Thank You!