School and District Report Cards Validation WebEx

School and District School and District Report CardsReport Cards

Validation WebExValidation WebEx

Jon WiensJon WiensOffice of AssessmentOffice of Assessment

Oregon Department of EducationOregon Department of EducationEmail: jon.wiens@state.or.usEmail: jon.wiens@state.or.us

Changes to the Report CardChanges to the Report Card

Disaggregated cohort and NCES Disaggregated cohort and NCES graduation rates on the summary graduation rates on the summary sheets.sheets.

Attendance for 2009-10 uses 3Attendance for 2009-10 uses 3rdrd period ADM.period ADM.

Participation rating now includes Participation rating now includes Science participation.Science participation.

Report Card TimelineReport Card Timeline

Sept 9Sept 9 11stst Preview of Summary sheets Preview of Summary sheets and unsuppressed details and unsuppressed details

Sept 16 Sept 16 SAT validation closes.SAT validation closes.

Sept 23Sept 23 22ndnd Preview Preview

Sept 30Sept 30 33rdrd Preview. All appeals due. Preview. All appeals due.

Oct 5Oct 5 Final district previewFinal district preview

Oct 6Oct 6 District and media webinarsDistrict and media webinars

Oct 7Oct 7 Public ReleasePublic Release

Report Card OverviewReport Card Overview

The main report card includes a lot of The main report card includes a lot of data. data.

Much of this was validated prior to Much of this was validated prior to September 9.September 9.

We are correcting several formatting We are correcting several formatting errors and reposting on Sept 16errors and reposting on Sept 16thth..

Sept 16Sept 16thth repost will include state and repost will include state and national SAT data.national SAT data.

RC ValidationsRC Validations

Here is partial list of RC Validations:Here is partial list of RC Validations:Validation Opened Closed

NCES Graduation (High School Completers) Mar 4 Apr 2

Dropout Rate (Early Leavers) Mar 4 Apr 2

General Fund Apr 29 May 28

ESD Support Apr 29 May 28

Bond Level Apr 29 May 28

Videoconferencing Facilities Apr 29 May 28

Classes taught by Highly Qualified Teachers Jun 3 Jun 24

Emergency Certification Jun 3 Jun 24

Spring Membership Jun 8 Jul 23

Attendance Jun 8 Jul 23

RC Validations (cont’d)RC Validations (cont’d)

Validation Opened Closed

School Size 6/8 7/23

Students attending from/in another district 6/8 7/23

English Language Learners 6/8 7/23

Expulsions due to Weapons 7/8 7/15

School Personnel 7/8 8/13

Class Size (elementary) 7/8 8/13

SAT Scores 9/9 9/16

Report Card detail and summary sheets 9/9 9/30

How to ValidateHow to Validate Log into the secure ode district site.Log into the secure ode district site. Choose ApplicationsChoose Applications Select Report Card/AYPSelect Report Card/AYP Select one of:Select one of:

– School and District Report Card PDFSchool and District Report Card PDF– School Report Card Detail PDFSchool Report Card Detail PDF– SAT Scores: note that the SAT data we SAT Scores: note that the SAT data we

receive from the college board is the receive from the college board is the latest test for the student, not the latest test for the student, not the highest test.highest test.

School Report Card School Report Card Summary Summary

Data ElementsData Elements

School at a Glance -- HSSchool at a Glance -- HS

School at a Glance -- ElemSchool at a Glance -- Elem

School at a Glance – data detailsSchool at a Glance – data details

Number of Students – based on average daily Number of Students – based on average daily membership from 3membership from 3rdrd period cumulative ADM. period cumulative ADM. Excludes program type ’02’ and ’03’Excludes program type ’02’ and ’03’

SAT scores – collected directly from the college SAT scores – collected directly from the college board board

Attendance – 2009-10 is from 3Attendance – 2009-10 is from 3rdrd period period cumulative ADM. Uses only program type ‘01’cumulative ADM. Uses only program type ‘01’

Participation – based on reading, math, writing Participation – based on reading, math, writing AND science at all tested grades.AND science at all tested grades.

Graduation Rate – both the old NCES rate and the Graduation Rate – both the old NCES rate and the new cohort rate are shown.new cohort rate are shown.

Achievement DataAchievement Data

Achievement DataAchievement DataThe “Academic Achievement” charts use AYP reporting rules:The “Academic Achievement” charts use AYP reporting rules:

– Students resident at the school on May 3Students resident at the school on May 3– Full Academic YearFull Academic Year– 1% flags for extended assessments1% flags for extended assessments

The “Improvement” chart uses:The “Improvement” chart uses:– Percent meeting or meeting growth targetsPercent meeting or meeting growth targets– High schools show graduation rates. Next year this will show High schools show graduation rates. Next year this will show

four- and five-year cohort rate data.four- and five-year cohort rate data.

Data is suppressed if Data is suppressed if – Fewer than 6 studentsFewer than 6 students– Greater than 95% metGreater than 95% met– Less than 5% metLess than 5% met– Graduation data is not suppressedGraduation data is not suppressed

Writing at Grades 4 and 7 is not displayedWriting at Grades 4 and 7 is not displayed

Statewide Statewide Assessment Assessment

ResultsResults

Statewide Assessment ResultsStatewide Assessment ResultsThe “Student Achievement” chart uses PAGR reporting rules:The “Student Achievement” chart uses PAGR reporting rules:– All students resident at the school on May 3, no full academic All students resident at the school on May 3, no full academic

year requiredyear required– All extended assessments are not metAll extended assessments are not met– Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroup

Data is suppressed if Data is suppressed if – Fewer than 6 studentsFewer than 6 students– Greater than 95% met, in which case both the meets and Greater than 95% met, in which case both the meets and

exceeds columns show “>95.0”exceeds columns show “>95.0”– Less than 5% met, in which case both the meets and exceeds Less than 5% met, in which case both the meets and exceeds

columns show “< 5.0”columns show “< 5.0”

The “Student Participation” table has:The “Student Participation” table has:– PAGR participation ratesPAGR participation rates

Science staging is open, so results may differ slightly from PAGR.Science staging is open, so results may differ slightly from PAGR.

Account-Account-ability ability

InformationInformation

Accountability InformationAccountability Information

Shows the AYP met/not met status at Shows the AYP met/not met status at your school.your school.

The order of subgroups differs from The order of subgroups differs from the AYP report, but is consistent with the AYP report, but is consistent with earlier pages of the RC.earlier pages of the RC.

This page also contains the local This page also contains the local information panel.information panel.

District Report Card District Report Card Summary Summary

Data ElementsData Elements

Front PageFront Page

The first page of the district report The first page of the district report card shows:card shows:

District AYP statusDistrict AYP status Report Card rating for each school in Report Card rating for each school in

the district, and the AYP school the district, and the AYP school improvement status for each school.improvement status for each school.

District District InformationInformation

District InformationDistrict InformationBar charts show grade by grade percent met Bar charts show grade by grade percent met

according to AYP rules:according to AYP rules:– Students resident in the district on May 3Students resident in the district on May 3– Full Academic year within the districtFull Academic year within the district– 1 percent cap1 percent cap

Data is suppressed if Data is suppressed if – Fewer than 6 studentsFewer than 6 students– Greater than 95% metGreater than 95% met– Less than 5% metLess than 5% met

Writing at Grade 4 and 7 is not displayedWriting at Grade 4 and 7 is not displayed

District InformationDistrict Information

Participation includes reading, math, Participation includes reading, math, science and writingscience and writing

Attendance is from 3Attendance is from 3rdrd period ADM period ADM HQT “High Poverty” and “Low Poverty” HQT “High Poverty” and “Low Poverty”

schools are in the highest and lowest schools are in the highest and lowest quartiles for FRL percent in the state.quartiles for FRL percent in the state.

HQT and Emergency Cert Data utilizes HQT and Emergency Cert Data utilizes data from the TSPCdata from the TSPC

Statewide Statewide Assess-Assess-

ment ment ResultsResults

Statewide Assessment ResultsStatewide Assessment ResultsThe “Student Achievement” chart uses PAGR reporting rules:The “Student Achievement” chart uses PAGR reporting rules:– All students resident in the district on May 3, no full academic All students resident in the district on May 3, no full academic

year requiredyear required– All extended assessments are not metAll extended assessments are not met– Transitioning LEP students are not included in LEP subgroupTransitioning LEP students are not included in LEP subgroup

Data is suppressed if Data is suppressed if – Fewer than 6 studentsFewer than 6 students– Greater than 95% met, in which case both the meets and Greater than 95% met, in which case both the meets and

exceeds columns show “>95.0”exceeds columns show “>95.0”– Less than 5% met, in which case both the meets and exceeds Less than 5% met, in which case both the meets and exceeds

columns show “< 5.0”columns show “< 5.0”

The “Student Participation” table has:The “Student Participation” table has:– PAGR participation ratesPAGR participation rates

Science staging is open, so results may differ slightly from PAGR.Science staging is open, so results may differ slightly from PAGR.

Account-Account-ability ability

InformationInformation

Accountability InformationAccountability Information

District AYP status. Note that all District AYP status. Note that all grade bands have been combined.grade bands have been combined.

NAEP Results. NAEP does not NAEP Results. NAEP does not provide scores for districts or provide scores for districts or schools.schools.

Financial Data. Note that this is for Financial Data. Note that this is for 2008-2009.2008-2009.

Report Card Report Card Detail Sheets and Detail Sheets and

School Rating School Rating FormulaFormula

Rating ComponentsRating Components AchievementAchievement

– An index that utilizes growth and weights An index that utilizes growth and weights students in underperforming subgroupsstudents in underperforming subgroups

Improvement (high schools only)Improvement (high schools only)– The two-year improvement in the The two-year improvement in the

performance indexperformance index Attendance or GraduationAttendance or Graduation ParticipationParticipation

– Includes reading, math, writing, AND scienceIncludes reading, math, writing, AND science AYP StatusAYP Status

Detail Detail Sheet Sheet Cover Cover PagePage

The Achievement IndexThe Achievement Index

Utilizes the Growth modelUtilizes the Growth model– Students not meeting in the prior year are given a Students not meeting in the prior year are given a

“growth target” for the current year. Those students “growth target” for the current year. Those students whose score is at or above their growth target will have whose score is at or above their growth target will have “Met Growth”“Met Growth”

Points awarded according to:Points awarded according to:– 133 points for Exceeds133 points for Exceeds– 100 points for Meets100 points for Meets– 100 points for Did Not Meet, but Met Growth100 points for Did Not Meet, but Met Growth– 0 points for Did Not Meet and did not meet growth 0 points for Did Not Meet and did not meet growth

Use the same students as are used for AYP Use the same students as are used for AYP – includes extended assessmentsincludes extended assessments– includes the 1% cap for extended assessmentsincludes the 1% cap for extended assessments

Weighting of SubgroupsWeighting of Subgroups To address the Achievement Gap, a school’s To address the Achievement Gap, a school’s

Achievement Index is a weighted average of the Achievement Index is a weighted average of the achievement those in subgroups with an historic achievement those in subgroups with an historic statewide achievement gap. statewide achievement gap.

The weighting of subgroups does not provide The weighting of subgroups does not provide “extra credit” to schools with students in the “extra credit” to schools with students in the subgroups.subgroups.

Schools with significant achievement gaps will see Schools with significant achievement gaps will see a negative impact on their achievement index.a negative impact on their achievement index.

Schools in which subgroups are outperforming the Schools in which subgroups are outperforming the all students subgroup will see a positive impact on all students subgroup will see a positive impact on their index.their index.

The Achievement IndexThe Achievement Index Subgroups included in the weighted index:Subgroups included in the weighted index:

– All StudentsAll Students– Students with disabilitiesStudents with disabilities– Limited English proficientLimited English proficient– Economically DisadvantagedEconomically Disadvantaged– American Indian/Alaskan NativeAmerican Indian/Alaskan Native– Black (not of Hispanic origin)Black (not of Hispanic origin)– HispanicHispanic

Achievement Index Cut-scoresAchievement Index Cut-scores

OutstandingOutstanding SatisfactorySatisfactory In Need of In Need of ImprovementImprovement

Elementary/Elementary/

MiddleMiddle90.0 or Higher90.0 or Higher 60.0 to 89.960.0 to 89.9 Less than 60.0Less than 60.0

High SchoolsHigh Schools 80.0 or Higher80.0 or Higher 50.0 to 79.950.0 to 79.9 Less than 50.0Less than 50.0

Detail Sheet - AchievementDetail Sheet - Achievement

Improvement (High Schools)Improvement (High Schools)

Since high school students do not have Since high school students do not have growth targets, we measure improvement growth targets, we measure improvement in high schools as the year to year in high schools as the year to year improvement in student performance.improvement in student performance.

Schools with an “Improved” rating will Schools with an “Improved” rating will have their achievement rating raised by have their achievement rating raised by one category.one category.

Detail Sheets:Detail Sheets:Improvement Improvement Index for High Index for High

SchoolsSchools

Improvement - ExampleImprovement - Example

Other IndicatorsOther Indicators Graduation: High Schools with a two-year Graduation: High Schools with a two-year

total of at least 20 graduates and dropoutstotal of at least 20 graduates and dropouts Cohort rates have been included for Cohort rates have been included for

information only. They will be included in information only. They will be included in the rating next year.the rating next year.

Attendance: Elementary/Middle schools Attendance: Elementary/Middle schools and high schools with small numbers of and high schools with small numbers of graduates/dropoutsgraduates/dropouts

All schools are rated on participation in All schools are rated on participation in reading, math, writing AND science.reading, math, writing AND science.

Other IndicatorsOther Indicators

The ratings for these other indicators can The ratings for these other indicators can limit a school’s overall rating, as shown limit a school’s overall rating, as shown below.below.

Limit for Overall RatingLimit for Overall Rating

IndicatorIndicator In Need of In Need of ImprovementImprovement SatisfactorySatisfactory OutstandingOutstanding

GraduationGraduation Less than 60.0Less than 60.0 60.0 to 68.060.0 to 68.0 68.1 or Higher68.1 or Higher

AttendanceAttendance Less than 89.0Less than 89.0 89.0 to 91.989.0 to 91.9 92.0 or Higher92.0 or Higher

ParticipationParticipation Less than 94.5Less than 94.5 94.5 or Higher94.5 or Higher

Detail Detail Sheets:Sheets:

Additional Additional IndicatorsIndicators

Calculating the Overall RatingCalculating the Overall Rating1. The preliminary school rating is the 1. The preliminary school rating is the

Achievement RatingAchievement Rating

2. If the Attendance/Graduation or 2. If the Attendance/Graduation or Participation ratings are lower than the Participation ratings are lower than the Achievement Rating, reduce the overall Achievement Rating, reduce the overall rating to the lowest of these two ratingsrating to the lowest of these two ratings

3. If the school received a “Met” on AYP, the 3. If the school received a “Met” on AYP, the school can be rated no lower than school can be rated no lower than Satisfactory. This step overrides any Satisfactory. This step overrides any prior designation of “In Need of prior designation of “In Need of Improvement”Improvement”

Overall Rating - ExampleOverall Rating - Example

Overall Rating - ExampleOverall Rating - Example

Overall Rating - ExampleOverall Rating - Example

ResourcesResources

Main Report Card Page Main Report Card Page http://www.ode.state.or.us/go/reportcardhttp://www.ode.state.or.us/go/reportcard

Report Card Manuals Report Card Manuals http://www.ode.state.or.us/search/page/?id=24

Report Card Calculators and How to Report Card Calculators and How to Reads Reads http://www.ode.state.or.us/search/page/?id=661

Longitudinal Student Growth Model: Longitudinal Student Growth Model: http://www.ode.state.or.us/search/page/?id=2495http://www.ode.state.or.us/search/page/?id=2495