Embed Size (px)
Citation preview
September 12, 2013
Jonathan Wiens, PhD
Office of Assessment and Information Services
Oregon Department of Education
School and District Report Cards
2
TimelineReport Card Ratings ReviewReview of the new Report Cards
Today’s Topics
3
Report Card TimelineSept 12 Report Card validation opens
(English only)
Sept 12-23 Validation for Supplemental Data Collection (Letters and Curriculum)
Sept 19 Spanish report card preview opens
October 3 Final preview of Report Cards and suppressed Ratings Details
October 7 Media receives embargoed filesOctober 10 Public release of Report Card and
Ratings
* - handouts and video for this and other trainings at: https://district.ode.state.or.us/search/page/?id=226
New validation site – see the July 12 th video training at https://district.ode.state.or.us/search/page/?id=226
for more details
Achievement Data Insight Application
5
Achievement Data InsightThis is the new site that hosts Report Card
Validations.Debuted on June 6Suggestions for improvement are welcome.ODE hosted a training on June 6, available at
the Video Training site: https://District.ode.state.or.us/search/page/?ID=226
Contact District Security Administratorhttps://district.ode.state.or.us/apps/login/searchSA.aspx
Permissions are set by validation type
6
Application Landing Page
If you do not see the application, contact your district security administrator.
7
Application Landing Page
• Validations tiles• Latest validation information• Status/Count down
• Open and All tabs• Options Menu
8
Report Card Validation“Details” report provides the data included in the rating. “Summary” is the actual report card.
“Language” will include Spanish on September 19th.
Suppressed details available on October 3rd.
Overview -- See the July 12th video training at https://district.ode.state.or.us/search/page/?id=226
for more details
Report Card Rating Details
School ratings are rated based on 5 main factors:Achievement: percent met in reading and mathGrowth: individual student growth in reading and
mathSubgroup Growth: growth for historically
underserved subgroups*Graduation: cohort graduation ratesSubgroup Graduation: graduation rates for
historically underserved subgroups*
* - Economically disadvantaged; Limited English Proficient; Students with disabilities; and a combined American Indian/Alaska Native, Black, Hispanic, and Native Hawaiian/Pacific Islander subgroup.
Oregon’s School Rating Model
Categories are weighted according to the table below:
Weighting in Overall Rating
CategoryElementary and Middle
Schools
Combined Schools (e.g., K-12, 6-12)
High Schools
Achievement 25% 20% 20%
Growth 50% 30% 20%
Subgroup Growth 25% 15% 10%
Graduation 25% 35%
Subgroup Graduation 10% 15%
Schools receive a rating of Level 1 (lowest) to Level 5 (highest) and points in each of the categories
The percentage of points earned for each indicator are combined into an overall score and Level for the school. Missing one or more participation targets
lowers the rating by one level.
A “Level 1” in graduation means the school’s rating can be no higher than Level 2.
Oregon’s School Rating Model
Schools are given one of five rating Levels. These levels can be described as follows:Level 5 The top 10% of all schools in the state
(5% of Title I schools)Level 4 Above average, generally meeting
AMOsLevel 3 Below average, but not in the lowest
15%Level 2 In the lowest 15% of schoolsLevel 1 In the lowest 5% of schools in the state.
Final ratings were posted on August 22nd.
School Ratings
(Almost) All schools receive a rating.New schools and small schools will not be
rated.No new priority or focus schools.
Schools identified last year remain priority or focus schools for 2013-14 and beyond.
There will be a new list of Model schools. Title I schools with a Level 5 rating
2012-2013 School Ratings
14
Detailed Review of Data Included
School Report Card Redesign
As part of the ESEA Waiver Oregon committed to a redesign of the school and district report cards.
A Report Card Steering Committee was appointed, consisting of a diverse group of Oregon Stakeholders.
First meetings were in October 2012 and final recommendations were given to ODE in April 2013.
Details posted at: http://www.ode.state.or.us/search/page/?id=3881
State Board approved the redesign at its May meeting.
Report Card Redesign
16
17
Validation Notes
This front page will only show during the preview window. It will not be included in the public release.
It will contain information pertinent to each preview.
18
Report Card Redesign
This is page one of the Elementary school prototype.
All prototypes are available at:http://www.ode.state.or.us/search/page/?id=3881
Provided to ODE via the Supplemental Data Collection.
English and Spanish translations must be provided.Header data comes from our Institutions database.
Please check that the website link is correct.
Letter from the Principal
19
Data comes from 3rd Period Cumulative ADM. Gives a “May 1” snapshot of the school.
English Learners – “Ever EL,” includes students reported as EL since 2006-07 in Oregon. This definition is used everywhere, except for high school outcomes.
Students attending 90% or more days aligns to the “Not Chronically Absent” measure on the Achievement Compacts.
School Profile
20
The Schools Report Card Rating is shown on the leftSchools are placed in one of three positions within each level based on
their “Weighted Percent.”On the right, schools are identified as being in
(approximately) the top, middle or bottom third of comparison schools.
School Rating
21
Comparison schools are based on a combination of: Percentage of economically disadvantaged students Percentage of English learners (using ever-EL) Percentage of underserved races/ethnicities: American
Indian/AK Native, Black, Hispanic, and Pacific Islander Within school year mobility rates
Each school has up to 20 comparison schools that are used for all “Like-School” measures on the report card.
Comparison school ratings indicate whether or not the school’s “Weighed Percent” puts them in the top third, middle third, or bottom third of its comparison schools.
For other measures the students in the comparison schools are pooled and the rate for the pooled group is calculated.
Comparison Schools
22
Rating on the left comes from the ratings detail sheets. Schools are placed in one of three positions within each level
based on their “Weighted Percent.” Comparison schools are determined using a combination of:
Percent economically disadvantaged Percent English learners (using ever-EL) Percent underserved races/ethnicities: American Indian/AK Native,
Black, Hispanic, and Pacific Islander Within school year mobility
Each school has up to 20 comparison schools that are used for all “Like-School” measures on the report card.
Comparison school ratings indicate whether or not the school’s “Weighed Percent” puts them in the top third, middle third, or bottom third of its comparison schools.
For other measures the students in the comparison schools are pooled and the rate for the pooled group is calculated.
Comparison Schools
23
24
Report Card Redesign
This is page two of the Elementary school prototype.
High schools have graduation data here.
All prototypes are available at:http://www.ode.state.or.us/search/page/?id=3881
Shows assessment performance for the last four years. Includes all students enrolled on May 1 that were full academic year.
Rules match those on the ratings details. School results are suppressed if fewer than 6 students, >95%
met/exceeded, or <5% met/exceeded. Participation rate won’t be checked on this first preview.
Progress
25
Shows 2012-13 results for student subgroups. Includes students enrolled on May 1 for a full academic year. Includes comparison to the state.
Outcomes (Elem/Middle)
26
• Most results will match the ratings details. However, additional subgroups are present here.
• Important Note: English Learners is ever-EL here. On the ratings details it is current EL or exited within the previous two years.
Includes completion and college/career readiness indicators.
Outcomes (High)
27
• Freshmen on track submitted by districts.
• SAT data is from the College Board (not yet available)
• Continuing education is from the National Student Clearinghouse
Shows 2012-13 graduation/dropout indicators by subgroup. Students are EL for On Track, Graduation and Completion if
they were served or eligible at any time during high school. This is the one place that “Ever EL” is not used.
Outcomes (High)
28
• Includes Oregon performance for each subgroup, and how the school compares to the state average for that subgroup.
• State On Track numbers not yet available.
29
Curriculum & Learning Environment
This is page three of the Elementary school prototype.
High schools and middle schools have additional categories.
Priority, Focus, and Model will have Title 1 information at the bottom.
Detailed Review of Data Included
District Report Card Redesign
31
Validation Notes
This front page will only show during the preview window. It will not be included in the public release.
It will contain information pertinent to each preview.
32
District Report Card Redesign
This is page one of the district prototype.
All prototypes are available at:http://www.ode.state.or.us/search/page/?id=3881
Provided to ODE via the Supplemental Data Collection.
English and Spanish translations must be provided.Header data comes from our Institutions database.
Letter from the Superintendent
33
Data comes from 3rd Period Cumulative ADM. Gives a “May 1” snapshot of the district.
District Profile
34
• English Learners –reported as EL at any time in Oregon (since 2006-07).
• Students attending 90% or more days aligns to “Chronically Absent” measure on Achievement Compacts.
• Student wellness and racial equity submitted by districts.
35
Report Card Redesign
Page two of the district card is a continuation of the district profile on page 1.
Expulsions data will be on the preview.
All prototypes available at:http://www.ode.state.or.us/search/page/?id=3881
Shows assessment performance for the last four years.
Includes student enrolled on May 1 that were full academic year in the district.
Data is broken down by grade spans.
Includes Oregon and Like-District values for 2012-13.
Participation rate won’t be checked on the first preview.
Progress
36
Includes completion and college/career readiness indicators. Matches the high school reports.
Outcomes
37
• Freshmen on track submitted by districts.
• SAT data is from the College Board (not yet available)
• Continuing education is from the National Student Clearinghouse
• 2009-10 Completion and Continuing Education data is not available.
Shows 2012-13 graduation/dropout indicators by subgroup. Students are EL for On Track, Graduation and Completion if
they were served or eligible at any time during high school. This is the one place that “Ever EL” is not used.
Outcomes
38
• Includes Oregon performance for each subgroup, and how the district compares to the state average for that subgroup.
• State On Track numbers not yet available.
Submitted in the supplemental data collection.
Curriculum and Learning Environments
39
Spanish must also be submitted.
Shows the number of priority, focus, and model schools in the district.
Federal Title 1 Designation
40
Questions?
42
Report Card Page: http://www.ode.state.or.us/search/page/?id=3881Assessment Inclusion Rules Report Card Technical Manual
District Training Site: https://district.ode.state.or.us/search/page/?id=226
ESEA Waiver: http://www.ode.state.or.us/go/nextgen
Assessment Reporting Schedule: http://www.ode.state.or.us/wma/teachlearn/testing/schedules/asmtreportsched1213.pdf
Application Assistance: [email protected]
Useful Links
43
ESD Partners: http://www.ode.state.or.us/wma/teachlearn/testing/oaks/esdpartners1213.pdf
Report Card and RC Validations in general Jon Wiens: [email protected] Josh Rew: [email protected]
Assessments Cindy Barrick: [email protected]
School and District Profiles Isabell Jacoby: [email protected]
Cumulative ADM Joy Blackwell: [email protected]
Highly Qualified Teachers Anna Haley: [email protected]
Contacts
