Michigan School Report Card Update

Michigan School Report Card Update

Michigan Department of Education

Today We Will discuss…Today We Will discuss…

What’s New for 2005 Report CardEducation YES!Adequate Yearly Progress

Preview of 2006 Report CardState AccreditationAdequate Yearly Progress

Education YES!until 2005-06

Education YES!until 2005-06

Achievement Status

AchievementChange

Indicators

Education YES!Education YES!

Achievement Status Up to a three year Average Weighted Index

Achievement Change Improvement (or Decline) Based on 100% by 2013-14

Achievement Growth Delayed until 2006-07

Indicators of School Performance “Investments” to Improve Achievement Self-Assessments

Achievement Status and Change

Achievement Status and Change

ElementaryEnglish Language Arts and

MathematicsMiddle School and High School

Mathematics, English language arts, Science and Social Studies

School Performance Indicators

School Performance Indicators

Instructional Quality

EngagementLearning

Opportunities

Extended Learning Opportunities Continuous

ImprovementFamily Involvement

Teacher Quality/Professional

Development

Student Attendance & Graduation RateCurriculum

AlignmentArts Education and

HumanitiesFour-Year Education & Employment PlanPerformance

Management Systems

Advanced Coursework

School Facilities

Self Assessment RatingsSelf Assessment Ratings

Systematically and Consistently Meets Criteria

Progressing Toward Criteria Starting to Meet Criteria Not Yet Meeting Criteria

Indicators DetailIndicators Detail

Indicators and Achievement

Indicators and Achievement

A B C D F TotalA 392 896 907 438 123 2,756B 16 55 101 78 31 281C 4 5 20 26 18 73D 0 1 5 14 12 32F 0 0 2 4 2 8

Total 412 957 1,035 560 186 3,150

Number of Schools

Achievement GradeIn

dica

tor

Gra

de

What’s New for 2005 –Education YES!

What’s New for 2005 –Education YES!

Display of Evidence and Self-Ratings for the Indicators of School Performance

The Education YES! Composite Grade Indicator score cannot improve the

composite score and grade by more than one letter grade more than the achievement grade

Education YES!Composite GradeEducation YES!

Composite Grade

Indicator EvidenceIndicator Evidence

Indicator EvidenceIndicator Evidence

What’s New for 2005 - AYPWhat’s New for 2005 - AYP

Students Reported in an Ungraded Setting

Adjustment for Measurement Error to Improve AYP Reliability

Small SchoolsSubgroup Size for AYP DeterminationNonstandard Accommodations – Count

as “NOT TESTED”

2004-05 Report Card2004-05 Report Card

Minimum n for district AYP based on 1% of enrollment if district or school enrollment is more than 3,000

Nonstandard accommodations and unethical administrations will not count as participation for AYP

1% - 2% - I’m Confused1% - 2% - I’m Confused

Special Education Alternate Assessment Flexibility Approved for 2005 Applies to Students in Phase 2 – Functional

IndependenceProposed Federal Rules Expected in the

Fall1% Exception Still Needed for Phase 1

students – most significantly disabled

AYP ReliabilityMargin of ErrorAYP ReliabilityMargin of Error

Sources of ErrorMeasurement Error - APPROVED

Would the student score the same if tested again?

Standard Error of MeasurementSampling Error – NOT APPROVED

Does the sample of students tested reflect the whole school?

Standard Error of Proportion with Finite Sampling Error Correction

Measurement ErrorMeasurement Error

400

450

500

550

600

650

Students

Sca

le S

core

Cut score

# proficient students = 12

# not proficient students = 12

Measurement ErrorMeasurement Error

400

450

500

550

600

650

Students

Sca

le S

core

Cut score

# proficient students = 10

# not proficient students = 10

# provisionallyproficient students = 4

Provisionally Proficient Students - ELA

Provisionally Proficient Students - ELA

ELA Grade 4 ELA Scale Score is at or above 508 and

Reading Scale Score is at or above 478 and Writing Scale Score is at or above 475

ELA Grade 7 ELA Scale Score is at or above 499 and

Reading Scale Score is at or above 466 and Writing Scale Score is at or above 480

Provisionally Proficient Students - Math

Provisionally Proficient Students - Math

Grade 4 MathMath Scale Score is above 510 and

Math Scale Score is at or below 550Grade 8 Math

Math Scale Score is above 501 and Math Scale Score is at or below 559

Preview of 2005-06 AYPPreview of 2005-06 AYP

1st year of 3-8 assessmentAYP – Use all scores for a school

Composite Percent Proficient Cannot ignore valid scores Group size rule may be modified Full Academic Year rule may be modified

New AYP objectives An impact analysis will be needed The new objectives will be based on only 9

years to 100% proficiency

State Accreditation Issues for 2006

State Accreditation Issues for 2006

Student AchievementStatus – New “Cut Scores” NeededChange – Can’t Compare Old and

New TestsGrowth – Cannot measure until 2007

Indicators of School PerformanceMeasure the School Improvement

Framework

Possible Measurement ToolsPossible Measurement Tools

School Report and Self-AssessmentFocus on Process

Teacher SurveyFocus on instruction and collaboration

School Leader SurveyFocus on Leadership

Possible Measurement ToolsPossible Measurement Tools

“Hard” DataHighly Qualified from Registry of

Educational PersonnelCoordination With Other Processes

North CentralOther Potential Tools

Parent SurveyStudent Survey

QuestionsQuestions

Do we need a parent survey?Do we need a student survey? How

does it differ by grade range?Are we overlooking groups whose

perspective is important?When is the appropriate time to

administer the data collection? January-February?

Possible Policy QuestionsPossible Policy Questions

Recognition of existing ProcessesNorth Central

Fair accountability for non-Title I Schools

Role of AYP as a part of state accreditation

Original Indicator Revision ScheduleOriginal Indicator Revision Schedule

February 2005 Presentation to State Board of Education

Winter-Spring 2005 Development of Measurement Plan

Fall, 2005 Field Testing

Fall 2005 Data Collection on Revised Indicators

Winter 2006 Report Cards Available to Start Appeals

Contact InformationContact Information

Paul BielawskiOffice of Educational Assessment and

AccountabilityMichigan Department of EducationPO Box 30008Lansing, MI 48909(517) 335-5784bielawp@michigan.gov