Embed Size (px)
Citation preview
Teacher Evaluation Viewed Through
The Lens of High-Stakes Assessment
Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Linda TylerVice President, Teacher Licensure and Certification
Educational Testing Service
2 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Higher Stakes Demand Higher Rigor
High stakes
Low stakes
Low rigor
High rigor
From here
ToHere
Lawsuits
Wasted resources
3 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
More Rigor in Overall System and Individual Measures
• Teacher evaluation system
• Individual measures including– Classroom observation– Assessment of artifacts/portfolios–Measures of student learning– Student, parent, teacher survey
4 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Assessment Design
• Define purpose and claim• Define desired evidence• Define or select tasks, exercises, collection
plan, evaluation criteria• Design “system” (combination and
weighting of data, role of human judgment, policies, support)
• Development plan, testing plan, validity plan
5 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Access and Fairness Issues
• Providing very clear communication to teachers about the system and measures
• Doing as much as possible to achieve “standardized conditions”
• Mitigating unfair advantages• Analyzing data to check for impact by
race/gender/school• Reviewing materials to increase clarity and
check for bias, stereotypes, etc.
6 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Assessment Policy Decisions
• Grace period during start-up• Handling formal challenges• Re-testing• Qualifications of evaluators• Familiarity between teacher and
evaluators• Handling suspected misconduct• Confidentiality of data, results
7 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Classroom Observation
• Observer training– Benchmarks, samples– Bias training
• Observer certification• Ongoing monitoring and calibration– Third-party checks– Periodic re-certifications– Resources for observers
• Ongoing data analysis
8 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Artifacts/Portfolio Measures
• Comparable submissions from all teachers• Random collection vs. teacher-selected• Clear instructions• Non-burdensome collection• Minimize coachability• Rubrics and scoring need same rigor as
classroom observation
9 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Final Considerations
• Design and development are deliberate and iterative
• Data analysis is critical for monitoring quality of the system
• Well-researched instruments are worth considering first before designing from scratch
• Human judgment should be part of a high-stakes system
04/19/2310 Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved.
Thank You
Linda [email protected]
