Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Update on the PARCC and Smarter Balanced PARCC and Smarter Balanced
Assessment Consortia
August 16, 2013
RTTT Assessment Program Requirements
Groups of 15 or more states could apply for a grant to develop online next generation assessment systems that:online, next-generation assessment systems that:• Assess shared standards in mathematics and ELA/literacy for
college- and career-readiness
• Measure individual growth as well as proficiency;
• Utilize technology to the maximum extent appropriate; and
• d i f i h i f l f• Provide information that is useful in informing: Teaching, learning, and program improvement;
Determinations of school effectiveness and of principal and teacher p peffectiveness for use in evaluations and support; and
Determinations of individual student college and career readiness, such as determinations made for high school exit decisions, college suc as dete at o s ade o g sc oo e t dec s o s, co egecourse placement to credit-bearing classes, or college entrance.
Operational by 2014 – 2015 school year (US Department of Education, 2010)2
Assessment Consortia MembershipsThe Two State-Led
Comprehensive Assessment ConsortiaMembershipsComprehensive Assessment Consortia
PARCC20 states & DC
Smarter Balanced• 26 states
Both:Pennsylvania20 states & DC 26 states y
Washington, DC
Hawaii
Neither: Alabama, Minnesota, Nebraska, Texas, Utah, Virginia
The Partnership for the pAssessment of Readiness forReadiness for
College and Careers (PARCC)
4
PARCC
Last quarter of school year
English Language Arts/Literacy and Mathematics, Grades 3 – 11
PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; professional development materials; and an interactive report generation system
Returns information about
DIAGNOSTIC ASSESSMENT
PERFORMANCE-BASED
END-OF-YEARASSESSMENTMid-Year Performance-
MID-YEARASSESSMENT
scoring training modules; professional development materials; and an interactive report generation system.
Retake OptionFlexible timing
student strengths and weaknesses to inform
instruction, supports, & professional development
BASEDASSESSMENT
• ELA/literacy tasks• Math tasks
ASSESSMENT • ELA/literacy• Math
Flexible timing
Mid-Year Performance-Based Assessment
(Potentially summative)ELA/Literacy• Speaking• Listening
Flexible timingFlexible timing Flexible timing Flexible timing
OptionalAssessmentsto inform
Summative assessment f t bilit
Required but not summative, not used for
Developed by The Center for K–12 Assessment & Performance Management at ETS, version 5, March 22, 2012. For detailed information on PARCC, go to http://PARCConline.org.
* After study, individual states may consider including this as a summative component.
to informinstruction
for accountabilitynot used for accountability
PARCC Summative Assessments: Performance Based AssessmentsPerformance-Based Assessments
• Taken after roughly 75% of instructional year
Final 12 weeks of school year
Taken after roughly 75% of instructional year
• 3 ELA/literacy tasks over 3 sessions• 1 narrative task PERFORMANCE
BASED
• 1 literary analysis task • 1 research simulation task
M th t k 2 i
BASED ASSESSMENT
• ELA/literacy• Math
• Math tasks over 2 sessions• complex, real‐world application problems• emphasis on mathematical practices and modeling
• Electronic and distributed human scoring
• Results by end of school year 6
PARCC Summative Assessments: End of Year AssessmentEnd-of-Year Assessment
• Taken after roughly 90% of instructional year
• Multiple item types including constructedEND‐OF‐YEARASSESSMENT
p yp gresponse and technology enhanced
• Fixed‐form, with multiple forms per grade level
• Will include items across a range of cognitive demand
• Electronically scored• Electronically scored
7
PARCC:
Summative Components
Last 12 weeks of year
Summative Components
• Timed spread over nine testing sessions
Last 12 weeks of year
Timed, spread over nine testing sessions
• Estimated testing time, ELA + math: 8 hours in grade 39 hours in grades 4 ‐ 59.5 hours in grades 6 – 8 9.5 ‐ 10 hours in high school
PERFORMANCEBased Assessment
• ELA/literacy• Math
END OF YEARASSESSMENT
Re‐take option• PT and EOY scores combined for accountability• 1 Retake in 3 – 8 and up to 3 in HS, as State/locally approved
8
• Paper and pencil version as accommodation and for at least the first year at additional cost
PARCC: Speaking/Listening AssessmentSpeaking/Listening Assessment
ELA/Literacy• Speaking• Listening
• Required in grades 3 ‐ 11, but not used for accountability;
Flexible timing
Required in grades 3 11, but not used for accountability; also available in grades K‐2
• Scored by classroom teacher using standardized rubricScored by classroom teacher using standardized rubric
• Scores may be used within students’ grades 9
PARCC Supports: Interim AssessmentsInterim Assessments
MID‐YEAR ASSESSMENT DIAGNOSTIC ASSESSMENT
Flexible Timing
• Optional Diagnostic Assessment, grades 2 – 8p g , g• Two‐stage adaptive assessment designed to inform instruction
• Optional Mid‐Year Performance Tasks, grades 3 – 11Optional Mid Year Performance Tasks, grades 3 11• Designed to mirror summative Performance Tasks
10
PARCC Supports: The Partnership Resource CenterThe Partnership Resource Center
PARTNERSHIP RESOURCE CENTER: Digital library of released items, formative assessments, model content frameworks instructional and formative tools and resources; student and educator tutorials and practiceframeworks, instructional and formative tools and resources; student and educator tutorials and practice tests, scoring training modules; professional development materials; and an interactive report generation system
• Reporting suite with customizable reports for user groups• Reporting suite with customizable reports for user groups• Online practice tests• Formative assessment items and tasks• Professional development materials – scoring, use of data• Instructional tools and resources developed by Partner statesO i l “ d ” i i ll b dd d f i• Optional “ready‐to‐use,” instructionally embedded formative tasks and tools for K‐1
11
PARCC Assessment SystemPARCC Assessment System
Last quarter of school year
English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School
PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; professional development materials; and an interactive report generation system
Returns information about
DIAGNOSTIC ASSESSMENT
PERFORMANCE-BASED
END-OF-YEARASSESSMENTMid-Year Performance-
MID-YEARASSESSMENT
scoring training modules; professional development materials; and an interactive report generation system.
Retake OptionFlexible timing
student strengths and weaknesses to inform
instruction, supports, & professional development
BASEDASSESSMENT
• ELA/literacy tasks• Math tasks
ASSESSMENT • ELA/literacy• Math
Flexible timing
Mid-Year Performance-Based Assessment
(Potentially summative)ELA/Literacy• Speaking• Listening
Flexible timingFlexible timing Flexible timing Flexible timing
Projected cost as of spring 2013: $29.50 per student annually, for both ELA and math summative assessments,
Developed by The Center for K–12 Assessment & Performance Management at ETS, version 5, March 22, 2012. For detailed information on PARCC, go to http://PARCConline.org.
delivered and scored.
PARCC: Supports and TimelineSupports and TimelinePlans as of spring 2013, subject to change
2012 - 20132012 - 2013• K-16 Educator Leader Cadres launched (24 per state) and
provided on-going training• Prototype items & tasks released (www.parcconline.org)Summer 2013• More prototype items & tasks released• 2 sets of online Professional Learning Modules releasedFall 2013Fall 2013• Assessment PD modules releasedSpring 2014• Practice tests availablePractice tests available• College readiness tools released 2014 – 2015 school year• Mid-Year and Summative assessments ready2015 – 2016 school year• K-1 formative tasks ready• Diagnostic and Speaking/Listening assessments ready 13
Th S t B l d The Smarter Balanced Assessment Consortium
14
Smarter BalancedSmarter Balanced
Last 12 weeks of school year
English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School*
DIGITAL LIBRARY of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; practice tests;
t i i d l d t h ll b ti t l
Computer Adaptive
INTERIM ASSESSMENT
Computer Adaptive
INTERIM ASSESSMENT
scorer training modules; and teacher collaboration tools.
Scope, sequence, number, and timing locally determined
Assessment and Performance Tasks
Assessment and Performance Tasks PERFORMANCE
TASKS• 1 ELA/Literacy
Task• 1 Math Task
COMPUTER ADAPTIVE
ASSESSMENT• ELA/Literacy • Math
Optional Interim assessment Summative assessment
locally determinedRetake Option
* Summative and interim assessments for grades 3 – 8 and 11, with additional supporting assessments for grades 9 and 10.** Time windows may be adjusted based on results from the research agenda and final implementation decisions.
system — no stakes for accountability
15
Smarter Balanced Summative Assessment
Performance TasksPerformance Tasks
Last 12 weeks of year*
• Taken after roughly 75% of instructional year
• One ELA task and 1 math task per year, p y ,90 – 120 minutes per content area
• Focus on hard‐to‐measure standards
PERFORMANCETASKS
• Reading• Writing• Math
• Combination of machine and teacher/human scoring
R lt b d f h l• Results by end of school year
16
Smarter Balanced Summative AssessmentComputer Adaptive End-of-Year Assessment
Last 12 weeks of year*
Computer Adaptive End-of-Year Assessment
• Taken after roughly 90% of instructional year
• Multiple item types including constructed• Multiple item types including constructedresponse and technology enhanced
• Adaptive delivery can span up to two
COMPUTERADAPTIVE
ASSESSMENT
Adaptive delivery can span up to two grade levels up or down to gain accuracy and clearer profile of strengths and needs
Re‐take option
17
Smarter Balanced
Summative Components
Last 12 weeks of year
Summative Components
• Untimed over multiple testing sessions
Last 12 weeks of year
Untimed, over multiple testing sessions
• Estimated testing time, ELA + math: 7 hours in grades 3 – 5 PERFORMANCE
TASKS• Reading
COMPUTERADAPTIVE
7.5 hours in grades 6 – 8 8.5 hours in grade 11
• Reading• Writing• Math
Re‐take option
ASSESSMENT
• PT and EOY scores combined for accountability
• 1 Retake, if locally approved, for testing irregularities
18
• Paper and pencil version for 3 years; thereafter as accommodation
Smarter Balanced Supports: Optional Interim Assessment SystemOptional Interim Assessment System
INTERIM INTERIM INTERIM
• Computer adaptive, multiple item types from EOY summative
• Customizable: number, scope, timing
• Non‐secure and fully accessible ‐‐ teachers can see items and student responses
• Produces links to student resources and PD resources19
Smarter Balanced Supports:
The Digital Clearinghouse
Last 12 weeks of year*
The Digital Clearinghouse
DIGITAL CLEARINGHOUSE of formative tools, processes and exemplars, released items and tasks, modelDIGITAL CLEARINGHOUSE of formative tools, processes and exemplars, released items and tasks, model curriculum units, educator training; professional development tools and resources, interactive reporting system; scoring training modules, and teacher collaboration tools.
• Reporting suite with differentiated tools for usersReporting suite with differentiated tools for users
• Online Practice Test utility
• Assessment literacy modules
• Formative tools, exemplar instructional modules, vetted and rated units
l d f k d b• Released performance tasks and rubrics
• Issue‐focused chat rooms for teachers26
Smarter Balanced Assessment SystemS a te a a ced ssess e t Syste
Last 12 weeks of school year
English Language Arts/Literacy and Mathematics, Grades 3 – 8 and High School*
DIGITAL LIBRARY of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; practice tests;
t i i d l d t h ll b ti t l
Computer Adaptive
INTERIM ASSESSMENT
Computer Adaptive
INTERIM ASSESSMENT
scorer training modules; and teacher collaboration tools.
Scope, sequence, number, and timing locally determined
Assessment and Performance Tasks
Assessment and Performance Tasks PERFORMANCE
TASKS• 1 ELA/Literacy
Task• 1 Math Task
COMPUTER ADAPTIVE
ASSESSMENT• ELA/Literacy • Mathlocally determined
Retake Option
Projected cost as of spring 2013: $22 50 d ll f b h ELA d h i
21
$22.50 per student annually, for both ELA and math summative assessments, delivered and scored. Additional $4.80 per student annually for use of the interim assessment system and optional resources.
The Smarter Balanced Open Source System Architecture
Test AdministrationTest Registration, Test Delivery, Test
Scoring
Test CreationItem Authoring, Item Banking, Test
Creation
Open Source System Architecture
Data Warehouse
SharedServices
& Reporting
Future Plug‐and‐Play
Applications
Submit to Library
Review Against Quality Criteria Digital Library
Applications
Publish to Library
Browse/Search
Download / Stream
Apply in Classroom Rate
TRAINED EDUCATORS IN CONSORITUM
STATES
EDUCATORS IN
CONSORTIUM STATES
Commission Content Development to Q li C i i S ifi i
PUBLISHERS
LEADERS FROM
STATES EDUCATORS IN
CONSORTIUM STATES
Quality Criteria Specifications
Smarter Balanced: Supports and TimelinePlans as of spring 2013, subject to change
2012 2013
Supports and Timeline
2012 - 2013• Prototype items & tasks released (www.smarterbalanced.org• Practice Test utility available to teachers, students, publics y , , p
Summer/fall 2013• Teacher cadres (avg. 90 per state) trained in use of formative tools
and PD modules; ready to lead in state trainings (Summer)and PD modules; ready to lead in-state trainings (Summer)
• First set of Exemplary Instructional Modules released (Fall)
Winter 2014Winter 2014• Second set of Exemplary Instructional Modules released
Fall 2014Fall 2014• Comprehensive Electronic Platform, including Digital Library launched• Interim assessments available 23
www k12center org
CONTACT
www.k12center.org
CONTACT
Pascal (Pat) D. Forgione, Jr., Ph.D.Pascal (Pat) D. Forgione, Jr., Ph.D.Distinguished Presidential Scholar and Executive Director
Center for K-12 Assessment & Performance Management at ETS701 Brazos Street, Suite 500
Austin TX 78701Austin, TX 78701E-Mail: [email protected]
Nancy DooreyDirector of ProgramsDirector of Programs
Wilmington, DEE-Mail: [email protected]