Embed Size (px)
Citation preview
1
MISSOURI STATE BOARD OF EDUCATION AGENDA ITEM: September 2018
REPORT ON 2018 MISSOURI ASSESSMENT PROGRAM (MAP) GRADE-LEVEL AND END-OF-COURSE (EOC) PERFORMANCE LEVELS AND PRELIMINARY STATEWIDE
RESULTS IN ENGLISH LANGUAGE ARTS AND MATHEMATICS
STATUTORY AUTHORITY:
Sections 160.514 and 161.092, RSMo
Consent
Item
Action Item
Report Item
STRATEGIC PRIORITY Access, Opportunity, Equity – Provide all students access to a broad range of high-quality educational opportunities from early learning into post-high school engagement.
SUMMARY The report will provide information about the establishment of performance levels and cut scores for new Grade-Level and End-of-Course assessments in English Language Arts and Mathematics administered in 2017-18. The report includes preliminary statewide results for these assessments. PRESENTERS Blaine Henningsen, Assistant Commissioner; Lisa Sireno, Standards and Assessment Administrator, Office of College and Career Readiness will assist with the presentation and discussion of this agenda item.
Missouri Assessment ProgramEstablishing Performance Levels and Cut Scores
for English Language Arts and Mathematics Assessments
September 18, 2018
Missouri Assessment ProgramAssessment Authorization
Grade-Level ELA and Mathematics (grades 3-8) ESSA
Grade-Level Science (grades 5 and 8) ESSA
End-of-Course Algebra I, Biology, English II ESSA
End-of-Course American Government MSIP
End-of-Course Algebra II, American History, English I, Geometry, Personal Finance, Physical Science Optional
2
About the MAP Tests• Students take Grade-Level assessments in mathematics and English language arts
each year in grades 3-8. • Grade-Level assessments are administered during the spring testing window.• Students take Algebra I and English II End-of-Course assessments at the end of
instruction.• End-of-Course assessments are offered in summer, fall and spring test windows.• Middle school students who take advanced math courses and take Algebra I,
Geometry or Algebra II End-of-Course aren’t required to take the Grade-Level math test that year.
• Scores are expressed in four performance levels: below basic, basic, proficient, advanced.
3
Building MAP TestsStandards Adoption
Describe Performance
Levels in Draft
Develop Test Blueprints
Write Test Items
Review Items for Content
and Bias
Administer Field Test
Review Field Test Data
Create Operational Test Forms
Administer Operational
Test
Establish Performance
Levels
Report Results
4
Three cut scores classify test takers into four performance levels.
AdvancedCut Score
Below Basic Proficient Advanced
BasicCut Score
ProficientCut Score
Basic
Performance Levels and Cut Scores
5
End-of-Course Bookmark WorkshopsJuly: Missouri educators make content-based cut score recommendations using information from MAP tests and ACT.Grade-Level Bookmark WorkshopsJuly: Missouri educators make content-based cut score recommendations using information from MAP tests and NAEP.
Policy ReviewAugust: Policy group considers cut score recommendations, their implications and uses.
Technical Advisory Committee MeetingAugust: National experts on measurement and assessment review the processes and results to help ensure technical quality.
Process for Establishing Performance Levels
6
Establishing Performance Levels
Bookmark Workshops• Over 150 Missouri educators participated, representing grade-
level and content-specific experience; various geographic regions of the state; rural, urban and suburban schools; and the diversity present in Missouri schools.
• Educators developed cut score recommendations using performance level descriptors, the content of the MAP tests, and information about Missouri students’ performance on ACT and NAEP.
7
Establishing Performance LevelsPolicy Review• A ten-member panel made up of district leaders, building
leaders and higher education faculty reviewed the End-of-Course and Grade-Level workshop recommendations.
Technical Advisory Committee Review• Missouri’s group of national experts reviewed the process from
planning through implementation. They critiqued plans, observed the bookmark workshops, facilitated the policy review, and provided a final analysis of the process employed for establishing performance levels.
8
2017-2018
English Language Arts and Mathematics
Cut Scores and Impact Data
9
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8Basic 331 337 351 371 384 393Proficient 364 388 403 413 435 443Advanced 395 419 431 438 456 476
300
325
350
375
400
425
450
475
500
525
English Language Arts Grade-Level Cut Scores
10
English I English IIBasic 204 205Proficient 300 301Advanced 394 424
100
150
200
250
300
350
400
450
500
English Language Arts End-of-Course Cut Scores
11
2312 11 14 15 13 10 13
2838 41 37 41 38
32 30
27 30 26 26 20 3040
47
22 20 22 22 24 19 1910
G RA DE 3 G RA DE 4 G RA DE 5 G RA DE 6 G RA DE 7 G RA DE 8 EN G L I SH I EN G L I SH I I
Below Basic Basic Proficient Advanced
English Language Arts Impact Data
12
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8Basic 326 358 377 388 394 420Proficient 362 387 410 417 435 468Advanced 390 413 435 438 462 506
300
325
350
375
400
425
450
475
500
525
Mathematics Grade-Level Cut Scores
13
Algebra I Geometry Algebra IIBasic 204 204 215Proficient 279 294 308Advanced 346 386 390
100
150
200
250
300
350
400
450
500
Mathematics End-of-Course Cut Scores
14
25 27 24 28 25 33 2917 22
28 27 35 31 3737
2737 34
25 2524 22 22
21
22 28 27
22 21 17 20 16 922 18 18
G RA DE 3 G RA DE 4 G RA DE 5 G RA DE 6 G RA DE 7 G RA DE 8 AL G EBRA I G EOM ETRY AL G EBRA I I
Below Basic Basic Proficient Advanced
Mathematics Impact Data
15
16
Grade-Level and End-of-Course contractors generate information for school districts and charter LEAs in October.• Individual student reports• District and building data
Reporting Performance Levels
