Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary OBrian, Director of Assessment Illinois State Board of Education

Student Assessment Updates

Susie Morrison, Deputy Superintendent Chief Education Officer

Mary O’Brian, Director of Assessment

Illinois State Board of Education

3 Welcome to 2013-2014 School Year

• PARCC • 2014 ISAT• Change in performance level cut

scores• Growth model

Changes in Assessment

Content contained is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License

Assessment

Instruction

Curriculum

Higher Expectations with Common Core

4

ELA/Literacy

Read sufficiently complex texts independently

Write effectively to sources

Build and present knowledge through research

Math

Solve problems: content and mathematical practice

Reason mathematically

Model real-world problems

Have fluency with mathematics

Key ELA and Literacy Shifts• Reading

– Balance of literature and informational texts– Focus on text complexity

• Writing – Emphasis on argument and informative/

explanatory writing– Writing to sources – Writing analytical essays

• Speaking and Listening– Inclusion of formal and informal talk

5

Key Mathematics Shifts

• Each grade focuses on fewer standards:• Greater depth • Coherent progression across

grades

• Conceptual understanding of topics

• Extend knowledge to real-life modeling and application

6

What Is PARCC?

The Partnership for Assessment of Readiness for College and Careers: Made up of 19 states + DC and US Virgin Islands

KY and PA are participating states Developing common, high-quality math and English

language arts (ELA) tests for grades 3–11Computer-based and linked to what students need to

know for college and careers

Field Testing: Spring 2014

For use starting in the 2014–15 school year

7

8

Getting All Students College and Career Ready

K–2 Grades 3–8 HighSchool

Optional K–2 assessment being developed, aligned to

the Common Core State Standards

Timely data showing whether ALL students are on track for college and career

readiness

College readiness score to identify who is ready for college-

level coursework

Success In first-year,

credit-bearing, postsecondary

coursework

Ongoing student support/interventions

Professional development for educators

PARCC Assessment DesignEnglish Language Arts/Literacy and Mathematics, Grades 3-11

End-of-Year Assessment

• Innovative, computer-based items

Performance-BasedAssessment (PBA)

• Extended tasks• Applications of concepts

and skills

Summative,Required assessment

Interim, optional assessment

Diagnostic Assessment• Early indicator of student knowledge and skills to inform instruction, supports, and PD

ELA - Speaking And ListeningAssessment

• Locally scored• Non-summative, required

Optional Assessments/Flexible Administration

Mid-Year Assessment• Performance-based• Emphasis on hard-to-

measure standards• Potentially summative

2

ELA: Grade 7 Sample Item

10

Students read the text that introduces the topic Items are designed to help students gather information from the

texts to lead to the final writing prompt Items require different types of responses to allow students to

demonstrate a command of evidence with complex texts

Part A: Highlight the claim that is supported by the most relevant and sufficient facts within “Earhart’s Final Resting Place Believed Found.”

Part B: Click on two facts within the article that best provide evidence to support the claim selected in Part A.


11

Claims

Earhart and Noonan lived as castaways on Nikumaroro Island.

Earhart and Noonan’s plane crashed into the Pacific Ocean

People don’t really know where Earhart and Noonan died.


12

Math: Grade 3 Sample Item

13

• This a fairly traditional fraction task in a computer-based setting.

• Unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy and there is more than one correct solution.

• Unlike paper and pencil tests, students can create a visual representation even though the task is scored automatically.

Math: Grade 3 Sample Item

14

• Second part of multi-step problem, and, unlike traditional multiple choice, it is difficult to guess the correct answer or use a choice elimination strategy.

Math: High School Sample Item

15

Item has two possible solutions Students have to recognize the nature of the equation to know how to

solve Technology prevents guessing and working backward

PARCC Comprehensive Accessibility Policies

16

Accommodations**

* Available to all participating students**For students with disabilities, English learners, and English learners with disabilities

Accessibility Features for All Students

17

Accessibility Features for All StudentsAudio Amplification

Blank Paper (provided by test administrator)Eliminate Answer Choices

Flag Items for ReviewGeneral Administration Directions Clarified (by test administrator)

General Administration Directions Read Aloud and Repeated (by test administrator)

Highlight ToolHeadphones

Magnification/Enlargement DeviceNotePad

Pop-Up GlossaryRedirect Student to Test (by test administrator)

Spell CheckerWriting Tools

Accessibility Features Identified in Advance

18

Accessibility Features Identified in Advance

Answer Masking

Background/Font Color (Color Contrast)

General Masking

Text-to-Speech for the Mathematics Assessments

Line Reader Tool

Administrative Considerations for All Students

• Detailed guidelines will be included in the PARCC Test Administration Manual.

• Principals may determine that any student may require one or more of the following test administration considerations, regardless of the student’s status as a student with a disability or an English learner: – Small group testing – Frequent breaks – Time of day – Separate or alternate location – Specified area or seating – Adaptive and specialized equipment or furniture

19

Presentation Accommodations

20

Content Area Presentation Accommodations

ELA/Literacy Text-to-Speech or Video of a Human Interpreter for the ELA/Literacy Assessments, including items, response options, and passages*

Braille Edition of ELA/Literacy Assessments(Hard-copy braille tests and refreshable braille displays for ELA/Literacy)

Closed-Captioning of Multimedia Passages on the ELA/Literacy Assessments

Descriptive Video

Mathematics Video of a Human Interpreter for the Mathematics Assessments for a Student Who is Deaf or Hard of Hearing

Braille Edition of Mathematics Assessments(Hard-copy braille tests for Mathematics)

Both Content Areas

Additional Assistive Technology (Guidelines available fall 2013)

Tactile Graphics

Video of a Human Interpreter for Test Directions for a Student Who is Deaf or Hard of HearingPaper-and-Pencil Edition

Response Accommodations

21

Content Area Response Accommodations

ELA/LiteracyScribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for constructed responses on the English Language Arts/Literacy Assessments*

Word prediction on the ELA/Literacy Performance-Based Assessment*

Mathematics Calculation Device and Mathematics Tools*(on Non-calculator Sessions of Mathematics Assessments)

Both Content Areas

Additional Assistive Technology (Guidelines available fall 2013)

Braille note-taker

Scribing or Speech-to-Text (i.e., Dictation/Transcription or Signing) for the Mathematics assessments, and for selected response items on the English Language Arts/Literacy assessments

PARCC Technology Platform

22

• PEARSON’s TestNav platform has been selected for the Field Test (Spring 2014) and 1st Operational assessment in 2014-15.

• TestNav will provide a Proctor Caching solution that will allow for test downloads to individual computers for testing and then uploads when testing is completed reducing the amount of bandwidth needed during test administration.

• TestNav specifications (including bandwidth) will be released in August.

23

Looking Ahead

April 2013

• Draft Performance Level Descriptors for public review (April 10-May 8)

• Draft Accommodations Manual for students with disabilities and English learners for public review (April 18-May 13)

Spring 2013

• Test Blueprints and Evidence Statements (~May 1)• Guidance on Participation in Field Test and Practice Tests

June 2013 • Final Subject- and Grade-Level Performance Level Descriptors• Final Accommodations Manual for Students with Disabilities and

English Learners

Summer 2013

• Additional Sample Items • Estimates for Assessment Cost

Fall 2013• Design of Student Score Reports• Minimum Technology Specifications, version 3.0

24

Looking AheadThroughout 2013-14

• Additional Guidance to Districts on Assessment Administration

Spring 2014 • Field Test Administration and Practice Test

Fall 2014 • Operational Assessment Administration Manual

SY 2014-15• Operational Administration of PARCC Summative

Assessments

Summer 2015

• Standard Setting

PARCC Field Testing

• PARCC is developing a stratified random sample for classrooms to participate in field testing

• Classrooms will be chosen within schools given identified characteristics– Most students will take either Performance-

based assessments OR End of Year assessments


• Change reading approximately 20 percentage points

• Change in mathematics approximately 25 percentage points


Change in Performance Level Cut Scores

Change in Performance Level Cut Scores


• Backmapping process was used with data from 2011 PSAE and 2008 8th grade ISAT– Equipercentile equating was used to determine

performance categories– Maximizes the reliability of these data

• Reliability and stability of the new performance levels was tested through analysis of trend data for all ISAT scores for five years

2014 ISAT

• 100% of the test items are connected to the Common Core State Standards

• Test maps will be available soon


ISAT Online Pilot

• 15 districts have been invited to participate in online pilot– One grade level at one school within each

district

• Districts are at all levels of technology readiness


• Growth model metrics: Underlying assumptions

– Valid, reliable, and fair– Transparent– Value proficiency at the

Meets Standards level– Value changes in

achievement level of students

School A

Performance Level in Year 2

1A 1B 2A 2B 3A 3B 4A 4B

Performance

Level in Year 1

1A

1B 1

2A 1 2

2B 1 3 6 7

3A 1 3 3 2 1

3B 2 11 9 1 1

4A 4 6 4 4

4B 1 5 1 2

77.5% of Students Meet/Exceed Standards Growth Value: 94.5

School B


1A 1B 2A 2B 3A 3B 4A 4B

Performance

Level in Year 1

1A 1

1B 1 13 8 5 1

2A 4 12 16 4

2B 16 12 5 1

3A 1 2 6 3

3B 2 3 1

4A 1

4B

28% of Students Meet/Exceed Standards Growth Value: 111.2

School C


1A 1B 2A 2B 3A 3B 4A 4B


1A 1 3

1B 4 9 5 1 1

2A 8 14 17 6 1

2B 4 5 46 31 5

3A 1 18 50 16 2

3B 5 19 24 6 4

4A 3 13 7 2

4B 1 1 3 7 4

58.4% of Students Meet/Exceed Standards Growth Value: 101.5

• Each student within the school/district is placed within a cell of the table based on his or her ISAT scores over two years

• The scores of all the students within the school or district are averaged to determine a total growth value

Implementation Process

36

2,339,468 Every Student Every Day

36

Documents

Student Assessment Updates Susie Morrison, Deputy Superintendent Chief Education Officer Mary OBrian, Director of Assessment Illinois State Board of Education