Spring 2010 Mathematics and English II Item Tryout: The Next Generation of

Assessments

2010 Accountability Conference

Greensboro, North Carolina

February 18, 2010

Michael Gallagher

Jim Kroening

Amy Callipare

Randy Craven 1

Purpose of the Item Tryout

• Framework for Change: The Next Generation of Assessments and Accountability (June, 2008)

• A new generation of assessments based on new essential standards

• Online assessments consisting of innovative item types

• Provide data to support additional research, analyses, and development

2

Math Item Tryout

• Math item tryout in Spring 2010 will be administered at a sample of schools and grades

• Item tryout will be linked to the new Mathematics Essential Standards adopted by the State Board of Education (SBE) in September 2009

• Grades 4, 7, and Level A will be included

3

Math Item Tryout (continued)

• Two forms will be administered

• Each form will be administered in both online and paper/pencil formats

• The target is approximately 2,000 students for each of the four possibilities

• The tryout forms will be fairly short and include several constructed response questions and several fill-ins in addition to M/C

4

Math Item Tryout (continued)

• Grade 4: 35 M/C, 3 CR, and 3 FI

• Grade 7: 32 M/C, 3 CR, and 3 FI

• Level A: 41 M/C, 3 CR, and 3 FI

• “Stand alone” field tests are planned for school year 2010-2011

• Item tryout and field test results are not used for accountability at any level (state, LEA, school, or individual student)

5

Math Item Tryout (continued)

• Encourage students to do their best but not to worry if they see a problem linked to a new objective which is unfamiliar

• Item tryout will provide information and experience to prepare for operational tests

• The first operational year for the next generation math tests is currently scheduled for school year 2011-2012

6

English II Item Tryout

• Students in sample currently enrolled in English II

• Items aligned to the English II Essential Standards adopted by the SBE in September 2009

• English II Assessment specifically designed as an online assessment – no paper/pencil mode available

• Consists of a variety of innovative items types types

7

English II Item Tryout (continued)

• Two forms will be administered involving approximately 8,000 students

• Testing window for English II and Math April 12 - 23, 2010

• “Stand alone” field tests planned for school year 2010 - 2011

• First statewide operational assessment scheduled for school year 2011 – 2012, replacing the current English I Test and Grade 10 Writing Assessment

8

New Online Test System

• NCTest (v2)

• Developed with Google Web Toolkit (GWT)

• Test Simulation available soon

• Test Simulation to show new item types

• Test Simulation Types:- English II

- Math

9

10

11

12

Online Test Registration/Setup

• TOPS will auto-register students in sampled schools by pushing data supplied by Accountability IT into NCRegistration

• LEA TCs will need to schedule sessions in NCRegistration

• Session scheduling will work more like the Writing Instruction System On-Demand (start time and end time set by district/school) – No start time windows

13

Item Tryout Online Layout

• Test Administrators login to NCTest (v2)

• Test Administrators choose student for computer workstation from list

• Student Start Page

• Controls Review Page

• Test Questions

• Student Survey (at the end of the test)

14

Item Types Review

• Standard Multiple Choice• Stimulus Multiple Choice• Stimulus Excerpt Multiple Choice• Standard Constructed Response• Stimulus Constructed Response• Stimulus Ranking or Choice• Text Identify• Thesis Choice• Presentation Plan• Formula Fill In• Others, TBD

15

Contact Information

• Michael Gallagher Mgallagher@dpi.state.nc.us

• Jim Kroening Jkroening@dpi.state.nc.us

• Amy Callipare ACallipare@dpi.state.nc.us

• Randy Craven Randy_Craven@ncsu.edu

16