Measured Progress ©2011

DEVELOPMENT OF COMPUTER-BASED TESTING ACCOMMODATIONS FOR

STUDENTS WITH VISUAL DISABILITIES

JUNE 27, 2012MINNEAPOLIS, MN

• Goal: Creation of a fully functional computer based testing platform that supports refreshable braille interoperability

• Measured Progress: Development of product, enhancement, alpha and beta testing

• ETS: pilot and field testing

Project Overview

Measured Progress ©2011

Development• Key Steps

1.Creating code that allows the testing platform to communicate directly with commonly used electronic braille displays

2.Expanding meta-tag system to include braille representations of test content

• Capabilities: Focused on enhancing the NimbleTools platform to deliver the following testing accommodations: key-stroke navigation, refreshable braille output, braille keyboard input of responses, screen magnification, and audio output.

Measured Progress ©2011

• NimbleTools computer delivery system

• Freedom Scientific Focus 40 Blue

• 8th Grade level Reading passages and items from the National Accessible Reading Assessment Projects (NARAP)

Content and instruments

Measured Progress ©2011

Measured Progress ©2011

Measured Progress ©2011

Conducted in Massachusetts in December 2011 with 6 students

• Recommendations

• Improving formatting and layout

• Creating an orientation to familiarize students with the system

• Improving read aloud tool

• Easier navigation of system

Alpha Test

Measured Progress ©2011

• Positive Feedback

• Navigating passage was easy

• Responding to test items on the braille display was unique and more effective than usual response method

• Answer Verification was helpful

Alpha Test II

Measured Progress ©2011

Conducted at the Washington School for the Blind in March with 8 students

• Feedback

• Orientation file was effective in helping familiarize users with system

• New Shortcuts made navigation simple

• Read Aloud tool used a clear voice and changing speeds wasn’t difficult

Beta Test

Measured Progress ©2011

• On the orientation: “I don’t think it was too much. Nice having list at end with all the commands. The orientation was good to help understand it.”

• On answer input: “(Answering was) Not difficult at all. It was nice, just being able to put in an answer.”

• On the read aloud quality and its value: “I liked the voice, it compares well to (MAC) voice over. I would use just the speech (on a test) because I can’t read as fast as that with braille.”

• On the overall system: “Its set up really well. I wouldn’t change much.”

• “Its set up really well. I wouldn’t change much.”

Beta Test II

Measured Progress ©2011

• Measured Progress is in the process of a 3 month development and content production process right now in preparation for future testing

• Fall 2012 ETS will conduct pilot test with 20 students

• Spring 2013 ETS will conduct field test with 100 students

Moving Forward