1
Nebraska State Accountability Spring 2012
Online Test Administration TrainingFebruary 28-29, 2012
2
Agenda
Introductions: Your NeSA Project Team Testing Window & Other Key Dates General Guidelines Paper/Pencil Testing Procedures Reporting
3
NeSA Project TeamPatricia Johnson, Program Director
John Born, Senior Project Manager
Stacey Reasoner
Computerized Assessments and Learning Project Manager
Rachel Lappe, Project Manager
Valerie Cook, Project Manager
4
Finding the Answers to Your Questions
DRC’s NeSA Customer Service
1(866)342-6280
8:00 a.m. – 5:00 p.m. CST
7:00 a.m. – 5:00 p.m. (March 19-May 11, 2012)
5
NeSA-Reading Program to Date Standalone Field Test in 2009. Operational testing of all students in grades 3-8
and 11 since 2010; Performance Level cut scores set.
Additional field testing embedded in operational tests.
6
NeSA-Mathematics Program to Date
Standalone Field Test in 2010. Operational testing of all students in grades 3-8
and 11 since 2011; Performance Level cut scores set.
Additional field testing embedded in operational tests.
7
NeSA-Science Program to Date
Standalone Field Test in 2011. 2012 marks the first year of operational testing
of all students in grades 5, 8, and 11. Additional field test items embedded in
operational tests. Performance Level cut scores to be set this
summer.
8
2012 NeSA Training
DRC’s eDIRECT & Enrollments System Training September 27-29, 2011 https://ne.drcedirect.com Recording available on NDE website
Technology Coordinator WebEx Training November 8-10, 2011 Recording available on NDE website
9
2012 NeSA Training (con’t)
Test Administrator WebEx Training Online – February 28-29, 2012 Paper/Pencil – February 28-29, 2012 Alternate Assessment – March 1, 2012
2012 NeSA Reporting WebEx Training August 7-9, 2012
10
Testing Window
March 26- May 4, 2012
The window is the same foronline and paper/pencil
administrations, including the NeSA-Alternate Assessments.
11
2012 NeSA Key Dates
Test Administration Training February 28-March 1
CAL Management Tools Available March 5
Paper/Pencil Test Materials Delivered to Districts March 5
Online Test Session Tickets Available March 5
Districts Train School Personnel and Distribute MaterialsOne Week Priorto Test Window
Testing Window March 26-May 4
Last Day for UPS to Pick Up Test Materials from Districts May 9
Please note
12
NeSA-Reading, Mathematics, and Science– two sessions each
Flexibility during the 6-week window Make-ups required Recommend scheduling early in the window Recommend avoiding Mondays and Fridays
Scheduling the Test
13
Online version of the NeSA-Mathematics and Science tests available in Spanish.
Braille and Large Print versions of the testbooklets available for NeSA-Reading, Mathematics, and Science.
Spanish translations of NeSA-Mathematics and Science paper/pencil test booklets available.
Spanish translation versions of the NeSA-Reading test materials available from NDE.
Accommodations
14
Accommodations for Students with IEP or 504 Plans and English Language Learners must be reported in Management Tools Student Editor for online testers.
See NDE website for the Approved Accommodations Document.
http://www.education.ne.gov/Assessment/NeSA_Accommodations.htm
Accommodations
15
Procedures for online schools with some students taking the paper/pencil test
All students contained in the NSSRS file for online schools will be loaded into the NeSA online testing system and listed in Student Editor.
PreID Labels provided for NeSA-Alternate Assessment students only. Use District/School Labels and fill in answer sheets for others.
Mixed Mode Testing
16
Procedures for online schools with some students taking the paper/pencil test
Do NOT edit/change online records for students taking the paper/pencil test – complete answer sheets.
Do NOT distribute Test Session Tickets to students taking the paper/pencil test – if printed, destroy them securely.
Mixed Mode Testing
17
Prepare Students for Testing Inform students of the scheduled test sessions in
advance. Explain to the students why they are being given
the test and how the results will be used. Students should realize that doing their best is
important.
18
Prepare Testing Locations
Plan ahead – check schedules. Organize test materials. Provide a testing location with good lighting and
comfortable seating and as free of outside disturbances as possible.
Remove visual aids/clues. Post a TESTING IN PROGRESS sign.
Prepare Testing Location
19
Test Security Test is not to be viewed by anyone prior to administration. NeSA-Reading, Mathematics, and Science materials may not be reproduced. No coaching or feedback with regard to content. Move around the testing site and be aware that students are following instructions.
See test administration manual for comprehensive test security information.
Test Security
20
Test Security Restrict electronic devices (e.g., Palm Pilots, cell phones, PDAs, wristwatches with electronic displays, calculators, iPods,
MP3 players, etc.) Recommend one assistant/proctor per 12-15 students, in addition to Test Administrator. Students must not be left alone with test materials. Students cannot take test materials out of the testing site.
Test Security
21
Live Demonstration of Online Testing Software
CAL Version 6.7
22
Student Tutorials and Practice Tests are currently available. Make sure students have practiced using software and tools. Use the NeSA shortcuts on the computer desktop to access the Practice Tests and
Tutorials.
Online Tutorials and Practice Tests
Practice Tests Tutorials
23
Online Tutorials and Practice Tests
24
Online Tutorials and Practice TestsOnline Tutorials and Practice Tests
25
Online Tutorials and Practice TestsOnline Tutorials and Practice Tests
26
Online Tutorials and Practice TestsOnline Tutorials and Practice Tests
27
Online Tutorials and Practice Tests
Sample Reading Item
Online Tutorials and Practice Tests
28
Online Management Tools Data Tools- Add a Student- Student Editor
Online Management Tools
29
Online Management Tools Testing Main Page- Print Tickets
- Monitor Status
• Reactivate Tickets (same day)
• Student Status Spreadsheet
- View Results (Preliminary Individual Test Results and Group Summary) for Reading, Mathematics, and Science
- Audit Spreadsheet
Manage Testing
30
Online Testing Preparation
Primary Test Preparation Tasks
1. View/Edit student data
2. Add new students
3. Print Test Session Tickets
Online Testing Preparation
31
StudentEditor
32
View/Edit Student DataView pre-registered student data via Student Editor.
Start by searching for student records.Searches can be narrowed based on specific criteria and filters.Select how many student records to display per page.Edits made to student information during the NeSA-Writing window have not been retained.
View/Edit Student Data
33
34
35
View Student Data byDownloading the Student Data PDF
36
View and edit student data via the Student Editor tabs.
- Identification- Location- Demographic- Not Tested- Alternate Assessment- Accommodations – IEP/504 & Visual- Linguistic Support – ELL- Spanish
37
Edits made to student Identification, Location, and/or Demographic information will be reflected across all content areas.
Edits made to Not Tested, Alternate Assessment, Spanish, Accommodations, and/or Linguistic Support must be made for each content area to which they apply.
Any edits made to student data will NOT be updated in NSSRS. Notify the NDE if you find incorrect student information.
38
Identification Student ID and Name fields are taken directly from
NSSRS. NDE will review all mismatches.
Identification
39
Location District-level users can change a student’s school within
the district. School and grade are taken directly from NSSRS. NDE
will review all mismatches.
Location
40
Demographic Demographic fields are taken directly from NSSRS. NDE
will review all mismatches.
Demographics
41
Not Tested MUST select Not Tested codes by the end of the testing
window for any student in the system that does not take NeSA-Reading, Mathematics, and/or Science.
Not Tested
42
Alternate Assessment
Flag Alternate Assessment for Reading before testing. Test Session Ticket will not be printed for Alternate Assessments.
Alternate Assessment
43
Alternate Assessment or Spanish Flag Alternate Assessment for Mathematics and/or Science
before testing . Test Session Ticket will not print for Alternate Assessments.
Flag students who require a Spanish translation for Mathematics and/or Science before testing to get correct Test Session Tickets.
Alternate or Spanish Assessment
44
Accommodations – IEP/504 & Visual Flag Visual Accommodations for students before testing to
enable Visual Accommodations tools. Visual Accommodations tools are a form of Content
Presentation accommodations. Indicate other accommodations by the end of the testing
window for any student in the system that takes a test with accommodations.
Accommodations – IEP/504 & Visual
45
Linguistic Support - ELL LEP/ELL Eligible should be checked on the Demographic
tab for any students who receive Linguistic Support. Indicate Linguistic Support accommodations by the end of
the testing window for any student in the system that takes a test with accommodations.
Linguistic Support - ELL
46
Students can be added any time after Management Tools open and before the Testing Window ends (March 5- May 4).
If students are added after Test Session Tickets have been printed, tickets for individual students can be printed.
Make every effort to match new student data exactly to the data on file in NSSRS.
Add New Students via Add a Student
47
Add a Student
48
Manage Testing
Select Test Administration - 2012 NeSA-R,M,S. Functionality available:- Print Tickets- Monitor Status (and Reactivate)- View Results (NeSA-Reading, Mathematics, and
Science)- Audit Spreadsheet
49
Manage Testing
50
Print Test Session Tickets
Available Monday, March 5. Print tickets for both Test Sessions. Print tickets for all three subjects. Tickets are secure test materials. Recommend printing tickets one week prior to
initial test session.
Print Test Session Tickets
51
Print Test Session Tickets
Tickets can be printed by subject/grade or for individual students.
- Tickets will print for students at online schools who are taking the paper/pencil version of the test unless otherwise specified (either exclude from printing or destroy tickets after printing).
- No tickets will be printed for students flagged Alternate Assessment in Student Editor.
Print Test Session Tickets
52
Print Test Session TicketsPrint Test Session Tickets
53
Print Test Session TicketsPrint Test Session Tickets
54
Print Test Session Tickets Prints 12 tickets per page. Ticket Packet includes: Administration Information, Summary,
Tickets for Session 1 and Session 2.
Example of Standard Session Ticket
Print Test Session Tickets
55
Print Test Session Tickets Visual Accommodations and/or Spanish translation will be noted on Test Session
Tickets printed for students flagged with these accommodations. Make sure students’ computers comply with extra system requirements for Visual
Accommodations tools.
Examples of Visual Accommodations and Spanish Translation Test Session Tickets
Print Test Session Tickets
56
Test Session Tickets
Test Session Tickets
57
Monitor Status of Test Sessions. View/Print Student Status Spreadsheet. Reactivate Test Session Tickets. Review Audit Spreadsheet. View Results.
Primary Test Administration Activities
58
Monitor StatusMonitor Status
59
Monitor Status
Monitor Test Sessions- Color coded testing status icons.- Test Sessions may be taken out of
order. View/Print Student Status Spreadsheet- Excel-compatible format of status screen.- Status, test duration, start times, and end
times by test session for each student.
Monitor Status
60
Monitor StatusMonitor Status
61
Reactivation Test Session Tickets (login passwords) are only active for 90
minutes after a student logs into test. Tests are not timed and students will never be forced out of a
test. Pause functionality (15 minutes). Inactivity of 15 minutes during testing will cause the system
to log student out of test. Internet connectivity issues and unexpected interruptions can
happen (fire drill, emergency, computer freezes up, power outage).
Reactivation
62
Reactivation
Reactivation of ticket will be required if it has been more than 90 minutes since login.
Same day only. Reactivations will expire at the end of day. District Assessment Contacts may email NDE at
[email protected] with any questions about reactivation procedures.
Reactivation
63
ReactivationReactivation
64
Reactivation
Same day reactivation only
Reactivation
65
View ResultsView Results
66
View Results Preliminary individual student test results and group
summary information for NeSA-Reading, Mathematics, and Science.
Students must complete both sessions. Student Test Results – Raw Scores and Percent
Correct (embedded field test items excluded). Students testing paper/pencil and/or taking the
Alternate Assessment are not included in Group Summary information.
View Results
67
View ResultsView Results
68
View Results
69
Audit SpreadsheetAudit Spreadsheet
70
Audit Spreadsheet
Use this report to verify that all students in your district, school, or grade have tested.
The Audit Spreadsheet is updated nightly.
Audit Spreadsheet
71
Online Testing: Wrap-Up Disposal of Test Session Tickets- Tickets are secure materials and must be distributed and
collected as such.- School Test Coordinator to collect and destroy. Online Manual for Test Coordinators and Administrators- Posted on NDE website, eDIRECT Documents, and
Documentation on CAL’s NeSA Main Page.- Provides information for test preparation and administration
directions for testing day.- Includes Directions for Administering the 2012 NeSA-Reading,
Mathematics, and Science Tests.
72
Contrasting GroupsStandard Setting Survey
Survey for NeSA-Science will be conductedMarch 7-23 via eDIRECT.
All Nebraska science teachers are eligible. Participants should attend 1 of 6 short WebEx
training sessions March 7-13.
Contrasting Groups Standard Setting Survey
73
Bookmark Standard Setting
Standard Setting for NeSA-Science will be conducted June 26 in Lincoln.
Panelists will be selected from the nominated pool so that the state is fully represented.
Bookmark Standard Setting
74
Reporting
Spring 2012 NeSA-Reading, Mathematics, and Science results will be reported in August pending establishment of Science Performance Level cut scores.
2012 NeSA-Reading, Mathematics, and Science Reporting Workshops will be conducted via WebEx August 7-9, 2012.
Reporting
75
2012 Reading, Mathematics, and Science ReportsImmediate Results for Online Testing via Management Tools
Test Results (Number & percent correct for students tested online) Group Summary
Reports Posted to eDIRECT in August Student Data Files Performance Level Summary (State, District, School) Reading and Mathematics Indicator Summaries (State, District, School) NEW! Science Grade Level Standard Summary (State, District, School) District Report of School Performance School Student Roster Individual Student Report also available online
Printed Reports Delivered in August Individual Student Report – 2 copies
76
Questions & Answers