Embed Size (px)
Citation preview
2011-2012
Winter
Algebra 1
End-of-Course (EOC)TRAINING MATERIALS
Computer-Based Test (CBT) or Paper-Based Test (PBT)
2
The slides that relate to computer-based testing only will be abbreviated as CBT.
The slides that relate to the administration of paper-based test (regular print or Braille), contain an icon of a pencil and a test to indicate that the information pertains to paper-based testing only.
*Note that large print paper-based tests are no longer available.
CBT: Readiness Activities
• Complete Computer-Based Assessment Certification Tool at https://app1.fldoe.org/CBT/CertificationTool/.
• The instructions are posted to www.FLAssessments.com/CertificationGuide.
• Complete school-wide Infrastructure Trial: November 14-21, 2011 (refer to Weekly Briefing #10940).
• All schools that will participate in the Algebra 1 EOC computer-based assessment must complete the survey in the tool and the infrastructure trial.
3
CBT Web-ex Training Sessions
• Recorded sessions available for the Winter EOC CBT WebEx trainings at www.FLAssessments.com/Training.
• Technology Coordinator Training– Wednesday, November 16, 10:00 am EST (For
districts testing in December)
• District/School Assessment Coordinator Training– Thursday, November 17, 1:00 pm EST (For districts
testing in December)
• Please refer to Weekly Briefing #10940.
4
Glossary of Terms
• PearsonAccess – www.pearsonaccess.com/fl A website used for almost all test preparation (e.g., PreID),
setup, administration, and reporting tasks. Correct test administration must be selected each time you log
in. Requires a username and password. Links to support materials:
www.FLAssessments.com/WinterEOC www.FLAssessments.com/AdditionalResources
PearsonAccess will timeout after 14 minutes of inactivity.
5
Glossary of Terms
• PearsonAccess Training Center Accessed from the Training Center tab on PearsonAccess
Home page. Provides an opportunity to
Practice PearsonAccess tasks Manage the Infrastructure Trial in preparation for testing
Requires a username and password.
6
School User Accounts
• School user accounts are required to access the Pearson site for FCAT / FCAT 2.0 / EOC testing. School Administrator (principal): can view
score reports when test results are posted. CBT Coordinator (school assessment
coordinator): can complete all activities related to the setup and administration of computer-based testing.
CBT Test Administrator (test administrator): can only view students testing and can resume tests for students if they exit the test. 7
School User Accounts
• School assessment coordinators may set up CBT Test Administrator accounts in one of two ways: Individual accounts for each test administrator
− Test administrator will set up unique password. Generic accounts linked to the school
assessment coordinator− The password will be the same for all test
administrators.− These accounts can be randomly assigned.
• Test administrators may monitor and resume students with a school user account.
8
Glossary of Terms
• Proctor Caching is a process of loading or “caching” test content locally on a computer at the school level. Does not require a separate caching server and can run on
any workstation on the network that meets minimum requirements.
Proctor Caching software is provided by Pearson. Reduces test delays due to network congestion. Provides students with a more seamless testing experience. Required for all FCAT/FCAT 2.0/EOC computer-based
testing in Florida.
9
Glossary of Terms
• TestNav 6.9 (TestNav) Platform for Florida’s high-stakes computer-based
statewide assessments. Software application installed either on a file server or
on each computer that will be used for testing.
10
Note: This is the URL used for operational testing; it is different from the URL used for the Infrastructure Trial.
Glossary of Terms
• TestHear Platform used to deliver accommodated forms (e.g., large print, zoom,
color contrast, screen reader, assistive devices) for Florida’s high-stakes computer-based statewide assessments.
Software application installed on each computer that will be used to test students who require computer-based accommodations. NOTE: FLDOE will notify districts when the updated TestHear software is ready (available 11/18).
TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows.
11
• ePAT Electronic Practice Assessment Tool Provides students an opportunity to practice using the computer-based platform
prior to testing. Available for download at www.FLAssessments.com/ePATs. Download ePAT launcher separately from test content. Accommodated ePATs are also available. Launcher is bundled with the practice
test content for accommodated forms. Scripts and instructions for downloading ePATs are under the Resources tab.
12
Glossary of Terms
Winter 2011-2012 EOCTest Administration
Schedule
*Paper-based test administration must be completed within the first 5 days of the testing window.
**Any student not finished by the end of the allotted time may continue working; however, testing must be completed within the same school day.
For security purposes, testing at a school should be completed within one week; however, up to two consecutive weeks will be allowed to accommodate computer-based testing needs.
Any deviation from this schedule requires written approval from the FDOE prior to implementation.
13
• Students are now required to sign/agree to a pledge that states that they will not “give or receive unauthorized help” and they acknowledge that such help is cheating.
• In addition to the Florida EOC Administration and Security Agreement, test administrators are now required to sign a Test Administrator Prohibited Activities Agreement indicating that they understand prohibited activities during test administration and possible consequences of inappropriate behavior.
• Test administrators must maintain an accurate seating chart for each group of students testing in the same room.
• Accommodated computer-based test forms (large print, color contrast, zoom, screen reader, assistive devices) will be accessed using TestHear software.
• Districts must make arrangements to test Florida Virtual School (FLVS) Full-Time public school students, as well as other virtual program students, per Section 1002.45(6)b, Florida Statutes (F.S.).
14
What’s New for Winter EOC
• The following students will participate in the Winter 2011-2012 Algebra 1 EOC Assessment administration: All students who will complete one of the following courses at
the end of semester 1, or who have completed one of the following courses since the Spring 2011 administration:o Algebra 1 – 1200310o Algebra 1 Honors – 1200320o Algebra 1-B – 1200380o Pre-AICE Mathematics 1 – 1209810o IB Middle Years Program/Algebra 1 Honors –
1200390
15
Students to be Tested
16
Students may be Tested
• The following students are also eligible to participate in the Winter 2011-2012 Algebra 1 EOC Assessment administration: Students who entered 9th grade and completed
Algebra 1 course work in the 2010-11 school year but have not yet taken the assessment to be averaged as 30% of their course grade
Students who entered 9th grade and participated in the Algebra 1 EOC Assessment in the 2010-11 school year who are in “grade forgiveness programs” and wish to improve their course grade
Students in a credit acceleration program (CAP) who wish to take the assessment to earn course credit
• Students who receive part-time instruction from a virtual program and are enrolled in a brick-and-mortar district public school should be coded with the district/school numbers for their organization of enrollment to ensure they are reported to the correct schools. These students should not be confused with full-time
virtual program students. • Private school students who receive part-time instruction
from a virtual program do NOT participate in statewide assessments unless they are part of a school choice scholarship program, such as the McKay Scholarship Program.
17
Virtual School Program Students
Students enrolled full-time in one of the following virtual school programs and who meet the requirements for students to be tested for this administration will need to be accommodated for testing in the district in which they reside.
18
Virtual School Program Students
Virtual Program/School District/School Number
State Level
FLVS Full-Time 71/0300 (Middle School) or 71/0400 (High School)
Florida Virtual Academy 50/7079
District Level
District Virtual Instruction Program (VIP):Miami-Dade Online Academy (M-DOA)
District Number/7001 or 702313/7001
• Joan Cortez will be setting up these students in computer-based sessions for schools that will be expected to test M-DOA students.
See Winter EOC Manual, Appendix A for more information about students to be tested, including:
•English Language Learners (ELL), pp. 149-154
•Students with Disabilities (ESE), pp. 154-155
•TestHear Accommodated CBT Forms, pp. 156-165
19
Other Students to be Tested
Accommodations Index• Appendix A of the Winter EOC manual has been expanded to include paper-
based and TestHear accommodations. See the index below.
20
General Information
Test Accommodations Page 148
Computer-Based Accommodations for Students With Disabilities Pages 149-150
Paper-Based Accommodations for Students With Disabilities Page 150
Administration Accommodations for Students With Disabilities Pages 151-154
Unique Accommodations Page 154
Administration Accommodations for English Language Learners (ELLs) Pages 154-155
TestHear (Accommodated CBT Forms)
TestHear Functionality Pages 156-165
Script for Administering the Accommodated Practice Test (TestHear ePAT) for Algebra 1 Pages 166-175
Script for Administering Accommodated Computer-Based Algebra 1 EOC Pages 176-187
Regular Print Paper-Based Accommodation
Script for Administering the Paper-Based Algebra 1 EOC Assessment Pages 188-196
Script for Gridding a Non-Preidentified Student Grid Sheet Pages 197-198
Script for Verifying a Preidentified Label Pages 199-200
Special Documents (Braille Only)
Special Documents Test Administration Page 201
Special Documents Test Administrator Responsibilities Before and During Testing Pages 202-204
ESE Accommodations• Must be documented on the student IEP or Section 504
plans• Administration Accommodations
Flexible Presentation Flexible Responding Flexible Setting Flexible Scheduling
• Paper-based Accommodations* Regular Print Braille
• Computer-based Accommodations Large Print Color Contrast Zoom Screen Reader Assistive Devices
* Note: Large print (LP) and one-item-per page (OIPP) will be provided in computer-based test format only. 21
Test Accommodations Field in ISIS • Verify that all students requiring special test materials have
the proper test accommodation documented in ISIS (Weekly Briefing #10296).
• Test accommodations codes: C - Contracted Braille U - Uncontracted Braille L - Large Print O - One item per page P - Paper format test booklet instead of CBT G - Large Print, Paper or CBT R – Reading Passage booklet for CBT only A- “Accommodated” CBT test form Q - Unique accommodation, other
Note: Paper-based large print forms will NOT be available for CBT administrations. Students with this accommodation will be scheduled for an accommodated CBT test form in TestHear.
22
CBT: Accommodations Codes
The following codes should be used by test administrators to record accommodations actually used by each student during the test administration. This information is later recorded in PearsonAccess by the school assessment coordinator.
• For ESE/504 students: 1-FP = Flexible Presentation 1-FR = Flexible Responding 1-FSC = Flexible Scheduling 1-FSE = Flexible Setting 1-AD = Assistive Devices
• For ELL students: 2-FSC = Flexible Scheduling 2-FSE = Flexible Setting 2-AHL = Assistance in Heritage Language 2-ADI = Approved Dictionary
23
Test Administration and Security Procedures
• State and District Requirements Standards, Guidelines, and
Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp
– Adopted by School Board
– General Guidelines Florida Test Security Statute
and Rule School Procedural Checklist District Monitors 24
Florida Statute and State Board Education Rule
• Prohibited Activities Reading the passages, test items, or performance tasks. Revealing the passages, test items, or performance tasks. Copying the passages, test items, or performance tasks. Explaining or reading test items or passages for students. Changing or otherwise interfering with student responses
to test items. Causing achievement of schools to be inaccurately
measured or reported. Copying or reading student responses.
25
Test Security Policy and Procedures
• Prohibited Activities Allowing students to handle secure materials
before or after test administration. Leaving secure materials unattended. Leaving secure materials in classrooms or
taking them out of the building overnight. Administering the test to family members.
26
Electronic Devices
• Prohibited Activities Possession of any electronic device that
reproduces, transmits, calculates, or records IS cause for invalidation.
‾ “Possession” is defined as “within arm’s reach,” even if the electronic device is not visible.
‾ Students should not have cell phones in their pockets, clipped to their belts, at their desks, or anywhere they can be easily accessed during testing.
Test administrators and proctors should also turn-off their electronic devices during testing. 27
General Security Guidelines
Do• Provide secure storage• Restrict access – 3 or fewer keys• Handle secure materials,
including affixing of labels in a limited-access area
• Secure visual barriers on computer workstations
• Maintain documentation– Chain of custody– Book assignment to
students• Train test administrators
and proctors• Monitor students during
lunch break or extended breaks
28
Do Not• Allow
unauthorized access to materials or content
• Open secure materials prior to date allowed
• Allow untrained or uncertified staff to test students
• Coach or provide assistance during test administration
• View, review, copy, or debrief test content
Missing Materials and Test Irregularities/Security Breaches
• Test administrators should report any test irregularities (e.g., disruptive students, loss of Internet connectivity) and possible security breaches to the school assessment coordinator immediately.
• The school assessment coordinator must contact the district assessment coordinator to report a test irregularity or security breach and/or report any missing materials including the following as applicable:
Test and answer books Student Authorization Tickets Session Rosters Work folders Reference sheets 29
Reporting Irregularities
30
Reporting Irregularities
• School personnel must be prepared to provide documentation and information in support of subsequent investigations of an incident.
Testing conditions and test security protocol Testing location of students, including a list
of students who tested at the same location and their seating assignment
Academic history of students Resolution of the incident Steps implemented to avoid future losses or
security breaches 31
Caveon Data Forensics
• The FDOE has contracted with Caveon Test Security to provide its Caveon Data Forensics™ for all statewide assessments.
• Caveon will analyze data to identify highly unusual test results for two primary groups: Students with extremely similar test
responses; and Schools with improbable levels of similarity,
gains and/or erasures.• Flagging only the most extreme results
32
Communicate Testing Policies to Students and Parents
Prior to testing, make sure students understand the following policies:•Electronic Devices Policy: If students are found with ANY electronic device during testing, their tests will be invalidated. Define electronic devices for students and ensure they are aware they cannot access their devices until testing is completely finished.•Leaving Campus: If students leave campus before completing the test (for lunch, an appointment, illness, etc.), they WILL NOT be allowed to complete the test.•NEW! Student Pledge: Students will be asked to agree to a pledge stating that they will not give or receive unauthorized help during the test. If students are caught cheating or irregular answer patterns are detected during scoring, their tests will be invalidated.
33
Receive Test Materials
• The first school box is a white box with a red stripe.
• Work folders and reference sheets were shipped with the Winter EOC Manuals.
• Inventory the contents of your boxes within 24 hours of receipt and report any missing materials immediately.
• Proper documentation must be kept at all time to account for all test materials.
• See pp. 45-46 of the Winter EOC Manual for a list of materials included in school boxes and special document boxes.
34
Test Scripts
Method of Delivery
ScenarioUse scripts on
pages
Computer
Students will test using regular CBT forms via TestNav (may require administration accommodations, such as flexible scheduling, flexible setting, etc.)
EOC Manual: pp. 33-42
Students will test using accommodated CBT forms via TestHear (e.g., zoom, large print, color contrast, screen reader, assistive devices)
EOC Manual: pp. 176-187
Paper
Students will test using regular print paper-based materials (provided as accommodations only)
EOC Manual: pp. 188-196
Students require Braille test materials as an accommodation
Braille Scripts and NotesEOC Manual: pp. 201-204
35
Train Test Administrators and Proctors
• ALL personnel involved in the Winter 2011-12 Algebra 1 EOC test administration must receive training prior to the Winter EOC administration and sign the Florida EOC Test Administration and Security Agreement.
• NEW! Test administrators must also sign the Test Administrator Prohibited Activities Agreement indicating that they understand prohibited activities during test administration and possible consequences of inappropriate behavior.– Please review Appendix B: Florida Test Security Statute
and Rule and Test Security Policies and Procedures.– All signed forms must be retained at the school site for 1 year
following the release of results.
• Only instructional certified personnel may serve as test administrators.
• Instructional certified personnel AND support staff may serve as proctors.
36
Proctors
*It is recommended that a proctor be assigned to a room with 25 or fewer students whenever possible.
*It is recommended that a proctor be assigned to a room with 25 or fewer students whenever possible.
When testing a large group of students, proctors MUST be assigned to the room to assist the test administrator.
37
1-25 students Test Administrator*
26-50 studentsTest Administrator and
1 Proctor
51-75 studentsTest Administrator and
2 Proctors
Florida EOC Test Administration and Security Agreement Form and Test Administrator
Prohibited Activities Agreement Form
38
Supervise Test Administration
• Test administrators MAY NOT: Talk with students about test items Help students with their answers Provide students with any information that would allow
them to infer the correct answer Discuss test items or answers with students even after
testing has been completed CBT only: Have any desktop-viewing programs or similar
software that would enable a test administrator to view test items and student responses
Refer to the Test Administrator Prohibited Activities Agreement for a list of activities that are prohibited before, during, and after testing.
39
CBT: Provide Instructions• Test administrators are instructed to contact you in the
following circumstances: A student has not participated in a practice test session.
A student has trouble logging in the first time.
A student cannot see the shading on the Test Group Code screen.
A test administrator does not have a Student Authorization Ticket for a student.
A Student Name or Student ID is not correct (e.g., misspelled) on the Student Authorization Ticket.
A student is in the wrong test or the wrong accommodated form.
A student refuses to agree to the student pledge.
A test administrator is concerned that a student is unable (e.g., too ill) to finish the test.
A student Exits the test to finish later and logs out of the test session.
A student has not completed the test at the end of the allotted time and will need additional time to continue working.
Provide instructions for test administrators to handle these circumstances.
40
CBT: Materials Needed
• Testing materials needed: Student Authorization Tickets Pen/pencil Session Roster Florida Computer-Based Testing Work
Folders Reference Sheets Calculators, optional
41
CBT: Student Authorization Tickets
For computer-based testing:
• Student Authorization Tickets (secure materials)
Session/Test/Location Student Name/Date of Birth/Student ID (partial) Student Signature Line URL/Login ID/Test Code (password)
• Students need a pencil or pen to sign their tickets.• The Last Name, First Name, and ID number must be correct
for the student to use the ticket. • The ID number will show the last five digits of the Florida Student
Number OR the last four digits of the Social Security Number and an X.
• If the Date of Birth is the only incorrect field, the student may use the ticket and the birthdate can be updated after testing by the school assessment coordinator.
42
Samples Of Printed Student Authorization Tickets
Detail View/Single TicketDetail View/Single Ticket
List View/3 TicketsList View/3 Tickets
Grid View/6 TicketsGrid View/6 Tickets
43
CBT: Session Roster
• Session Roster can be used to record or verify most of the required administration information.
• Use the Form/Form Group Type field to confirm the correct form has been assigned to each student.
44
• Florida Computer-Based Testing Work Folders A piece of yellow 11x17 paper folded in
half that students use to work Mathematics problems.
oNEW! The last page of the folder (back cover) is printed with graph paper.
Used work folders are secure materials.
45
CBT: Work Folders
Test Code & Test Group Code
Test Code Test Group CodeA six-digit code created by PearsonAccess and printed on Student Authorization Tickets and Session Rosters. The Login ID and the test code are required to log in to TestNav.
A unique four-digit number used to identify groups of students tested together, which is created by school assessment coordinators. This is entered after the Welcome screen in TestNav and before students see the first question.
46
• Reference Sheets The computer-based Algebra 1 EOC has a pop-up window that
includes the Algebra 1 End-of-Course and Geometry End-of-Course Assessments Reference Sheet.
Schools are provided paper copies of reference sheets for paper-based and computer-based testers. These are packaged as stand-alone pages and shipped with test materials.
47
CBT: Reference Sheets
CBT: Calculators
• The four-function calculators formerly referred to as “FCAT calculators,” are now called “approved four-function calculators”.
• Computer-based Mathematics tests have a built-in, four-function calculator (TI-108).
• Students may request to use a hand-held FCAT calculator instead of the online TI-108 calculator after participating in a CBT practice test.
48
PBT: Materials Needed for Testing
• Test Documents Winter Algebra 1 EOC Assessment Next
Generation Sunshine State Standards Test and Answer Book
Reference Sheets – packaged as stand-alone pages and shipped with test materials
Calculators
• Pre-populated Administration Record/Security Checklists available in PearsonAccess.
49
CBT: Practice Test (ePAT)• ALL students MUST complete an ePAT to learn how to use the
computer-based system. Even students who participated in a previous computer-based test
MUST complete the appropriate ePAT(s) prior to this administration.
Students who will take an accommodated computer-based forms must take the corresponding TestHear ePAT.
• Ensure that the following items have been downloaded to each computer that will be used for a practice test (Winter EOC Manual, pp. 94-96). For TestNav: the ePAT Launcher and appropriate test content
(Algebra 1 EOC). For TestHear: the accommodated ePAT, which includes the launcher
and the test content.• ePAT scripts provided in the Winter EOC Manual and under the
Resources tab at www.FLAssessments.com/ePATs. • Recommend completing at least two weeks prior to administration.50
CBT: Practice Test (ePAT)
• About the ePAT Familiarizes students with
Item typesReference SheetOnline toolsProcess of responding to items on the computer
Practice test items are not intended to replicate the difficulty of the items on the test.
Work Folders will not be provided for practice tests.Instruct students to bring their own scratch paper and
pencils/pens.
51
CBT: TestNav Online Tools
Tool Name Icon
Pointer
Eliminate Choice
Highlighter Tool
Eraser Tool
Help Tool
Calculator Tool
Straightedge Tool
Exhibit Tool
52
TestHear provides the same tools with slightly different icons. See Appendix A for more information about TestHear functionality and tools.
CBT: TestHear ePATs
• Students are required to participate in a practice test using the ePAT with the same accommodations that will be provided to them on the operational assessment.
• The accommodated ePATs must be downloaded and installed on the computer workstation that will be used for the practice test.
• TestHear will only operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS 10.4 or on Macs that cannot also run Windows.
• Instructions for installing and running TestHear ePATs are provided in the Winter EOC Manual (pp. 95-96).53
PearsonAccess: Managing Student Information
• Manage Student Information PreID file generated on November 11 captured student
demographic information and was uploaded to PearsonAccess.
Student enrollment changes after November 11 must be manually entered and/or updated into PearsonAccess.
−School users may add students using the Create New Student wizard.
• Ensure Correct Test Administration is Assigned When assigning students to the Winter EOC test through
the New Student Wizard, ensure students are assigned the December form. If the wrong form is assigned, the student will not be able to test.
54
PearsonAccess
Filters and Search Fields in PearsonAccess• Any column with this button can be filtered.
To filter data, click the symbol and enter the filter criteria.
The column will be filtered according to the search term.
• Clicking on the column heading also allows you to sort the data in descending or ascending order. Once the data is sorted, an up or down arrow appears after the column heading.
55
PearsonAccess: Session Roster
• Access Session Roster Test sessions must be created in PearsonAccess Students must be assigned to a test session. (You
may move all students in “FL CLASS” to the test session.) Test sessions can be modified at any time.
Session rosters are created in PearsonAccess for each test session.
• Session Roster is used to verify the accuracy of Student Name and Student ID number.
56
CBT: Verify Student Data in PearsonAccess
View and Verify Student Data
The Last Name, First Name, and ID number must be correct in PearsonAccess.
• Confirm all students are in test sessions (p. 52).
• View and verify student data (p. 53).
57
PearsonAccess: Test Sessions
• Two ways of organizing test sessionsA. By Test Group – only includes students in a particular
group (e.g., class, testing room) who will be testing togetherAdvantage: PearsonAccess can be used to manage the testing groups, and session rosters will include only one group of students testing together. PearsonAccess can also be used to distinguish between students taking regular computer-based form (Main) and the accommodated forms.Disadvantage: will require setup and management of more sessions
B. By Test Day – includes all students in a school to be tested in a subject on a particular dayAdvantage: greater security because a session can be started and stopped on the same dayDisadvantage: requires coordination of testing groups at the school
58
CBT: Create a New Test Session
1. Log in to PearsonAccess, select Winter 2011-12 Algebra 1 EOC administration.
2. Go to Test Management>Manage Test Sessions.
3. Click New Session to go to the New Test Sessions screen.
59
4. Enter the session details: Session Name (50-character limit) School Test to be Administered (December Algebra 1) Default Form Group Type (Main or appropriate
accommodated form) Scheduled Start Date (used for planning purposes – a test
session will not start until you click START on the Session Details screen)
CBT: Create a New Test Session
60
5. Add students to test sessions by:• Class (View By: Classes) (FL CLASS)• Individual Student (View By: Students)
6. Select the check box for each class or student to be added to a session.
7. Click Save.8. Return to the newly created test session or to the
Manage Test Sessions screen.9. Maintain a list of all test sessions. Ensure technology
coordinator cached test content for all sessions and Proctor Caching is running for sessions prior to the first day of testing.
CBT: Create a New Test Session
61
CBT: Assigning Accommodated Forms
Creating an Accommodated Test Session (instructions in the Winter EOC Manual): •If your school will set up test sessions by test group, all students requiring accommodated computer-based test forms (including assistive devices) will need to be in a separate session and in a separate testing room from students who are using non-accommodated CBT forms. (Separate sessions/rooms are required because the students require different scripts.)•If your school will set up test sessions by test day or by test administration, it is not necessary to create a separate session for students who require accommodated CBT forms. Follow the instructions for assigning an accommodated form for each student.
62
CBT: Assigning Accommodated Forms
Assigning an Accommodated Form (instructions in the Winter EOC Manual pg 64) Click “Specify” or “Override” on the Session Details screen to assign a specific form to a student.
63
Form Name in PearsonAccess
Accommodations Offered
Lrg Prt Large PrintZoom ZoomCol Con Color ContrastScr Rdr Screen ReaderLrg Prt + Col Con Large Print and Color ContrastLrg Prt + Scr Rdr Large Print and Screen ReaderLrg Prt + Col Con + Scr Rdr Large Print, Color Contrast, and Screen
ReaderZoom + Col Con Zoom and Color ContrastZoom + Scr Rdr Zoom and Screen ReaderZoom + Col Con + Scr Rdr Zoom, Color Contrast, and Screen
ReaderCol Con + Scr Rdr Color Contrast and Screen ReaderAssistive Devices Assistive Devices
CBT: Scenario/Action RequiredScenario Action Required
Student Name or Student ID Number is incorrect
See Delete a Student (p. 54) then Add a Student (pp. 55-57).
Other student information is incorrect besides Student Name or Student ID
See Manage Other Student Information (pp. 62-63) and Update Student Information (pp. 77-78).
Error in Student Name after first 11 characters of the first name or after the first 12 characters of the last name
Use the incorrect profile for testing, then update the fields after testing.
Student not included in PreID upload, student is new to school, or student transfers from another school or district
See Add a Student (pp. 55-57). (For a student transfer, do not attempt to change the student’s enrollment in PearsonAccess.)
New test needs to be added or changed for an existing student, or incorrect test format is assigned (e.g., changing paper to online)
See To change the tests assigned to a student (pp. 62-63). (Note: changing a test to paper in PearsonAccess will not automatically order materials or print a PreID label.)
Student not participating in the administration
Remove from any test sessions. No further action required.
64
PBT: Student Demographic Information
• PreID file generated on November 11 captured student demographic information for the PreID student labels.
• Student grid sheet captures student demographic information.
• Blank student grid sheets (non-preidentified) must be gridded using a No. 2 pencil. Only school personnel may grid the following: Primary
Exceptionality, Section 504, ESE/504 Accommodation Types, ELL Accommodation Types, and ELL
School personnel or students may grid the following: Student Name, District/School Number, Social Security Number or Florida Student Number, Date of Birth, Student Grade Level, Gender, Ethnicity, and Race
Incomplete grid sheets will result in delayed score reporting for those students 65
PBT: Sample Student Grid Sheet
66
Sample Preidentified (PreID) Student Label
• Four elements must be correct on PreID labels: student name, student ID number, district number, and school number.
• If the student name, ID number, district number, OR school number is INCORRECT on a label, a replacement non-preidentified test and answer book MUST be gridded.
67
PBT: Student Information Box
68
On the back of the paper-based test and answer book, complete the Student Information Box to indicate whether the student is taking the Algebra 1 EOC Assessment for the first time and whether the student is currently enrolled in, was previously enrolled in, or has never been enrolled in one of the courses in the Course List box.
PBT: Security Numbers
• Used to account for each test and answer book• Consists of a nine-digit number followed by a check
digit• Packing list will indicate the number ranges assigned
to each school, and written documentation of the number ranges must be maintained at all times during distribution and return of books.
• Pre-populated Administration Record/Security Checklists are provided in PearsonAccess.
• Test administrator should maintain a list of all secure materials assigned to him or her, including any additional materials assigned throughout the administration.
• See page 11 of the manual if a document becomes soiled. 69
Students assigned to your room (Student Name and Student ID) Attendance Information
P=Present, A=Absent, W=Withdrawn, P/I=Present but Invalidated Accommodations provided
For ESE/504 students: 1-FP = Flexible Presentation; 1-FR = Flexible Responding; 1-FSC = Flexible Scheduling; 1-FSE = Flexible Setting; 1-AD = Assistive Devices
For ELL students: 2-FSC = Flexible Scheduling; 2-FSE = Flexible Setting; 2-AHL = Assistance in Heritage Language; 2-ADI = Approved Dictionary
Test Group Code Signatures of test administrator and school assessment
coordinator and dates for when secure materials (e.g., used Work Folders, Student Authorization Tickets, Session Rosters, used Reference Sheets) are received and returned
(PBT Only) Unique security number of the test and answer book assigned to each student
70
Required Administration Information
Security Log
• Schools are required to maintain an accurate Security Log for each testing room.
• Anyone who enters a room for the purpose of monitoring a test MUST sign the log for that testing room, regardless of how much time he/she spends monitoring a testing room.
• A perforated Security Log can be found in the manual.
• Blank Security Log can also be found at www.FLAssessments.com/WinterEOC.
71
Sample Security Log
72
Seating Chart
73
• NEW! Test administrators are required to maintain an accurate seating chart for each testing room.
• Seating charts must include the following: Room name/number Student names Each student’s location in the room during testing Date Starting time Test administrator name Names of proctors (if applicable) Test group code For CBT only: Session name in PearsonAccess
• Seating charts must be returned to the school assessment coordinator after testing.
• If students using extra time are moved to a new location to complete the test, a new seating chart must be created for this location.
CBT: Prepare Testing Room• All software applications, including Internet browsers, must be closed on
all student workstations.• Start TestNav or TestHear, type in the correct URL, and open each
student workstation to the student login screen.
• Install visual barriers to prevent student’s from easily viewing other students’ computer screens.
• Provide instructions to contact the technology coordinator or school coordinator during testing without leaving the room unattended.
• Test Sessions have a unique six-digit test code (password) that will be printed on the Student Authorization Tickets and Session Roster. Test Code (6-digits) (password) is used to access the test. Test Group Code (4-digits) is used to identify groups of students
tested together.74
CBT: Monitoring Test Sessions• Monitoring test sessions and resuming students in PearsonAccess
School coordinators will resume students as needed and may require test administrators to contact them during testing to request this authorization or
Test administrators may resume students if PearsonAccess accounts have been created by the school assessment coordinator.
• Securing a student’s computer if a student leaves the room and will resume testingRecommended Long breaks: student must exit the TestNav system by clicking the X
or the red circle in the top corner and then clicking Yes, exit the test
Student will not be able to continue testing until he/she is authorized to resume testing in PearsonAccess.
Short breaks: visual block (e.g., a file folder) must be applied to obscure the computer screen or monitor turned off
• Accessing student comment forms after testing (www.FLAssessments.com/EOCStudentCommentForm). 75
CBT: Supervise Test Administration
• If a computer is disconnected from the test: Technology coordinator must be contacted to help
diagnose any technical issues
School assessment coordinator must be contacted to resume student’s test in PearsonAccess
OR
If test administrators have a Test Administrator account in PearsonAccess, they may resume the student’s test and assist the student with logging in again. School assessment coordinator must train test administrators to resume students in PearsonAccess.
76
Supervise Test Administration
• During testing, ensure that students: Clear the area around their workstations or desks of all materials
except for the appropriate test materials Do not have books, notes, extra scratch paper, or electronic
devices of any kind (except for approved calculators) during testing, even if they do not use them
Have signed or agreed to the student pledge Do not talk or make any disturbance Work independently
Are recording their answers in the appropriate area
Work in the correct test
For CBT, check student name and test in the top left corner of the computer screen.
For PBT, check the document title at the top of the grid sheet.77
CBT: Manage Test Sessions
TASK DESCRIPTIONEOC
MANUAL PAGES
View an Existing Test Session
Check the session details and verify that students are assigned to the correct session.
58
Add, Move, or Remove Students
Manage student session assignments 58-59
Manage Class Information (optional)
Classes can be used to manage students in PearsonAccess.
60-61
Manage Other Student Information
Some student data may be changed in PearsonAccess.
62-63
Technology Coordinator Proctor Cache Test Items
Proctor Caching is required for efficient test delivery. Provide technology coordinators with a list of all test sessions for school.
98-125
Print Student Authorization Tickets and Session Rosters
Each student needs a Student Authorization Ticket in order to log in to the test session, and each test administrator needs a Session Roster.
65-66
Distribute Student Authorization Tickets and Session Rosters to Test Administrators
Student Authorization Tickets and Session Rosters are secure and should only be distributed on the day the assessment will be administered.
65-66
CBT: Activities During Testing
TASK DESCRIPTION
MANUAL
PAGE(S)
Start test sessionsA session must be started in PearsonAccess before students can begin the test.
73
Monitor session details
Keep track of each student’s testing status in PearsonAccess.
73-74
Resume students’ tests
If a student exits the test (intentionally or unintentionally) and will finish later.
74-76
79
Note: NEVER submit a student’s answers or mark a student’s test complete because of a technical issue without first receiving directions from FDOE or Pearson. Only mark a student’s test complete if the test is intended to be scored.
CBT: Activities After Testing
TASK DESCRIPTION
MANUAL
PAGE(S)
Mark a student’s test “complete”
Mark a student’s test complete if a student exits the test and will not resume the same test.
79-80
Stop test sessions
A test session cannot be stopped until all students are in “Completed” or “Marked Complete” status or until “Ready” students have been removed.
80
Invalidate testsAny tests that should not be scored must be invalidated.
80-81
Record accommodations
All accommodations used by students must be recorded in PearsonAccess.
81-82
80
CBT: Record Accommodations
• Only record accommodations actually used by the student. Under the “Student Registration” link, view by registered
students then search for the student Click on the name of the student to go to student’s profile Click on the “Assigned Tests” tab and click the Algebra 1
link then click on Edit Update the appropriate fields according to the
Accommodations Descriptions and Instructions on pages 70-71
After edits are complete, click Save
• Must be completed by 4:00 PM EDT Friday of the week the student tested.
81
Test Invalidation Policies and Procedures
• Purpose of test invalidation is to identify when the validity of test results has been compromised.
• A test administrator should discuss any situation involving possible invalidation with the school assessment coordinator and the situation should be investigated before a final invalidation decision is made.
• A test MUST be invalidated if either of the following circumstances occurs: A student has an electronic device during testing. A student is cheating during testing.
82
Test Invalidation Policies and Procedures
A test MAY be invalidated if any of the following circumstances occur:
1. A student becomes ill and is unable to finish, OR a student is not allowed the correct amount of time.
2. A student was given an accommodation not allowed on the Algebra 1 EOC.
3. A student was given an accommodation not on the student’s IEP, Section 504 plan, or ELL plan.
4. A student was not provided an allowable accommodation listed on the student’s IEP, Section 504 plan, or ELL plan.
5. An error occurs in test administration or procedures that could compromise the validity of the test results (e.g., students had access to an unauthorized visual aid that gave an unfair advantage).
6. A student is disruptive during testing. 83
CBT: Test Invalidation
• Any tests that should not be scored must be invalidated. Test must be in “completed” status or “marked
complete” status.−Under the “Student Registration” link, view by registered
students then search for the student−Click on the name of the student to go to student’s profile – Click on the “Assigned Tests” tab and click the Algebra 1 link
then click on Edit– Scroll down to the “Do Not Score Reason” field and choose
Yes – Select a reason in the “Do Not Score Reason” field and
Save
• Must be completed by 4:00 PM EDT Friday of the week the student tested. 84
PBT: DNS and UNDO Bubbles
• Located in the SCHOOL USE ONLY box on the student grid sheet.
• If a DNS bubble has been gridded by mistake, erase the DNS bubble and grid the UNDO bubble. Package the document with other TO BE SCORED materials.
85
PBT: DNS and UNDO Bubbles
The DNS bubble MUST be gridded if any of the following circumstances occur: 1.The document is defective and USED.2.A student name, student ID number, district number, OR school number is INCORRECT on a label affixed to a USED document. 3.A student label has been placed over another student label on a USED document.
Under the following circumstances, it is NOT necessary to grid the DNS bubble if the document has been packaged properly for return with all other NOT TO BE SCORED materials: 1.The preidentified document belongs to a student who has withdrawn before testing begins. 2.The preidentified document belongs to a student who was absent during the entire testing window. 3.The document is defective and UNUSED.4.The preidentified information is incorrect and the document is UNUSED. 86
Organizing Paper Test Materials
Organize your paper-based materials according to the list below:
•TO BE SCORED – Cover sheet and regular print or Braille materials, if applicable
•NOT TO BE SCORED – Cover sheet and regular print or Braille materials (includes unused documents and documents with the DNS bubble gridded), if applicable
•Test administration manuals, security log, required administration information, seating chart, used and unused work folders, and used and unused Reference Sheets
87
Prepare Paper Materials for Return
Mispackaged paper-based materials will delay reporting of student results.
1. Verify that all distributed secure materials have been returned. Notify the district immediately if any secure materials are missing.
2. Check for and remove any stray reference sheets from the test and answer books.
3. Make copies of the records of required administration information.
4. Make copies of all Security Logs and seating charts and file the copies.
5. If a test has been invalidated, verify that the DNS bubble has been gridded.
Verify that the DNS bubble has been gridded on defective documents and that the document is placed with NOT TO BE SCORED materials.
Verify that no DNS bubble has been gridded by mistake. If it has, verify that the DNS bubble has been erased and the UNDO bubble has been gridded and place the document with TO BE SCORED materials.
88
Document Count Forms1. Verify that all paper-based documents from make-up sessions are included.
2. Complete a separate form for your school and M-DOA program, if applicable. Do not combine more than one school under the same count form.
3. Also, complete a separate form for special document type (Braille) materials, if applicable. Do not copy blank count forms; however, once the count forms are completed, you may copy them for your records.
4. Place each completed form on top of the first stack of corresponding TO BE SCORED test and answer books.
89
Document Count Forms
90
Paper Bands
• Each special program (school) and document type (regular print or Braille) must be banded separately. You may use more than one paper band per school or document type, if necessary.
• Complete all fields on the paper band.
91
92
TO BE SCORED Regular Print Packaging Diagram
93
Special DocumentsPackaging Diagram
N NOT TO BE SCORED Regular Print
• The following materials must be placed in the Not To Be Scored box: Unused test books, unused, non-
preidentified and preidentified documents, and defective documents with all DNS bubbles gridded.
• Keep at the school for one calendar year: Student Authorization Tickets Copies of all records of administration
information
94
District Assessment Coordinator Only Box
• The following materials must be placed in the District Assessment Coordinator Only box: Session Rosters or Administration Record / Security
Checklist or school’s developed form with all the required information.
Original Seating Chart Original Security Logs Work Folders (used and unused) Original Accounting for All Secure Documents, if
applicable Original School Procedural Checklist (FM-6927)
• Keep copies of documentation for your records.• Note: Securely destroy all used reference sheets at the
school. 95
Package Paper Materials
96
• TO BE SCORED Test and Answer Books (regular print) – Red-labeled boxes
• NOT TO BE SCORED Materials (regular print) – Yellow-labeled boxes
• All Special Documents Materials (To Be Scored and Not To Be Scored), if applicable (Braille) – White-labeled boxes
• District Assessment Coordinator ONLY box
Materials Return Schedule
• All schools must hand-deliver the Algebra 1 EOC paper-based and Special Documents test materials to the Test Distribution Center (TDC), 13135 S.W. 26 Street Miami, FL 33175, before 3:30 p.m. on Monday or Tuesday, December 12 or 13, 2011. To Be Scored, Not To Be Scored, and/or
District Assessment Coordinator Only Box. Please refer to the “Friendly Reminder”
(Attachment H) in your training packet.97
Technology Coordinator
Before, During, and AfterTesting
All instructions for the Technology Coordinator apply to computer-based test administrations
only.
98
Read the test administration manual. Read the Test Administration Policies and Procedures and sign the EOC CBT
Administration and Security Agreement. Meet with the school assessment coordinator to discuss the administration
of the computer-based test and walk through the test administration. Discuss and implement plans for handling possible technical interruptions
during testing. Ensure that each computer station is equipped with a keyboard and mouse
(or other pointing device). Disable instant messaging and email notification, screen savers, power
savers, and remote desktop. Disable or delay anti-virus, auto-scan and/or auto-update, system restore
utilities, Windows Security Firewall, or web content filtering If a firewall is used, appropriate destination/port/protocol combinations are
allowed through the firewall. Any proxy servers have been checked to ensure that the appropriate URLs
are not blocked. Internet content filters are configured to allow the specific IP addresses
required for administering computer-based testing.99
Activities Before Testing
Workstation Specifications
General Specifications (Windows/PC and Apple/Macintosh)Each computer must meet or exceed the following General Specifications in addition to the applicable Operating System Specifications below: 500 MB available disk space 1024x768 screen resolution Keyboard and mouse (or other pointing device) High-speed internet connection
Operating System Specifications
Windows/PC
Windows XP (Service Pack 3) Pentium III 733 MHz processor 512 MB RAM
Windows Vista (Service Pack 1) Pentium III 1 GHz processor 1 GB RAM
Windows 7 Pentium III 1 GHz processor 1 GB RAM
Apple/Macintosh
Mac OS X 10.4G3, G4, G5 500 MHz processor512 MB RAM
Mac OS X 10.5Intel, G4, G5 867 MHz processor512 MB RAM
Mac OS X 10.6Intel processor1 GB RAM
100
Workstation Specifications
Additional Specifications for TestHear (Accommodated Forms)
• TestHear will operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS X 10.4 or on Macs that cannot also run Windows.
• For students requiring the screen reader, the computer must be equipped with an audio card and headphones.
101
• For an optimal student experience, any computer that takes a noticeably long period of time (e.g., more than 10 seconds) to start and run applications, even computers which meet the requirements, should not be used for high-stakes computer-based testing, if possible.
• The testing platform does not permit access to other applications during testing. This means that any applications that may automatically launch during testing will interrupt the student’s testing session, logging the student out of the test. Applications such as antivirus updates, power management software (laptops), screen savers, and email with automatic message notifications should be configured so they do not launch during test sessions.
Monitor Display and Shading
102
• To ensure students will see all of the content in the test, students are asked to confirm that they can see the 15% shading on the Test Group Code screen when they first log in to the test.
• If students cannot see the shading, they must exit the test and their monitor settings must be adjusted.
• General instructions for adjusting monitor settings are provided on pp. 131-132 (Winter EOC Manual). The steps for changing contrast and brightness settings will vary depending on the manufacturer and model of each individual monitor.
Proctor Caching• Instructions for installing Proctor Caching are provided in the
Winter EOC Manual (pp. 98-110). • Computers used for Proctor Caching do not need to be server-
class machines but should meet the system requirements. Proctor Caching can run on either a Windows or Mac operating
system, and each can support both Windows and Mac-based testing workstations.
• Each testing computer must be configured to refer to a Proctor Caching computer in order to obtain test content. If more than one computer is being used for Proctor Caching, be
sure to specify the IP address of the correct Proctor Caching computer during the TestNav installation process.
For example: if there are 80 computers that may be used for testing and two Proctor Caching computers, 40 of the testing computers may be configured to link to Proctor Caching computer A, and the remaining 40 may link to Proctor Caching computer B.
103
Proctor Caching• Proctor Caching Security
Proctor Caching software stores a copy of the test content on the local hard drive of the machine on which it runs.
Test content transmitted and stored by the Proctor Caching computer is in encrypted format.At no time does the Proctor Caching computer un-encrypt the test
items.
“Purge cache” function deletes all encrypted test content from the hard drive of the Proctor Caching computer.FDOE and Pearson require that test content be purged at the end of
each administration window.
• Proctor Caching Computer Placement Proctor caching can be implemented at either the lab- or the
school-level. Computer should be located as close as possible on the network to
the student workstations. 104
TestNav• Installation instructions are provided in the Winter EOC
Manual (pp. 110-117).• Once TestNav has been properly installed and tested, it
should continue to be successful on student workstations through the test administration, as long as no incompatible software updates are made.
• Annual updates to TestNav may require re-installation of software. (There are currently no updates to the software for 2011-2012. The version of TestNav installed for 2010-2011 can be used for 2011-2012, unless otherwise indicated by the FDOE.)
File Share vs. Local Install• Two options for installing TestNav
File Share Local Install
105
TestHear• TestHear must be installed on all computers that will be used by
students requiring accommodated CBT forms (e.g., large print, zoom, screen reader, color contrast, assistive devices).
• Instructions for downloading and installing TestHear are provided in the Winter EOC Manual (pp. 117-118). A new version of TestHear must be installed for this administration (available 11/18).
• TestHear ePATs will only operate on Windows PC workstations and on Macintosh workstations that have Mac OS 10.5 or later installed and are running Windows (e.g., via Boot Camp). TestHear will not work on Mac OS 10.4 or on Macs that cannot also run Windows.
• Local installation is required for TestHear.• TestHear accommodated forms are larger than regular TestNav
forms. To help determine bandwidth requirements and to provide an opportunity to practice loading TestHear forms, accommodated test data has been added to the Testing Volume Calculator in the TestNav System Check (www.FLAssessments.com/SystemCheck) and to the Infrastructure Trial in the Training Center.
106
Activities During Testing
Ensure Proctor Caching software is running on all Proctor Caching computers.
• Turn on Proctor Caching software Windows: go to Start>All Programs>Proctor
Caching>Proctor_Caching Mac: once Proctor Caching is initiated it will
not have to be restarted unless it has been manually stopped.
Monitor each testing room to ensure that there are no technical issues.
Be available during testing to answer questions from test administrators. 107
Activities After Testing
Purge Test Content from the Proctor Caching Computer
Complete Comment Form at www.FLAssessments.com/WinterEOC.
108
For paper-based and computer-based administrations:• Inappropriate actions by school personnel before, during, or after test
administration may result in consequences including test invalidations and/or loss of teaching certification.
• All school personnel involved with the Winter EOC must sign the Florida EOC Test Administration and Security Agreement stating they have read and agree to abide by all test administration and test security policies and procedures.
• School assessment coordinators and test administrators must maintain certain required administration information.
• Test administrators must also sign the Test Administrator Prohibited Activities Agreement indicating that they understand prohibited activities during test administration and possible consequences of inappropriate behavior.
• Test administrators must maintain an accurate seating chart for each group of students testing in the same room.
• Students may not have any electronic or recording devices at their desks, in their pockets, or anywhere they can reach them during testing, even if the devices are turned off or the students do not use them.
• Students are required to sign the Student Pledge stating that they will not give or receive unauthorized help during the test.
• If a student begins a test and leaves campus without finishing, he or she will NOT be allowed to complete that test.
109
Reminders for Winter EOC
For computer-based testing only: • Test Administrator user accounts are available in
PearsonAccess. Instructions for creating/assigning these accounts are provided in your training packet.
• Students are required to participate in a practice test (ePAT) using the appropriate script provided in the manual.
• Students should be encouraged to complete the comment form (http://www.FLAssessments.com/EOCStudentCommentForm) after they finish the test.
• Technology coordinator must purge test content at the conclusion of the testing window.
110
CBT: Reminders for Winter EOC
Comment Forms
• Complete Comment Form at www.FLAssessments.com/WinterEOC. School Assessment Coordinator Test Administrator Technology Coordinator
• Please provide feedback that will be meaningful to the FDOE and Pearson.
111
Training Materials
• This training presentation is available at: http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp.
• The Winter 2011–2012 End-of-Course Test Administration Manual and training presentation are also available at:
www.FLAssessments.com/WinterEOC www.FLAssessments.com links are redirects for materials
posted to www.PearsonAccess.com/fl.
112
Pearson Support and PearsonAccess
• Contact Pearson Support Phone Number: 1-877-847-3043 E-mail: [email protected]
• Appendix C provides the following information: PearsonAccess
User AccountsBrowser requirementsLogging in for the first timeResetting passwords
Training CenterTest Setup Exercise
113
Contact Information
Student Assessment and Educational Testing
Maria C. Bruguera, Director IEmail: [email protected] or
Mara Ugando, Staff SpecialistEmail: [email protected]
305-995-7520Infrastructure and System Support
Roly Avila, SupervisorEmail: [email protected]
114
