Upload
others
View
5
Download
0
Embed Size (px)
Citation preview
ACCESS for ELLs
Test Coordinator Training
Fall 2020
Dan Wiener, Administrator of Inclusive Assessment
Melanie Manares, English Proficiency Assessment Coordinator
Shannon Cullen, MCAS and ACCESS Assessment Specialist
Department of Elementary and Secondary Education
Massachusetts Department of Elementary and Secondary Education
How to Ask a Question
2
Please use the Q&A function to ask a
question.
Questions will be answered as they are
asked.
Massachusetts Department of Elementary and Secondary Education
ACCESS for ELLs: Directing Your Questions
• MA Department of Elementary and Secondary
Education (DESE) [email protected] 781-338-3625
o Policies and program management
o Preparation for test administration
• WIDA Consortium (41 states) [email protected] 866-276-7735
o Standards, training, and test development
• Data Recognition Corporation (DRC)
[email protected] 855-787-9615
o Technology, WIDA AMS, test materials (production, shipping,
scoring, reporting)3
Massachusetts Department of Elementary and Secondary Education
WIDA Personal Accounts
• Instructions for creating WIDA personal accounts are available at
http://www.doe.mass.edu/mcas/access/PersonalAccount-Instruct.html.
• WIDA personal accounts set up last year are still active and must be used. Do not
create a new personal account. Call WIDA Help for assistance (866-276-7735).
• Personal accounts may be updated by users to add or change information
(e.g., district or email address). You will need access to the email associated with
that account.
o Log in and select at the top right corner of the screen.
o Enter updates in the gray column on the right.
o Once you are finished, click Save.
• A personal account is needed to view training modules, access screener test
materials, take certification quizzes, and access the Download Library.
4
Massachusetts Department of Elementary and Secondary Education
WIDA Personal Accounts
• Staff who need a WIDA personal account should contact
their District ACCESS Test Coordinator for assistance.
• New District ACCESS Test Coordinators who wish to obtain
district-level permissions should ensure their name appears
in that role in School and District Profiles, then contact the
WIDA Help Desk at 866-276-7735 or [email protected].
• The Department will not create WIDA personal accounts
or assign permissions.
5
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: District Test Coordinator Accounts
• Staff should contact their District ACCESS for ELLs Test
Coordinator for assistance in creating WIDA AMS accounts for:
o School ACCESS for ELLs Test Coordinators
o Technology Coordinators (Educational Technology Directors)
o Test Administrators
• New District ACCESS for ELLs Test Coordinators who require a
district test coordinator account must contact DRC Help Desk at
855-787-9615 or [email protected].
• The Department will no longer create those accounts.
6
Massachusetts Department of Elementary and Secondary Education
DESE School and District Profiles
7
Massachusetts Department of Elementary and Secondary Education
DESE School and District Profiles (continued)
8
Massachusetts Department of Elementary and Secondary Education
DESE School and District Profiles (continued)
9
Massachusetts Department of Elementary and Secondary Education
DESE School and District Profiles (continued)
10
Or go to:
http://www.doe.mass.edu/InfoServices/data/diradmin/list.aspx
to see a list of Directory Administrators.
Massachusetts Department of Elementary and Secondary Education
Plans to administer ACCESS for ELLs in January-May
• We do not anticipate cancelling testing this school year.
• We do expect ELs to test in person in their district to the greatest extent possible.
• DESE has extended the end of the test window to May 20
• Districts should begin to strategize and plan how this will occur.
o Plan to test small groups of students in widely spaced, clean, well-ventilated areas.
o Determine spaces and scheduling this fall (test setup in AMS); train and certify test administrators.
o Remind students to bring back their school-issued computers with INSIGHT software for the test.
o Can test all four domains in one day, if desired, to decrease number of sessions
• Remote testing options were considered, but WIDA, DRC, and member states determined that
logistics, proctoring, technology trouble-shooting, test security, and provision of accommodations
would be problematic.
• Test high-priority students first: ELs who are close to exiting, and those who were screened remotely
but not face-to-face.
• Remove students from test sessions if reported as EL in October due to provisional identification,
but later rescreened and determined not to be EL. Code these students as non-EL in the next SIMS. 11
Massachusetts Department of Elementary and Secondary Education
Expectation for Students to Take Online Tests
• Schools are expected to administer online tests to virtually all students.
o Students in grades 1–3 will continue to take paper-based writing test.
o ACCESS handwriting booklets are available for grades 4-12 Writing test for
students with disabilities or for first-year ELs (i.e., a student who was first
reported as EL in the October 2020 SIMS) who are unable to take the
computer-based test. Schools must order handwriting booklets during the
Additional Test Material Ordering Window.
o Paper-based tests are available to ELs with disabilities whose IEP or 504 plan
lists this or for first-year ELs (i.e., a student who was first reported as EL in the
October 2020 SIMS) who are unable to take the computer-based test.
• Paper-based Kindergarten tests and Alternate ACCESS for ELLs will continue
for all students.12
Massachusetts Department of Elementary and Secondary Education
Benefits of Online Testing
• Easier to administer, no materials storage, fewer shipments, fewer security
concerns
• Simultaneous test administration for multiple grades, subdomains, and
proficiency levels within same test setting.
• No need to pre-select test tiers; online tests perform this function for
students, based on Listening and Reading results.
• A range of built-in accommodations and accessibility features
available in online tests
• Can administer online Speaking test to a small group of 3–5 students per
test administrator (not individually), using headsets with microphones.
o Speaking tests are centrally scored by DRC, not locally scored, so Speaking
certification is not required by test administrator.13
Massachusetts Department of Elementary and Secondary Education
2021 ACCESS for ELLs: Important Dates
Before Testing
Test administrators complete online training and obtain necessary certifications.
October 2020–January 2021
DESE will pre-order test materials November 23, 2020
Online test set-up (schools review and update student Pre-ID file, as needed)
December 3, 2020–May 20, 2021
Schools receive test materials January 4, 2021
Schools order additional materials, if necessary January 4–May 14, 2021
Test Administration Administer ACCESS for ELLs tests January 7–May 20, 2021
After TestingSchedule UPS pickup of paper testing materials May 20, 2021
Deadline for UPS pickup May 21, 2021
Before Results are Reported Pre-reporting data validation (districts) July 6-July12, 2021
Results ReportedResults posted electronically in WIDA AMS August 5, 2021
Reports sent to schools and districts TBD
After Results are Reported
Post-reporting data validation (districts) TBD
Validated and corrected results posted electronically
TBD14
Massachusetts Department of Elementary and Secondary Education
Test Administrator and Test Coordinator Certification
• Each educator must login to WIDA personal account to access training.
• Test Coordinators and Test Administrators must review training modules on WIDA secure portal and complete checklist.
• Test Coordinators and Test Administrators must complete the ACCESS
online training session(s) and be certified for the tests they will administer.
▪ Recertification is required every two years.
▪ Those who were certified and administered ACCESS tests in 2019-2020 (last
year) need not recertify; all others must pass the appropriate Administration
Quiz with score of 80% or higher.
• Online training modules are available now, but better to train closer to the testing window.
15
Massachusetts Department of Elementary and Secondary Education
Training for Online Test
16
Training Audience Key Elements Outcome
ACCESS for ELLs
Test Coordinators
(All Test Forms)
ACCESS for ELLs Online Test
Administrators
(Grades 1-12)
Online modules via Training
Course; Certification Quiz;
MA ACCESS for ELLs
Checklist
Certificate of
Completion
ACCESS for ELLs Technology
Coordinators (Educational
Technology Directors)
Online procedures via
WIDA AMS; Checklists
Should be verified by
Test Coordinator
(as listed on checklists)
Massachusetts Department of Elementary and Secondary Education
Training and Certification for Paper-Based Tests
17
Training Audience and Topics Key Elements Outcome
ACCESS for ELLs
Paper Test
Administrators
(Grades 1-12)
Paper Test
Administration
Procedures
Scoring the
Speaking Test
Online modules via Training
Course; Certification Quiz;
MA ACCESS for ELLs Checklist
Speaking Test Scoring Module
via Training Course
Certificate of
Completion
Certification based on
Speaking Test Scoring
quiz
Alternate ACCESS for
ELLs Test Administrators
Online modules via Training
Course; Certification Quiz;
MA ACCESS for ELLs Checklist
Certification based on
Alternate ACCESS quiz
Kindergarten ACCESS for
ELLs Test Administrators
Online modules via Training
Course; Certification Quiz;
MA ACCESS for ELLs Checklist
Certification based on
Kindergarten quiz
Massachusetts Department of Elementary and Secondary Education
Accessing the Training Courses• Go to the WIDA website and log in to the WIDA Secure Portal in the dropdown
menu: https://wida.wisc.edu/login
• Use “My Account & Secure Portal” page to:
Access personal training records
Search Download Library for useful resources
Update and edit personal account information
Navigate to the various training courses
District coordinators monitor training of staff 18
Massachusetts Department of Elementary and Secondary Education 19
My Account & Secure Portal: Training Courses
•Access trainings for
the different tests by
clicking on the
appropriate tile
•Order or download
Screener materials
from the tiles here as
well.
Massachusetts Department of Elementary and Secondary Education
My Account & Secure Portal: ACCESS for ELLs Online Training for Test Administrators and Test Coordinators
20
Massachusetts Department of Elementary and Secondary Education 21
Click on the My Training Certificate
tile to view your certificate and list of
quizzes passed.
Click on the My Training & Quiz
History tile to take quizzes and see a
list of quizzes that you passed.
My Account & Secure Portal: Quizzes and Training Certificate
Massachusetts Department of Elementary and Secondary Education
Monitoring Certification of Test Administrators in Each District
• School and district leaders must ensure that a sufficient number of
test administrators are trained and certified.
• WIDA Personal Account district-level permissions allow you to view
names of those who have completed training and are certified.
• Contact the WIDA Help Desk at 866-276-7735 or [email protected] if not
already authorized to monitor certification in your school/district.
22
Massachusetts Department of Elementary and Secondary Education
User Account Management – District Test Coordinators
23
Massachusetts Department of Elementary and Secondary Education
WIDA Assessment Management System (WIDA AMS)
• Within AMS, designated staff may:
o Access user guides and software downloads
o Edit student information
o Create and add students to test sessions
o Remove students from test sessions
o Designate accommodations
o Print test tickets
o Monitor student progress
o View/print reports and results after testing and scoring are completed
• DESE will pre-load student data in AMS (via the Pre-ID file), at
https://www.wida-ams.us/ and place a csv file of the uploaded school-
level data in the Security Portal DropBox.24
Massachusetts Department of Elementary and Secondary Education
WIDA/DRC Testing Resources – WIDA Secure Portal
• On the My Account & Secure Portal page
o Training Courses
• In the Download Library
o “District and School Test Coordinator Manual”
o “Test Administrator Manual”
o “Accessibility and Accommodations Supplement”
o “WIDA AMS User Guide”
o “Technology Troubleshooting 2020–21”
o “COS-SD Technology Readiness Checklist for WIDA Online Assessments”
o “2020–21 ACCESS and Screener Webinar Calendar”
• Available on the MA state page on the WIDA website
o “ACCESS for ELLs Online Checklist” and “ACCESS for ELLs Paper Checklist”
o “State-Specific Directions” in the State Testing Requirements accordion tab25
Massachusetts Department of Elementary and Secondary Education
ACCESS Test Materials Pre-ordered for 2020–2021
Materials pre-ordered by DESE based on ELs reported by districts in October SIMS
• Paper-based tests will be pre-ordered for
o Kindergarten
o ELs with IEPs who took paper-based tests last year.
▪ Tier B/C will be ordered if Tier A was taken last year.
▪ If no tier listed for last year, Tier A will be ordered.
• Online tests will be pre-ordered for
o ELs without IEPs who took paper-based tests last year
o All other ELs
• Accommodations from last year will be applied to the school’s order (e.g., if a student took
Braille last year, Braille will be pre-ordered this year).
• If student took Alternate ACCESS last year, Alternate ACCESS will be ordered this year.
• If Kindergarten test shows “Do Not Score = SPD” in all four domains last year, a grade 1
Alternate ACCESS will be pre-ordered this year.26
Massachusetts Department of Elementary and Secondary Education
Student “Pre-ID” File
• DESE uploads Pre-ID files for each school in WIDA AMS and in
DropBox for test setup after December 3.
o Pre-ID file will be in the ACCESS 2021 file in DropBox. “Title III Inbox”
permission needed (see your Directory Administrator for permissions).
o Students in the Pre-ID file will be placed into generic test sessions.
o Schools update and revise test sessions as needed (i.e., add students,
change accommodations, change test sessions, remove students from
test session).
o Changes must be made in AMS to take effect.
o Pre-ID labels will be generated for all students and shipped to schools
with test materials, including those testing online.
o Pre-ID labels that are not used should be securely destroyed.27
Massachusetts Department of Elementary and Secondary Education
Student “Pre-ID” File (continued)
•Pre-ID files are found in the Security Portal
DropBox in csv format after December 3.
•To make changes for multiple students:
oFirst, download the csv file from DropBox, then
make edits and save in csv format, and upload to
WIDA AMS using the Upload Multiple Students tab.
oChanges made in AMS (or uploaded as csv) will
override what was pre-loaded in December. 28
Massachusetts Department of Elementary and Secondary Education
Test Setup: Manage Students Tab
29
See p. 63,
AMS User
Guide• Change
accommodation type
• Edit demographics
• Change test session
• Upload additional
students
(From the
“Manage
Students” page):
• Click Find
Students
• Click View/Edit
icon
• Make edits
• Save
Massachusetts Department of Elementary and Secondary Education
Preparation Before Testing• Review participation, preparation, and test administration requirements.
o MA Principal’s Pre-Administration Manual
o ACCESS for ELLs Checklists and State-Specific Directions (WIDA MA State Page)
• Review WIDA AMS User Guide.
• Train and certify test administrators
o Self-administer the required online test administrator training module(s).
o Become certified (certification required every two years).
o Test coordinator monitors that test administrators are certified.
• Determine which students require accommodations, including paper-based
tests.
o Paper tests allowed for ELs with disabilities and newcomers who are unable to take
computer-based tests.
o Accessibility and Accommodations Supplement
• Determine testing tier (paper-based only). See Principal’s Pre-Administration
Manual, page 6.30
Massachusetts Department of Elementary and Secondary Education
Participation Requirements: ACCESS for ELLs
• Students in K-12 must take ACCESS for ELLs if they:
o were reported as EL in the October 2020 SIMS, OR
o arrived after October 2020 and will be reported as EL in the next available SIMS report.
• Students should be considered for Alternate ACCESS for ELLs if they:
o meet the criteria found in the “Participation Guidelines: Which Students Should Take the Alternate
ACCESS for ELLs?”, and
o were reported as EL in October 2020 SIMS or will be reported as EL in the next available SIMS
report.
• Students are not required to take ACCESS for ELLs if they are:
o reported as EL in October 2020 SIMS, but exited EL status before testing begins (i.e., before
January 7, 2021), OR
o provisionally identified as EL but rescreened and determined to be non-EL but were reported as EL
in October SIMS
o in kindergarten and have significant cognitive disabilities (No Alternate ACCESS test in K).
▪ Bubble Do Not Score code SPD for all domains if kindergarten EL should take Alternate ACCESS31
Massachusetts Department of Elementary and Secondary Education
ACCESS Participation Requirements (continued)
The following EL students are not required to take one or more sections
of ACCESS for ELLs. If student:
• was reported as “Sensory: Hard of Hearing or Deaf”
o take Reading and Writing, but not Listening and Speaking tests, if unable to listen
and/or respond verbally to test items
• was reported as “Sensory: Vision Impairment or Blind”
o take Braille versions of Reading and Writing, but not Listening and Speaking tests,
which rely on visual stimuli, if unable to view test items
• was reported as nonverbal (or selectively mute) in the IEP and does not use AAC device
o take Listening, Reading, and Writing, but not Speaking, if unable to respond verbally
to test items
• meets criteria to receive ELA read-aloud “special access” accommodation on MCAS (and
this is listed in their IEP or 504 plan)
o take Listening, Speaking, and Writing, but not Reading test32
MUST BUBBLE “SPD” FOR
EACH TEST NOT REQUIRED!
Massachusetts Department of Elementary and Secondary Education
Assigned Scores for Domains Coded “SPD”• Available only for ELs with disabilities who are unable to participate in a domain
test due to lack of an available accommodation (see previous slide). Student must have an IEP or 504 plan and be coded SPD for missing domain in WIDA AMS or in test booklet.
• If coded appropriately, DESE will calculate and assign an overall score for eligible student, and the missing domain score(s), for up to two missing domains.
• An assigned overall score for an eligible student can be used to determine progress toward proficiency and, if score is “proficient,” exit student from EL status.
• ISRs will not show the assigned score (domain score will be reported as N/A).
• Letter to parents can provide the assigned score and explain that it is assigned, based on performance in other domains, due to an unavailable accommodation.
• See the Guide to Assigning Scores for Missing Domains on ACCESS for ELLs Tests (for ELs with Disabilities) on the Department’s ACCESS for ELLs page.
33
Massachusetts Department of Elementary and Secondary Education
System Requirements
• Major Changes:
o DRC ended support for Windows 7 and Windows Server 2008 on October 31,
2020
o DRC anticipates moving iPad OS14.x to full support in November 2020
o DRC will end support for iPad OS 12 in December 2020
o DRC has added Ubuntu 20.04 LTS to the list of fully supported operating
systems
• Educational Technology Directors should be aware of the
requirements.
• Contact DRC Customer Support at 855-787-9615 or
[email protected] with questions.
34
Massachusetts Department of Elementary and Secondary Education
Technology Requirements for Online Testing
35
• Technology requirements for the online test are
available in the WIDA Secure Portal and in WIDA AMS.
oUser Guide, Readiness Checklist, System Requirements
• Standard headphones are needed for all domains.
• The online Speaking test:
o Requires a headset for each student (i.e., headphone with
built-in microphone)
o Up to 5 students per test administrator
o Centrally scored by test contractor
Massachusetts Department of Elementary and Secondary Education
WIDA Trainings for Technology Coordinators
• Pre-Testing: Software Updates & Technology Readiness Checklist
o Tuesday, October 6, 2020
• Pre-Testing: Technology Installations
o Thursday, October 8, 2020
• Pre-Testing: Technology Coordinator Support for Test Administrators
o Tuesday, November 10, 2020
• During Testing: Technology Troubleshooting
o Thursday, January 7, 2021 from 2:00–3:00pm ET
• Links to recorded webinars are in the WIDA Secure Portal
Download Library36
Massachusetts Department of Elementary and Secondary Education
Technology Troubleshooting During Testing
If you receive a system error message, try the following before calling
the Help Desk:
• Are multiple students experiencing the same issue?
o Check the system status page for any system outage information.
o Check with the technology support team from the site to see if there are any issues.
• If the issue is isolated to only a few students try:
o Rebooting the machine. Does the error still occur?
o Moving the student to a different computer. Does the error still occur?
o Mark affected computer with a sticky note and notify your technical department.
• If still not resolved,
o see Technology Troubleshooting 2020-21 in the Download Library
o call DRC Customer Service (866-276-7735) with the information found on page 3.
37
Massachusetts Department of Elementary and Secondary Education
Testing Resources and Materials
• State-Specific Directions
o Available on the WIDA state page for MA
o Also available on the Department’s ACCESS for ELLs page
• Non-disclosure and User Agreement (NDUA)
o Users who log in to the WIDA Secure Portal automatically agree to the NDUA.
o Printed copies of NDUA not included in materials shipments.
• Overage
o Included in the shipment of paper test materials to schools
o Use overage before ordering additional materials, if possible.
38
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: Additional Test Materials Ordering
• Test materials will arrive in schools on or about January 4, 2021.
• Once materials are received in early January, verify that the number of
materials and accommodated forms are appropriate.
• Additional materials may be ordered between January 4–May 14.
o Before placing an additional test materials order, verify whether you can use
overage materials included in your shipment.
o Include UPS labels, DRC return shipping labels and any School/District labels
needed with your additional test materials order.
o If possible, additional materials orders should be combined into one order.
• Materials may not be transferred between test sites.
39
Massachusetts Department of Elementary and Secondary Education
Test Security
• Test administrators may view test booklets up to 24 hours before the
test is administered, under principal’s supervision in a secure location.
• Store paper materials in a secure location when not in use.
• For online testing, seat students at least 6 feet apart for safety and so they
cannot see adjacent screens. For example, you may seat students:
o with barriers between computers
o staggered face-to-face, an appropriate distance apart
o every 4−6 seats
• Ensure that students do not have access to electronic devices such as cell
phones, smart watches, tablets, and computers other than the one they are
testing on. 40
Massachusetts Department of Elementary and Secondary Education
Safety Considerations for In-Person Testing
• Ensure an appropriate physical distance between students.
• Ensure more medically at-risk students are tested individually or with
siblings from the same household.
• Wear masks and consider using face shields and gloves.
• Maintain clean environment
o Alcohol swabbing or disinfectant wiping of headphones and microphones.
o Use of disposable plastic sheaths on microphones, if available.
o Wipe keyboards and desks with a sanitizing wipe between student tests.
o Wipe laminated materials with sanitizing wipe between student tests.
o Allow equipment to rest after cleaning and between students.
• Test in spacious, well-ventilated rooms.41
Massachusetts Department of Elementary and Secondary Education
Safety Considerations for In-Person Testing (cont.)
• Online testing
o Plan for additional time to sanitize the materials and equipment
between students.
oConsider reducing student-to-test administrator ratio for group
administered tests.
oConsider training more test administrators to accommodate
additional groups of students.
o Inform parents of the test location and safety precautions in place.
o Encourage students to speak clearly and loudly through their mask.
oAvoid using computer’s internal microphone for the Speaking test.42
Massachusetts Department of Elementary and Secondary Education
Safety Considerations for In-Person Testing (cont.)
• Paper-based, Kindergarten, and Alternate ACCESS testing
oPlace a plexiglass barrier between students and the test
administrator
oUse a pencil to point (both the test administrator and the
student)
oDisassemble test booklet and place pages into sheet
protectors within a binder, or cover materials in plastic wrap,
laminate, or place in plastic bags to be wiped down
oHave only one person (the test administrator or the student)
touch the booklet.43
Massachusetts Department of Elementary and Secondary Education
Test Domains and Grade Level Clusters
44
*Kindergarten is a paper-based test kit.
**K, 1, 2, and 3 are separate paper-based tests for Listening, Reading, and Writing.
Paper-based Speaking tests are clustered as shown above.
**
Massachusetts Department of Elementary and Secondary Education
Listening Item Layout (Online Test)
45
Massachusetts Department of Elementary and Secondary Education
Reading Item Layout (Online Test)
46
Massachusetts Department of Elementary and Secondary Education
Speaking Item Layout (Online Test)
47
Massachusetts Department of Elementary and Secondary Education
About the ACCESS for ELLs Speaking Test
• Speaking test measures student’s ability to produce oral academic English
by responding verbally to pre-recorded test questions.
• A “virtual test administrator” guides the student through questions
designed to elicit language at progressively higher levels of proficiency.
• Students listen to recording of a “model (sample) student” responding to a
question; then, student responds to a similar question at the same
proficiency level, using the model student’s response as an example.
• Students provide responses by clicking the “Record” button, then speaking
clear and complete responses into the microphone. Make sure students’
screens are set to “Record” and not “Pause."
• Responses are recorded and automatically submitted for scoring. 48
Massachusetts Department of Elementary and Secondary Education
About the ACCESS for ELLs Speaking Test (cont.)
• Speaking tasks are presented at three proficiency levels: Levels 1, 3, and 5.
o Tier assignment is based on the results of Listening and Reading tests, which
must be administered first
o Tier assignment is available almost immediately
• The length of response time depends on the task, grade-level test, and
student’s proficiency level.
• During scoring, students will not be penalized for running out of time
and/or not completing a sentence or thought.
• Student responses do not need to be accurate or lengthy to score well, but
they should be clearly delivered and include relevant word choices
focused on the question.49
Massachusetts Department of Elementary and Secondary Education
Preparing to Administer the Speaking Test• Set up testing environment with enough space between students to minimize
distractions, and to allow for privacy when students are speaking.
• WIDA recommends testing up to 3-5 students per test administrator. Newcomers
and students at lower proficiency levels may need individual testing.
• Test administrator should test new (or shy) students individually and encourage the
students to “talk to you” while speaking into microphone.
• Practice with students before testing (See slide 52 for link to sample test questions)
o Let student know that he/she will follow “Nina’s” model responses on the test.
o Have student practice responding using progressively longer and more complex
sentences.
o Role-play with students wearing headsets (with microphones) so they will become
familiar with this technology.
o Watch the histogram to ensure whether their voice is being recorded loudly enough.50
Massachusetts Department of Elementary and Secondary Education
Reminders for Students Taking the Speaking Test
• “Pause”: Stop, take a breath, and think about what you will say before you
hit the “Record” button. Start recording when you are confident that you
have a response ready.
• Speak clearly―do not whisper.
• Use all the available time to respond in order to demonstrate knowledge of
vocabulary and ability to connect ideas.
• Use words like and, because, then, and also to extend what you are saying.
• Speak about as long as Nina speaks.
• Use the pictures to help you think of things to say.
• Do not hit STOP until you are sure you have finished. You cannot go back
once you hit STOP.
51
Massachusetts Department of Elementary and Secondary Education
Sample Speaking Test Items and Scoring Tools
• Sample items provide opportunity to practice spoken language
as they would on the Speaking test.
• Interpretive Guide for Score Reports
https://wida.wisc.edu/assess/access/scores-reports
• WIDA Speaking Scoring Scale Grades 1-12 (used to score
responses to ACCESS for ELLs and WIDA Screener test items).
• WIDA Speaking Rubric Grades 1-12 (used to understand the
scores students earn on ACCESS and WIDA Screener, analyze
student performance in the classroom, and plan ways to scaffold
language learning).52
Massachusetts Department of Elementary and Secondary Education
Writing Item Layout (Online)
53
Massachusetts Department of Elementary and Secondary Education
Online Writing Test: Delivery and Response
• Students in grades 4–12 will keyboard their Writing responses.
o Students who need handwriting booklets (took last year, as indicated in the student’s
IEP; or if a first-year EL and unable to take the computer-based test) must have
booklets ordered by the school during the Additional Test Material Ordering window.
o If a different format is needed for a student, make changes in WIDA AMS and order
materials during Additional Test Material Ordering window. Changes must be made in
WIDA AMS before printing test tickets.
54
Grade Levels and Tiers Writing Test Format Writing Response Mode
1-3
All TiersPaper Handwriting
4-12
All TiersOnline
• Keyboarding is the default.
• Handwriting is available as an
accommodation, if listed in IEP; or if the
student is a first-year EL and unable to
take the computer-based test.
Massachusetts Department of Elementary and Secondary Education
Order of Test Administration
Online and Paper test formats: • Give Listening test first, then Reading, then Writing and Speaking
(in either order). Can give 2−4 test sessions per day to reduce number
of sessions.
Online format:• Students’ performance on the Listening and Reading tests will
determine students’ tier placement for Writing and Speaking.
Paper-based format: • Listening and Reading tests are group-administered.
o May administer both together in one session or as separate sessions.
• Writing and Speaking Tests may be administered in either order, after
Listening and Reading tests are given. 55
Massachusetts Department of Elementary and Secondary Education
Writing Tiers for Online Test Administration
• A Tier Placement Report must be generated for students who will
use a handwriting test booklet for the Writing test.
o Procedures for running this report are given in the WIDA AMS User
Guide on page 99.
• After Listening and Reading tests are completed, run the report to
identify which tier booklet (A or B/C) the student should receive.
• Grades 1-3 Writing tests using handwriting booklets must be
administered in separate test sessions by grade cluster and tier
(e.g., Grade 1 Tier A, Grade 1 Tier B/C, Grades 2-3 Tier A, and Grades
2-3 Tier B/C).
56
Massachusetts Department of Elementary and Secondary Education
Estimated Administration Times
Students work at their own pace – tests are untimed.
• Listening - Approximately 40 minutes
• Reading - Approximately 45 minutes
• Speaking - Approximately 35 minutes
• Writing - Approximately 65 minutes
These are guidelines/suggestions for scheduling purposes only
and include only actual testing time (not preparation or breaks).
57
Massachusetts Department of Elementary and Secondary Education
Paper-based ACCESS: General Information
• Grades and grade clusters:
o Grades K, 1, 2, 3, 4−5, 6−8, 9−12
• Listening and Speaking
o Test Administrators will play pre-recorded prompts on a CD.
o Listening and Speaking test audio are on the same CD.
• Speaking
o Speaking test is divided into two tiers (A and B/C).
o Individually administered with pre-recorded prompts.
o Test administrators will score student responses (paper only).
▪ Must be trained and certified
58
Massachusetts Department of Elementary and Secondary Education
Paper-based ACCESS: Tier Selection
• There are two tiers for each of the four domains.
o Tier A is appropriate for ELs who:
▪ are first-year ELs without previous instruction in English
▪ receive literacy instruction in their native language ONLY
▪ have low levels of English literacy (Level 1- low Level 3)
o Tier B/C is appropriate for ELs who:
▪ have social language proficiency and some, but not extensive, academic
language proficiency in English
▪ have acquired some literacy in English and may be approaching grade-
level literacy
▪ are at an English proficiency level of approximately Level 3.5 or higher.59
Massachusetts Department of Elementary and Secondary Education
Paper-Based ACCESS: Test Administration
• Affix the correct label. Note: Booklets without a label will not be scored.
o Pre-ID Label for each student (White)
o District/School Label (Yellow)
o “Do Not Process” Label (White with Orange Stripe)
• Complete demographic information in booklet
o Do not cross out information on labels.
o Consult the State-Specific Directions (on WIDA MA State page) regarding which
fields to complete.
o Double-check demographic information before submitting test materials, including
Do Not Score codes.
o Bubble in circles completely in #2 pencil (not pen).
• Return test materials once most of the testing has been completed, so DRC can
begin scoring.
60
Massachusetts Department of Elementary and Secondary Education
Do’s and Don’ts: Bubbling Item Responses
61
✓ Number 2 pencil
✓ Completely fill in the bubble
✓ Dark circles
X No light pencil
X No pen
X No marks other than complete fill
Massachusetts Department of Elementary and Secondary Education
Paper-Based ACCESS: Scheduling Considerations
o Determine number of test administrators needed for each
test and test location, including providing
accommodations.
o Schedule according to time estimated for each test.
o Plan make-up sessions in case of inclement weather.
o Schedule group-administered tests by tier and grade
cluster.
o Schedule individual administrations of Speaking,
Kindergarten, and Alternate ACCESS tests.
62
Massachusetts Department of Elementary and Secondary Education
Tools, Accommodations, and Test Administration Considerations
ACCESS for ELLs, Kindergarten ACCESS for ELLs, and Alternate
ACCESS for ELLs incorporate the use of:
o Universal tools available to all students
▪ Embedded in online tests, or provided by test administrator
during testing
o Test administration considerations available to all students
▪ At the discretion of the principal (or designee)
o Accommodations available only to ELs with disabilities
▪ As indicated in the student’s IEP or 504 Plan
See the Accessibility and Accommodations Supplement.63
Massachusetts Department of Elementary and Secondary Education
Universal Tools: Available to All Students
If needed, provide student with:
• Audio aids
• Color contrast/alternative background and font color (online)
• Colored plastic overlay (online, paper)
• Highlighter (online, paper), colored pencils, or crayons (paper)
• Keyboard navigation (online)
• Line guide (online) or tracking tool (paper)
• Low-vision aids or magnification devices
• Sticky notes (online)
• Scratch paper 64
Massachusetts Department of Elementary and Secondary Education
Administrative Considerations: Available to Any Student, at Principal’s Discretion
• Adaptive and specialized equipment or furniture
• Familiar test administrator
• Frequent or additional supervised breaks
• Individual or small group setting
• Monitor placement of responses in the test booklet or onscreen
• Read aloud test to self
• Specific seating
• Short segments
• Verbal praise or tangible reinforcement for on-task or appropriate behavior
• Verbally redirect student’s attention to the test (English or Native Language)65
Massachusetts Department of Elementary and Secondary Education
ACCESS Accommodations for ELs with Disabilities
• Special test format (paper, large print, Braille)
• ASL interpretation of test directions (SD)
• *Manual control of item audio (MC)
• *Repeat item audio (RA)
• Human reader for items (HI)
• Human reader for response options (HR)
• Human reader repeats items (RI)
• Human reader repeats response options (RR)
• Large print version of test (LP)
• Braille (BR)
• Scribe (SR)
• Word processor or similar keyboarding device used to respond to test items (WD)
• Student responds using a recording device, then played back and transcribed by student (RD)
• *Extended Speaking test response time (ES)
• Test administered by school personnel in non-school (alternate) test setting (NS)
66
* These must be pre-ordered in
WIDA AMS before testing begins.
Massachusetts Department of Elementary and Secondary Education
Accommodations Policies
• Accommodations must be listed in the student’s IEP or 504 plan.
• The following accommodations are NOT allowed:
▪ Reading aloud test items on the Reading test.
▪ Translating test items into a language other than English
(although directions may be translated, if native language speaker
is available)
▪ Signing test items, passages, and/or responses (although
directions may be signed)
▪ Use of bilingual word-to-word dictionaries
▪ Responding to test questions in a language other than English67
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: “Do Not Score” Code - SPD• Do Not Score Code “SPD” should be selected in cases where a student did
not complete a domain(s) because of an unavailable accommodation or
specific disability, including:
o students with a vision or hearing impairment who cannot take the Listening and
Speaking domain tests, OR
o students who have “special access” ELA read-aloud accommodation, which is
unavailable for ACCESS Reading test, OR
o students who are non-verbal/selective mute and cannot take the Speaking
domain test
If SPD “Do Not Score”
code is not selected and
the domain is not
administered, student
will count as absent. 68
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: “Do Not Score” Code – SPD (cont.)
• Kindergarten: Do Not Score Code “SPD” should be selected
for students who:
owould take the Alternate ACCESS if it were available
(all domains = SPD)
oneed to take Alternate ACCESS is listed in the student’s IEP
If SPD “Do Not Score”
code is not selected and
the domain is not
administered, student
will count as absent.
69
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: “Do Not Score” Code – SPD (cont.)
• In WIDA AMS, follow this path:
All Applications>Student Management>Manage Students
• Select the test administration, district name, etc. from the dropdown
boxes and fill in the student’s name. Click “Find Students”.
70
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: “Do Not Score” Code – SPD (cont.)
• Under the blue bar below the dropdown boxes, find the
student.
• Click on the View/Edit icon and edit information.
• Click on the Do Not Score tab and select Deferred Special
Education/504 (SPD) for the appropriate domain(s).
71
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: Other “Do Not Score” Codes• Absent should not be selected unless the student was absent the entire
testing window. Requires DRC intervention if accidentally applied.
• Invalidate can only be selected by the State.
• There will be an opportunity during the Post-reporting Data Validation to
remove codes accidentally applied. Must be corrected during the window.
• Do Not Score codes must be reviewed during the Pre-reporting Data
Validation process so that results are not accidentally suppressed.
72
Massachusetts Department of Elementary and Secondary Education
Test Ticket Information
•Test tickets are considered secure materials.
•Test tickets are printed by Test Coordinator or Test
Administrator for students prior to taking the test.
•Test tickets include the student’s name, username, and
password for the test session.
•Students should verify that they have their own test
ticket prior to logging in to the test.
73
Massachusetts Department of Elementary and Secondary Education
Test Ticket Information (continued)
• Accommodations that should be listed on test tickets:
oManual control of item audio (MC)*
o Repeat item audio (RA)*
o Extended Speaking test response time (ES)*
• N/A should be in the Accommodation field for all other
accommodations.
• It will either say “Writing” for a keyboarded writing response;
or “Writing HW”, for a handwriting booklet writing response.
• Grades 1-3 will not have test tickets for the Writing domain as
writing is completed in a paper student test booklet.74
Massachusetts Department of Elementary and Secondary Education
Test Ticket: Edit/Print Ticket Status
75
Massachusetts Department of Elementary and Secondary Education
Test Ticket: Sample
76
Massachusetts Department of Elementary and Secondary Education
Kindergarten ACCESS for ELLs
• Individually administered
• Approximately 45 minutes
per student
• Adaptive format
• Includes manipulatives
• All components scored by
the Test Administrator during test administration
• May be administered in two sessions (A-C, and D-F).
77
Massachusetts Department of Elementary and Secondary Education
Alternate ACCESS for ELLs
New on the DESE ACCESS Web page:
Participation Guidelines: Which Students Should Take the Alternate ACCESS for ELLs?
• For ELs with the most significant cognitive disabilities in grades 1-12
• Untimed, but takes about 20 minutes to administer each domain
• Individual (1:1) test administration
• No tiers
• All domains scored by test administrator
• Scripted tasks read by Test Administrator, with repetition, cues, and
task modeling
• Requires training and certification to administer
• DRC processes the scored tests for reporting78
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: System Status Indicator
• Located on the WIDA AMS login page
• If you suspect your technical problems are due to a system
outage, follow the link near the bottom of the login page to
confirm that all test systems are working as expected.
79
Massachusetts Department of Elementary and Secondary Education
WIDA AMS: Student Status Dashboard
• The Student Status Dashboard allows user to display student
testing status by school and test administration.
• Test data can be filtered by status, grade, and domain.
80
Massachusetts Department of Elementary and Secondary Education
Procedures for Students Who Transfer to and from a Massachusetts School During Testing
• Transfer student to new school in WIDA AMS if within district.
• Submit Student Transfer Form in WIDA AMS for district-to-
district transfers
• See “Instructions for Student Transfers During Testing” on
DESE’s ACCESS for ELLs web page for more information:
www.doe.mass.edu/mcas/access/
• Instructions for completing the Student Transfer Form in WIDA
AMS are available on pp. 72-75 of the WIDA AMS User Guide.
81
Massachusetts Department of Elementary and Secondary Education
DESE Online System: Service Now
• “Service Now” is the DESE online system to:
o Request Testing in an Alternate Setting
o Report Testing Irregularities
o Request Tier Overrides (Online testing only)
o Report Discrepancies after testing (including Requesting a Booklet
Search or Scoring Appeal)
• Links to online forms for these functions available on the
DESE ACCESS web page at www.doe.mass.edu/mcas/access/.
82
Massachusetts Department of Elementary and Secondary Education
Service Now
83
Massachusetts Department of Elementary and Secondary Education
Service Now
84
Massachusetts Department of Elementary and Secondary Education
Service Now: Testing Irregularities
Please report any of the following to the Department as soon as possible
after it occurs:
• Use of cell phones or other unauthorized devices during test administration.
• Use of English-language dictionary, bilingual dictionary, or thesaurus.
• Interruption during the test that does not permit the student to resume
testing on the same day.
• Student took the test using another student’s ticket.
• Student took the test with incorrect accommodations or without
accommodations listed in their IEP/504 plan.
• Student took the wrong test mode.
85
Massachusetts Department of Elementary and Secondary Education
Materials Return: May 21, 2021
86
Scratch paper should be securely destroyed.
Massachusetts Department of Elementary and Secondary Education
Materials Return: Do a Final Check
• Booklets with student responses should have a label.
• Front and back covers must be bubbled correctly.
• Unused booklets should not have a label.
• Responses to Braille or large print should be transcribed into
standard booklets (can fold Braille and large print materials and
return with standard test materials).
• See the “Preparing Materials for Return” section of the District
and School Test Coordinator Manual (bottom of page 22) for
more information.
87
Massachusetts Department of Elementary and Secondary Education
Late Materials Return
•Materials returned after the deadline will not be
processed with on-time materials.
•Materials returned late will not have a data validation
window.
•Reports of results for late materials may be issued
after general release of other results, later in the
summer.
88
Massachusetts Department of Elementary and Secondary Education
Pre-Reporting Data Validation
• Pre-reporting data validation window: July 6-July 12, 2021
• Districts verify and update student demographics in WIDA AMS for
any student who took the test, but for whom demographic
information is missing or incorrect.
• This process ensures that complete and accurate reports (both
electronic and printed) will be available to districts.
• Pre-reporting data validation should be completed by Test
Coordinators.
• More information in the WIDA AMS User Guide Supplement for Data
Validation available in WIDA Secure Portal>Download Library89
Massachusetts Department of Elementary and Secondary Education
Data Validation
90
Massachusetts Department of Elementary and Secondary Education
Data Validation (continued)
91
Massachusetts Department of Elementary and Secondary Education
Post-Reporting Data Validation
• Post-reporting data validation window: TBD
• Districts verify and update student demographics in WIDA
AMS for any student whose demographic information is
missing or incorrect.
• DESE will review requests for Test Booklet Searches and
Scoring Appeals until (date to be determined).
• More information in the WIDA AMS User Guide Supplement
for Data Validation available in the WIDA Secure
Portal>Download Library
92
Massachusetts Department of Elementary and Secondary Education
Contact Information
• MA Department of Elementary and Secondary Education (DESE):
781-338-3625 or [email protected] (NEW address) ▪ Policies and program management
▪ Preparation for test administration
• WIDA Help Desk: 1-866-276-7735▪ Personal accounts
▪ Standards
▪ Training materials and certification
• DRC Help Desk: 1-855-787-9615▪ WIDA AMS user accounts, session management, ordering additional materials
▪ Technology issues
▪ Test materials
▪ Reporting and results93
THANK YOU
781.338.3625 [email protected]
www.doe.mass.edu/mcas/access/ 75 Pleasant Street, Malden, MA 02148
Dan Wiener, Administrator of Inclusive Assessment
Melanie Manares, English Language Proficiency Assessment Coordinator
Shannon Cullen, MCAS and ACCESS Assessment Specialist