Maine Educational Assessments (MEA)...Launch the kiosk or the app and login using the site readiness credentials. Run the test on a handful of devices for each configuration. Once

© 2017 eMetric LLC Do Not Distribute

Maine Educational Assessments (MEA)2018-2019

Mathematics and ELA/Literacy

Test Administration Workshop

Grades 3-8

1


Presenters

Nancy Godfrey, Assessment CoordinatorMaine Department of Education

Trystan Moss, Project Manager IIIeMetric

Andrew Wallace

Technology Advisor to the MDOE Assessment Team

2


Google Sheet

https://bit.ly/2GBKMy9

3


Agenda

What’s New in 2019?

MEA Online System

• Portal Overview

• Kiosk Overview

• Important Information

Conclusion

• Key Dates

•Questions & Answers

4


What’s New in 2019?

MEA Portal Updates

• Class Creation

• School-Level Access to the Dashboard

MEA Kiosk Updates• Student Toolbox Revamped

• New Text Highlighter Tool

• Expandable Passages

• Stimulus-Level Notes via Notepad

• Pause/Exit Functionality

• Options Page for Students with Accommodations

• Accessibility Settings for Mojave Users

5


MEA Online System

Online System

Portal

Users Administration

Site Setup Students ClassesTest

SessionsDashboard

Test Delivery

KioskMobile Apps

6


MEA Portal

User Management

7


Portal Access

Access

• http://maine.measuredprogress.org

• Available as of February 11, 2019 – DACs should have received login credentials

Browser Specifications• Chrome™ 71 or newer

• Firefox® 64 or newer

• Safari® 12 or newer

• Internet Explorer® 11

• Microsoft Edge 42.17 or newer

8


District-Level User Roles

User Role Responsibilities

District Assessment Coordinator (DAC) • Manage & reactivate users (all roles)• Assign student accommodations• Create, edit, and view classes• Schedule, manage and monitor test sessions• Prepare IT network for student testing if

there is no IT Coordinator

District User (DU) • View users• View students• View classes• View & monitor test sessions

IT Coordinator (ITC) • View users• Prepare IT network for student testing• Conduct Site Readiness testing

9


School-Level User Roles

User Role Responsibilities

School Test Coordinator (STC) • Manage & reactivate users (TAs)• Assign student accommodations• Create, edit, and view classes• Schedule test sessions• Manage & monitor test sessions• Prepare IT network for student testing if

there is no IT Coordinator

Test Administrator (TA) • View students• View classes• View & monitor test sessions

10


User Management

✓ Create New User Accounts• New users will receive an email from the Maine Service Center

containing a username and temporary password

✓ Reactivate User Accounts from 2018

✓ Upload & Export Users• Each code should contain 4 characters; include leading zeros.

Example:

If SAU ID = 42, then ORG ID = 0042

If SAU ID = 42 and School ID = 52, then ORG ID = 0042-0052

11


User Management

Icon Description

District-level users (DU & ITC)

will have a four-digit number in

the Org column.

School-level users (STC & TA)

will have a four-digit district

code followed by a hyphen and

a four-digit school code. To

assign a school-level user to

multiple schools, separate the

codes with a |.

The Phone, Fax, and Address

columns are optional and are

not required for the User

Upload.

1

2

3

1

2

3

12


User Management

Demo Includes:

1. Logging in to Portal. 2. Updating your password. 3. Manually creating a new user. – STC user that is assigned to two schools.4. Uploading a new user file containing multiple users. 5. Reactivating existing users. 6. Forgot My Password? link

13


MEA Portal

Administration

14


Administration Workflow

HomeSite

ReadinessStudents Classes

Test Sessions

Dashboard

The Administration component consists of 5-6 tabs depending on your account type. Home – this is where you can view important announcements, access links for downloading the Kiosks, and attain the Proctor Password and Site Readiness log in credentials. Site Readiness – this is where you can certify your site as ready for testing. Students – this is where you can assign student accommodations. Classes – this is where you can verify your rosters for testing.Test Sessions – this is where you will schedule your classes for test sessions. And, the Dashboard – this is where you can view helpful charts and data at the district level.

15


Icon Description

Tabs allow the user to

navigate through the

Administration component.

Kiosk installers for Mac and

Windows devices are

available here.

The proctor password is

used if a student has paused

their test for longer than 30

minutes or has been

inactive in a test for longer

than 60 minutes.

Site Readiness login

credentials are available for

each school.

Home

2

3

4

1

2

3

4

1

16


Site Setup & Site Readiness

✓ Installation• Download and install Kiosk and Mobile Apps

✓ Conduct Site Readiness Testing• Site Readiness login credentials are available in the Portal

• Run the test on each device configuration

✓ Review Results• Details are available on the Site Readiness tab in the Portal

✓ Site Certification• Certify your site as ”Ready for Testing” in the Portal

The first step for conducting Site Readiness testing is to download and install the Kiosks and Mobile Apps onto the devices that will be used for testing at your school. Once you’ve downloaded and installed your Kiosks and Mobile Apps, log in to the Portal to retrieve the site readiness login credentials for your school. Launch the kiosk or the app and login using the site readiness credentials. Run the test on a handful of devices for each configuration. Once you’ve successfully completed your Site Readiness testing, log back into the Portal and navigate to the Site Readiness tab within the Administration component. Here, you can view the details of the devices that you used for Site Readiness testing. Finally, you’ll certify your site as ready for testing.

Each site has it’s own login credentials for Site Readiness. Each school needs to be certified as ready for testing.

17


Site Readiness Test: System Set-Up

Once you’ve logged in to the Site Readiness test, you will see two available sessions. First, click on the Check System Set-Up button.You will see a screen similar to this; the details will include your connection capacity – which is the calculated download speed between your testing device and the data center. This section will specify a recommended maximum number of students who can simultaneously login and download the test. If you plan to test a higher number of students that the recommended number, we recommend staggering the student group logins by 1-2 minutes.

Once you’ve passed all of the sections, you will be prompted to click the Return button to go back to the main selection page. From that page, you will take the Student Interface Test to complete Site Readiness testing on this device.

18


Site Readiness Test: Student Interface

The Student Interface test will give you access to the testing environment exactly as a student would see it. You can preview tools and interact with items to ensure that the display is showing up correctly. Once you’ve completed the Student Interface test, go back to the Portal to view the details of your testing and certify your site as ready.

19


Site Readiness Results & Certification

20


Students

✓ Review Student Information & Enrollment Data

✓ Assign Accommodations• DACs and STCs are responsible for assigning all embedded and

non-embedded student accommodations

✓ Accommodations Upload & Export• Upload Window (at any time): 2/11/19-3/17/19

• Upload Window (after 6:00 pm): 3/18/19-4/12/19

• Manual Window (at any time): 2/11/19-4/12/19

21


Transfer Students: Scenario 1

Student started or completed a test session in their previous school & is transferred with no change to grade level• The student's previously started or completed test session(s) will be transferred to the

new school.

• The student will be added to a new class in the new school.

• The name of the class will be "Transfer Grade X Content Area Student ID" where grade level will be the grade in which the student is enrolled and content area will be the content area associated with the transferred test session.

• The new class will be automatically scheduled to a test session in the new school.

• The test session(s) that the student previously started will appear as Completed in test session details.

22


Transfer Students: Scenario 2

Student started or completed a test session in their previous school & is transferred with a change to grade level• The student's previously started or completed test session(s) will NOT be transferred to

the new school.

• Example: A student is enrolled in Grade 3 at School A and completes Math Session 1. The student transfers to School B and is enrolled in Grade 4. The completed Grade 3 session will not be transferred because the student is no longer enrolled in Grade 3.

23


Students

Icon Description

Accommodations can be assigned, uploaded, and exported in bulk

View the classes a student is assigned to

Verify a student’s enrollment information

Manually assign accommodations via the Student Profile

2

1

1

2

3

4

3

4

24


Classes

✓ Verify Class Rosters• Think of a “class” as a “proctoring group”

• Classes are pre-generated based on grade (as reported in Synergy) and content area

✓ Optional: Create Classes for Test Scheduling*• Classes can be created manually or via file upload

*This is a new permission in 2019

25


Classes

Icon Description

Toggle to select a school and content area

Manually create or upload a grade level class (optional)

View a class roster

Edit a class roster

2

1

3

4

1 2

3

4

26


Test Sessions

✓ Schedule Tests

✓ Verify Form Assignment for Text-to-Speech Testers• If class is already scheduled but student has not logged in:

• Assign accommodation.

• Click the Generate Missing Student Test Logins button on the Test Session Details page.

• If class is already scheduled and student has logged in:• Contact Maine DOE.

✓ Print Student Logins

✓ Manage & Monitor Test Sessions• Test Status export is available at the school and test level

27


Test Sessions

Icon Description

Toggle to select school, content area, and test

Schedule a new test session or export test status

View details of a test session and print student logins

If a test session has been scheduled but no students have logged in, it may be deleted

2

1

3

4

1 2

3

4

28


Test Sessions: Generating Missing Logins

Scenario 1: Enrollment Changes After Scheduling✓ Students Automatically Added to Pre-Generated Classes

✓ Generate Test Logins for Updated Students

✓ Print New Student Logins

Scenario 2: Text-to-Speech Accommodation Assigned After Scheduling✓ Assign Text-to-Speech Accommodation

✓ Generate Test Logins for Updated Students

✓ Print New Student Logins

If there were any enrollment updates to your district/school AFTER you scheduled test sessions (e.g. students moving in to your school, students changing registration from Alternate Assessment (MSAA) to eMPowerME, grade errors/changes in Synergy, etc.), these students WILL NOT have test session tickets! The student will automatically be enrolled in the grade level classes and assigned to a test session, but to get their login credentials the DAC/STC will need to click the "Generate Missing Student Logins" button within the student’s test session details page.

Additionally, if a student is scheduled to take a test BEFORE being assigned a Text-to-Speech accommodation and HAS NOT logged in to the test, the DAC/STC must assign the accommodation within the student’s profile on the Students tab of the Administration component and then click the "Generate Missing Student Logins" button within the student’s test session details page. This will ensure that the student is assigned to the correct TTS form.

If a student is scheduled to take a test BEFORE being assigned a Text-to-Speech accommodation and HAS logged in to the test, the DAC/STC must contact the MDOE to have the test session invalidated. The student will be scheduled to take the test again.

29


Dashboard

✓ Access Data at the District or School Level

✓ View Charts• Concurrent Testers

• Number of Tests Scheduled

• Percentage of Tests Completed

• Operating Systems Usage

• and more

30


Administration

31


MEA Kiosk Overview

Student Device RequirementsDesktop & Laptop

CPU 1.3 GHz

Memory 2 GB (4 GB is strongly recommended for best performance)

Input Device Keyboard (wired or wireless)/Bluetooth mouse or touchpad

Windows® Windows 7 and Windows 10 (32-bit and 64-bit)

Mac OS® 10.13 – 10.14 (64-bit only)

Tablet/Netbook/2-in-1

iOS 11.4 – 12.1

Chromebook™ netbook computer

Chrome OS™ 69 – 71

Windows-based tablets/netbooks/2-in-1

Windows 10 (32-bit and 64-bit)

32


MEA Kiosk Overview

System Requirements – All HardwareConnectivity Student devices must be able to connect to the internet via wired

or wireless networks.Internet connectivity is required at the beginning of the test to authenticate the student login and to download the test content. Internet connectivity is required at the end of the test to submit responses for scoring.

Screen Size 9.7” screen size or larger; ”10-inch class” tablets or larger

Screen Resolution 1024 x 768 or larger

Headphones/Earphones/Ear Buds

Required for students who have a Text-to-Speech accommodation for Mathematics or Essay tests. Microphones are not required.

33


MEA Kiosk Overview

Installation RequirementsContent Filtering Proxies, Firewalls or Locally Used Proxy Software

Review the Kiosk Installation Guide available on the Help & Support site for a full list of URLs that need to be whitelisted on ports 80 and 443: https://maine.onlinehelp.measuredprogress.org.

Sandboxing Applications (i.e. DeepFreeze)

Choose a network or local folder that is not touched by the sandboxing apps during installation for stored responses and installation folders.

Thin-Clients Ensure there is enough memory, CPU, and bandwidth on the server to accommodate multiple student test sessions.

34


Installation Workflow

✓ Review the Kiosk Installation Guide

✓ Download Kiosk Installers from Portal

✓ Install Kiosk on Testing Devices

✓ Download Apps from App Stores

✓ Conduct Site Readiness Testing

✓ Certify Site

35


Important Installation Information

Chromebook Installation“Do not erase all local data” must be selected from the User Data section in the Device Settings during installation in order for student responses to be stored in local storage in the event of a network outage.

Mac Devices Running Mojave 10.14.x and NO MDM

There will be an accessibility warning the first time the kiosk is launched. In order to test, accessibility for the kiosk must be allowed in the System Preferences of each device.

36


Connectivity

Loss of Connectivity During Testing• Encrypted responses will be saved in the location indicated during installation

• Responses will be sent to the server once connectivity is restored

• Testing will not be interrupted

Loss of Connectivity When Submitting Test• Student will receive a warning screen to alert the test proctor that responses

cannot be sent

• Proctor must relaunch the kiosk once connectivity is restored to automatically send responses

Periodic Data Syncs (Heartbeats)▪ Triggered to periodically save and protect student responses▪ Internet interruption during testing:

Encrypted responses saved in the location indicated during installationResponses sent to server once internet connectivity is restored

▪ Internet interruption at the end of testing:Student will receive a warning screen to alert their proctor the responses cannot be sentProctor must re-launch the Kiosk once internet connectivity is restored to send responses

Keep in mind that if you install the saved response location on the network, the student testing device must maintain connection with the network. Otherwise, if the internet connectivity is interrupted AND the network connectivity is interrupted, the student will be unable to continue testing.

37


Stale Responses

STICK TO ONE DEVICE• Switching devices in the middle of testing may result in stale responses.

• If a student absolutely must switch devices, contact the Service Center first!

• (855) 652-8929, [email protected]

38


Testing: Launching the Kiosk

Kiosk is installed on each computer or on the network▪ Students will launch the Kiosk from a desktop icon or a network folder▪ Students log in using their provided usernames and passwords▪ Logins provide unique access per student per test and are NOT case sensitive

39


Testing: Starting a Test

40


Testing: Student Interface

1

3

2

4

Icon Description

View the current question number or bookmark the item. Click to pull up the Test Review page.

Network Connectivity Indicator

Student Toolbox

Navigation Tools

1

2

3

4

1) The top-left of the primary interface displays the current question number that the student is on. When clicked, it will open the test review interface. Students can click the star next to a question number to flag, or bookmark, the question for later review. Bookmarked questions will be starred in the test review interface.

2) Any tools available to the student to assist them as they answer the question presented are available in the bottom left tool bar.

3) The network status indicator is green if the Test Delivery component detects that the network is accessible and functional. Otherwise, it displays in gray. When the user hovers the mouse pointer over the network indicator, network status text is also displayed.4) Students can click “Next” and “Back” or swipe left and right on a touch device to navigate through their test. A “Finish” button will appear on the final item. The “Pause” button will also appear here to allow the student to pause the test. If the student wishes to reset any changes made to the item, the student may click “Clear.”

41


Testing: Pause/Exit Functionality*

42


Testing: Pause/Exit Functionality*

Proctor Password• Must be kept confidential and used only by administrators.

• If the student pauses the test session and does not resume testing within 30 minutes, the Kiosk will automatically exit and the proctor password will be required to continue testing.

• If the student is inactive within a test session for longer than 60 minutes, the kiosk will automatically exit and the proctor password will be required to continue testing.

Notes & Markups

• If the student pauses the test session and resumes testing within 30 minutes, all notes and markups made prior to pausing the test will persist.

43


Student Toolbox: Universal Tools

Tool Icon Description

Expand Passage* Passages can be expanded for easier readability. Expanded passages can be collapsed.

Highlighter*The highlighter allows test takers to highlight text in a passage or item. The highlighted text will persist if a passage is expanded or collapsed.

SketchThe sketch tool allows test takers to highlight, sketch, or draw using black, red, or blue brushes, and erase drawings.

Line ReaderStudents use an onscreen tool to assist in reading by raising and lowering the tool for each line of text onscreen. The line reader is opaque and resizable.

Custom Masking Provides the ability to mask certain parts of the test interface or question.

Reverse Contrast Students can invert all color values in the user interface.

Notepad A notepad is provided for students to write different notes for different items. The notepad is resizable, draggable, and displays a timestamp for when its contents were last modified.

Answer Masking Students are able to “hide” possible answer choices (for multiple choice items only).

Zoom Students can magnify the entire screen up to 300% .

44


Student Toolbox: Item-Level Tools

Tool Icon Assessment/Content Area

Basic Calculator Grades 3-6 Mathematics

Scientific Calculator Grades 7-8 Mathematics

Ruler Mathematics

Equation Editor Mathematics

45


Student Toolbox: Accommodations

Accommodation Icon Description Content Area

Text-to-Speech Mathematics

Play, pause, skip passage, select text for on demand TTS, or stop audio. Rate and speed can also be adjusted.

Mathematics

Text-to-Speech Essay

Play, pause, skip passage, select text for on demand TTS, or stop audio. Rate and speed can also be adjusted.

Essay

Color ContrastChoose a text and background color from a set of 12 pre-defined color combinations.

All

Turn Off All Universal Tools

N/A Assigning this accommodation will turn off universal tools. All

Students with accommodations assignments are presented with an Options Page prior to starting their test session.

The Options Page gives the student a preview of the accommodations available to them.

46


Testing: Submitting the Test

✓ Click Finish on the last item.

✓ Review the Test Review page and click Turn In.

✓ Following the confirmation prompt click Turn In.

✓ Continue on to the next session or click Exit.

47


MEA Kiosk

48


Key Dates

Deliverable Date

Portal Opens! • DAC Login Credentials are Emailed• Kiosks & Mobile Apps Available for Download• Site Readiness Testing Available• Student Data Available

2/11/2019

Student Tutorials Available 2/11/2019 – 4/12/2019

Accommodations Upload Window (no time restriction) 2/11/2019 – 3/17/2019

Test Scheduling 3/8/2019

Operational Test Window 3/18/2019 – 4/12/2019

49


Student Tutorial Access

Available February 11, 2019 via Kiosk & Mobile App

• Grades 3-5 Username: Math3-5, Password: tutorial

• Grades 6-8 Username: Math6-8, Password: tutorial

Mathematics

• Grades 3-5 Username: Reading3-5, Password: tutorial

• Grades 6-8 Username: Reading6-8, Password: tutorial

Reading

• Grades 3-5 Username: WriLang3-5, Password: tutorial

• Grades 6-8 Username: WriLang6-8, Password: tutorial

Writing & Language

50


Help & Support

Measured Progress Service Center• Test Administration or Technical Questions:

[email protected]

• (855) 652-8929

Help & Support Site

• maine.onlinehelp.measuredprogress.org

Maine Department of Education

• MEA Policy & Testing Procedures Questions: [email protected]

• (207) 624-6775

51


Questions & Answers

Thank you.

52

Documents

Maine Educational Assessments (MEA)...Launch the kiosk or the app and login using the site readiness credentials. Run the test on a handful of devices for each configuration. Once