42
1 . Smarter Balanced District Test Coordinator Workshop 1 February 3-6 2015 Overview of Smarter Balanced Assessments Special Populations Test Readiness Presentation Overview 2

New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

  • Upload
    voliem

  • View
    214

  • Download
    0

Embed Size (px)

Citation preview

Page 1: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

1

.

Smarter Balanced District Test Coordinator Workshop

1

February 3-6 2015

Overview of Smarter Balanced Assessments

Special Populations

Test Readiness

Presentation Overview

2

Page 2: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

2

What is Smarter Balanced?

A. A buttery spread that helps lower your cholesterol?

B. A new testing company?

C. A state-governed project based at a research university?

All students enrolled in grades 3–8 and 11 are required to participate in the Smarter Balanced summative mathematics test except:

Students with the most significant cognitive disabilities who meet the state’s criteria for a mathematics alternate assessment based on alternate achievement standards (approximately one percent or less of the student population).

Students with state approved exemption.

All students enrolled in grades 3–8 and 11 are required to participate in the Smarter Balanced summative English language arts/literacy (ELA) test except:

Students with the most significant cognitive disabilities who meet the state’s criteria for the English language arts/literacy alternate assessment based on alternate achievement standards (approximately one percent or less of the student population).

English Language Learners (ELLs) who enrolled within the 12 months prior to the beginning of testing in a U.S. school have a one-time exemption. These students may instead participate in their state’s English language proficiency assessment consistent with state and federal policy.

Students with state approved exemption.

Student Participation for Smarter Balanced Math/ELA Assessments

4

Page 3: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

3

Testing Windows

5

New Hampshire Testing WindowsPractice/Training Test January 27, 2015

Interim Assessment(ICA and IAB)

February 9, 2015

Summative (Grade 3-8) March 16, 2015

Summative (HS) March 16, 2015

Smarter Balanced Summative Assessments Estimated Testing Times

6

Page 4: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

4

ELA Timing and Sequencing

7

Mathematics Timing and Sequencing

8

Page 5: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

5

Suggested order of administration for each content area:

Note: The ELA PT has two parts: • Part 1 – Research

• Part 2 – Full Write

Scheduling Test Sessions

9

CATCATClassroom Activity

Classroom Activity

PerformanceTask

PerformanceTask

Recommended to be administered no more than 3 days before the PT

Approximately 30 minutes

Designed to “level the playing field” to ensure that all students understand the context of the task

Administered in a classroom setting

Topics and scripted classroom activities available for download in Test Information Distribution Engine (TIDE).

Classroom Activity

10

Page 6: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

6

Smarter Balanced Practice and Training Tests

11

The training test should be taken by all students and within three weeks of when testing begins.

Response Types

12

Page 7: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

7

All universal tools

All designated supports, including:• Color contrast• Masking• Streamlining• Text-to-speech items • Translated test directions: Spanish • Translations (glossary): Spanish, Arabic, Cantonese, Filipino, Korean, Mandarin, Punjabi, Russian,

Ukrainian, Vietnamese• English Glossary • Stacked Translation: Spanish

All accommodations, including:• American Sign Language for all math items and ELA listening stimuli and items • Braille• Text-to-speech for reading passages in grades 6–high school • Closed Captioning

Embedded Universal Tools, Designated Supports, and Accommodations

13

Test Security Chart

14

Page 8: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

8

Appeal Types

15

Appeal Type Description

Reset a Test • Removes the test, and scores associated with the test, from the system• Enables student to start a new test• Requested due to accommodations not being set properly

Reopen a Test • Allows for a test that has already been submitted or has expired to be re-opened

Grace Period Extension • Extends the grace period if a test session is unexpectedly interrupted• Gives access to all previous answers

Restore a Test That Has Been Reset

• Return a test from the Reset status to its prior status• Only allowed on tests that have been reset• A test can be restored if it was reset in error

Invalidate a Test • Eliminates the test• Student loses that test and does not receive a score• Requested due to test security incidences

Currently Available • Interim Assessment Blocks (IAB)

• Interim Comprehensive Assessments (ICA)

Requires upload of school users to TIDE

Requires setting of designated supports and accommodations for students in TIDE

Educators must be trained

Students should be provided opportunity to take Practice/Training Tests

Interim Assessments

16

Page 9: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

9

AIR Systems Overview

Copyright © 2014 American Institutes for Research. All rights reserved.

• Portal

• Secure Browser

• Test Information Distribution Engine (TIDE)

• Test Delivery System (TDS)

• Online Reporting System (ORS)

Overview

18

Page 10: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

10

Portal – http://nh.portal.airast.org

19

User Pages

20

Page 11: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

11

2121

Resources

Important Dates

Practice and Training Tests

Modules:

- What is a CAT?

- Performance Task

- Accessibility and Accommodations

- Embedded Universal Tools

- Student Interface

- TA interface

- Technology Overview

Systems Requirements for Online Testing

Resources Available Now

22

Page 12: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

12

Resources Coming Soon

23

• Test Administrator and Test Coordinator Manual

• User Guides

– Test Information Distribution Engine (TIDE)

– Test Administration

– Online Reporting System (ORS)

– Teacher Hand Scoring System (THSS)

• Modules

– Test Administration Overview

– Test Information Distribution Engine (TIDE)

– Teacher Hand Scoring System (THSS)

What is the Secure Browser?

24

The secure browser is designed to ensure test security by prohibiting students from accessing any other programs or websites during testing.

Page 13: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

13

Download the latest secure browser from the portal. The field test secure browser will not work.

Before taking a test, all applications must be closed.

An iOS 8 compatible version can now be found in the Apple store.

Secure Browser Information

25

Secure Browser Download

26

Page 14: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

14

Accessing AIR Systems

27

Activating TIDE Account

28

Page 15: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

15

TIDE Overview

29

User Roles

30

Task DA DC SC TE TA

Viewing and Editing Student Settings

Uploading Test Settings

Order Materials

Adding User Accounts

Create Appeals

Downloading and Installing Voice Packs

Page 16: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

16

Roles and Usernames

31

TIDE Navigation

32

Page 17: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

17

Manage Users

33

Add Users

34

Page 18: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

18

NH Schools must register students taking the Smarter Balanced assessments via the i4see Workbench.

(http://www.education.nh.gov/data/i4see.htm)

Student records can not be added or deleted directly in AIR, they must be entered through i4see.

Students can only be tested in the school and grade that is entered in i4see.

Student Information (i4see)

35

There are reports on the i4see Workbench that school can use to print out a list of students registered as well as 'student tickets'.

The i4see coordinator for each school district should be able to help submit the students.

(see http://www.education.nh.gov/data/i4see_tip.htm -- for a list of 'i4see contacts at each district).

There is a TIP (technical insight paper) that explains the i4see submission process.

(see http://www.education.nh.gov/data/i4see_tip.htm -- for this TIP).

Student Information (i4see)

36

Page 19: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

19

Student Information

37

Retrieve Students

38

Page 20: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

20

Uploading Student Settings and Accommodations

39

Testing Tickets

40

Page 21: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

21

Orders

41

On-time Orders

42

Page 22: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

22

Appeals

43

Types of Appeals

44

Appeal Type Description

Reset a Test • Removes the test, and scores associated with the test, from the system• Enables student to start a new test• Requested due to accommodations not being set properly

Reopen a Test • Allows for a test that has already been submitted or has expired to be re-opened

Grace Period Extension • Extends the grace period if a test session is unexpectedly interrupted• Gives access to all previous answers

Restore a Test That Has Been Reset

• Return a test from the Reset status to its prior status• Only allowed on tests that have been reset• A test can be restored if it was reset in error

Invalidate a Test • Eliminates the test• Student loses that test and does not receive a score• Requested due to test security incidences

Page 23: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

23

Creating Appeals

45

Creating Appeals

46

Page 24: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

24

Viewing Appeals

47

Voice Pack

48

Page 25: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

25

Test Delivery System Overview

49

Two interfaces:• Student

• Test Administrator

Two sites• Operational

– Interim

– Summative

• Practice/Training Test

Student Interface

50

Page 26: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

26

Student Test Selection

51

Student Interface

52

Page 27: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

27

End of Segment

53

End of Test

54

Page 28: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

28

Test Administrator Interface

55

TA Interface: Overview

56

Page 29: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

29

TA Interface

57

Student Entry

58

Page 30: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

30

Save and Edit Details

59

Monitoring Student Progress

60

Page 31: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

31

Pausing and Stopping Sessions

61

This online course includes the following: Contains step-by-steps instructions for Test Administrators

Supplements other training resources (user guides, test coordinator manual, etc.)

Contains interactive portion

Contains quiz questions

Multiple viewing opportunities

Certificate of completion

Online TA Certification Course

62

Page 32: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

32

ORS Interface: Welcome Page

63

Which students have not yet tested?

Which students have started but not yet completed their test?

Which students need to finish tests that are going to expire soon?

Which students have paused tests?

Test Management Center: Plan and Manage Testing

64

Page 33: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

33

Special Populations

Copyright © 2014 American Institutes for Research. All rights reserved.

Available to  ALL Students

Available with IEP or 504 Plan

A Conceptual Model for SBAC Accessibility

Page 34: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

34

A Conceptual Model for SBAC Accessibility

A Conceptual Model for SBAC Accessibility

(Math),

Page 35: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

35

A Conceptual Model for SBAC Accessibility

EmbeddedAmerican Sign Language, Braille, Closed Captioning, Text to Speech(Reading)

Non-EmbeddedAbacus, Alternate Response Options, Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe, Speech--to -Text

Uploading Accommodations and Settings

70

Page 36: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

36

Test Readiness

Copyright © 2014 American Institutes for Research. All rights reserved.

Network Connection:• A stable, high-speed (wired or wireless) network and

internet connection are required for the test.

• The response time for each test depends on your network’s bandwidth, number of students simultaneously testing, size of test content, proxy server (if used), and other factors.

Network Requirements

72

Page 37: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

37

Network Configuration:• Session timeouts on proxy servers and other devices should be

set to values greater than the average scheduled testing time. For example, if test sessions are scheduled for 60 minutes, consider session timeouts of 65–70 minutes.

• Web proxy servers must be configured to NOT cache data received from servers.

• For any device that performs traffic shaping, packet prioritization, or quality of service, the IP addresses to be used for testing should be given a high priority to ensure the best performance.

Network Requirements

73

Performance Factors:• Bandwidth

• Number of students simultaneously testing

• Wireless networking configuration

• Secure browser

Network Requirements

74

Page 38: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

38

Bandwidth:• At least 20Kbps bandwidth per student being tested

• Affected by both Local Area Network (LAN) traffic and internet traffic from the router

• LAN should always be analyzed to determine potential traffic bottlenecks

Network Performance

75

Number of students simultaneously testing:• Network performance may slow when large numbers of

students are testing at one time.

• Perform network analyses at different times to ensure adequate capacity.

• Multiply the number of students being tested by 20Kbps to get an estimate of bandwidth needed, and compare that estimate with a network speed test.

Network Diagnostics

76

Page 39: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

39

Network Diagnostics Tool

77

Smarter Balanced Modules

Training Modules

78

What is a CAT? Technology OverviewPerformance Task Test Administration OverviewAccessibility and Accommodations Online Reporting System Embedded Universal Tools Teacher Hand Scoring System Student Interface TIDETA interface

Page 40: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

40

Test Administrator Manual

Test Coordinator Manual

Technology Coordinator Brochure

District/Test Administrator Brochure

TIDE Brochure

TDS Brochure

ORS Brochure

Manuals/Brochures

79

The following webinars will take place in February:

Technology Requirements for Online Testing

How to Start/Monitor Online Testing and Test Settings

How to Use the Online Reporting System

Upcoming Webinars

80

Page 41: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

41

Practice and Training Tests

81

Event Date(s)

Practice and Training Tests Release Date January 27, 2015

Smarter Balanced Interim Assessment Test Window (ICA and IAB)

February 9, 2015–June 12, 2015

Smarter Balanced Math/ELA Summative Assessment Test Window (Grades 3 – 8, HS)

March 16, 2015–June 6, 2015

Key Dates

82

Page 42: New Hampshire Training PPT 02 01 15 - NH Dept of Education · PDF fileSummative (Grade 3-8) March 16 ... Smarter Balanced Practice and Training Tests 11 ... Cantonese, Filipino, Korean,

42

Further Information

• New Hampshire Smarter Balanced Assessment Portal • http://nh.portal.airast.org/

New Hampshire Smarter Balanced Help Desk• American Institutes for Research

• 1-844-202-7584

[email protected]

Thank You!

Questions about the i4see submissions can be sent to [email protected]

Questions about the DLM process and assessment can be sent to [email protected]

More Contact Information

84