Smarter Balanced Interim Smarter Balanced Interim Assessments: Part IAssessments: Part I

1–2 p.m.

January 15, 2015

California Assessment of Student Performance and Progress (CAASPP)

2

Agenda

• Welcome• Purpose• Overview• Interim Assessment Block Availability in 2014–15• Reports• Uses for the Interim Assessments• Considerations• Questions

3

Purpose

To provide local educational agency (LEA) CAASPP Coordinators with information about the interim assessments to:

•Use the interim assessments in 2014–15•Plan for use in 2015–16

Interim Comprehensive Interim Comprehensive Assessments: OverviewAssessments: Overview

5

A Balanced Assessment System

Common Core State Standards

specify K-12 expectations

for college and career readiness

All students leave

high school college

and career ready

Teachers and schools have

information and tools they need to improve teaching

and learning

Summative:

Tests used for end-of-year accountability and evaluation

Interim:

Tests used for timely and periodic information based on local needs/goals

Formative resources:

Educator resources that support measuring student learning in real-time during instruction

6

Overview

Q: What are the Smarter Balanced Interim assessments?

A: The interim assessments are one component of the Smarter Balanced assessment system and are designed to support teaching and student learning throughout the year. The items are developed under the same conditions, protocols, and review procedures as those used in the summative assessments.

7

Overview

Q: Are students required to take interim assessments?

A: The interim assessments are optional, and are recommended. They enable teachers to check student progress throughout the year, providing actionable information to inform instruction and help students meet the challenge of college- and career-ready standards.

8

Overview

Q: At which grade levels are the interim assessments available?

A: The content of the tests have been aligned to the Common Core State Standards in grades 3–8 and high school. The grade level to assess should be based on the purpose of the testing event. Each test can be administered to students in the grade above and the grade below (e.g., a grade 7 interim test is not limited to grade 7 students, but can be administered to students in grades 6 or 8).

9

Overview

• Two types of interim assessments:1. Interim Comprehensive Assessments (ICAs)– English language arts/literacy (ELA) test and

performance task– Mathematics test and performance task

2. Interim Assessment Blocks (IABs)– There are between 5 and 17 IABs per grade and

content area

10

Overview

Interim Comprehensive Assessments:• Fixed form• Use the same blueprints and assess the same

standards as the summative assessments• Include the same item types and formats, including

performance tasks, as the summative assessments• Yield overall scale scores, overall achievement

level designations, and claim score information– Report against the same scale as the summative

test

11

Overview

• Examples of the use of ICAs include:− A new student from another state is given the

previous year’s ICA.− Mid-year a teacher gives an ICA to gauge how

students might perform on the summative assessment.

12

Overview

Interim Assessment Blocks (IABs)• Fixed form• Focus on fewer sets of skills (e.g., Geometry) • Flexible; supports instruction and curriculum• Include the same item types and formats, including

classroom activities and performance tasks, as the summative assessments

• Yield overall information for each block• Results are reported as Below Standard, At/Near

Standard, and Above Standard

13

Overview

• Examples of the use of IABs include:− A teacher uses the argument performance task

to determine the degree of a student’s understanding before or after instruction.

− A team of teachers uses a block to become informed about how a group of students are performing in geometry.

14

Overview

Q: How can I administer an interim assessment?

A: Interim tests are administered in the same way as summative tests. The test administrator (TA) must use the TA Interface and the student must log onto the test through the secure browser.

15

Administering and Handscoring the Interims

TOMSTOMSVerify student demographic

data

Test Administrator Test Administrator Interface Interface

Administer assessments

Interim Handscoring SystemInterim Handscoring SystemHandscore students’

constructed responses

Requires TOMS logon credentials

11

22

33

16

Overview

Q: Are interim assessments secure?

A: Interim assessment items are NOT secure; however, they are not intended for public use. Teachers or TAs may review the items and their students’ responses to the interim items.

17

Overview

Q: How long are the interim assessments?

A: The number of items on each interim assessment vary by grade and content area. The tests are untimed, so the amount of time it will take for students to complete the interim assessments will also vary.

18

Overview

Q: How will interims be scored?

A: Most responses are machine scored. All open-ended responses are handscored by a TA through the interim handscoring module. The machine-scored results are held until the open-ended portions of the test have been handscored and submitted. The results are then combined to generate a student report.

19

Overview

• Handscoring process:− Online− Rubrics and exemplars provided− Training Webcast scheduled for January 28

Interim Assessment Block Interim Assessment Block Availability for 2014–15Availability for 2014–15

21

IABs for ELA, Grades 3 to 5

Grades 3–5Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearch*Narrative Performance Task (Grades 4–5 only in 2014–15)

*Informational Performance Task*Opinion Performance Task (Grade 3 only in 2014–15)

*Will be available in 2015–16

22

IABs for ELA, Grades 6 to 8

*Will be available in 2015–16

Grade 6-8Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearch*Narrative Performance Task*Explanatory Performance TaskArgument Performance Task

23

IABs for ELA, High School

*Will be available in 2015–16

High SchoolRead Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchExplanatory Performance Task*Argument Performance Task

24

IABs for Mathematics Grades 3 to 5

IAB NameGrade

3 4 5

Operations and Algebraic Thinking *Numbers and Operations in Base 10 * Fractions Geometry   * *Measurement and Data * Mathematics Performance Task *Will be available in 2015–16

25

IABs for Mathematics Grades 6 to 7

IAB NameGrade

6 7

Ratio and Proportional Relationships Number System * Expressions and Equations Geometry *Statistics and Probability * *Mathematics Performance Task *Will be available in 2015–16

26

IABs for Mathematics Grade 8

26

*Will be available in 2015–16 (available as a single Expressions & Equations Block in 2014–15)

Grade 8*Expressions & Equations I (and Proportionality)*Expressions & Equations IIFunctionsGeometry

Mathematics Performance Task

27

IABs for Mathematics for High SchoolHigh School

Algebra and Functions – Linear FunctionsAlgebra and Functions – Quadratic Functions*Algebra and Functions – Exponential Functions*Algebra and Functions – Polynomials Functions*Algebra and Functions – Radicals Functions*Algebra and Functions – Rational Functions*Algebra and Functions – Trigonometric Functions*Geometry – Transformations in GeometryGeometry – Right Triangle Ratios in Geometry*Geometry – Three-Dimensional Geometry*Geometry – Proofs*Geometry – Circles*Geometry – Applications*Interpreting Categorical and Quantitative Data *Probability*Making Inferences and Justifying Conclusions Mathematics Performance Task

*Will be available in 2015–16

Student Reports Student Reports

29

Individual Student ReportHome Example State Bay View School District Bay View Central High Grade 11 Patrick Bowman’s Results

30

Obtaining Student Reports

Data WarehouseData WarehouseReceive and view student

reports

TOMSTOMSVerify student demographic

data

Test Administrator Test Administrator Interface Interface

Administer assessments

Interim Handscoring SystemInterim Handscoring SystemHandscore students’

constructed responses

Requires TOMS logon credentials

Requires same logon credentials used for the Digital Library

11

22

33

44

31

• Before you use the Interims:− Teachers will need Test Administrator access to

TOMS to administer and handscore the interim assessments.

All TOMS users must sign and submit a security affidavit.

–Teachers will use their Digital Library logon credentials to access the Data Warehouse to view student reports.

Systems Used for the Interims

Suggested Uses of the Suggested Uses of the Interim Assessments for Interim Assessments for

2014–152014–15

33

Inform Teaching and Learning

• Administer IAB(s) that align with current curriculum and pacing

• Use IAB results with other sources of evidence to identify student strengths and weaknesses

• Evaluate instructional progress and plan adjustments to increase student learning

34

Authentic Experience

• Create test sessions, pause the test, experience the same interface, etc.

• Respond to different types of questions• Use authentic technology– Keyboard– Mouse– Graphing• Experience content reflective of summative• Gauge time needed to complete the summative test

35

Accessibility Supports

• Universal tools, designated supports, and accommodations are modifiable on the TA Interface for the interim tests. − Provides an excellent opportunity to try out

accessibility supports with students and actual test items

• Note: Only universal tools will be modifiable on the TA Interface for the summative tests.

36

Handscoring

• Helps build content knowledge and supports collaboration within the school

• Provides a clear sense of where the student’s strengths and weaknesses are

• Builds teacher comfort with technology and the process of online scoring

• Gives a sense of the time required to hand score • Through anchor papers, exemplifies the criteria

present in the rubric

37

Implementation Plan for 2015–16

• Become familiar with the interim assessments• Evaluate the district’s available technology• Plan on how to roll out the interims next year:

– Who will be on the interim assessment implementation team?– Who will determine the use of the IABs and ICAs? – How frequently will you review and correct student demographics?

How do you handle students without SSIDs?– What is the process for entering, reviewing, and keeping accessibility

supports current in TOMS?– When and how will TAs (i.e., teachers) be given access? What is the

process for handling security agreements?– What is the plan for scoring (e.g., training, time to score)?– What is the schedule for the interim assessments? How does this

align with curricular pacing plans? How is this communicated? – How will interim assessment troubleshooting be handled?

Immediate ConsiderationsImmediate Considerations

39

Immediate Considerations

• Ensure all teachers have access to the appropriate systems to administer the interims (e.g., grades 2, 9, 10 and 12 teachers)

• Obtain security agreements from teachers • Ensure student demographic data is correct in California

Longitudinal Pupil Achievement Data System (CALPADS)– Especially students’ Statewide Student Identifiers

(SSIDs) and grade level• Provide test administration training for new teachers• Provide interim handscoring training for teachers

Questions?Questions?

Updates and Updates and AnnouncementsAnnouncements

42

Updates and Announcements

• Target release date for Interim Comprehensive Assessment, Interim Assessment Blocks, and the interim handscoring module is January 28.

• Student reports will be available late February.• Next Webcast: Smarter Balanced Interim

Assessments: Part II– Date: Wednesday, January 28, 2015– Time: 1 – 2 p.m.

Resources and SupportResources and Support

44

Help Desk Support

The California Technical Assistance Center (CalTAC) is here to support all LEA CAASPP coordinators!

Monday–Friday from 7 a.m.–5 p.m. PTE-mail: caltac@ets.orgPhone: 800-955-2954

Web site: http://caaspp.org