2012 Standardized Testing and Reporting (STAR) Program and CAHSEE Grade 10 CensusPre-Test Workshop for Test Site Coordinators

High Schools

Session One: 3:30-5:30 PMWednesday, 2/16/12–Montana Room

Session Two: 9:00-11:00 AMWednesday, 2/17/12–Montana Room

Presented by:Mao J. Vang, Ed.D.

Sacramento City Unified School DistrictAssessment, Research and Evaluation, Box 780

5735 – 47th Ave.Sacramento, CA 95824

Tel. 916-643-9420Fax. 916-643-9474

Agenda

• Introductions• CAHSEE Grade 10 Census Overview• Objectives• New in 2012• Test Security• STAR Program Overview• Test Site Coordinator Responsibilities

– Multiple Choice Tests• Documents and Coding• Test Variations, Accommodations & Modifications• Preparing Documents for Return• Additional Resources• Questions & Answers

2

Objectives• Provide an overview, key requirements, and

administration information for the 2012 Standardized Testing and Reporting (STAR) Program

• Present the requirements for ensuring test security• Review required student demographic information• Preview required forms and how to complete them• Review how to package and return all testing

materials • Visit Training Resources for Test Site Coordinators

Webpage

3

Key Dates

4

STAR Grade Testing Window Materials Delivery Materials Pickup

Writing Test        

EAP Writing Essay 11 March 5-23All high schools with grade 11 February 27-March 2 March 26-30

Multiple-Choice Tests        

CSTCMACAPASTS

2-11

Wave 1: March 27-May 3, 2012New Technology & Nonpublic Schools

March 19-23 May 7-11

Wave 2: April 18-May 18, 2012Traditional Calendar Schools, The Language Academy, & Yav Pem Suab Academy

April 9-13 May 21-24

Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If you complete testing ahead of schedule, contact AR&E to arrange for early pickup.

New for 2012

• Testing window: 23 days• Answer documents

– Front: SEID added– Back: NPS moved– CAPA (shading of “5”) for Level I ONLY

• Writing tests– Reading aloud prompt now accommodation– Writing test can only be given in 1 day

• CMA– Braille for all– Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer

documents

5

New for 2012

• District home, hospital, independent study has a school code– If district has a program– Use new district CDS code

http://www.cde.ca.gov/ds/sp/cl/documents/ calpadsupdflash41.doc• Security Audits• Mark Discrimination Analysis

6

STAR Program Overview

• California Standards Tests (CST)Grades 2-11 for most students, includes separate writing test in grades 4 & 7

• California Modified Assessment (CMA)Grades 3-11 for students with IEP specification, includes separate writing test in grades 4 & 7

• California Alternate Performance Assessment (CAPA) for students with significant cognitive disabilities

• Standards-based Tests in Spanish (STS) English learners grades 2-11 whose primary language is Spanish and:– Receive instruction in Spanish, or– Have been enrolled in US school < 12 months

7

Early Assessment Program

• EAP tests measure readiness for college English and mathematics for CSU and California Community Colleges (CCC) placement. CCC can begin accepting EAP results in 2010.– Administered as voluntary augmentations to grade 11 ELA

CST and the Algebra II and Summative High School Math CSTs– Students must mark ONLY ONE circle

8

Early Assessment Program• Items included in CST booklet– Extends CSTs by 15 items in ELA and Math. – EAP in English also requires a writing test that will

be administered separately from STAR. Essay is required if English score is desired to be sent to CSU and or CCC. Allow for an estimated time of 45 minutes to respond to the prompt.

– March 5-23, 2012 writing testing windowRefer to pages 46-47 in Coordinator Manual

9

Testing Requirements

• All students enrolled on the first day of testing for each district in grades 2-11 needs to be assessed with one of the following:– CST/CMA

– CAPA

10

Testing Requirements by CST Content

11

California Standards Test

Grade English Language Arts

Mathematics(Choose one end-of-course (EOC) completed in

summer 2011 or will complete in 2011-12 school year)

Science(Choose one end-of-course (EOC)

completed in summer 2011 or will complete in 2011-12 school year)

History-Social Science

General Math Algebra I Geometry Algebra II

Summative High School

MathGrade 10-

Life Science Biology Chemistry Earth Science Physics U.S. History World

History

9 Required

Required if not in Algebra I or higher

math

EOC EOC EOC EOC N/A EOC EOC EOC EOC N/A EOC

10 Required N/A EOC EOC EOC EOC Required EOC EOC EOC EOC N/A EOC

11

Required (additional

EAP questions + separate

EAP Writing Essay)

N/A EOC EOCEOC +

Additional EAP

questions

EOC + Additional

EAP questions

N/A EOC EOC EOC EOC Required EOC

Testing Requirements by CMA Content

12

Note: If current Individual Education Plan (IEP) specifies CMA content area for a student, the student does not take that corresponding part on the CST.

California Modified Assessment

Grade English Language Arts

Mathematics(Choose one end-of-course completed in summer

2011 or will complete in 2011-12 school year)Science

Algebra I Geometry Grade 10-Life Science

9 Available Available Available N/A

10 Available Available Available Available

11 Available Available Available N/A

CMA Participation• Current IEP specifying CMA & content area(s)• Previous participation– Previous CST Score of FBB or BB in subject area assessed

and may have taken the CST with modifications; and – 2 years scoring Proficient or Advanced on CAPA

• Not be eligible to take the California Alternate Performance Assessment (CAPA).

• Response to appropriate instruction– Receiving grade level instruction and has goals written to

grade level standards

13

Testing Requirements by CAPA Content

14

Note: If current Individual Education Plan (IEP) specifies CAPA for a student, the student takes CAPA for all content areas.

California Alternate Performance Assessment

Level Grades English Language Arts Mathematics Science

I 2-11 Required Required Required

II 2-3 Required Required Required

III 4-5 Required Required Required

IV 6-8 Required Required Required

V 9-11 Required Required Required

• Performance-based, one-on-one test • For students with significant cognitive disabilities

unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations

• Student must have an IEP • IEP specifies CAPA and level• Do not take STS• Answer document:– Use only 2012 answer document– Ensure correct CAPA Level

is marked in 7a

CAPA Overview

15

CAPA Overview (Continued)• CAPA is to be administered by trained licensed or

certificated individuals• 10% of the CAPA tests by level must be second rated• CAPA testing window is the same as the multiple-choice

window.• CAPA materials are include with multiple-choice materials.• For questions regarding training for CAPA examiners,

contact: – Linda Kawahara-Matsuo, District CAPA trainer– Special Education Department– 643-9122

16

CAPA Observers

• Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS)

• Double ratings are randomly selected• Observers must mark Observer and BOTH examiners

and observers must sign the answer document

17

Preparing To Administer the CAPAObserver’s Answer Doc

1 – Name, etc.3 – Date of Birth5 – Name6 – Gender7a – CAPA Level7b – Grade11 – Student ID12a – SSID

Use blank from overage.Observers must mark sections

18

Testing Requirements by STS Content

19

Standards-based Tests in Spanish

Grade English Language ArtsMathematics

(Algebra I and Geometry are available for grades 8-11)

2 Available Available3 Available Available4 Available Available5 Available Available6 Available Available7 Available Available8 Available Available9 Available Available

10 Available Available

11 Available Available

Note: Students in grades 8 and 9 who are not taking Algebra I or Geometry courses take NO STS math, but do take CST math.

STS Overview• Required for English learners (ELs) in grades 2-11

whose primary language is Spanish and who either:– Receive instruction in Spanish regardless of the length of

time they have been enrolled in the U.S.; or– Have been enrolled in a school in the U.S. less than 12

cumulative months. • Not to be administered to English-only,

I-FEP, R-FEP, or dual immersion who do not meet the inclusion criteria stated.

• Students taking the STS must also take CSTs or the CMA• Students who take CAPA do NOT take STS

20

• Site Coordinator Segment– General, first part about security only– Refer to Site Coordinator Updates for 2012

Handout

2012 STAR Pre-Test Workshop || Slide 21

View Training Video

Security Documents• The STAR Security Agreements from STAR test site

coordinators (principals) MUST be received by AR&E before test materials may be delivered to test sites.– Principals must review and sign the 2012 STAR Test

Security Agreement and send it to STARSupport@sac-city.k12.ca.us

• STAR test site coordinators MUST have a completed 2012 STAR Test Security Affidavit from test examiners before giving them testing materials.

22

Test Security Agreement and Affidavit

Send copies of all Test Security and Affidavits to STARSupport@sac-city.k12.ca.us or Box 780 by first day of multiple choice testing.

Sign by all others having access to STAR Tests

Sign by Principal or Designated Test Site Coordinator

23

Security Audits

• At randomly-selected schools and district offices• Before, during, or after testing• Are materials secure, accounted for, and when not in

use locked-up• Are correct administrative procedures being

followed: – Materials have been removed or covered– Students are not being coached through the exams– Only appropriate accommodations and or modifications

are being provided, et. al.

2012 STAR Pre-Test Workshop || Slide 24

Mark Discrimination Analysis

• An automated process completed at the time of test booklet (grades two and three) and answer document scanning

• Identifies erasures to determine if the response has changed from:– Correct to wrong, or– Wrong to wrong, or– Wrong to correct, or

• From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses

Wrong left wrong, orCorrect left correct, orNo response

Test Site Coordinator (TSC)Responsibilities Overview

• Attend training provided by district STAR coordinator (Assessment, Research and Evaluation-ARE)

• Study and become familiar with the documents and procedures: – 2011 STAR District and Test Site Coordinator Manual– Directions for Administration for at least one-grade level CST

and CMA– STAR Test Site Coordinator Summary of Responsibilities

Handout

26

TSC Responsibilities Overview Continued

• Schedule all tests and make-ups within the testing window (See sample schedules posted at Website)

• Inform teachers, students and parents of the testing schedule and where students are to report on the day tests are administered

• Train personnel at your site– Use Examiners Training Videos with Updates for 2012

Handout posted on Website– Use Test Examiners and Proctors Training Presentation

posted on Website– Obtain Security Affidavits from all personnel involved

27

TSC Responsibilities Overview Continued

• Monitor test administration• Handle defective test materials• Manage emergency situations– Use Appendix C: STAR Program Irregularities and

Incidents, pages 80-84 of manual– Complete the appropriate report form and send a

copy to the district coordinator

28

TSC Responsibilities Overview Continued

• Maintain the security of all testing materials– When conducting inventory, begin with Box 1 and use the Test Site Packing

List to verify that all materials were packaged accurately– Lock Freight Kit packet in secure place with test materials until needed– Contact Assessment, Research and Evaluation (643-9420) immediately for any

discrepancies.– Save original boxes for returning materials

• Distribute/collect test materials daily at your site– No test materials should be left in a classroom overnight– Use Inventory Forms posted at Website

• Ensure testing of all students in grades 2-11 • Act as liaison between your site and district coordinator• Obtain/return all test materials to/from district on time

29

Pre-identified (Pre-ID) Documents

• Pre-identified students have pre-printed answer documents

• Newly enrolled students (02/01-04/18/12)– Check for pre-printed label, if available, put it on answer

document and treat document the same as if pre-ID.– If no pre-printed label, hand-bubble all demographic fields.

30

CMA Materials for 2012Grades 8−11

• If Pre-ID:– For grades 8–11 if at least one CMA test is

pre-identified for a student, the student will receive both the CMA and the CST pre-identified answer documents

• If NOT Pre-ID:– Answer documents sent based on test

booklets ordered

CMA Materials for 2012Grades 8−11 Continued

• CMA for grades 8 and 11– Both CST and CMA grade-level test booklets available for each

student taking one or more CMA exams• All students must take the CST History/Social Science in grade

8 and U.S. History in grade 11• CMA for grades 9 and 10

– Grade-level CMA test booklets for only the CMA tests to be administered• CST available only if needed• Students in grades 9 and 10 may take only CMA (ELA, Algebra

I, Geometry, grade 10 Life Science)

Coding Student InformationPre-ID Answer Documents

Pre-ID Barcode:Check student name and give to correct student

33

On the first day of testing, per teacher-read instructions, all students must complete Section 1

Coding Student InformationBlank Answer Documents

34

On the first day of testing, per teacher-read instructions, all students must complete Section 1

All demographic information must be hand-gridded.

Coding Student InformationTest Version Numbers (Gr. 8-11)

• Students will have 2 answer docs if they are taking CMA• Must mark version # for grade level tests and EOC tests Gr. 8 CST, pp. 2 & 3 Gr. 8 CMA, p. 2

3535

A2: Special Conditions• Test coordinator

completes A, E, M, P, & T

• Teacher completes C, F, L, X, Y, & Z

A4: English Learner (EL) Test VariationsExaminer completes if any EL variations were used

Coding Student InformationAfter Each Test

36

A3: Accommodations and Modifications

Examiner marks• whether student has

IEP or 504 Plan and • which accommodations

were used

37

• Two types of testing variations– ALL – available for all students

– 1 – available if regularly used in the classroom

Testing Variations

38

• Students may use accommodations and/or modifications if – Specified in IEP or Section 504 Plan and – Regularly used in the classroom

• Accommodations and modifications are to be used only to allow a student to access the test, not to provide an advantage– Accommodations do not change what the test is measuring– Modifications change what the test is measuring

Note: Refer to Appendix E: Allowable Test Variations, Accommodations, and Modifications, pp. 87-91 in Coordinator Manual

Accommodations & Modifications

Preparing Documents for ReturnTranscribing and Voiding Documents

• Transcribe braille and large print (or not processed)

• Write VOID on any answer document(s), with marks,not to be scored; return with nonscorables

39

Preparing Documents for ReturnSchool Grade Identification Sheet (SGID)

• Complete for each set of answer documents or test booklets

• Check counts to be accurate• Place on answer documents

for correct – Grade– School (school code machine-

marked)

Pre-printed

Preparing Documents for ReturnComplete Master File Sheet

Write in:• Number of SGID• Number of

Scorable Documents

• Totals

41

• Return with each school • Check counts to be accurate• Required with scorables if materials

were ordered:– Write “0” (zero), no blanks– If not tested, note that school did not test

EAP Scorables Packing Order

42

Multiple Choice Scorables Packing Order

43

44

Label Boxes for Return to District

EAPEnglish Essay

Multiple Choice Tests (CST, CMA, CAPA & STS)

ScorableMaterials

Non-scorableMaterials

ScorableMaterials

Non-scorable

Materials

Magenta Labels

Yellow Labels

Orange Labels

Green Labels

• Site Coordinator Segment– CST High School– Refer to Site Coordinator Updates for 2012

Handout

View Training Video

Additional Resources: Rosters• Rosters will be sent from STARSupport@sac-city.k12.ca.us: – Pre-ID roster• Students’ demographic information that have been pre-coded on

answer documents or late labels– STS test roster • Students who need to take STS

– CMA test roster• Students who have been identified to participate using CMA on one

or more tests – End-of-course test roster (Grades 7-11)• End-of-course tests based on student enrollment. Test site

coordinators need to verify– Pre-ID roster Code Conversion

46

Resources & Contact InformationAll training materials and updates will be posted on the district’s Internet:http://scusd.s468.sureserver.com/training-resources-test-site-coordinators

47

STAR Support Contact: Assessment, Research, and Evaluation5735 – 47th Ave.Serna Center, Box 0780 Phone: 643-9420 Fax: 643-9474Email: STARSupport@sac-city.k12.ca.us

Questions and Answers

48

?