Upload
domenic-moore
View
212
Download
0
Embed Size (px)
Citation preview
Assessment Services, SDUSDAssessment Services, SDUSD
2012 STAR Nuts & Bolts Grades 6-11
2012 STAR Nuts & Bolts Grades 6-11
Traditional Calendar
Traditional Calendar
2
AgendaAgendaNew for 2012New for 2012
Test Security Test Security
Before TestingBefore Testing
During TestingDuring Testing
After TestingAfter Testing
3
What’s New for 2012?What’s New for 2012?• The testing window has been extended
by 4 days• In Section A3 Section A3 on the answer document,
you must indicate IEPIEP or 504504 in subsection “a” even if the student did not use an accommodation or modification
• There are 2 new fields on the answer document: 12b12b SEID for ELA teacher and 12c12c SEID for Math teacher; DO DO NOT COMPLETENOT COMPLETE
IGNORE IGNORE
12b & 12c12b & 12c
4
What’s New for 2012?What’s New for 2012?• Mark discrimination analysisMark discrimination analysis– an automated
process completed at the time of scanning to determine how many responses have been changed; results of the analysis are sent to the CDE leading to investigations at schools with excessive erasures
• Random security auditsRandom security audits
• The language regarding the “clean up” of answer booklets has been clarified- nothing within the response circle may be erased
Ensure that you and your staff 1. Do NOTNOT erase anything in the response
circles
2. Do NOTNOT darken any marks in the response circles
CLARIFICATION ON RESPONSE CIRCLES (BUBBLES)CLARIFICATION ON RESPONSE CIRCLES (BUBBLES)
5
What’s New for 2012?What’s New for 2012?
6
SecuritySecurity• Security Agreements
• Security Affidavits
• All materials must be kept in a CENTRAL, LOCKED, SECURE area
In RED Envelope
Agreements Signed @ Nuts & Bolts
BLM
7
Security AuditsSecurity Audits• Possible visit from ETS/Global Compliance
Service – BeforeBefore testing (pages 63-6463-64 in manual)
– DuringDuring testing (pages 64-6564-65 in manual)
– AfterAfter testing (pages 65-7065-70 in manual)
– Ask for “official” letter from the representative when he/she comes to your school
– Auditors will check that all materials are secure, accounted for, and when not in use locked up
8
Before TestingBefore TestingIdentifying Students to Test?Identifying Students to Test?
Accommodations & ModificationsAccommodations & Modifications
Receiving & Ordering MaterialsReceiving & Ordering Materials
Preparing Materials & LocationsPreparing Materials & Locations
Providing Training for StaffProviding Training for Staff
9
Who should participate in the STAR Program?
Who should participate in the STAR Program?
ALLALL students in grades 2-11 except those exempt by parent or guardian
Parent Exemption Request form in BLM
Students participate in STAR by taking either the CSTs, CMA, or CAPA
10
2012 STAR: Identifying Students2012 STAR: Identifying Students
• California Standards Tests (CSTs) = grades 2-11; most students take CSTs
• California Modified Assessment (CMA)= grades 3-11; must meet SBE eligibility criteria; must be in IEP
• California Alternate Performance Assessment (CAPA) = grades 2-11; students with severe cognitive disabilities; must be in IEP
STAR Item & Estimated Time Charts, pages 106-111 in manual
Page 76 in manual for CMA criteria
See CMA & CAPA rosters
2011 STAR — Students Tested Statewide(English–Language Arts)
2011 STAR — Students Tested Statewide(English–Language Arts)
11
89.5%
5.0%
3.5%
1.0%CST Without Disabilities (4,201,345 students)
CST With Disabilities(254,341 students)
CMA(174,155 students)
CAPA(46,806 students)
12
Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each Grade
Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each Grade
Grade 6 Grade 7 Grade 8
Grade Level ELA
CST or CMA CST or CMA CST or CMA
Grade Level Math
CST or CMA CST or CMA(not enrolled in
Algebra)
Grade Level Science
CST or CMA
Grade Level History-SS
CST
Content-Specific Math
Algebra I CSTor
Algebra I CMA
CST (Gen Math, Alg I, Geom, etc)
orAlgebra I CMAGeometry CMASTAR Item & Estimated Time
Charts, pages 106-111 in manual
See Handout
13
Required Tests for CST/CMARequired Tests for CST/CMATests (non-CAPA students)Tests (non-CAPA students)Required Tests for CST/CMARequired Tests for CST/CMATests (non-CAPA students)Tests (non-CAPA students)Grade 9 Grade 10 Grade 11
Grade Level ELA CST or CMA CST or CMA CST or CMA
Grade Level Science
CST or CMA
Grade Level History-SS
CST
Content-Specific Math
CST (Gen Math, Alg I, Geom, etc) orAlgebra I CMAGeometry CMA
CST (Algebra I, Geometry, HS Sum
Math, etc) orAlgebra I CMAGeometry CMA
CST (Algebra I, Geometry, HS Sum
Math, etc) orAlgebra I CMAGeometry CMA
Content-Specific Science
CST (Biology, Physics, Chem, etc)
CST (Biology, Physics, Chem, etc)
CST (Biology, Physics, Chem, etc)
Content-Specific History-SS
World History CST
World History CST
World History CST
See Attachments G, H, & I of Administrative Circular #54
14
Identifying Students for the Standards-based Tests in Spanish (STS)
Identifying Students for the Standards-based Tests in Spanish (STS)
Eligibility Criteria1. Spanish-speaking EL
students enrolled less than 12 months in a US school
2. Spanish-speaking EL students receiving instruction in Spanish regardless of months enrolled
see rosters and directions
– Reading & Lang. Arts (Grades 2-11)
– Grade Level Math (Grades 2-7)
– Algebra 1 STS (Grades 7-11)
– Geometry STS (Grades 8-11)
Eligible students take the STS in addition to the
CST and/or CMA(CAPA students do NOT take STS)
15
Special Education, 504 Students, and English LearnersSpecial Education, 504 Students, and English Learners
• Identify “CAPA” & “CMA” students
• Review IEP and 504 Plans for accommodations & modifications that must be made available to students
• Plan for any variations that EL students will use during testing
• Identify English Learners who must take the STS
See Attachment D of Administrative
Circular # 54
16
Accommodation vs. ModificationAccommodation vs. Modification• AccommodationsAccommodations
– Change conditions for testing, but do not change what is being measured
– Count as-is; no impact on API & AYP
• ModificationsModifications
– Change testing conditions and what is being measured
– Reported “as is” on the Student Report
– Count as far below basic (200) for API
– Do not count as proficient or as a participant for AYP
17
Modifications are NOT ALLOWED on the CMA
Modifications are NOT ALLOWED on the CMA
See Attachment D of Administrative
Circular # 54
Modifications are only allowed on CST & STS (if in 504 or IEP)
18
Receiving MaterialsReceiving Materials
SECURE ALL
MATERIALS
SECURE ALL
MATERIALS
ORDER ADDITIONAL MATERIALS
ORDER ADDITIONAL MATERIALS
INVENTORY UPONRECEIPT
INVENTORY UPONRECEIPT
Verify Quantity
Note missing materials; contact
Denise ASAP if there are
discrepancies
Fax FormReseal Boxes
Store in a SECURE,
LOCKED areaBLM
SAVE BOXES
Count each booklet; packs of 20 don’t always contain 20
19
Identifying and Training StaffIdentifying and Training Staff
• CST ExaminerCST Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit
• CMA ExaminerCMA Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit
• CAPA ExaminerCAPA Examiner = certificated employee of SDUSD who has received CAPA examiner training and has signed a STAR Security Affidavit
• STS ExaminerSTS Examiner = employee of SDUSD who has been trained, has signed a STAR Security Affidavit, and is bilingual in English and Spanish
• ProctorProctor = employee of SDUSD who has been trained and has signed a STAR Security Affidavit.
See page 11 in manual
20
Required Training for StaffRequired Training for Staff• Ensure Consistency
Directions For Administration (DFA) must be read verbatim
• Ensure Test SecurityMonitor students; actively superviseCollect test booklets and answer
documents before dismissing studentsEnsure there is enough time to
complete a part before beginning the part
Do not send unsupervised student(s) with test materials to alternate location
Report all irregularities/incidents ASAP
See Handout
21
Required Training for StaffRequired Training for Staff• Test Examiners CANNOTCANNOT:
Review test questions before, during, or after testing
Leave instructional materials up in the classroom
Check students’ answers Advise students of a wrong answer
or advise student to check an answer
Withhold answer docs until students demonstrate they have the right answers
Divulge the contents of the test(s) to anyone
Ensure that all examiners READ & UNDERSTAND the AFFIDAVIT
22
Prepare Testing LocationsPrepare Testing Locations• Create an ideal testing environment- free from
noise with good lighting & ventilation
• Remove or cover all instructional materials visible to students related to the content of the test
• Make arrangements for students w/IEPs & 504s (i.e. read aloud)
• Prepare a separate room(s) for CMA test-takers
• Set up a quiet room where students who need more time to test can be escorted by an adult
• Arrange an activity and separate room for students not tested (exempt by parent)
23
Preparing & Distributing MaterialsPreparing & Distributing Materials• Materials provided by school:
– No. 2 pencils with erasers– “Testing- Do Not Disturb” signs– Scratch paper for math & science tests– Highlighters may be used (caution to grades 2 & 3)
• Make arrangements for students w/IEPs & 504s (i.e. Braille version, large-print, calculator, same version test for students with ”read aloud”, etc.)
Page 6
6 in
man
ual
• Check materials out and in DAILYDAILY– see Inventory Control form; excel version on our website at http://www.sandi.net/page/1545
BLM
BLM
24
During TestingDuring Testing
Directions For AdministrationDirections For Administration
Required Fields on Answer Docs.Required Fields on Answer Docs.
Managing Emergency SituationsManaging Emergency Situations
Test Booklet VersionsTest Booklet Versions
25
CST, CMA, & STS Test Booklets- Multiple VersionsCST, CMA, & STS Test Booklets- Multiple Versions
• Each grade level has multiple versions of the test
• Schools will receive only one version at grade 2
• Schools will receive multiple versions for grades 3-11
• For students who are eligible for the “read aloud” accommodation/modification, make sure you test with the same version when administering to a small group
Students MUST hand-grid the version number used on the answer document
Students MUST receive the same test version for the entire duration of the test
CRITICAL
26
Directions For Administration (DFA)Directions For Administration (DFA)
• Grade 2 CST DFA is SECURE and cannot be distributed to teachers BEFORE testing; the nonsecure version may be used for training
• Additional DFAs may be downloaded at:
• “SAY” boxes must be read exactly as written• “T” in “SAY” boxes indicates that everything in the box
may be orally translated for EL students if regularly done in the classroom; can translate “SAY” boxes only and may not assist students with test questions
http://www.startest.org/dfa.html
27
Managing Emergency Situations Managing Emergency Situations and Testing Incidentsand Testing Incidents
Managing Emergency Situations Managing Emergency Situations and Testing Incidentsand Testing Incidents
Test administration incidentTest administration incident = any situation that occurs before, during, or after testing that does not conform to the instructions stated in the DFA or the coordinator’s manual
• Disruption in testing (fire alarm, power outage, evacuation)
• Test administration error (randomly distributing Pre-ID’d answer documents)
• Student cheating (mark A2, Special Conditions) Complete a Test Administration Incident Report form Make copy of report form for your files; send original
in REDRED envelope to Assessment Services
BLM
Pages 65 and 82 in manual
28
Testing IrregularitiesTesting IrregularitiesTesting IrregularitiesTesting Irregularities
Testing irregularities Testing irregularities = circumstances that may compromise the reliability and validity of test results; could negatively impact API and AYP
• Coaching students, leaving instructional material up during testing, allowing students to use additional materials not specified in the IEP/504, etc.
• Inappropriate test preparation• Breach in security (i.e. copying tests)Contact Erin Gordon ASAP
Pages 80-81 in manual
29
Answer DocumentsAnswer Documents Answer DocumentsAnswer Documents
• Pre-ID answer documents Pre-ID answer documents = for students enrolled before 2/07/122/07/12; will be included in your will be included in your initial shipment initial shipment
• Pre-ID labels Pre-ID labels = for students enrolled between 2/07/122/07/12 and 4/05/124/05/12; pick up from Annex 10 after they arrive in the district (week of 4/16/12)
• Hand-gridHand-grid blank answer documents blank answer documents = students enrolled after 4/05/124/05/12 until the first day of testingfirst day of testing; demo guides will be provided for students enrolled between 4/06/124/06/12 and 4/12/124/12/12
30
Answer DocumentsAnswer Documents ContinuedAnswer DocumentsAnswer Documents Continued• There are separateseparate answer booklets/documents
for CMA and CST at grades 3 and grades 8-11• If there have been changeschanges since the pre-id file
submission, a blank answer document must be hand-gridhand-grid
• There are minimal fieldsfields requiredrequired to match CMA and CST for students (grades 3 & 8-11) with one Pre-ID’d answer document who will be taking both a CST and CMA:
1. Name (last, first, and middle initial)2. Birth date3. Gender4. Statewide Student Identifier (SSID)
31
CST/CMA Answer Docs
- FRONT
CST/CMA Answer Docs
- FRONT
= Must Be Completed by HAND
= Included in Pre-ID
Students must use the correct answer document; check barcode label
Sample answer document on page 130 in manual
= Hand-grid ONLY if applicable
Bar
cod
e L
abel
ID
IGNOREIGNORE
32
CST Answer Documents- FRONTCST Answer Documents- FRONT
Box 7c = hand-grid for students taking the CMA
= Must Be Completed by HAND
Box 1 = completed by the student
= Hand-grid ONLY if applicable
33
CST Answer Documents INSIDECST Answer Documents INSIDE
For Content-Specific Math and Content-Specific Science the Math/Science CST or Math CMA taken MUST be hand-grid
Version # must be hand-grid
34
Answer Documents ContinuedAnswer Documents ContinuedEarly Assessment Program (EAP)Early Assessment Program (EAP)
Answer Documents ContinuedAnswer Documents ContinuedEarly Assessment Program (EAP)Early Assessment Program (EAP)
• Grade 11 ONLY• To receive status for ELA, students must complete:
– Writing essay in March; and– CST multiple choice questions; and– Additional EAP multiple choice questions.
• For mathematics, students must complete additional questions on the Algebra II CST or Summative High School Mathematics CST
• Students must mark ONLY ONE circle
35
Answer DocumentsAnswer Documents Grade 7 CMA MathGrade 7 CMA Math
Answer DocumentsAnswer Documents Grade 7 CMA MathGrade 7 CMA Math
Grade 7 Math and Algebra I CMA have different numbers of questions
36
= Hand-grid ONLY if used by student
= Hand-grid ONLY if applicable
CST answerDocuments
- BACK
CST answerDocuments
- BACK
= Included in Pre-ID
37
= Hand-grid ONLY if applicable
CST AnswerDocuments
- BACK
CST AnswerDocuments
- BACK
Box A2: Special Condition codes on page 120 in manual(i.e. absent, parent exempt, cheated, refused to test)
Box A1: only complete if directed by Erin (testing irregularities)
38
CST/CMAAnswer
Documents- BACK
CST/CMAAnswer
Documents- BACK
= Hand-grid ONLY if used by student
Box A3b: Box A3b: hand-grid only if used by student; no modifications allowed on the CMA; codes on pages 120- 122 in manual
Box A4: Box A4: hand-grid only if used by student; no glossary use allowed on ELA; codes on page 122 in manual
= Hand-grid ONLY if applicable
Box A3aBox A3a: must be completed for ALL students who have an IEP or 504
39
CAPA Answer Documents - FRONTCAPA Answer Documents - FRONT
= Must Be Completed by HAND
= Included in Pre-ID
Box 7a Box 7a = CAPA Level must be
hand-grid
Bar
cod
e L
abel
ID
IGNORE
IGNORE
Box 4Box 4 = Version # is 4
Sample answer document on page 140 in manual
40
CAPA Answer
Documents- BACK
CAPA Answer
Documents- BACK
= Hand-grid ONLY if used by student
= Hand-grid ONLY if applicable
= Included in Pre-ID
= Must Be Completed by HAND
41
After TestingAfter TestingAfter TestingAfter Testing
Prepare Answer DocumentsPrepare Answer Documents
Complete Required FormsComplete Required Forms
Pack Materials ProperlyPack Materials Properly
Return Materials to Annex 10Return Materials to Annex 10
Account for ALL MaterialsAccount for ALL Materials
42
Prepare SCORABLE Answer DocumentsPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents
1. Check that the demographic information is complete & correct
2. Hand-grid A2, A3, & A4 if applicable3. Check that version #s and math/science test
taken has been completed (grades 7-11)4. Check for tears, stray marks, pen marks5. Check for paper clips, science reference sheets,
scratch paper6. Transcribe answers to clean answer document if original is damaged
An answer document must be submitted for every student (grades 2-11) enrolled on the 1st day of testing
43
Grade 10CST/CMA
Grade 10CAPA
Grade 10STS
Prepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents Continued ContinuedPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents Continued Continued
1. Separate all answer documents by GRADEGRADE
2. Within each grade, separate by TEST TYPETEST TYPE (CST/CMA, CAPA, STS)
3. Within each test type separate documents for students who were EXEMPTEXEMPT by parent (P on A2) and who were ABSENTABSENT (A on A2) for the entire test window
= ABSENT
= EXEMPT
44
Apportionment FormApportionment Form
•Complete one grade level at a time
•Indicate your school’s first day of testing
•Sign and have principal sign
•Return in RED envelope
45
Principal’s CertificationPrincipal’s
Certification
Principal’s signature
Return in RED envelope
46
School & Grade Identification (SGID)- side 1School & Grade Identification (SGID)- side 1
Complete 1 SGID per grade grade level and test test typetype: 1) CST/CMA; 2) CAPA; and 3) STS
Hand-grid appropriate test
Hand-grid grade level; leave blank for CAPA
Number of answer docs. under this SGID
Pages 26 & 93
in manual
First day of testing
When was STS given? If no STS, leave blank
47
School & Grade Identification (SGID)- side 2School & Grade Identification (SGID)- side 2
Complete top ONLY for grades 2-8
Pages 99-105 in manual for
coding instructional
materials
Teacher Reports are no longer available, so don’t complete bottom portion
48
Master File SheetMaster File Sheet
Submit with SCORABLE SCORABLE materials- Box 1
For CAPA =
all grades and levels are stacked together under 1 SGID
Page 95 in manual
Totals
The Master File Sheet should be the first thing we see when we open Box #1 of your scorablesscorables
49
50
Packing Scorable Materials
Packing Scorable Materials
Master File Sheet on Top
SGID on top of each stack of answer docs
SCORABLESCORABLE materials returned in ORANGEORANGE labeled boxes
Packing Order =1. CAPA2. CST/CMA (lowest grade level on top)
3. STS (lowest grade level on top)
See pages 67- 69 in manual
51
Preparing Non-Scorable MaterialsPreparing Non-Scorable Materials
Damag
ed-
trans
crib
ed
VOID answer documents if:
•Student transferred to a different school before your first day of testing
•Demographic information on PreID was incorrect & blank document was used
•Original answer document was damaged and transcribed to new answer document
VOIDED answer documents go in NON-SCORABLES
52
Packing NON-Scorable Materials
Packing NON-Scorable Materials
NON-SCORABLE Materials Return
in GREEN labeled boxesUnused Freight Kit Materials
USED Scratch Paper (return or securely destroy)
CAPA•Unused CAPA Answer Docs
•VOIDED Answer Documents
•Examiner’s Manuals & Tests
CSTs/CMA (by grade level)•DFAs
•Unused & VOIDED Answer Documents
•Test Booklets
STS (lowest grade on top; highest grade on bottom)
•DFAs
•Unused & VOIDED Answer Documents
•Test Booklets
Page 67-70 in manual
TOP
BOTTOM
53
Returning Materials: Labeling Boxes Returning Materials: Labeling Boxes
Affix label to designated area on box
Put box counts in SCHOOL section
on labels
54
CORRECT WAY TO NUMBER BOXES
WRONG WAY TO NUMBER BOXES
COUNT SCORABLE BOXES
SEPARATELY FROM
NONSCORABLE BOXES
Lightly seal boxes to transport
55
56
RED EnvelopeRED Envelope
1. Signed Apportionment Form2. Signed Certification Form3. Signed Security Affidavits4. Incident Reports
Make copies for your files and submit originals
Do not pack RED envelope in
scorable and nonscorable boxes; keep
separate
Return your materials to Annex 10 by Return your materials to Annex 10 by 4:30 p.m. on your assigned day4:30 p.m. on your assigned day
Traditional School Deadlines: May 15: G-M (Elem & Middle)May 16: N-Z (Elem & Middle)May 17: A-F (Elem & Middle)May 18: Senior High Schools
57
58
Contact InformationContact Information
Assessment ServicesAssessment Services
Erin Gordon (619) 725-5687; [email protected]
Denise Ormsbee (619) 725-7059; [email protected]
Fax Number (619) 725-7070
Website: www.sandi.net/assessment
Special EducationSpecial Education
Sarah Ott (619) 725-7091 [email protected]
Julie Wade (619) 725-7412 [email protected]
Debby Warner (619) 725-7604 [email protected]
CAPA
CMA
CAPA