AIC AuditoriumAIC AuditoriumMarch 21, 2013March 21, 2013

1:00 P.M.1:00 P.M.

CRCT and CRCT-MCRCT and CRCT-MPRE-ADMINISTRATION PRE-ADMINISTRATION

WORKSHOPWORKSHOP

2

AGENDAAGENDA

• Reminders for School Test CoordinatorsReminders for School Test Coordinators• General Administration Information – CRCT & General Administration Information – CRCT &

CRCT-MCRCT-M• General Testing Guidelines and RequirementsGeneral Testing Guidelines and Requirements• Contact InformationContact Information• Questions and AnswersQuestions and Answers

3

Reminders for School Test Reminders for School Test CoordinatorsCoordinators

• Follow all regulations and procedures concerning the administration of any standardized test exactly without variance including any DCSD standard operating procedures;

• Read the Test Coordinator’s and Examiner’s Manuals thoroughly. Seek guidance from Research, Assessments, and Grants with any unclear items;

• Re-deliver all training to local school on April 3, 2013. Re-deliver the Accommodations In-service on or before April 3, 2013. Maintain a signature log (sign in/out) of those individuals trained;

• Allow for all accommodations to be correctly provided. Consult the GA DOE’s Student Assessment Handbook and the Accommodations Manual for Students with Disabilities as well as Research, Assessments, and Grants for assistance;

• Provide correct versions of tests for each student;

• Report any irregularity to the Research, Assessment, & Grants Department and the local school Principal;

• Review page 44 of the GA DOE’s Student Assessment Handbook for further guidance.

4

GENERAL ADMINISTRATION

INFORMATION: CRCT AND CRCT-M

5

IMPORTANT DCSD DATES: CRCT & CRCT-M

April 16-April 26Tuesday, April 16 READING CRCT/CRCT-M Wednesday, April 17 ELA CRCT/CRCT-MThursday, April 18 MATH CRCT/CRCT-M Friday, April 19 Make-ups CRCT/CRCT-MMonday, April 22 Make-ups CRCT/CRCT-MTuesday, April 23 SCIENCE CRCTWednesday, April 24 SOCIAL STUDIES CRCTThursday, April 25 Make-ups CRCTFriday, April 26 Make-ups CRCT

Due Dates for Scorables to Warehouse:Tuesday, April 23 – CRCT-M 12:00 - 4:00pm

Friday, April 26 and Monday, April 29, 2013 – CRCT – see schedule

6

CRCT Test Constructs

Basic Reminders:• Content Areas - Reading, ELA, Math, Science

& Social Studies;• Grades being tested:

– Spring Main Administration: Grades 3 – 8 – Summer Retest Administration: Grade 3 –

Reading; Grades 5 & 8 - Reading and Math• All items are “Selected Response” (multiple

choice)

7

• Common Core Georgia Performance Standards (CCGPS) – alignment for Reading, English/Language Arts, and Mathematics

• Georgia Performance Standards (GPS) – alignment for Science and Social Studies

• Continued field testing of content for CCGPS and GPS

CRCT Test Constructs

8

CRCT Key PointsCRCT Key Points

• The state’s window for the CRCT is April 1 – May 3. If you have a Grade 3, 5, or 8 student miss the district’s full window, then there is the possibility that the student may still take the Reading and/or Mathematics test (as appropriate) while the state’s window is still open. Contact Research, Assessment and Grants if this RARE situation occurs.

9

CRCT-M Test ConstructsCRCT-M Test ConstructsBasic Reminders:• Content Areas – Reading, ELA, and Math only;• Grades being tested:

- Spring Main Administration: Grades 3 – 8;- Summer Retest Administration: Grade 3 –Reading; Grades 5 & 8 -

Reading and Math ;• Like the CRCT, all items are “Selected Response” (multiple choice);• What is different:

– A student may take between one to three content area CRCT-M tests;– There are 10 fewer items than on the CRCT per content area;– Students will take CRCT in any content area that is not assessed by

CRCT-M (therefore, all students will take the CRCT in Science and Social Studies)

10

CRCT-M Test ConstructsCRCT-M Test Constructs

Number of Items by SubjectOperatio

nalField Test Total

Reading 30 10 40

ELA 40 10 50

Math 50 10 60

Field Test items help to create a pool of items for future test administrations.

They are included with

Operational items in all

content areas at all

grade levels, but are

not reported as part of

the student’s score.

11

Types of Revisions• Simplify language in question/stem and/or distracters• Simplify graphics, visuals, etc.• Eliminate extraneous information• Substitute another (more familiar) word without changing

the construct• Reformat items or passages (e.g., adding more white

space, size of text)• Adjust layouts (e.g., reorder items or passages)• Separate reading passages into segments, followed by

related items

CRCT-M Test ConstructsCRCT-M Test Constructs

12

• Students who achieved Basic Proficiency for 2 consecutive years in the same content area are ineligible for the CRCT-M in that content area for 2013.

• The CRCT-M is only available for students receiving special education services who meet specific CRCT-M eligibility guidelines and whose IEPs reflect this assessment for each content area;

• CRCT-M test materials were ordered December through January; however, updates reported to East DeKalb have been ordered as well;

• Remember an eligible student may take the CRCT-M in the subject(s) determined through the eligibility process, but will also participate in the CRCT in Science and Social Studies and for those subjects (Reading, ELA, and Math) for which they were not eligible for CRCT-M;

• Special care must be taken to ensure students get the right assessment – carefully review all CRCT-M participants prior to testing to make sure that they are eligible!

CRCT-M Key PointsCRCT-M Key Points

13

Pre-Administration:

Security• School Test Coordinators should use the Materials Verification Form to

check materials out to Test Examiners. All materials are returned to the School Test Coordinator for secure storage at the end of testing session;

• Security wafer seals on all test books cannot be broken until testing begins;

• Each classroom must have adequate staff to monitor testing;

• Should any test irregularities occur, contact Research, Assessment and Grants for instruction;

• There should be no weekend activities or entry at any school between April 1 and April 29 unless AAS and Research, Assessment and Grants have been notified via email using the district’s Local School Weekend Access form (from the Principal);

14

Pre-Administration: CRCT Security Checklist

It will not be necessary to use this form to checkout materials each day of testing (use the Materials Verification Form); however, this form must accurately reflect to whom booklets are assigned. Cross-checks and confirmations should occur during testing by both the Test Examiner and Test Coordinator. The Test Examiner should sign prior to testing to acknowledge books assigned to him/her and a copy of this should be included with the Test Examiner’s materials each day. Test Examiners should check this form daily against booklets received.

15

Pre-Administration: CRCT Security Checklist

Just as in the case for the CRCT Security Checklist, the same is true for the CRCT-M Security Checklist – use the Materials Verification Form; however, this form must accurately reflect to whom booklets are assigned. Cross-checks and confirmations should occur during testing by both the Test Examiner and Test Coordinator. The Test Examiner should sign prior to testing to acknowledge books assigned to him/her and a copy of this should be included with the Test Examiner’s materials. Test Examiners should check this form daily against booklets received.

Teacher Name only

16

Be sure to complete the School Inventory Checklist found on page 15 of your CRCT and CRCT-M Test Coordinator’s Manual. Secure these documents with

your school records.

Pre-Administration: Security

17

Pre-Administration: Letter to Parents

Please postmark the CRCT/CRCT-M

Parent Letter to your school’s

parents/guardians before April 1, 2013. Translated version

will be added to DeKalb Discussions.

18

Pre-Administration: Local School Training

• All schools must administer their local school workshops on April 1, 2013 – Principal should be present;

• All schools will rotate Test Examiners for the 2013 CRCT/CRCT-M MainAdministration. No core teacher should administer any section of theCRCT/CRCT-M to his/her own students (only exception is sign languageinterpreters and/or IEP – “Test administered by certified educator familiarto student” – notify RAG of these situations for approval).Accurate records must be kept detailing which Test Examiner is assignedto which group of students;

• Test Examiners should be provided with a testing roster listing Test Examiner, Proctor (if necessary), assigned students, and any possible accommodations prior to the start of testing;

• All staff members should have a firm understanding of any guidance or requirements concerning testing as well as what to do should they need to report any type of irregularity;

19

Pre-Administration: Local School Training

Test Coordinators should provide a second training to all Test Examiners who will administer any accommodations found in an IEP, 504 Plan, and/or ELL/TPC Plan (especially take note of Read Aloud Guidelines & Tutorial on the GA DOE site and the GA DOE’s Accommodation Manual and Accommodations FAQ document at

http://www.doe.k12.ga.us/Curriculum-Instruction-and-Assessment/Assessment/Pages/CRCT-Resources.aspx

and

http://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/Information-For-Educators.aspx

This separate training session should take place for those Test Examiners providing accommodation on any day prior to Wednesday, April 3;

20

• All Examiners providing accommodations must be familiar with those accommodations listed in IEPs, 504 Plans, ELL/TPC Plans;

• As a general reminder, accommodations must:- be required by the student in order to participate in the assessment;- be provided during routine instruction and assessment in the classroom;

• Accommodations may not:- alter, explain, simplify, paraphrase, or eliminate any test item, reading

passage, writing prompt, or choice option;- provide verbal or other clues or suggestions that hint at or give away the

correct response to the student;

• For Large Print and Braille, transpose student answers using two certified employees and complete the Transposing Documentation – beginning with this testing window, one of the employees must be an administrator;

• Accommodations should not be seen for the first time during the administration of an assessment!

Pre-Administration: Local School Training

21

Pre-Administration: Pre-Administration: Pre-ID LabelsPre-ID Labels

• Pre-ID information was reported to GA DOE on Wednesday, February 6 (all students enrolling after this date will not have a label);

• If the Pre-ID Label is incorrect, do not use – it will override bubbled

information! School’s data clerk/registrar should check to see if the student’s records need to be updated;

• Pre-ID should be applied prior to testing;

• Pre-ID labels should match student being tested EXACTLY (watch for similar names);

• If a student does not have a Pre-ID label, information must be bubbled on the answer document;

• When bubbling demographic information, fill in the text boxes first, then bubble;

22

• CRCT Pre-ID labels are included in each School

Test Coordinator Kit. • Three (3) CRCT barcode labels are available for

each student. CRCT labels should not be used for the CRCT-M (CRCT-M will have its own labels).

• Visible information includes:– Student name & GTID – School and System names & codes– Grade– Student birthday & gender– Ethnicity, Race and Primary SRC (PSRC)– Barcode number

Pre-Administration: Pre-Administration: CRCT Pre-ID LabelsCRCT Pre-ID Labels

23

•Three barcode labels for each student•Do not use if inaccurate•Barcodes override bubbling•Additional labels can be used on test booklet

CRCT Answer document CRCT Test booklet Spare (Do not use for CRCT-M)

Pre-Administration: Pre-Administration: CRCT Pre-ID LabelsCRCT Pre-ID Labels

24

• Pre-ID labels will come with CRCT-M School Test Coordinator Kit.

• Two barcode labels for each student come with CRCT-M for use on the answer document only (one for the answer document and one spare).

• Visible information includes:

- Student name & GTID

- School and System names & codes

- Grade

- Student DOB and gender

- Ethnicity, Race, and Primary SRC (PSRC)

- Barcode number

Pre-Administration: Pre-Administration: CRCT-M Pre-ID LabelsCRCT-M Pre-ID Labels

25

• Do not use if inaccurate

• Barcodes override bubbling

Pre-Administration: Pre-Administration: CRCT-M Pre-ID LabelsCRCT-M Pre-ID Labels

26

If Barcode applied incorrectly– If answers have been gridded:

- Transcribe student answers & demographics onto a replacement answer sheet.

- Write VOID over the original booklet/answer sheet, and return it with non-scorable materials.

– If answers have not been gridded:- Write VOID over the original answer sheet, and return it with

non-scorable materials.

If student transfers– Barcode not applied to an answer document:

- Destroy the barcode.

– Barcode applied to an answer document: - Write VOID over the original booklet/answer sheet, and return it

with non-scorable materials if no answers gridded

Pre-Administration: Pre-Administration: Pre-ID LabelsPre-ID Labels

27

*Each line of section 1 as well as section 9 must be completed for every student with or without a

label

Classroom Teacher = Teacher of Record (not Test Examiner)

*For students without labels, complete Sections 2 – 8

2. Student NameLeave all blank spaces empty

3. Date of BirthDon’t forget to bubble “month”

4. Gender5. Ethnicity6. Race7. GTID

Listed in eSIS as State Ministry Number

8. FTE Student #Listed in eSIS as SSN

9. Form #Critical and must be coded

Coding Instructions: CRCTCoding Instructions: CRCT

28

Remember: Demographic data

needs to be completed by the student on page three of CRCT

Answer Document

Coding Instructions: CRCTCoding Instructions: CRCT

29

Complete Section 15 – 17 for all students – with or without labels

as appropriate/directed.

15.Local Optional Coding (See slide 40-41 for special program codes)

16.GNETS For DeKalb-Rockdale Program and the satellite GNETS sites

17. IR, IV, and PIV CodingTo be completed only as directed by Research, Assessments, and Grants

Coding Instructions:Coding Instructions:CRCT Additional CodingCRCT Additional Coding

30

Each line of section 1 must be completed for every student with or

without a label

Classroom Teacher = Teacher of Record (not Test Examiner)

For students without labels, complete Sections 2 – 9 (remember February 6)

2. Student NamePrint name and bubble correspondinglyLeave all blank spaces empty

3. GTIDListed in eSIS as State Ministry Number

4. FTE Student #Listed in eSIS as SSN

5. Date of Birth6. Gender7. Grade8. Ethnicity9. Race

Coding Instructions: CRCT-MCoding Instructions: CRCT-M

31

CRCT-M Answer DocumentCRCT-M Answer DocumentFront Cover Inside Front

32

Inside Back Back Cover

CRCT-M Answer DocumentCRCT-M Answer Document

33

Front page of Answer Document (different than CRCT)

• State Required Codes (SRC)

• Accommodation Type (Setting, Presentation, Response, Schedule)

• Conditional Accommodation (Y?)

• Accommodation based on

• EIP Served (Y?)

• Braille/Large Print

Coding Instructions:Coding Instructions:CRCT-M Additional CodingCRCT-M Additional Coding

Bubble current SRC even if it is included on label; however, if the current SRC is not on the label or does not match, discard the label and bubble all demographic information.

If an Accommodation Type is bubbled;

ACCOMMODATIONS must be bubbled also

34

SPECIAL NOTE: Coding ELL Deferred on CRCT-M is different from CRCT process.

ELL Deferred coding will appear on both Reading and ELA sections rather than as a single entry on the Answer Document (as seen on

the CRCT)

Coding Instructions:Coding Instructions:CRCT-M Additional CodingCRCT-M Additional Coding

35

Coding Instructions:Coding Instructions:CRCT-M Additional CodingCRCT-M Additional Coding

Complete Section 15 – 17 for all students – with or without labels

as appropriate/directed.

12. GNETS For DeKalb-Rockdale Program and the

satellite GNETS sites

13. Local Optional Coding (See slide 40-41 for special program codes)

16. IR, IV, and PIV CodingTo be completed only as directed by Research, Assessments, and Grants

36

Local Optional Codes Box:Local Optional Codes Box:CRCT & CRCT-MCRCT & CRCT-M

ENTER 0011 = Elementary & Middle School students who participated in NCLB/AYP School Choice at any time after August 2002 and who are still participating. (Office of School Improvement can provide list)

~ Required for state and federal reporting

ENTER 0012 = Middle School students participating in BOTH NCLB/AYP School Choice and Accelerated CCGPS Coordinate Algebra/Analytic Geometry A during 2012 – 2013.

~ Required for state reporting

ENTER 0022 = Elementary & Middle School students who received Supplemental Educational Services (SES) during 2012 – 2013. (Office of School Improvement can provide list)

~ Required for state and federal reporting

ENTER 0023 = Middle School students participating in BOTH NCLB/AYP Supplemental Education Services and Accelerated CCGPS Coordinate Algebra/Analytic Geometry A during 2012 - 2013.

~ Required for state reporting

ENTER 0033 = Middle School students enrolled in Accelerated CCGPS Coordinate Algebra/Analytic Geometry A during 2012 - 2013.

~ Required for state reporting

37

Local Optional Codes BoxLocal Optional Codes BoxCRCT & CRCT-MCRCT & CRCT-M

ENTER 0044 = Elementary students participating in the DeKalb Montessori Program in 2012 – 2013 (Briar Vista, Huntley Hills, & Midway)

~ Required for local school choice reporting

ENTER 0055 = Elementary & Middle School students participating in the High Achievers Magnet Program in 2012 – 2013 (Code all students in “whole school models” – such as Kittredge and Wadsworth or only “magnet students” in “school within a school” models such as Chapel Hill MS and Chamblee MS)

~ Required for local reporting

ENTER 0056 = Middle School students enrolled in High Achievers Magnet Program AND Accelerated Math 6/7A, Accelerated Math 7B/8, Accelerated CCGPS Coordinate Algebra/Analytic Geometry A

~ Required for local reporting

ENTER 0066 = Elementary students enrolled in schools/classrooms participating in the Elementary Math/Science Partnership Grant

~ Required for local reporting

38

Testing: PreparationTesting: Preparation

• Remove or cover instructional materials that may prompt Remove or cover instructional materials that may prompt student responses;student responses;

• Arrange seating to promote individual work;Arrange seating to promote individual work;• Post a sign on the outside of the classroom door: “Testing: Post a sign on the outside of the classroom door: “Testing:

Do Not Disturb.”Do Not Disturb.”• One proctor is recommended for up to 30 students and One proctor is recommended for up to 30 students and

required for more than 30;required for more than 30;• Examiner Materials:Examiner Materials:

– Examiner’s Manual;Examiner’s Manual;

– Test books (Gr. 3-8) & Answer sheets (Gr. 3-8);Test books (Gr. 3-8) & Answer sheets (Gr. 3-8);

– Scratch paper for Math;Scratch paper for Math;

– Two No.2 pencils with erasers per student;Two No.2 pencils with erasers per student;

39

Testing: AdministrationTesting: Administration

• All standardized tests must begin within thirty minutes of the school’s official start time;

• Students take one content area per day and should sign-in each day;• All sections from a single content area must be administered the same day;• Students can write in the test books (but Highlighters are not allowed!);• Teachers should understand that they are expected to monitor students by

circulating and checking to prevent cheating, use of calculators, going ahead, looking back, etc…. Teachers should not use cell phones, texting, working at computers, reading magazines, etc…;

• Any incident worth noting should be recorded by the teacher in the Examiner’s Incident Log. The Examiner’s Incident Log should then be collected by the Test Coordinator and remain on file for five years. If the incident rises to the appropriate level, it should be reported as an irregularity;

• Examiners should collect and count all materials each day before leaving the test environment;

40

Students may take stretch breaks between sections.

• As a general rule, a student who leaves the room during Section 1 may not complete Section 1. They may resume testing in Section 2 once it starts. An exception relative to a restroom emergency is explained in restroom break guidance document.

• Known medication times/fragile conditions/504 Plans, etc. must be planned for ahead of time.

Testing: AdministrationTesting: Administration

41

Testing - Testing - CRCTCRCT::Small Group KitsSmall Group Kits

• Small Group Kits will be provided to schools;• These kits are for those students who need a

special administration of the exam in a small group environment based upon an accommodation found in an IEP, 504 Plan, and/or ELL/TPC plan;

• Small Group Kits consist of 10 test books of the same grade and form and the appropriate examiners manual for that form.

• Schools can also use regular overage materials to create Small Group Kits using a common form.

42

Small Groups and the Small Groups and the CRCT-MCRCT-M

• The CRCT-M is a test designed for small numbers of students;

• Schools will receive only one form for the CRCT-M;

• For this reason, schools will not receive any special packaging of small group materials;

• Because districts receive only one form, all test materials can be used for those students who need a special administration of the exam in a small group environment

43

Hospital Homebound Hospital Homebound Documentation FormDocumentation Form

44

Post-Test Activities: CRCT & CRCT-MPost-Test Activities: CRCT & CRCT-M

• Verify that Test Examiners have returned all materials (this is on-going each day!);

• Inventory scorable and non-scorable materials separately;• Complete the School Security Checklist and place in the first

box of scorable material.  • Return original School Security Checklists and signed

Packing Lists to the warehouse.• Verify that “VOID” is written across every voided Test

Booklet and Answer Sheet. Return voided documents with non-scorables.

45

Post-Test Activities: Post-Test Activities: CRCT Security ChecklistCRCT Security Checklist

46

Post-Test Activities: Post-Test Activities: CRCT Packing ListCRCT Packing List

Rogers

RogersRogers

Etc….

47

Post-Test Activities:Post-Test Activities:CRCT-M School Security ChecklistCRCT-M School Security Checklist

48

GENERAL TESTING

GUIDELINES AND REQUIREMENTS

49

Irregularities (IR) / Invalidations (IV)Irregularities (IR) / Invalidations (IV)

• Events and circumstances that depart from standardized testing procedures are

irregularities.

• Irregularities that significantly affect student performances or compromise the integrity of the testing may result in invalidation of student scores.

50

Examples of Irregularities in Examples of Irregularities in Security Procedures: Security Procedures:

– Examinee was given access to test questions or prompts prior to testing

– Test Examiner or other personnel copied or reproduced and distributed secure test materials

– Test Examiner or other personnel provided answers to the examinee

– Interruptions in normal administration schedule

51

Examples of Irregularities during Examples of Irregularities during Testing Administration:Testing Administration:

– Test Examiner or other personnel failed to follow administration directions for the test

– Examinee’s test booklet, answer sheets, or portfolio entries (GAA) are lost

– Test Examiner fails to provide an examinee with a documented accommodation or provides examinee with an accommodation that is not documented

52

ParticipationParticipation Invalidation Invalidation (PIV) (PIV)

• In addition to irregularities (IR) and invalidations (IV), systems will have to code for Participation Invalidations (PIV) for students who receive an accommodation that is not on the list of state-approved accommodations or not on the student’s IEP.

• A potential PIV occurs when a student receives an unapproved conditional accommodation such as the reading of the test passages or use of a calculator on the Math test.

• Federal regulations stipulate that when inappropriate accommodations are used, students may not be considered participants in accountability calculations.

53

Participation Invalidation Participation Invalidation (PIV) (PIV)

• A potential PIV will also occur when students who are ineligible to take the CRCT-M are given the test.– CRCT-M mistakenly given instead of the CRCT.– CRCT-M given to students who earned scores

at or above 330 (Basic Proficiency: PL3) for two consecutive years.

– CRCT-M administered to students who Met or Exceeded Standard on the CRCT in 2012.

54

Steps for Reporting an Steps for Reporting an IrregularityIrregularity

All personnel in the local system must follow All personnel in the local system must follow protocol as they become aware of testing protocol as they become aware of testing irregularities.irregularities.

Examiner:Examiner:--Examiner must notify Principal and School Test Coordinator of incidentExaminer must notify Principal and School Test Coordinator of incident

-School Test Coordinator must notify System Test Coordinator-School Test Coordinator must notify System Test Coordinator

-Request detailed written statements from all parties involved if necessary-Request detailed written statements from all parties involved if necessary

-Follow up on details (“connect the dots”)-Follow up on details (“connect the dots”)

-Follow district procedures regarding alleged misconduct-Follow district procedures regarding alleged misconduct

55

Characteristics of a Quality Characteristics of a Quality InvestigationInvestigation

School Test Coordinator: School Test Coordinator: – Communicate with the Principal and System Test Coordinator Communicate with the Principal and System Test Coordinator

about a possible testing irregularityabout a possible testing irregularity– System Test Coordinator will provide guidance regarding System Test Coordinator will provide guidance regarding

investigation if necessaryinvestigation if necessary– Statements should be provided by all parties involved in the Statements should be provided by all parties involved in the

irregularityirregularity– Return all documentation to the System Test CoordinatorReturn all documentation to the System Test Coordinator

56

CRCT/CRCT-M Retest/GHSWT CRCT/CRCT-M Retest/GHSWT Examiner’s Incident LogExaminer’s Incident Log

Any incident worth noting should be recorded by

the Test Examiner in the Examiner’s Incident Log. The Examiner’s Incident

Logs should then be collected by the Test

Coordinator and remain on file for five years. If the incident rises to the

appropriate level, it should be reported as an

irregularity

57

CRCT/CRCT-M Irregularity FormCRCT/CRCT-M Irregularity Form

Note that Form

Numbers must be

included on new

Irregularity Forms.

Submit Forms immediately upon

directive from Department of Research,

Assessments, and Grants!

Details of the event should be documented on the Statement Report and submitted along with the Irregularity Form to Allison via email.

58

Reporting Irregularities and Reporting Irregularities and InvalidationsInvalidations

Irregularities MUST be handled and reportedIrregularities MUST be handled and reportedIMMEDIATELY. IMMEDIATELY.

SomeSome examples of irregularities (or IV / PIV): examples of irregularities (or IV / PIV):• wrong version of a test;wrong version of a test;

• wrong accommodations;wrong accommodations;

• cheating;cheating;

• students working in the wrong section;students working in the wrong section;

• testing procedures not being followed;testing procedures not being followed;

• missing test materials;missing test materials;

• breach of test security;breach of test security;

59

Breaches of Professional EthicsBreaches of Professional Ethics Gives examinees access to test questions prior to testing;

Copies, reproduces, or uses in any manner inconsistent with test security regulations all or any portion of secure test booklets;

Coaches examinees during testing, or alters or interferes with examinees’ responses in any way;

Makes answers available to examinees;

Fails to follow security regulations for distribution and return of secure test materials as directed, or fails to account for all secure test materials before, during, and after testing;

Uses the secure test booklets for any purpose other than examination; or

Participates in, directs, aids, counsels, assists, encourages, or fails to report any of these prohibited acts.

SHARE THIS INFORMATION AT YOUR LOCAL SCHOOL WORKSHOP!

60

General Keys to Test Security

REMEMBER:

ALL TESTING IRREGULARITIES ARE REQUIRED TO BE REPORTED IMMEDIATELY TO RESEARCH, ASSESSMENTS, AND GRANTS!

• Lock tests up!

• At every departure from a secure storage location, tests and materials should be counted and recounted. The same should occur when they return to the secure storage location. Signatures should be logged at each event;

• Before students leave the test setting, all material counts must be accurate;

• Any individual responsible for secure test materials should not lose sight of them;

• Test booklets must remain in their shrink-wrapped packages as late as possible to avoid security concerns;

• No one should review/peek at secure test materials;

• Secure test materials should not be copied;

• Students should always sign-in (name, signature, and form number) and place names on test booklets and scratch paper;

• Teachers should monitor students just as they would in any other setting/situation (classroom, hallways, cafeteria, buses, gym, etc…)

61

Planning for a Conducive EnvironmentPlanning for a Conducive Environment • Ensure that seating spaces and writing surfaces are large enough. • Seating arranged to prevent cheating. • No cell phones or other electronic devices in the test setting. • No. 2 Pencils - Each student should have two applicable/allowable

writing instrument on test days. However, there should be an extra supply available.

• Scratch Paper – The use of scratch paper is allowed for the Mathematics CRCT only. Scratch paper should be provided by the school for each student.

• Calculators – Students cannot utilize calculators unless stated in an IEP.

• Keep a timing device visible - you should have a clock or watch to keep track of time during test administration.

• Prior to testing, make a plan for students who finish early, arrive late, appear to be (or become) ill, etc.

• Place a “Testing – Do Not Enter” sign on the door each day;

62

Planning for Test AdministrationALONG WITH THEIR PRINCIPALS, TEST COORDINATORS SHOULD BE CERTAIN THAT:

• they hold a PSC-issued certificate

• plan for all aspects of the school’s test administration (scheduling logistics), monitor test administration environment

•they have attended system-level training (or school training for Principals);

• all staff members have been appropriately trained and are completely clear on their obligations and ethical duties (Principals should attend as well);

• a secure location with extremely limited access is available to store secure testing items (Test Coordinator and Principal should be the only individuals with keys);

• receipt of test items is documented and matches packing list. Many of the secure test items possess barcodes and/or serial numbers assigned specifically to each individual site;

• appropriate arrangements have been made to allow for accommodations found on IEPs, ELL-TPCs, 504 Plans, etc…;

• a bell schedule has been designed that will allow for a conducive testing environment;

• all necessary materials and supplies are available (pencils, pens, etc…);• receive/verify test material counts after testing each day

Electronic versions of the System/School Test Coordinator Manuals and the Examiner’s Manual for all of these tests can be found on DeKalb Discussion. It

is a Test Coordinator duty to read them!

63

Planning for Test AdministrationPlanning for Test AdministrationTEST EXAMINERS SHOULD BE CERTAIN THAT:TEST EXAMINERS SHOULD BE CERTAIN THAT:

• they have attended all local school training, have a clear understanding of they have attended all local school training, have a clear understanding of all requirements for each unique standardized test, and have signed a log all requirements for each unique standardized test, and have signed a log to verify participation in all training (sign in and out); to verify participation in all training (sign in and out);

• all testing directives are followed exactly;all testing directives are followed exactly;

• students’ Answer Documents are prepared correctly as directed;students’ Answer Documents are prepared correctly as directed;

• they monitor the testing environment to make certain that students they monitor the testing environment to make certain that students respond in the appropriate sections of the Answer Document (e.g., that respond in the appropriate sections of the Answer Document (e.g., that Social Studies items are answered in the section marked SOCIAL Social Studies items are answered in the section marked SOCIAL STUDIES). Marking responses in the wrong content area, even if later STUDIES). Marking responses in the wrong content area, even if later erased, can cause scoring errors and flags for any erasure analysis; erased, can cause scoring errors and flags for any erasure analysis;

• students code the correct form number/letter on their Answer Documents students code the correct form number/letter on their Answer Documents and write their names on their Test Booklets and/or scratch paper if and write their names on their Test Booklets and/or scratch paper if directed;directed;

• any potential irregularity is reported to the school’s Test Coordinator any potential irregularity is reported to the school’s Test Coordinator immediately. immediately.

64

Planning for Testing AdministrationPlanning for Testing Administration

TEST EXAMINERS SHOULD BE CERTAIN THAT:TEST EXAMINERS SHOULD BE CERTAIN THAT:• they have an active Georgia PSC-issued certificate they have an active Georgia PSC-issued certificate

(teachers, counselors, administrators, paraprofessionals)(teachers, counselors, administrators, paraprofessionals)• deliver the Examiner’s Manual with fidelitydeliver the Examiner’s Manual with fidelity• correctly deliver assigned accommodationscorrectly deliver assigned accommodations• verify that students’ answer documents are prepared verify that students’ answer documents are prepared

correctly correctly beforebefore testing begins. testing begins. • Refer to the detailed listing of roles and Refer to the detailed listing of roles and

responsibilities in the GA DOE responsibilities in the GA DOE Student Assessment Student Assessment HandbookHandbook..

65

General Keys to Materials SecurityGeneral Keys to Materials Security

• All personnel involved in the administration must All personnel involved in the administration must be trained in a manner appropriate to their role; be trained in a manner appropriate to their role; this includes all staff who are involved in the this includes all staff who are involved in the handling of secure test materials (receipt, handling of secure test materials (receipt, distribution, pre/post administration activities, distribution, pre/post administration activities, etc.).etc.).

• Volunteers who assist in the school (non-Volunteers who assist in the school (non-employees) should not handle test materials or employees) should not handle test materials or manage testing logistics but may assist in the manage testing logistics but may assist in the administration in other ways (front office support, administration in other ways (front office support, hall monitors, etc.).hall monitors, etc.).

66

General Keys to Materials SecurityGeneral Keys to Materials Security

• Staff members who are not involved in testing Staff members who are not involved in testing should also be aware of the school’s should also be aware of the school’s responsibility for test security. responsibility for test security.

• Paraprofessionals, custodial staff, and others in Paraprofessionals, custodial staff, and others in the school who may be in classes during testing the school who may be in classes during testing or may be near the area where tests are stored, or may be near the area where tests are stored, even though they do not have direct access to even though they do not have direct access to tests, should be aware of security rules.tests, should be aware of security rules.

67

ACCOMMODATIONSACCOMMODATIONS

68

Accommodations ConsiderationsAccommodations ConsiderationsIn Georgia accommodations MAY NOTIn Georgia accommodations MAY NOT

• alter, explain, simplify, paraphrase, or alter, explain, simplify, paraphrase, or eliminate any test item, reading passage, eliminate any test item, reading passage, writing prompt, or choice optionwriting prompt, or choice option

• provide verbal or other clues or suggestions provide verbal or other clues or suggestions that hint at or give away the correct response that hint at or give away the correct response to the studentto the student

Only state-approved accommodations may be used on state-mandated assessments, following the guidance issued.

69

Accommodations GuidelinesAccommodations Guidelines• Know who your SWD, ELL, and 504 students are who require Know who your SWD, ELL, and 504 students are who require

accommodations, and plan well in advance for their needs;accommodations, and plan well in advance for their needs;• If applicable, plan for small groups and the need for the same form If applicable, plan for small groups and the need for the same form

number/letter;number/letter;• Know who your visually impaired students are and ensure you have the Know who your visually impaired students are and ensure you have the

correct supply;correct supply;• Make provisions for Extended Time students;Make provisions for Extended Time students;• Plan in advance for any Word to Word (EL) Dictionary needs;Plan in advance for any Word to Word (EL) Dictionary needs;• Ensure that Examiners are completely familiar with the proper way to Ensure that Examiners are completely familiar with the proper way to

deliver the necessary accommodations;deliver the necessary accommodations;• Collaborate with others as needed to ensure that all paperwork (IEP’s, Collaborate with others as needed to ensure that all paperwork (IEP’s,

ELL-TPC’s, 504 Plans, etc.) is in order;ELL-TPC’s, 504 Plans, etc.) is in order;• The transfer of student responses to a student answer document (in The transfer of student responses to a student answer document (in

cases such as Large Print and Braille administrations) should be cases such as Large Print and Braille administrations) should be completed with a witness present, and the witness should hold a PSC-completed with a witness present, and the witness should hold a PSC-issued certificate;issued certificate;

70

Accommodations GuidelinesAccommodations Guidelines

What is a nonreader?

A non-reader is a student whose disability prohibits him/her from decoding at any level of difficulty and, therefore, from reading and comprehending text at any level of difficulty. These students are unable to move from parts (individual letters and words) to whole (phrases and sentences) and gain meaning from text. Often the cognitive effort expended on decoding words is such that they do not gain meaning from the text, and therefore are unable to demonstrate comprehension of what they have read. Non-readers have access to text only through assistance (i.e., a human reader or assistive technology).

A non-reader is not a student who reads below grade level. Students who read below grade level are reading, although they may struggle to fully comprehend grade-level text. Nonetheless, these students are able to comprehend text and each test contains a range of reading passages so that struggling readers can demonstrate their reading skill. For struggling readers (those who read below grade level), reading the test questions can serve to reduce the reading load and allow the student to focus his/her cognitive effort on the reading passages.

71

Accommodations Guidelines: SWDsAccommodations Guidelines: SWDsGuidance for Use of Conditional Accommodation #19: Oral reading of reading passages in English only by reader or assistive technology. The use of this conditional accommodation for the Reading CRCT and CRCT-M must be restricted to grades 3 – 8 and maybe considered when BOTH of the following conditions apply:

1. The student has a specific disability that severely limits or prevents him or her from decoding text at any level of difficulty, even after varied and repeated attempts to teach the student to do so (i.e. the student is a non-reader, not simply reading below grade level); AND 2. The student has access to printed materials only through a reader or other electronic format during routine instruction.

Text must be read word-for-word exactly as written. The test administrator may not provide assistance to the student regarding the meaning of words, intent of test items, or responses to test items. The test administrator may not rearrange the order of text (e.g., read the questions before reading the passage). The test administrator may read test text to a small group provided all students have the same test form number. When a small group setting is used, the passage may be read once and each test item may be read twice. Each student must have a test book and must be instructed to follow along in their test booklet as the test administrator reads the text.

72

Accommodations Guidelines: SWDsAccommodations Guidelines: SWDs

Guidance for Use of Conditional Accommodation #32: Basic function calculator or adapted calculator. The use of this conditional accommodation may be considered for the Mathematics CRCT and CRCT-M when the following conditions apply: 1. The student has a specific disability that severely limits or prevents her or his ability to calculate mathematically, even after varied and repeated attempts to teach the student to do so; AND2. The student has access to mathematical calculation only through the use of a calculator, which the student uses for classroom instruction.

Only a basic function calculator or basic adapted calculator may be used. The test administrator may not provide any assistance or direction to the student regarding the use of the calculator.

73

Accommodations Guidelines: ELsAccommodations Guidelines: ELsGuidance for Use of Conditional Accommodation #9: Oral reading of reading passages in English only. The use of this conditional accommodation for the Reading CRCT must be restricted to grades 3-8 and may be considered when BOTH of the following conditions apply:

1. The student’s English proficiency scores and experiences in the classroom indicate the student cannot access, retain, or comprehend written text without the assistance of a reader; AND2. The student is not poised to exit language assistance services within the current school year.

Text must be read word-for-word exactly as written. The test administrator may not provide assistance to the student regarding the meaning of words, intent of test items, or responses to test items. The test administrator may not rearrange the order of text (e.g., read the questions before reading the passage). The test administrator may read test text to a small group provided all students have the same test form number. When a small group setting is used, the passage may be read once and each test item may be read twice. Each student must have a test book and must be instructed to follow along in their test booklet as the test administrator reads the text.

74

Accommodations ConsiderationsAccommodations Considerations

• Approved accommodations appear in the GA DOE’s Approved accommodations appear in the GA DOE’s Student Assessment HandbookStudent Assessment Handbook and in the and in the Accommodations ManualAccommodations Manual (published 2008) (published 2008)

• Accommodations not specified in SAH need to be pre-Accommodations not specified in SAH need to be pre-approved . . . approved . . . Requests must be received 4 – 6 weeks Requests must be received 4 – 6 weeks in advance of the state testing window for the in advance of the state testing window for the applicable assessment.applicable assessment.

• Advanced Reading AidsAdvanced Reading Aids– Plan ahead for ordering electronic formats for read-Plan ahead for ordering electronic formats for read-

alouds (such as Kurzweil) alouds (such as Kurzweil) (Requests should be (Requests should be submitted 8 – 12 weeks in advance at minimum)submitted 8 – 12 weeks in advance at minimum)

75

TESTING FORMSTESTING FORMS

76

Materials Verification Form: CRCT

Materials verification form

must be completed each

day. Test Examiner

should count and sign-out

materials. Test Coordinator (or

assistant) should count and sign-in materials!

77

Student Daily Sign-In

Students in each class should sign-in before the start of each day’s CRCT/CRCT-M content test. Sign-in logs should be maintained by the school.

78

Examiner’s Incident Log/Notes

Any incident worth noting should be recorded by

the teacher in the Examiner’s Incident Log. The Examiner’s Incident

Logs should then be collected by the Test

Coordinator and remain on file for five years. If the incident rises to the

appropriate level, it should be reported as an irregularity. Logs should

be used for all tests.

79

Secure Testing Room Access Form

This form must be placed at the

access point before entering the secure

storage area for any state

assessment. All elements must be completed each time someone

enters the secure room.

80

Student Non-Participation Reconciliation Forms

Schools should still be prepared to address “non-participants”:Schools should still be prepared to address “non-participants”:• Each school will use the Each school will use the Non-Participants Reconciliation FormNon-Participants Reconciliation Form to record to record

the names of each student who should have tested, but was a non-the names of each student who should have tested, but was a non-participant;participant;

• The original form will be submitted to the warehouse when scorables The original form will be submitted to the warehouse when scorables are returned (local schools should keep a copy for their records);are returned (local schools should keep a copy for their records);

• Schools will categorize their “non-participation” as one of the following Schools will categorize their “non-participation” as one of the following four choice - Medical Emergency, Illness, Other, Unknown;four choice - Medical Emergency, Illness, Other, Unknown;

• If you have any questions regarding a non-participant, please contact If you have any questions regarding a non-participant, please contact Research, Assessment, and Grants;Research, Assessment, and Grants;

• Districts may be asked by the GA DOE to submit records on those non-Districts may be asked by the GA DOE to submit records on those non-participants, so records must be accurate and submitted;participants, so records must be accurate and submitted;

• CCRPI requires 95% participation of students on each content test CCRPI requires 95% participation of students on each content test in order for points to be awardedin order for points to be awarded

81

Local School Records

School Maintains the Original

1. Examiner’s Incident Log

2. Secure Testing Room Access Documentation

3. Local School Workshop Signature Log

4. Examiner’s rosters

5. Logistical materials - bell schedule, teacher rotation, etc

6. Packing lists

7. Vendor’s School Inventory Checklist (see slide 18)

Schools are required to maintain applicable documents on site for five years. Some of the documentation will be the original forms, but some will be copies of the forms submitted to Research, Assessments, and Grants when scorables are

submitted. For any item below in which the school maintains a copy, the original is submitted to Research, Assessments, and Grants:

Original to Assessment - Retain Copy

1. Student Non-Participation Reconciliation Form

2. Transposing Documentation

3. Principal’s Certification Forms – DCSD and GA DOE

4. School Group List

5. Security Checklist

6. DCSD School Inventory Count Form

7. Packing Lists

82

GA DOE WEBSITEhttp://www.gadoe.org/Curriculum-Instruction-and-Assessment/Assessment/Pages/default.aspx

LOOK IN HERE

CLICK HERE

83

ContactsContacts

For assessment, test material, test coding, and testFor assessment, test material, test coding, and test

security/irregularities questions please do not hesitate tosecurity/irregularities questions please do not hesitate to

contact Trenton, Allison, Brenda or Anita in the Departmentcontact Trenton, Allison, Brenda or Anita in the Department

of Research, Assessment & Grants by phone (678) 676-0300 of Research, Assessment & Grants by phone (678) 676-0300 or by emailor by email

QUESTIONS?QUESTIONS?