Embed Size (px)
Citation preview
Dr. John D. Barge, State School Superintendent
End of Course TestsPre-Administration Webinar Spring 2011March 8 - 9, 2011
While you are waiting, please do the following:
Configure your microphone and speakers by going to:•Tools-audio-audio setup wizard
Enter/edit your profile information by going to:•Tools-Preferences-My profile...
•Complete the information on the “identity’ tab, click ‘OK”
•To view the profile of another user, hover your mouse over his or her name in the participants window
Our session will start momentarily
AGENDA• Introductions• What’s New• Purpose/Overview• Use of Calculators• Scheduling Considerations/Test Makeup Procedures• Students to Be Tested/Accommodations/State Required Codes • Grading• System Personnel Responsibilities/Examiner Training• Security/Testing Irregularities• Receipt, Return and Tracking of Materials• Scores and Reports• EOCT Important Dates/EOCT Resources• Contact Information
What’s New?
1. Batched Class Rosters• One PDF per content area on a daily basis• Current: School ABC has 5 American Literature Class
Reports & 3 US History Class Reports posted on PearsonAccess on 02/02/2011.
• Future: In addition to the Class Roster postings noted above, School ABC will also get 1 PDF for all American Literature Class Reports & 1 PDF for all US History Class Reports on 02/02/2011.
2. Separate codes for Irregularities and Invalidations
The purpose of the EOCT is to assess student achievement of the state adopted curriculum in core courses and to provide diagnostic data in support of improved student achievement.
Purpose
Overview
• Ninth Grade Literature and Composition• American Literature and Composition• Biology• Physical Science• U. S. History• Economics/Business/Free Enterprise• Mathematics I: Algebra/Geometry/Statistics• Mathematics II: Geometry/Algebra II/Statistics
Overview
Test Total # Items
# Items Scored
Ninth Grade Literature
80 68
American Literature 80 68
Biology 80 68
Physical Science 80 68
U. S. History 80 68
Economics 80 68
Mathematics I 62 54
Mathematics II 62 54
Two core forms per subject area
Overview
• Scale Scores• Does Not Meet 200-399• Meets 400-449• Exceeds 450+
Overview
• End-of-Course Tests may be administered via paper and pencil or online. – Paper/ pencil assessments are only available during
the winter, spring and summer administrations.– Online assessments are available for all
administrations and should be considered for groups who need scores returned quickly (i.e., seniors who may need the passing score to graduate).
Overview
• Each test booklet is divided into two sections.• Students may complete Sections I and II in day one or Section I
in day one and Section II in day two.• Students may not complete a portion of a section and then
complete the remainder of the section later in the day or the next day.
• This will result in an invalidation of the test. – For example, if a student becomes ill during Section I and does not
complete that section, the student may not complete the remainder of the Section I upon return to school.
• Calculators are allowed for Mathematics I, Mathematics II, Physical Science and Economics.
• Calculators that store text or graphing calculators cannot be used. – Examiners should verify appropriate calculator use
prior to the beginning of testing.
• Electronic testing format provides “4-function” calculators.
Use of Calculators
Scheduling Considerations
• EOCT may be scheduled at any time during the state testing window.– Individual subject areas should continue to be
administered on the same or consecutive days within the system.
– At no time should some students complete a test one week and another group of students complete the same test the following week.
– Systems must complete the Administration Details page in PearsonAccess during the enrollment window (Test Setup/Enter Administration Details).
Scheduling Considerations
• Schools must adhere to the testing times prescribed in the Examiner’s Manuals. – Allowing too much or too little time may result in an
invalidation.
• When scheduling tests, consider the optimum time to administer the tests. – Consider logistics, including time and staffing. – During one-day test administrations, lunch should
not serve as the break between sections I and II.
Test Make-Up Procedures
• The purpose of the make-up days is to administer the tests to students who are unexpectedly absent during the regularly scheduled administration.
• Make-up days are designed for students who have unplanned/unavoidable absences.
Students To Be Tested
• Any student, regardless of grade-level, enrolled in an EOCT course must take the appropriate EOCT.– For example, if a student is taking a course to complete
the state requirement for Mathematics I, that student must take the Mathematics I EOCT, regardless of the course title assigned by the local system.
Students To Be Tested
• Students who are:– taking a block-scheduled course who complete the full
year course in one semester will be tested at the end of that semester.
– following a traditionally scheduled (36-week) course will be tested at the end of the second semester of the course.
– completing a course at the end of one semester (typically Economics) will be tested at the completion of the course.
Students To Be Tested
• Students enrolled (or dually enrolled) in:– alternative schools. – credit recovery or “make-up” courses. – college courses, online courses, or correspondence classes
and are receiving credit towards graduation for an EOCT course.
• Middle School students enrolled in an EOCT course, whether or not they receive HS credit for the class.– These students will also be required to take the
appropriate CRCT.
Students To Be Tested
• Students with disabilities and English Language Learners (ELL) who are enrolled in EOCT courses for credit. – Students who receive accommodations for instructional and
classroom assessment purposes may also be eligible for accommodations during the administration of End-of-Course Tests.
– Accommodations provided for statewide assessment must be listed on IEP, IAP, or ELL TPC and should be consistent with the student’s instructional program.
• Students enrolled in your system who are also enrolled in EOCT courses via Georgia Virtual School (GAVS) – Must be administered the appropriate EOCT at their home
school.– It is the school test coordinator’s responsibility to ensure that
these students’ answer documents are coded accurately (30 under SDU A) so that results may be reported to GAVS.
– Documents not coded to reflect students enrollment with GAVS could delay or interfere with student grade reports.
Students To Be Tested
Students To Be Tested
• Students enrolling from non-accredited programs.– Must take and pass the EOCT with a minimum of 70
grade conversion score to receive credit for the course. – It is the responsibility of the local school system to
determine whether criteria are met for awarding credit.
• If a student wishes to transfer credit in an EOCT course completed at an accredited institution, they are not required to complete the EOCT.
• Only approved accommodations (listed in the Accommodations Manual and the Student Assessment Handbook) may be used.
• Use of accommodations not on the list must be approved in advance by Melissa Fincher, Associate Superintendent of Assessment and Accountability at the Georgia Department of Education (404-656-2668).
• Four to six weeks should be allowed for these requests to be reviewed.
Accommodations
Grading
• The EOCT will count as 15% of the student’s final course grade.
• Students must earn a 70 or higher final course grade to pass the course and earn credit for graduation.
• If your school awards 1.0 credit upon completion of a year long course, the EOCT should count as 15% of that final grade.
• If your school awards 0.5 credit at the end of the first semester, and 0.5 credit at the end of the second semester, the EOCT should count as 15% of the final second semester course grade.
Grading
• If a student is absent on the day of the test and misses all make-up opportunities, the student may receive an Incomplete and take the EOCT during the next available testing window.
• A school may not issue a “zero” for an EOCT grade in lieu of a test administration. – However, if you feel that a student is intentionally “absent” on
all testing/make-up days, document all testing opportunities made available to the student and contact parent. After sufficient attempts have been made, a school can issue a zero for 15%, or an Incomplete.
Grading
• EOCT scores must be included on or with students’ report cards.
• If student report labels were ordered, they are to be placed on students’ permanent record folder. – Systems may request these labels on the
PearsonAccess Administration Details page during each enrollment period.
System Personnel ResponsibilitiesDetailed descriptions of roles and responsibilities are provided in the SAH, 2010-2011.•Superintendent•System Test Coordinator (STC)•Principal•School Test Coordinator•Examiner•Proctor
Examiner Training
• Documentation of attendance at the district and building level (include agenda and materials used).
• Ensure examiners have an opportunity to review examiner manual prior to testing date (in a secure environment).
• Examiners should be clear on logistical procedures in place for security of materials.
Security
• All EOCT must be administered and supervised by a Georgia-certified educator.
• Maintaining test security and test integrity is critical.• Students and teachers need to understand test
protocols and the ramifications of not following testing procedures. Violations may result in invalidation of students’ tests and/or referral to the Professional Standards Commission for disciplinary action.
Security
• Student Test Booklets must be kept secure at all times.
• Shrink-wrapped packages must remain sealed until Test Coordinators are ready to prepare test materials for administration.
• Students must write their names on the cover of their test booklet and any scratch paper.
Security
• Test Coordinators and/or Examiners should keep a record of all students tested for each EOCT administration.
• In addition to student’s name and EOCT administered, please remember to include form numbers for each student in your documentation.
• Refer to the Student Assessment Handbook for additional security information.
Testing Irregularities
• All personnel in the local system must follow protocol as they become aware of testing irregularities.
• Signs of any testing irregularity must be dealt with immediately. – Test Examiner > School Test Coordinator > System
Test Coordinator > Melissa Faux
Testing Irregularities
• All irregularities must be coded, documentation completed and submitted on the Testing Irregularity Form in the MyGaDOE Portal.
• Once the irregularity code is received, it may be used on future common place irregularities but all irregularities must still be documented in the portal.
• Only the GaDOE may invalidate assessments.
Testing Irregularities
• When entering the documentation into the portal, you must include the form number of the test that needs to be coded as an irregularity or invalidated.
• Portal documentation must clearly indicate if a score should be invalidated, or counted as an irregularity.
• Failure to include the form number when completing the Testing Irregularity Form will result in the delayed and/or inaccurate reporting of scores.
Testing Irregularities - Paper
• On answer documents, you must:– Fill-in the appropriate irregularity or invalidation bubble.
– Grid the 5-digit SDU B code.– Failure to grid both the correct SDU-B code and fill-in the
correct corresponding bubble will result in the delayed and/or inaccurate reporting of scores.
Testing Irregularities – Some Scenarios to Avoid
Bubble Irregularity Code ScoreINV Valid IRR code Invalidated
INV No code Scored As Is
IRR Valid INV code Invalidated
IRR No code Scored As Is
No Bubble Valid INV code Invalidated
No Bubble Valid IRR code Scored as an IRR
Failure to grid both the correct SDU-B code and fill-in the correct corresponding bubble will result in action listed in the right-hand column.
Testing Irregularities – Online • For online students, follow these steps in PearsonAccess:
– Test Management Overview/Register Students (find & select student)/Assigned Tests (Choose the subject)/Edit
– Select ‘yes’ using the drop down options for either the Irregularity or Invalidation box.
– Enter the 5-digit SDU B code.
– Failure to select ‘yes’ for the correct indicator (irregularity/invalidation) and/or failure to enter the correct corresponding SDU-B code will result in the delayed
and/or inaccurate reporting of scores.
Student Authorization Ticket
Testing Irregularities – Online
• To avoid a student testing under another student’s GTID, you must :•print all Student Authorization Tickets •have students verify and sign their names before testing begins
Students must verify and sign their names
Allb, Allcorrect
Receipt of Materials• Materials will be delivered on April 11-13.• System Test Coordinators must:
– Ensure sufficient quantities of materials are provided for each school.– Locate pickup/return instructions, memo, return labels, and
airbills/bills of lading.– For any discrepancies, contact Pearson Customer Call Center at 888-
705-9414.
• School Test Coordinators should sign for materials and verify counts.– Upon receipt use security checklist (found in shipment) to inventory
all materials. Please document any instances of missing test books in the portal.
• Test Examiners should sign for materials and verify counts.
Answer DocumentsComplete Following Sections for All Students(with or without Pre-ID labels)
Place Pre-ID Label here
• Please place Pre-ID Labels in box located at the bottom left hand corner of answer document.– Please do not submit documents with labels placed
incorrectly on answer document; this may delay scoring.
• For students without Pre-ID Labels, all demographic information must be bubbled (in addition to aforementioned information).
Answer Documents
Complete Following Sections Only if Applicable• SRC must be coded for students with IEP, ELL/TPC, or 504 IAP,
with or without accommodations • Types of accommodations:
– S – Setting– P – Presentation– R – Response– SC – Scheduling
• Identify basis of accommodations:– IEP, ELL/TPC, or 504 IAP– Only complete this section if an accommodation was actually given
Answer Documents – FOR TEACHER USE ONLY
• If applicable, code Braille or Large Print.• The PTNA option should only be bubbled by
the Examiner if a student is present and can not or will not take a test. If a student answers one question on any section of the test, PTNA should not be bubbled.
Answer Documents – FOR TEACHER USE ONLY
Complete Following Sections Only if ApplicableState Directed Use (SDU A and SDU B)• SDU A – Code for Georgia Network for Educational and
Therapeutic Support (GNETS) and Georgia Virtual School (GAVS)• SDU B – Two codes, one for Irregularity and one for Invalidation
– Call GaDOE for code– Melissa Faux at 404-656-5975– The 5 digit SDU-B code must be gridded (paper) or entered
online in addition to indicating the appropriate corresponding bubble.
Answer Documents – SDU A/SDU B
Class Identification Sheet
Complete only one Classroom
Identification Sheet per group.
Results will be reported based on how answer documents are grouped behind Classroom Identification Sheets; you may group students in whatever manner meets the reporting needs of your school/system.
Return of Materials
Materials to be returned to Pearson:• Completed Answer Documents with Classroom ID Sheet• Test Booklets
– Test booklets (used and unused) are bar-coded and scanned upon receipt.
– Check each test booklet to ensure there are no Answer Documents in the books.
• It is critical to the success of the EOCT that all documents are returned immediately after test administration. Promptly returning your materials helps ensure timely results can be returned to your system.– Failure to return secure testing materials may result in referral to the
Georgia Professional Standards Commission (PSC).
Return of Materials
Do not return the following materials to Pearson:• Destroy/Shred all manuals, unused/voided answer
documents, scratch paper.• You must ensure all answer documents have been
accounted for PRIOR to destroying the unused/voided documents.
• Please keep the test booklet security checklist for your records.
Return of Materials
• Answer Documents– Returned by FedEx Overnight or K2 Logistics/AAA Cooper
(larger systems).– Use Pearson’s purple return labels along with FedEx airbill
(purple) or K2 Logistics/AAA Cooper overnight airbill.
• Test Books– Returned by FedEx Ground or K2 Logistics/AAA Cooper
(larger systems).– Use Pearson white return labels along with FedEx ground
label (red) or K2 Logistics/AAA Cooper freight bill.
• Check on the status of your shipments to and from Pearson:
–Test Setup>Order Additional Materials and Tracking>Orders from Pearson or Shipments to Pearson
Tracking of Materials
Scores and Reports
Systems will receive a full set of reports for each main administration. These reports include:
• Preliminary Class Roster (electronic only-PearsonAccess) with the 5-day turnaround (Rapid Scoring). – Includes Student Name, DOB, GTID, Grade Level and Grade
Conversion.– Posted electronically to PearsonAccess within 5 days from the
date answer documents are received for scoring.– Class Rosters will be posted once a representative sample has
been received. Once Class Rosters are available, Preliminary Class Roster Reports will be removed from PearsonAccess.
• Class Roster Reports (electronic only-PearsonAccess) will post once a representative sample of subject areas have been received. – Once Class Rosters are posted, Preliminary Reports will be removed
from PearsonAccess. – Includes Scale Score, Performance Level, Grade Conversion score,
and domain level information for each student in a specific class. – The batch printing of Class Rosters will be available
• Individual Student Reports (electronic or paper if requested)– Includes Scale Score, Performance Level, and a Grade Conversion
score. – Posted electronically or sent at the end of the administration with
summary reports.– One copy should be filed in the student’s permanent record and
one given to student/parent.
Scores and Reports
Scores and Reports
• Summary Reports (system, school and class) – Generated by subject and present summary statistics for a particular
group of students.• Content Area Summary Reports (system and school)
– Provides information for school, system and state at the Domain Level.• Data File
– Posted to GaDOE portal at the time summary reports are posted.• Five day Rapid Scoring and Reporting
– Once we’ve received representative sample:• Dependent upon accuracy of answer documents.• Dependent upon when answer documents are shipped and received.• Online Testing – results posted within 5 days of testing.
Delays in Scoring and Reporting• Late shipping • Errors in packing documents for return• Errors in coding answer documents• Invalid/incorrect or no form numbers• Labels placed incorrectly on answer document• Bent/folded or torn answer document• Stray marks• Students administered the same test twice
Scores and Reports
Important Dates – Spring/Summer 2011
Task Start Date End DateMarch mid-month online testing March 7, 2011 March 11, 2011
Summer 2011 enrollment counts entered on PearsonAccess March 21, 2011 April 1, 2011
Summer 2011 local scanning enrollment entered on PearsonAccess March 21, 2011 April 1, 2011
Spring 2011 Materials Delivered April 11, 2011 April 13, 2011
Spring 2011 Main Administration April 25, 2011 June 3, 2011
Spring 2011 Pickup Materials from systems April 26, 2011 June 3, 2011
Summer 2011 Administration June 20, 2011 July 22, 2011
Summer 2011 Materials Delivered June 8, 2011 June 8, 2011
EOCT Resources• Student Assessment Handbook• Georgia Assessment Calendar• Test Coordinator’s Manual• Examiner’s Manual/Online Examiner’s Manual• Interpretive Guide• Content Descriptions• Study Guides• Mathematics I and II Formula Sheets• Physical Science Periodic Table• Physical Science Reference Sheet
52
Contact Information
Georgia Department of EducationMelissa Faux Tony Eitel404-656-5975 [email protected] [email protected]
PearsonSue Boeckmann Robin Jindrich-Cecil888-705-9414 x 21-4282 888-705-9414 x [email protected] [email protected]
