TerraNova 2013 Training Guide Colleen Rohowsky, Office of the Director,, DoDDS-Europe

DODDS-EUROPE

TerraNova 2013

Training GuideColleen Rohowsky, Office of the Director,, DoDDS-Europe

It is DoDEA policy that all system wide assessments administered in DoDEA measure student performance so that inferences can be made about student achievement in basic skill areas as well as provide a source of information for decision-makers concerning programs and services.

DoDEA Regulation: 2000.06 Colleen Rohowsky, Office of the Director, DoDDS-Europe

DoDEA POLICY

22

3

1. Norm-referenced Student scores are compared with a

“normal” group of students at a grade level

(Ex. TerraNova, 3rd Edition, Multiple Assessments)

2. Criterion-referenced Student scores are compared with the

achievement of specific goals or standards (Ex. U.S. History End-of-Course Assessment)

Colleen Rohowsky, Office of the Director, DoDDS-Europe

ASSESSMENT TYPES

4

Refer to the TerraNova 3rd Edition Assessment Coordinators Manual and the publisher’s instructions in the Test Directions for Teachers

Follow procedures: Prior to Test Administration During Test Administration After Test Administration (Reference: TN 2013 ACM pages i-iv)

When Test Scores are Received, report any irregularities to the Amy Dilmar, District ISS

Assessment POC, and copy Colleen Rowhosky, the DODEA-Europe ISS Assessment Coordinator on the report as consultations with HQ and the test company may be necessary


THE SCHOOL ASSESSMENT COORDINATOR’S Checklist

5

Norm-referenced

Grades 3 – 11

Five Content Areas Tested: Reading, Language Arts, Mathematics, Science, and Social Studies

Baseline Established -2009

Testing Window: March 11-March 29, 2013 Colleen Rohowsky, Office of the Director, DoDDS-Europe

TerraNova

6

Do not discuss test questions or answers with anyone!

This means you may not go back over a test section and review it with students or colleagues –not anyone!

Consequences for divulging test questions will result in the invalidation of tests and other appropriate action


CRITICAL: TN TEST PROTOCOL

7

Certified educators must administer theTerraNova Proctors should not be parents of students in test session Review plans and procedures prior to testing Emphasize the importance of test security before, during and after

testing Proctors can fill-in student-identifying information on test books Proctors can make sure students are working in correct place and

marking only one answer for each test question Proctors can distribute test materials, separate punch-out rulers in the

classroom Proctors can collect materials at end of the testing session Test materials must be returned to the School Assessment Coordinator,

daily

(Ref. TN Test Directions for Teachers, p. 2, for more details)


TerraNova Protocol: Test Proctors

8

Reference DoDEA System wide Assessment Program Regulation 2000.06

Some highlights:

TerraNova materials may be distributed to *”certified” staff only. Students may not have access to any new or completed assessment materials other than their own and then only while they are actually taking the test

* (A certified educator: TP status and employed by the school or DSO or Area Office )


TerraNovaProtocol: Test Security

9

CTB “TerraNova, Test Directions for Teachers” may be reviewed by *certified educators at any time

DoD Sponsors may review the “Teacher’s

Guide to TerraNova” and the Student Practice Test-at the school- to determine any perceived conflict with family values or religious beliefs-they may NOT take them home

*(Educators employed in TP status at school or DSO)


TerraNovaSecurity Protocol: Teachers &

Sponsors

10

TerraNova Practice Tests may be taken home by students, after they have completed it in class (it may not be administered at home)

TerraNova Student Test Booklets are NOT available for review by anyone!

TerraNova ACM – not available for review by parents, community

Copying any portion of the TN is prohibited

All TN Student Test Booklets must be coded for student accommodations, if applicable, and shipped (with tracking numbers) for scoring & copies of tracking numbers must be sent to the District CSI/Assessment/Program Evaluation ISS-they forward to Area Office


TerraNova Security Protocol: Student Test Booklets

11

TN Student Test Booklets will be distributed to TN administrators - those administering the assessment and this means teachers or other authorized personnel, (certified educators) on the first day of the assessment

The Student Test Booklets will be collected, daily by a certified educator, at the end of each test session, and stored in a locked room or cabinet by the School Assessment Coordinator or an administrator


TerraNova Security for Student Test Booklets

Protocol: First Day of Testing

12

Tests will be distributed to teachers the morning of testing- each day of testing

Tests will be returned to the school Assessment Coordinator or school administrator daily and kept in a secure, locked location


TerraNovaProtocol: Test Security-During Testing

13

The school Assessment Coordinator will inventory and store all TerraNova materials in a secure location (e.g. locked cabinet, drawer, or storage room)

TN Student Test Booklets will not be available to teachers or students at any time, except during the administration of the test - starting the first day of testing and not before

Community members/parents do not have access to the TN Student Test Booklets or the TN ACM


TerraNova Security for Student Test Booklets

Protocol: Inventorying, Storing & Restricted Access

14

Administer the Practice Activities in advance of testing – not day of testing

Students must complete the Practice Activity in the classroom

Teachers will see which students have difficulty with aspects of the test, (such as bubbling-in the answers and can assist them prior to test time

Students may not take their Practice Activity home for homework

Once the Practice Activity is completed and reviewed with students by the teacher, students may take it home and it does not have to be returned to the school


TERRANOVAProtocol: Practice Activities

15

Follow the TN Test Directions for Teachers exactly

Test directions should be read aloud exactly as written

Per publisher’s guidelines–administer one content area a day (Contact DSO & Area Office, in extenuating circumstances that would prevent testing in one content area a day)

(Ref. Test Directions for Teachers, p. 2)

Permissible to change the order of the tests (Ref. Test Directions for Teachers, p. ii & p. 3)

Schedule make-ups, if students miss all or part of a test

(Ref. Test Directions for Teachers, p. 2)


TerraNova Protocol: Test Administration

16

Do not allow electronic devices of any kind in the testing area (includes cell phones, digital cameras, hand-held scanners, pagers, or games)

Do not allow use of markers, pens,

highlighters, crayons, colored pencils, paint, correction fluid on TerraNova

(Reference: Back of front cover of TerraNova 3rd Edition Test Directions for Teachers & pages 11 & 12)

Allow Number 2 pencils only


TerraNova Test AdministrationProtocol: Electronic

Devices/Markers

17

Test questions have been designed and adequate time has been provided so that using a calculator will not offer any particular advantage; however the classroom use of calculators is supported by the National Council for Teachers of Mathematics

(Reference HQ DoDEA Memorandum dated 12 Nov. 2008) (Reference TN 3rd Edition, Test Directions for Teachers, p. 1) Colleen Rohowsky, Office of the Director, DoDDS-Europe

TerraNova Test AdministrationUse of Calculators & Test Questions

18

Calculators should NOT be used in Part 1 of the TerraNova 3rd Edition, Multiple Assessments, Mathematics test

All students in grades 3-11 should have access to a calculator during the administration of Parts 2 and 3 of the TerraNova, 3rd Edition, Multiple Assessments Mathematics test

Students should be familiar with the use of a calculator prior to testing


TerraNova Test AdministrationProtocol: Calculators

19

Optional: Four-Function Calculators-not provided with test materials

(Ref. TN Test Directions for Teachers, page 1, Step 1)

The type of calculator provided should be one that students are familiar with in the classroom

If students have never used calculators in the classroom based on standard classroom practices, it cannot be assumed that they all know how to use a calculator-this may be the case especially for younger students (3rd grade, for example)


TerraNova Test AdministrationProtocol: Type of Calculator

20

The classroom use of calculators in DoDEA schools has been supported by DoDEA Headquarters in the past through direct purchase of calculators or FADing of money to the Area Offices for their purchase

Calculators were already purchased and in DoDDS-Europe schools

Four-function calculators may be used but are not provided with test materials

(See HQ Memorandum dated 12 Nov. 2008)

(See TN 3rd Edition, Test Directions for Teachers, p. 1)


TerraNova Test AdministrationPurchase of Calculators

21

The ESL Alternate Assessment (in the TN test family) is the CAT Survey Plus Mathematics Computation test

ESL Levels 1 and 2 students should participate in the CAT Survey Plus- (unless the ESL Student/Teacher Team determines the student has advanced enough-since the initial testing earlier in the school year- and can participate in the TerraNova

Levels 1 and 2 ESL students in Grade 3 mark their responses in the consumable Grade 3 CAT Plus student book

Levels 1 and 2 ESL students in Grades 4-11 are to only fill-in the Mathematics Computation section of the CAT Plus answer sheet (page 3 of the answer sheet)

Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372) Colleen Rohowsky, Office of the Director, DoDDS-Europe


TerraNova CAT Survey Plus MathematicsProtocol: ESL Alternate Assessment

22

The LAS Links Form B is also part of the ESL Alternate Assessment and is not administered during the TN test window

LAS Links Form B: Administered during End-of-Year ESL Assessment, April 1 – May 17, 2013, by the ESL teachers

The CAT Survey Plus Mathematics (alternate assessment from the TerraNova family) is administered during the TN test window

Area Office ISS ESL POC: Jizela Chirichetti (DSN: 338-7372)


Alternate ESL AssessmentsProtocol: ESL Form “B” LAS Links

23

Inclusive education supports the premise that ALL students are to participate in system wide testing

The “No Child Left Behind” Act also supports this

Accommodations enable a student to have equal access to participation in DoDEA assessments


ACCOMMODATIONSReasons Why

24

Any student (including home- schoolers) using test accommodations must have an Individualized Education Program (IEP), a 504 DoDEA Education Plan, or an ELL classification in place specifying the testing programs the student participates in, the content area appropriate for the student to be tested in, and the accommodations to be used.

(Reference TerraNova 3rd Edition Assessment Coordinator’s Manual pages 10 & 11 & DoDEA Regulation 2000.06, Enclosure 3)

Area Office ISS Student Services 504 POC: John Keating (DSN: 338-7358)


ACCOMMODATIONSRequirements

25

Alternate Assessment (SPED) all grades, as appropriate - must be on IEP

Test window: March - May, 2013

Area Office ISS SPED POCs:

Katharine Heath (DSN: 338-7208)

Maureen Crouse {Kurzweil POC} (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)


Alternate SPED AssessmentProtocol: SPED Alternate Assessment

26

Three Categories of Accommodations

Cat. 1 Least restrictive

Cat. 2 May influence results

Cat. 3. Most Restrictive – may impact results

Accommodations for Special Education students must be annotated in their IEP

See TerraNova, 3rd Edition, Assessment Coordinator’s Manual Spring 2013, p.9-21 for detailed information and guidance regarding accommodations

Area Office SPED POCs: Katharine Heath (DSN 338-7208) Maureen Crouse (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)


ACCOMMODATIONS Categories

27

Home-schooled students who are eligible for enrollment on a space-required, tuition-free basis, may participate in DODEA system wide testing

School should be contacted in advance of testing

The sponsor must verify eligibility; photo-IDs for student & sponsor, immunization records, PCS Orders

Home-schooled students are to be tested in a classroom with their like-age peers, at the time normally scheduled for that classroom’s assessment

Must have a DoDEA IEP if testing with accommodations


TerraNovaProtocol: Home-Schooled Students

28

Transportation costs will be the responsibility of the child’s sponsor, not the local school

All students are expected to follow strict classroom behavior expectations while testing

All students are expected to follow the test administrator’s directions & must report to class on tine as students cannot enter the classroom once testing has started

Scores earned will not be reflected on schools Summary Scores (Home-schooled students)

DoD sponsor will receive Individual Score Report


TerraNovaProtocol: Home-Schooled Students

(continued)

29

Practice Test Teachers guide NOT teacher directions Age appropriate/shots/photo id DoDDs IEP

Home School Clarifications

30

Scores may be used to make comparisons over time – longitudinal analysis

Scores may be used to evaluate program effectiveness (e.g. Continuous School Improvement)

Scores may help identify areas of concern

Scores may identify students’ skill strengths

Results of each system wide assessment identified to measure student achievement in DoDEA shall be used as one component of an assessment system for major decisions concerning the student’s future leaning activities (DoDEA Regulation 2000.06)


DoDEA System Wide AssessmentsProtocol: Scores

31

Classroom observations Classroom activities Homework assignments Teacher-made tests Criterion-referenced tests Locally SELECTED or purchased

assessments Portfolios Projects


OTHER ASSESSMENT TYPES

32

Some highlights, per Regulation 2000.06:

Developing, teaching, and/or practicing curriculum objectives based solely on the content objectives of the assessment

Using assessment preparation materials beyond the TerraNova Practice Activities or materials that are not part of a program materials adoption purchased by DoDEA


TerraNovaINAPPROPRIATE/UNETHICAL PRACTICES

33

Excluding students from the TerraNova without appropriate review and sponsor notification (against DoDEA policy)

Teaching to specific questions or tasks

Providing assistance that will inadvertently indicate an answer

Allowing students to use highlighters on the TN is not permitted as the use of highlighters is considered an accommodation and it must be on students’ IEPs - (If on the IEP, it is permissible - as an accommodation)


TerraNova Unethical Practices

(continued)

34

Halting all regular instruction weeks or days prior to the test and teaching just those concepts and content objectives on the assessment

Reviewing specific TerraNova items with students before or after the test (unethical and generally illegal)

Using identical or virtually identical questions or items from current or past assessments

Photocopying published assessments in whole or in part for any purpose (copyright infringement)

Prompting students to find the correct answer to any questions except Sample items


TerraNova Unethical Practices

(continued)

35

Providing students with a variety of test formats throughout the school year

Assisting students with mechanical acts such as finding the correct place

Reviewing general test directions and procedures prior to the assessment


TerraNova Ethical Practices

36

School Assessment Coordinator may distribute TN Test Directions for Teachers and other supplies prior to test time; but Not the TN Student Test Booklets as they are distributed on the First Day of TerraNova testing

Ensuring that assessment materials are secured at the end of each testing session - students should NOT have access to any of the assessment materials before or after the test administration sessions

Ensuring that teachers not discuss what was on the TerraNova assessment with anyone, before, during or after the test


TerraNova Ethical Practices

(continued)

37

Barcode labels are created by CTB by using the student information that has been provided by

DoDEA HQ

Using the barcode roster, verify that each student’s biographic and demographic information is accurate. If there are any errors in the student’s data – DO NOT use the barcode label

Affix one barcode label in the designated area on the back cover of the student test booklet

(Reference the TN ACM Spring 2013, pages 27 & 28 for further details) Colleen Rohowsky, Office of the Director, DoDDS-Europe

TerraNova Protocol: Barcodes (NEW)

38

DoDDS-EUROPE shipping suspense-

On or Before: April 5, 2013 Must be shipped via a traceable

method – School Assessment Coordinators send tracking

numbers to appropriate District CSI/Assessment/Program Evaluation ISS & once collected, each district forwards the numbers to the Area Office ISS counterpart


TerraNovaProtocol: Shipping

39

Bavaria: Marie McGurn (DSN: 468-7426) Heidelberg: Mary Leonhart (DSN: 388-9373) Isles: Jennifer Simmons (DSN: 226-7227) Kaiserslautern: Peggy Hoffman-Schmidt (DSN: 489-6339) Mediterranean: Amy Dilmar (DSN: 634-7738)

Area SPED ISSs: Katharine Heath (DSN: 338-7208)

Maureen Crouse {Kurzweil POC} (DSN: 338-7393) Rhonda Roddam-Duke (DSN: 338-7798)

Area ESL ISS: Jizela Chirichetti (DSN: 338-7372) Area Student Services (504) ISS: John Keating (DSN: 338-7358)

AREA POC: Colleen Rohowsky (DSN: 338-7204)

DODDS - EUROPE DISTRICT & AREA OFFICE

CSI/ASSESSMENTS/PROGRAM EVALUATION & SPED, ESL, STUDENT

SERVICES (504) ISSs

40

Testing window is 3 weeks◦ Schedule Recommendation is Mid Week ◦ Copy of schedule emailed to Amy by COB

February 26th

◦ Make ups/exceptions◦ Number of tests per day◦ Packaging/Shipping

Schedules—Med District

41

Webinar After testing New students Bar codes not accurate Disposal incorrect ones Assessment coordinator can pull together

groups of teachers to help verify bar codes

Bar Codes

42

Leave room—invalidates◦ Email Amy with Colleen R. on copy

Student take other subjects but not come back to that one

Cannot do make up of that test

Sick Students

43

ESL 1s 2s progressing to TN? ◦ Documentation

Each test booklet/inside cover

Accommodations Form—see form.◦ Team meetings necessary for accuracy ◦ Suspense is March 1

Accommodations

44

Scribe

Accommodation Questions

45

Link to guide

Multi-Age Guidelines

46

October forms w/signatures

Confidentiality Form

47

Pencils Calculators Security Consistency

Supplies

48

Tracking not just confirmation Send tracking number to Amy and copy

principal

Shipping

49

LIST

Nine Things NOT TO DO

50

To Be Determined

Extra Materials

Documents

TerraNova 2013 Training Guide Colleen Rohowsky, Office of the Director,, DoDDS-Europe