1 Standard Test Administration Testing Ethics Training PowerPoint Spring 2011 Utah State Office of Education

1

Standard Test Standard Test AdministrationAdministrationTesting EthicsTesting Ethics

Standard Test Standard Test AdministrationAdministrationTesting EthicsTesting Ethics

Training PowerPointTraining PowerPoint

Spring 2011Spring 2011

Utah State Office of EducationUtah State Office of Education

2

Purpose of TestingPurpose of TestingPurpose of TestingPurpose of Testing

Standardized administration of state Standardized administration of state tests providestests provides

An opportunity for students to An opportunity for students to demonstrate understandingdemonstrate understanding

Evidence of what students have Evidence of what students have learnedlearned

Scores which fairly reflect students Scores which fairly reflect students knowledgeknowledge

3

Purpose of TestsPurpose of TestsPurpose of TestsPurpose of Tests

Valid and reliable test resultsValid and reliable test results

Identify levels of proficiency and Identify levels of proficiency and areas that need improvementareas that need improvement

Evaluate the effectiveness of Evaluate the effectiveness of programsprograms

Compare schools and districtsCompare schools and districts

4

Educator ObligationEducator ObligationEducator ObligationEducator Obligation

Provide students an opportunity to Provide students an opportunity to demonstrate their understandingdemonstrate their understanding

Educators are to conduct testing in a fair Educators are to conduct testing in a fair and ethical mannerand ethical manner

Educators are accountable to their LEA, Educators are accountable to their LEA, and to the Utah State Board of and to the Utah State Board of EducationEducation

5

Ethical testing begins with ethical teachingEthical testing begins with ethical teaching::

Ensure that students are enrolled in the Ensure that students are enrolled in the appropriate course so that they receive appropriate course so that they receive appropriate instruction.appropriate instruction.

Provide instruction on the entire curriculum for a Provide instruction on the entire curriculum for a course.course.

Provide accommodations during instruction to Provide accommodations during instruction to eligible students as identified by an ELL, IEP or eligible students as identified by an ELL, IEP or 504 team.504 team.

Use a variety of assessment methods to inform Use a variety of assessment methods to inform instructional practices.instructional practices.

Appropriate Teaching Appropriate Teaching PracticesPractices


6



Introduce students to various test-taking Introduce students to various test-taking strategies throughout the year.strategies throughout the year.

Use the reference sheets provided for specific Use the reference sheets provided for specific assessments as instructional tools.assessments as instructional tools.

Reduce classroom interruptions to maximize Reduce classroom interruptions to maximize student learning.student learning.

Provide practice tests throughout the year using Provide practice tests throughout the year using high-quality, non-secure test questions.high-quality, non-secure test questions.

7

Appropriate Testing Appropriate Testing PracticesPractices


In In preparationpreparation for testing: for testing:

Appropriate environment is set. Appropriate environment is set.

Personnel who will administer tests must Personnel who will administer tests must be trained. be trained.

Accommodations are available for eligible Accommodations are available for eligible students.students.

Test material is secure at all times.Test material is secure at all times.

8

Appropriate Testing Appropriate Testing Practices Practices


DuringDuring testing: testing:

All students who are eligible for testing are All students who are eligible for testing are tested.tested.

All students are given the correct test.All students are given the correct test.

Information from the Test Information from the Test Administration Manual (TAM) is Administration Manual (TAM) is followed exactly.followed exactly.

Accommodations are provided to Accommodations are provided to eligibleeligible students.students.

9



Appropriate proctoring includes:Appropriate proctoring includes:

The importance of the test or test The importance of the test or test participation or the good faith efforts of all participation or the good faith efforts of all students is not underminedstudents is not undermined

Verifying the student has finished Verifying the student has finished answering all questions before submitting.answering all questions before submitting.

10



It is appropriate for proctors to identify students It is appropriate for proctors to identify students who may need completion or make-up who may need completion or make-up sessions. sessions.

For example, if a student:For example, if a student: Is absent for section 1, but completes the other Is absent for section 1, but completes the other

sections with their class, the studentsections with their class, the student’’s test should s test should not be submitted until the student has the not be submitted until the student has the opportunity to complete section 1.opportunity to complete section 1.

Needs more than the 55 minutes scheduled for Needs more than the 55 minutes scheduled for the computer lab to finish a section, another the computer lab to finish a section, another testing session for that student should be testing session for that student should be provided.provided.

11

Eligibility for testing accommodations are Eligibility for testing accommodations are determined through an ELL, IEP, or 504 determined through an ELL, IEP, or 504 team decision.team decision.

Accommodations should be used Accommodations should be used during instruction, not just during during instruction, not just during testing.testing.

For more information, see the Utah State Office For more information, see the Utah State Office of Educationof Education’’s Assessment Participation and s Assessment Participation and

Accommodations PolicyAccommodations Policy http://www.schools.utah.gov/eval/Special_Needs.asp

AccommodationsAccommodationsAccommodationsAccommodations

http://www.schools.utah.gov/eval/Special_Needs.asp

12



There should be a There should be a proctor and a proctor and a

certified teacher certified teacher present for each present for each testing session.testing session.

Educators must not Educators must not enter a studententer a student’’s s computer-based computer-based

test for any reason. test for any reason.

13

Test ResultsTest ResultsTest ResultsTest Results

Test results should be:Test results should be:

Provided to students and parents.Provided to students and parents.

Made available to educators for use in Made available to educators for use in improving their instruction.improving their instruction.

Maintained in student files.Maintained in student files.

Kept confidential.Kept confidential.

Remember that test materials must be Remember that test materials must be kept secure.kept secure.

14

Use of Data from CRTUse of Data from CRT’’ssUse of Data from CRTUse of Data from CRT’’ss● Educators may use the results from CRTs in Educators may use the results from CRTs in

considering a studentconsidering a student’’s course grade. s course grade. However, teachers need to understand what However, teachers need to understand what the results mean, and what information they the results mean, and what information they provide.provide.

● Raw score results Raw score results (the percent correct) are (the percent correct) are available within 48 hours of the testavailable within 48 hours of the test’’s s submission (computer-based). This data submission (computer-based). This data includes ELL/IEP students.includes ELL/IEP students.

15

Use of Data from CRTUse of Data from CRT’’ssUse of Data from CRTUse of Data from CRT’’ss

● Proficiency levels on assessments are Proficiency levels on assessments are determined after all student tests have been determined after all student tests have been scored and the results statistically analyzed. scored and the results statistically analyzed.

● Educators must be cautious when using raw Educators must be cautious when using raw score results in their grading system. score results in their grading system.

● Percent correct is used differently with CRTs Percent correct is used differently with CRTs than it is used in most classroom grading than it is used in most classroom grading systems.systems.

16

Use of Data from CRTUse of Data from CRT’’ssUse of Data from CRTUse of Data from CRT’’ssIt is recommended that educators work in It is recommended that educators work in

groups to decide how CRT data will be groups to decide how CRT data will be incorporated into grading systems incorporated into grading systems locally.locally.

The process of using data from CRTs in The process of using data from CRTs in considering a studentconsidering a student’’s grade should s grade should be transparent and equitable.be transparent and equitable.

17

Educator EvaluationsEducator EvaluationsEducator EvaluationsEducator Evaluations

Educator evaluations may include a section on Educator evaluations may include a section on testing practices totesting practices to Praise educators for outstanding practices.Praise educators for outstanding practices. Identify areas of concern.Identify areas of concern.

This could help to increase awareness and This could help to increase awareness and connect testing practices directly to teacher connect testing practices directly to teacher performance.performance.

Test results should Test results should notnot be used in teacher be used in teacher evaluations.evaluations.

18

Unethical PracticesUnethical PracticesUnethical PracticesUnethical PracticesIt is unethical for educators to jeopardize the It is unethical for educators to jeopardize the

integrity of an assessment or the validity of integrity of an assessment or the validity of student responses. student responses.

In addition to specific practices identified in In addition to specific practices identified in State Law and State Board Rule, unethical State Law and State Board Rule, unethical practices include. . .practices include. . .

19

Unethical PracticesUnethical PracticesUnethical PracticesUnethical Practices Providing students with questions Providing students with questions from the from the

testtest to review before taking the test. to review before taking the test.

Viewing a test, then Viewing a test, then changing instruction or changing instruction or reviewing specific conceptsreviewing specific concepts because those because those concepts appear on the test.concepts appear on the test.

Rewording or clarifying questions.Rewording or clarifying questions.

Allowing students to use unauthorized Allowing students to use unauthorized resources to find answers, including having resources to find answers, including having materials on walls which provide answers to materials on walls which provide answers to specific test questions.specific test questions.

20

Unethical PracticesUnethical PracticesUnethical PracticesUnethical Practices

Reclassifying students to alter subgroup Reclassifying students to alter subgroup reports.reports.

Allowing parent volunteers to assist with the Allowing parent volunteers to assist with the proctoring of a test their child is taking, or proctoring of a test their child is taking, or using students to supervise other students using students to supervise other students taking a test.taking a test.

Instructing/suggesting the student to rethink Instructing/suggesting the student to rethink his/her answers. his/her answers.

21

Is It Appropriate?Is It Appropriate?Is It Appropriate?Is It Appropriate?

To ensure that a practice is appropriate, To ensure that a practice is appropriate, ask the following questions:ask the following questions:

If my student is to get a valid and reliable If my student is to get a valid and reliable score that accurately portrays his/her score that accurately portrays his/her ability to understand the material, will this ability to understand the material, will this action:action:

Allow the student to answer a question Allow the student to answer a question that does not reflect his/her knowledge?that does not reflect his/her knowledge?

If the action did not occur would the If the action did not occur would the student response be different?student response be different?

22

Is It Appropriate?Is It Appropriate?Is It Appropriate?Is It Appropriate? If my student is to get a valid and reliable If my student is to get a valid and reliable

score that accurately portrays his/her score that accurately portrays his/her ability to understand the material, will this ability to understand the material, will this action:action:

Prevent the student and parent from Prevent the student and parent from receiving an accurate score that receiving an accurate score that represents the students knowledge and represents the students knowledge and understanding of the curriculum?understanding of the curriculum?

Would my practice change if I were being Would my practice change if I were being monitored?monitored?

23

Ethics ViolationsEthics ViolationsEthics ViolationsEthics ViolationsEthical violations are to be reported to the Ethical violations are to be reported to the

supervisor of the person who may be supervisor of the person who may be investigated, the school administrator, the investigated, the school administrator, the on-site assessment director, or the state on-site assessment director, or the state assessment director.assessment director.

ProtocolProtocol Policies and procedures will be followed.Policies and procedures will be followed. In most cases, an initial investigation will In most cases, an initial investigation will

be conducted at the school level.be conducted at the school level. The on-site assessment director will The on-site assessment director will

review the initial investigation and review the initial investigation and determine findings.determine findings.

24

Ethics ViolationsEthics ViolationsEthics ViolationsEthics Violations

Protocol Protocol (Continued)(Continued) If the violation is of sufficient concern, the If the violation is of sufficient concern, the

incident may also be forwarded to the incident may also be forwarded to the Utah Professional Practices Advisory Utah Professional Practices Advisory Commission (UPPAC) for review.Commission (UPPAC) for review.

If inappropriate practices are found, If inappropriate practices are found, teachers may receive further training or a teachers may receive further training or a reprimand, be subject to disciplinary reprimand, be subject to disciplinary action, be terminated, and/or lose their action, be terminated, and/or lose their Utah teaching license (see 53A-1-608; Utah teaching license (see 53A-1-608; R277-473-9).R277-473-9).

25

Ethics ViolationsEthics ViolationsEthics ViolationsEthics Violations

For more information about the For more information about the processes in place concerning the processes in place concerning the investigation of ethical violations, investigation of ethical violations,

contact your school testing coordinator contact your school testing coordinator or LEA assessment director.or LEA assessment director.

26

Investigation of ViolationInvestigation of ViolationInvestigation of ViolationInvestigation of Violation

The allegation will be forwarded to the The allegation will be forwarded to the individualindividual’’s supervisor who will initiate s supervisor who will initiate an investigation.an investigation.

Investigative information is always Investigative information is always confidential, including who filed the confidential, including who filed the complaint or who will be interviewed.complaint or who will be interviewed.

The investigation is conducted by The investigation is conducted by principal and/or district staff—never by principal and/or district staff—never by teachers or association teachers or association representatives.representatives.

27

Investigation of ViolationInvestigation of ViolationInvestigation of ViolationInvestigation of Violation

Initial investigation should be thorough Initial investigation should be thorough and include documentation.and include documentation.

Documentation could include:Documentation could include: Interviews of students, parents, teachers.Interviews of students, parents, teachers. Written statements.Written statements. Review of original testing documents.Review of original testing documents. Comparison of other testing results.Comparison of other testing results.

28

Investigation FindingsInvestigation FindingsInvestigation FindingsInvestigation Findings

The initial investigation should produce The initial investigation should produce findings:findings:

No, inappropriate practices were not No, inappropriate practices were not found:found:

Investigation ends.Investigation ends.

Investigation is inconclusive, orInvestigation is inconclusive, or Yes, inappropriate practices were found:Yes, inappropriate practices were found:

Further action is required.Further action is required.

29

Investigation FindingsInvestigation FindingsInvestigation FindingsInvestigation Findings

Maintain all documentationMaintain all documentation

NEVER promise the NEVER promise the teacher/administrator that the teacher/administrator that the

problem/complaint will not be reported problem/complaint will not be reported to the state.to the state.

30

Inappropriate Testing Inappropriate Testing PracticePractice


When an investigation results in a finding of an When an investigation results in a finding of an inappropriate testing practice, the on-site inappropriate testing practice, the on-site assessment director should be notified. assessment director should be notified.

The on-site assessment director should review The on-site assessment director should review the initial investigation and verify the the initial investigation and verify the findings. findings.

Possible outcomes may include:Possible outcomes may include: Letter of reprimandLetter of reprimand Disciplinary actionDisciplinary action No violation foundNo violation found TerminationTermination

31



The director or other individual may also The director or other individual may also forward the incident to the Utah forward the incident to the Utah Professional Practices Advisory Professional Practices Advisory Committee (UPPAC) for review.Committee (UPPAC) for review.

Report forms may be found at the Report forms may be found at the UPPAC websiteUPPAC website

http://www.schools.utah.gov/uppac/

http://www.schools.utah.gov/uppac/

32

Standard Testing Standard Testing Administration & Testing Administration & Testing

EthicsEthics


EthicsEthicsKnow the Utah State Law & Utah State Board RuleKnow the Utah State Law & Utah State Board Rule

http://le.utah.gov/~code/TITLE53A/53A01.htm

http://www.rules.utah.gov/publicat/code/r277/r277.htm Demonstrate ethical behaviorDemonstrate ethical behavior

For questionsFor questions• Review testing ethics frequently asked questions at Review testing ethics frequently asked questions at

http://schools.utah.gov/eval • Contact LEA assessment directorContact LEA assessment director

http://le.utah.gov/~code/TITLE53A/53A01.htm

http://www.rules.utah.gov/publicat/code/r277/r277.htm

http://schools.utah.gov/eval

33


EthicsEthics


EthicsEthics

Questions?Questions?

Documents

1 Standard Test Administration Testing Ethics Training PowerPoint Spring 2011 Utah State Office of Education