Virginia Department of Education Assessing English Language Learners Virginia Association of Test...

Virginia Department of EducationAssessing English Language

Learners

Virginia Association of Test Directors

2008 Assessment Conference

October 30, 2008

Richmond, VA

2

World-Class Instructional Design and Assessment

(WIDA) Consortium

• WIDA Consortium membership provides:

• Online and site based professional development training

• WIDA ACCESS Placement Test (W-APT )• ACCESS for ELLs® Score Report Guide• Technical assistance from WIDA and MetriTech

3

World-Class Instructional Design and Assessment

(WIDA) Consortium Assessments

• W-APT™

WIDA-ACCESS Placement Test

• ACCESS for ELLs®

Assessing Comprehension and Communication in English State-to-State for English Language Learners

• Alternate ACCESS for ELLs®

4

ACCESS for ELLs®

Test Administration

• Spring 2008 Administration• 28 school divisions

• Spring 2009 Administration• the Virginia Board of Education selected

ACCESS for ELLs® as the state-approved English language proficiency (ELP) assessment, September 26, 2007

• Statewide administration

• 2 testing window options

5

ACCESS for ELLs®

Testing Window Options

6

November 17 to December 17, 2008

Order Test Materials and Pre-ID Labels

February 9 - April 3, 2009

Administer ACCESS for ELLs®

April 10, 2009

Ship Test Materials to MetriTech

June 12, 2009

Receive Score Reports (approximately)

ACCESS for ELLs®

Option I Testing Window Timelines

7

January 5 to 30, 2009

Order Test Materials and Pre-ID Labels

March 16 - May 8, 2009

Administer ACCESS for ELLs®

May 15, 2009

Ship Test Materials to MetriTech

July 17, 2009

Receive Score Reports (approximately)

ACCESS for ELLs®

Option 2 Testing Window Timelines

8

School divisions must choose one of the two test window options for the divisionwide administration of ACCESS for ELLs®.

It is suggested that the DDOT and Title III coordinator jointly select the testing window option for their school division.

The DDOT will provide the test window option selected by the division via an online survey.

ACCESS for ELLs®

Testing Window Options

9

ACCESS for ELLs®

Test Administration

10

Division Directors of Testing (DDOTs) may assume responsibility for

• ordering, receiving, distributing, collecting, and returning secure and non-secure test materials; and

• receiving and distributing score reports.

ACCESS for ELLs®

Administrative Responsibilities

11

• Printing all ACCESS for ELLs® test materials

• Distributing all ACCESS for ELLs® test materials

• Scoring all ACCESS for ELLs® test materials

• Creating all ACCESS for ELLs® score reports

• Providing professional development training and technical assistance for ACCESS for ELLs® test administration

ACCESS for ELLs®

MetriTech Services

12

• Secure Web-based ordering at MetriTech Web site• www.metritech.com

• Test materials and Pre-ID labels• $23 per student• Pre-ID label file formats: Excel and CSV (comma separated)• 10% overage for all materials ordered• Orders shipped and returned by UPS ground

Note: Orders may also be sent via Fax.

ACCESS for ELLs®

Ordering Information

13

Pre-ID Labels data file descriptions for Virginia

• Fields 1-21 define demographic data• Fields 22-31 define types of instructional programs• Fields 32-36 define types of instructional services• Fields 37-44 define special accommodations• Field 45: State Testing Identifier

ACCESS for ELLs®

Ordering Information

14

Pre-ID LabelSample

ACCESS for ELLs®

Ordering Information

15

• Orders shipped and returned by UPS ground

• Orders received two weeks prior to testing window

• Divisions have one week after close of testing window to ship test material to MetriTech for scoring.

• Return all test materials, including unused and nonscorable test materials

ACCESS for ELLs®

Shipping Information

16

• One copy of the following reports:

• Division Frequency Report grouped by grade• School Frequency Report grouped by grade• Student Roster Report listing all students grouped by grade within a

school• Teacher Report detailing all scores for each student• Parent/Guardian Report per student

• Data CDs and additional reports may be ordered.

ACCESS for ELLs®

Score Reports

17

The following training materials are available on the DDOT secure Web page accessible through the Single Sign-on Web Systems (SSWS) application:

• Training PowerPoint presentation • Currently posted

• Training video streaming • expected to be posted second week of November 2008• E-mail notification will be sent.

ACCESS for ELLs®

MetriTech Training

18

• Customer Service: 800-747-4868• Fax: 217-398-5798• E-mail: wida@metritech.com

ACCESS for ELLs®

MetriTech Contact Information

19

ACCESS for ELLs®

Test Administration Training

20

The following training options will prepare test examiners for administering ACCESS for ELLs®.

• Training Toolkit CD-Rom

• Kindergarten ACCESS for ELLs® training DVD

• ACCESS for ELLs® Test Administrator Training

Note: WIDA refers to test examiners as test administrators.

ACCESS for ELLs®

Test Administration Training

21

• Online training course

• Requires individual accounts

• Username and password protected

• 3 training modules• Test Background and Group Administered

Components• Speaking Test Component• Kindergarten Component

• Quizzes for each training module

ACCESS for ELLs®

Test Administration Training for Test Examiners

22

Test Background and Group Administered Tests training includes:

• test administration manuals• organization of test forms in thematic folders• assigning students to tiers • listening, reading, and writing tests and administration

procedures• sample test items for listening, reading, and writing

tests• test background and group administered components

quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

23

Speaking Test training includes:

• test administration manual • organization of thematic folders• 3 tasks (in 3 Parts) for grade levels 1-12 • individual administration and scoring procedures• listening examples demonstrating application of the

scoring rubric• speaking test component quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

24

Kindergarten Test training includes:

• the kindergarten test administration manual • kindergarten test structure

• narrative and expository sections• administration and scoring procedures• sample test items for listening, reading, and writing

tests• sample speaking test sound files • kindergarten training video clips• kindergarten component quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

25

DDOTs will be responsible for creating accounts for all individuals who will participate in the online ACCESS for ELLs® test administration training.

ACCESS for ELLs®

Test Administration Training for Test Examiners

26

ACCESS for ELLs®

Test Administration Training

27

ACCESS for ELLs®

Test Administration Training

W-APT Username

28

ACCESS for ELLs®

Test Administration Training

W-APT Password

29

ACCESS for ELLs®

Test Administration Training

Select “Create an ACCESS for

ELLs® training account”

30

ACCESS for ELLs®

Test Administration Training

Click “Continue”

31

ACCESS for ELLs®

Test Administration Training

Select “Virginia”

Select first letter of your

school division

Select your school

division, then click

“Continue”

32

ACCESS for ELLs®

Test Administration Training

Enter the following information:

•First name•Last Name•E-mail Address•Retype E-mail Address•Password•Retype Password

This information may be considered “optional.”

Click “Create My Account!”

33

WIDA will notify individuals via e-mail that training accounts have been created and they may begin completing online training course.

ACCESS for ELLs®

Test Administration Training for Test Examiners

34

• The Secretary of Education interprets Title III Section 3112 (b) (3) (D) as follows:

All LEP students served by programs funded under Title III be assessed annually with an assessment or assessments that measure each of the language domains of speaking, listening, reading, and writing. States may not exempt LEP students from any portion of an annual ELP assessment.

Source:Federal Register, October 17, 2008 (Volume 73, Number 202)

ACCESS for ELLs® Participation

35

• Beginning with the 2009-2010 school year, LEP students, in grades 3-12, at levels 1, 2, 3, 4, as well as Monitor 1 and Monitor 2, must take the listening, speaking, reading, and writing subtests of the ELP assessment ACCESS for ELLs®.

ACCESS for ELLs® Participation

36

Standards of Learning Assessments Participation

37

LEP Student Assessment Participation Committee

• ESL Teacher

• Content Teachers

• Administrator or designee• Guidance Counselor• School Testing Coordinator

• Parent or Guardian, if possible

38

Testing Decisions for LEP Students

The LEP Student Assessment Participation Committee should consider:

• each LEP student on an individual basis;

• each LEP student’s English language proficiency level;

• each LEP student’s level of previous schooling in his/her native language; and

• each LEP student’s years of schooling in the United States.

39

Testing Decisions for LEP Students

The LEP Student Assessment Participation Committee should:

• determine the participation of each LEP student in each assessment; and

• document how each LEP student participates in the assessments.

40

LEP Student Assessment Participation Plan

• Each LEP student’s participation in the assessments requires documentation.

• A sample document is available in Limited English Proficient Students: Guidelines for Participation in the Virginia State Assessment Program, which is available on the Virginia Department of Education Web site.

Source:

http://www.pen.k12.va.us/VDOE/Assessment/LEPStudentsparticipationguidelines.pdf

41

LEP Student Assessment Participation

All LEP students participate in testing, including:

• “Recently Arrived” students;• students in grades 3 through 8; and • students enrolled in high school courses with End-

of-Course (EOC) assessments.

42

Assessment Participation2008-2009

Reading• LEP students who have attended schools in the

United States for less than 12 months may receive a one-time exemption for the SOL reading test in grades 3 through 8.

• All other LEP students in grades 3 through 8 must participate in the SOL reading tests or VGLA reading.

• There is no exemption for the SOL End-of-Course (EOC) English: Reading test.

43

Assessment Participation2008-2009

VGLA Reading Criteria• LEP students in grades 3 through 8 who are classified at

proficiency levels 1 or 2.

• LEP students with a disability may be eligible for the read-aloud accommodation.

• LEP students may take VGLA reading up to three consecutive years.

Sources:

SUPTS MEMO NO. 241, November 9, 2006

Virginia Board of Education Consolidates State Application Amended Accountability Workbook, 5.4, p. 56

44

Assessment Participation2008-2009

Mathematics• LEP students in grades 3 through 8 must participate

in the SOL mathematics tests.

• LEP students enrolled in mathematics courses with End-of-Course (EOC) mathematics tests must be tested.

45

Assessment Participation2008-2009

Mathematics• Plain English version of the grades 3 through 8 and EOC

Algebra I mathematics tests are available for • LEP students at proficiency levels 1 and 2; and

• all LEP students regardless of their proficiency levels during the first year of enrollment in a U.S. school.

• LEP students may take plain English mathematics tests up to three consecutive years.

Source:

Board of Education Consolidated State Application Amended Accountability Workbook, 5.4, p. 56

46

Assessment Participation2008-2009

Science

• NCLB Requirement• LEP students are to participate in the SOL science

tests once in elementary school, once at the middle level, and once at the high school level.

• LEP students may be exempt from the grade 3 SOL science test but must take the grade 5 SOL science test.

47

Assessment Participation2008-2009

Science

• NCLB Requirement• The resulting SOL science test scores are not

included in Adequate Yearly Progress (AYP) calculations and are not subject to the same participation requirements as reading and mathematics.

48

Assessment Participation2008-2009

History/Social Science

• LEP students may receive a one-time exemption in SOL history/social studies testing in grades 3 through 8.

49

Assessment Participation2008-2009

Writing

• LEP students may receive a one-time exemption in the SOL writing assessment in grades 5 or 8.

• There is no exemption for the SOL EOC English: Writing test.

50

SOL Assessments2008-2009

Standards of Accreditation (SOA) Adjustment

The scores of LEP students who have been enrolled in Virginia public schools for fewer than 11 semesters will be included in school accreditation ratings only if they earn passing scores.

51

Testing Accommodationsfor LEP Students

• Accommodations ensure that LEP students have equal access in demonstrating their achievement on the SOL assessments.

• Accommodations for the SOL assessments should be selected from those the LEP student uses routinely in classroom instruction and assessment.

• Students should not be provided with unnecessary or inappropriate accommodations.

Source: Limited English Proficient Students: Guidelines for Participation in the Virginia State

Assessment Program, June 2008

52

Testing Accommodationsfor LEP Students

Testing Accommodations may include:

• Timing/Scheduling• Setting• Presentation• Response

Source: Limited English Proficient Students: Guidelines for Participation in the Virginia State Assessment Program, June 2008

53

Testing Accommodationsfor LEP Students

Bilingual Dictionary

• LEP students who require a bilingual dictionary on statewide assessments may use only a paper dictionary.

• LEP students may use a bilingual dictionary on any SOL test based on their LEP student assessment participation plan.

• The use of electronic dictionaries and translators on statewide assessments is not allowed.

Source:

2007-2008 SOL Resource Manual, pp. 98-110

54

Testing Accommodationsfor LEP Students

English Dictionary• For all students, an English dictionary without a thesaurus may

be used only on the SOL English: Writing Test, short paper component.

• If a bilingual dictionary is not available, an English dictionary may be used.

Source:

Spring 2008 Writing Manuals , Examiner's Manual - Grades 5, 8, and End-of-Course p. 23

55

Testing Accommodationsfor LEP Students

Read-Aloud • ALLOWED

Students with a visual impairment, including blindness, and those students with a specific disability that severely limits or prevents them from decoding text at any level of difficulty, as determined by a diagnostic tool(s) or instrument(s) administered by a qualified professional, are allowed to use the read-aloud/audio accommodation on the statewide reading assessments.

Source:

SUPTS. MEMO NO. 235, October 27, 2006

56

Testing Accommodationsfor LEP Students

Read-Aloud • NOT ALLOWED

Students with disabilities who are simply having difficulty reading text and/or are reading below grade level are not allowed to use the read-aloud/audio accommodation on the statewide reading assessments.

Source:

SUPTS. MEMO NO. 235, October 27, 2006

57

Testing Accommodationsfor Post-Monitor Students

• A post-monitor student is no longer identified as a LEP student; therefore, he is no longer eligible for LEP accommodations.

• However if a post-monitor student is a student with a disability, he may receive accommodations for based upon his IEP or 504 plan.

58

Questions?

59

Contact Information

Robert FugateLEP Assessment Specialist

Office of Test Administration, Scoring, and Reporting

Virginia Department of Education

(804) 225-2107

student_assessment@doe.virginia.gov

60

Contact Information

WIDA Customer Service866-276-7735

help@wida.us

MetriTech, Inc.800-747-4868

wida@metritech.com