60
Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008 Richmond, VA

Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

Embed Size (px)

Citation preview

Page 1: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

Virginia Department of EducationAssessing English Language

Learners

Virginia Association of Test Directors

2008 Assessment Conference

October 30, 2008

Richmond, VA

Page 2: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

2

World-Class Instructional Design and Assessment

(WIDA) Consortium

• WIDA Consortium membership provides:

• Online and site based professional development training

• WIDA ACCESS Placement Test (W-APT )• ACCESS for ELLs® Score Report Guide• Technical assistance from WIDA and MetriTech

Page 3: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

3

World-Class Instructional Design and Assessment

(WIDA) Consortium Assessments

• W-APT™

WIDA-ACCESS Placement Test

• ACCESS for ELLs®

Assessing Comprehension and Communication in English State-to-State for English Language Learners

• Alternate ACCESS for ELLs®

Page 4: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

4

ACCESS for ELLs®

Test Administration

• Spring 2008 Administration• 28 school divisions

• Spring 2009 Administration• the Virginia Board of Education selected

ACCESS for ELLs® as the state-approved English language proficiency (ELP) assessment, September 26, 2007

• Statewide administration

• 2 testing window options

Page 5: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

5

ACCESS for ELLs®

Testing Window Options

Page 6: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

6

November 17 to December 17, 2008

Order Test Materials and Pre-ID Labels

February 9 - April 3, 2009

Administer ACCESS for ELLs®

April 10, 2009

Ship Test Materials to MetriTech

June 12, 2009

Receive Score Reports (approximately)

ACCESS for ELLs®

Option I Testing Window Timelines

Page 7: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

7

January 5 to 30, 2009

Order Test Materials and Pre-ID Labels

March 16 - May 8, 2009

Administer ACCESS for ELLs®

May 15, 2009

Ship Test Materials to MetriTech

July 17, 2009

Receive Score Reports (approximately)

ACCESS for ELLs®

Option 2 Testing Window Timelines

Page 8: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

8

School divisions must choose one of the two test window options for the divisionwide administration of ACCESS for ELLs®.

It is suggested that the DDOT and Title III coordinator jointly select the testing window option for their school division.

The DDOT will provide the test window option selected by the division via an online survey.

ACCESS for ELLs®

Testing Window Options

Page 9: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

9

ACCESS for ELLs®

Test Administration

Page 10: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

10

Division Directors of Testing (DDOTs) may assume responsibility for

• ordering, receiving, distributing, collecting, and returning secure and non-secure test materials; and

• receiving and distributing score reports.

ACCESS for ELLs®

Administrative Responsibilities

Page 11: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

11

• Printing all ACCESS for ELLs® test materials

• Distributing all ACCESS for ELLs® test materials

• Scoring all ACCESS for ELLs® test materials

• Creating all ACCESS for ELLs® score reports

• Providing professional development training and technical assistance for ACCESS for ELLs® test administration

ACCESS for ELLs®

MetriTech Services

Page 12: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

12

• Secure Web-based ordering at MetriTech Web site• www.metritech.com

• Test materials and Pre-ID labels• $23 per student• Pre-ID label file formats: Excel and CSV (comma separated)• 10% overage for all materials ordered• Orders shipped and returned by UPS ground

Note: Orders may also be sent via Fax.

ACCESS for ELLs®

Ordering Information

Page 13: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

13

Pre-ID Labels data file descriptions for Virginia

• Fields 1-21 define demographic data• Fields 22-31 define types of instructional programs• Fields 32-36 define types of instructional services• Fields 37-44 define special accommodations• Field 45: State Testing Identifier

ACCESS for ELLs®

Ordering Information

Page 14: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

14

Pre-ID LabelSample

ACCESS for ELLs®

Ordering Information

Page 15: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

15

• Orders shipped and returned by UPS ground

• Orders received two weeks prior to testing window

• Divisions have one week after close of testing window to ship test material to MetriTech for scoring.

• Return all test materials, including unused and nonscorable test materials

ACCESS for ELLs®

Shipping Information

Page 16: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

16

• One copy of the following reports:

• Division Frequency Report grouped by grade• School Frequency Report grouped by grade• Student Roster Report listing all students grouped by grade within a

school• Teacher Report detailing all scores for each student• Parent/Guardian Report per student

• Data CDs and additional reports may be ordered.

ACCESS for ELLs®

Score Reports

Page 17: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

17

The following training materials are available on the DDOT secure Web page accessible through the Single Sign-on Web Systems (SSWS) application:

• Training PowerPoint presentation • Currently posted

• Training video streaming • expected to be posted second week of November 2008• E-mail notification will be sent.

ACCESS for ELLs®

MetriTech Training

Page 18: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

18

• Customer Service: 800-747-4868• Fax: 217-398-5798• E-mail: [email protected]

ACCESS for ELLs®

MetriTech Contact Information

Page 19: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

19

ACCESS for ELLs®

Test Administration Training

Page 20: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

20

The following training options will prepare test examiners for administering ACCESS for ELLs®.

• Training Toolkit CD-Rom

• Kindergarten ACCESS for ELLs® training DVD

• ACCESS for ELLs® Test Administrator Training

Note: WIDA refers to test examiners as test administrators.

ACCESS for ELLs®

Test Administration Training

Page 21: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

21

• Online training course

• Requires individual accounts

• Username and password protected

• 3 training modules• Test Background and Group Administered

Components• Speaking Test Component• Kindergarten Component

• Quizzes for each training module

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 22: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

22

Test Background and Group Administered Tests training includes:

• test administration manuals• organization of test forms in thematic folders• assigning students to tiers • listening, reading, and writing tests and administration

procedures• sample test items for listening, reading, and writing

tests• test background and group administered components

quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 23: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

23

Speaking Test training includes:

• test administration manual • organization of thematic folders• 3 tasks (in 3 Parts) for grade levels 1-12 • individual administration and scoring procedures• listening examples demonstrating application of the

scoring rubric• speaking test component quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 24: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

24

Kindergarten Test training includes:

• the kindergarten test administration manual • kindergarten test structure

• narrative and expository sections• administration and scoring procedures• sample test items for listening, reading, and writing

tests• sample speaking test sound files • kindergarten training video clips• kindergarten component quiz

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 25: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

25

DDOTs will be responsible for creating accounts for all individuals who will participate in the online ACCESS for ELLs® test administration training.

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 26: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

26

ACCESS for ELLs®

Test Administration Training

Page 27: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

27

ACCESS for ELLs®

Test Administration Training

W-APT Username

Page 28: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

28

ACCESS for ELLs®

Test Administration Training

W-APT Password

Page 29: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

29

ACCESS for ELLs®

Test Administration Training

Select “Create an ACCESS for

ELLs® training account”

Page 30: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

30

ACCESS for ELLs®

Test Administration Training

Click “Continue”

Page 31: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

31

ACCESS for ELLs®

Test Administration Training

Select “Virginia”

Select first letter of your

school division

Select your school

division, then click

“Continue”

Page 32: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

32

ACCESS for ELLs®

Test Administration Training

Enter the following information:

•First name•Last Name•E-mail Address•Retype E-mail Address•Password•Retype Password

This information may be considered “optional.”

Click “Create My Account!”

Page 33: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

33

WIDA will notify individuals via e-mail that training accounts have been created and they may begin completing online training course.

ACCESS for ELLs®

Test Administration Training for Test Examiners

Page 34: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

34

• The Secretary of Education interprets Title III Section 3112 (b) (3) (D) as follows:

All LEP students served by programs funded under Title III be assessed annually with an assessment or assessments that measure each of the language domains of speaking, listening, reading, and writing. States may not exempt LEP students from any portion of an annual ELP assessment.

Source:Federal Register, October 17, 2008 (Volume 73, Number 202)

ACCESS for ELLs® Participation

Page 35: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

35

• Beginning with the 2009-2010 school year, LEP students, in grades 3-12, at levels 1, 2, 3, 4, as well as Monitor 1 and Monitor 2, must take the listening, speaking, reading, and writing subtests of the ELP assessment ACCESS for ELLs®.

ACCESS for ELLs® Participation

Page 36: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

36

Standards of Learning Assessments Participation

Page 37: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

37

LEP Student Assessment Participation Committee

• ESL Teacher

• Content Teachers

• Administrator or designee• Guidance Counselor• School Testing Coordinator

• Parent or Guardian, if possible

Page 38: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

38

Testing Decisions for LEP Students

The LEP Student Assessment Participation Committee should consider:

• each LEP student on an individual basis;

• each LEP student’s English language proficiency level;

• each LEP student’s level of previous schooling in his/her native language; and

• each LEP student’s years of schooling in the United States.

Page 39: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

39

Testing Decisions for LEP Students

The LEP Student Assessment Participation Committee should:

• determine the participation of each LEP student in each assessment; and

• document how each LEP student participates in the assessments.

Page 40: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

40

LEP Student Assessment Participation Plan

• Each LEP student’s participation in the assessments requires documentation.

• A sample document is available in Limited English Proficient Students: Guidelines for Participation in the Virginia State Assessment Program, which is available on the Virginia Department of Education Web site.

Source:

http://www.pen.k12.va.us/VDOE/Assessment/LEPStudentsparticipationguidelines.pdf

Page 41: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

41

LEP Student Assessment Participation

All LEP students participate in testing, including:

• “Recently Arrived” students;• students in grades 3 through 8; and • students enrolled in high school courses with End-

of-Course (EOC) assessments.

Page 42: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

42

Assessment Participation2008-2009

Reading• LEP students who have attended schools in the

United States for less than 12 months may receive a one-time exemption for the SOL reading test in grades 3 through 8.

• All other LEP students in grades 3 through 8 must participate in the SOL reading tests or VGLA reading.

• There is no exemption for the SOL End-of-Course (EOC) English: Reading test.

Page 43: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

43

Assessment Participation2008-2009

VGLA Reading Criteria• LEP students in grades 3 through 8 who are classified at

proficiency levels 1 or 2.

• LEP students with a disability may be eligible for the read-aloud accommodation.

• LEP students may take VGLA reading up to three consecutive years.

Sources:

SUPTS MEMO NO. 241, November 9, 2006

Virginia Board of Education Consolidates State Application Amended Accountability Workbook, 5.4, p. 56

Page 44: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

44

Assessment Participation2008-2009

Mathematics• LEP students in grades 3 through 8 must participate

in the SOL mathematics tests.

• LEP students enrolled in mathematics courses with End-of-Course (EOC) mathematics tests must be tested.

Page 45: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

45

Assessment Participation2008-2009

Mathematics• Plain English version of the grades 3 through 8 and EOC

Algebra I mathematics tests are available for • LEP students at proficiency levels 1 and 2; and

• all LEP students regardless of their proficiency levels during the first year of enrollment in a U.S. school.

• LEP students may take plain English mathematics tests up to three consecutive years.

Source:

Board of Education Consolidated State Application Amended Accountability Workbook, 5.4, p. 56

Page 46: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

46

Assessment Participation2008-2009

Science

• NCLB Requirement• LEP students are to participate in the SOL science

tests once in elementary school, once at the middle level, and once at the high school level.

• LEP students may be exempt from the grade 3 SOL science test but must take the grade 5 SOL science test.

Page 47: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

47

Assessment Participation2008-2009

Science

• NCLB Requirement• The resulting SOL science test scores are not

included in Adequate Yearly Progress (AYP) calculations and are not subject to the same participation requirements as reading and mathematics.

Page 48: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

48

Assessment Participation2008-2009

History/Social Science

• LEP students may receive a one-time exemption in SOL history/social studies testing in grades 3 through 8.

Page 49: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

49

Assessment Participation2008-2009

Writing

• LEP students may receive a one-time exemption in the SOL writing assessment in grades 5 or 8.

• There is no exemption for the SOL EOC English: Writing test.

Page 50: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

50

SOL Assessments2008-2009

Standards of Accreditation (SOA) Adjustment

The scores of LEP students who have been enrolled in Virginia public schools for fewer than 11 semesters will be included in school accreditation ratings only if they earn passing scores.

Page 51: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

51

Testing Accommodationsfor LEP Students

• Accommodations ensure that LEP students have equal access in demonstrating their achievement on the SOL assessments.

• Accommodations for the SOL assessments should be selected from those the LEP student uses routinely in classroom instruction and assessment.

• Students should not be provided with unnecessary or inappropriate accommodations.

Source: Limited English Proficient Students: Guidelines for Participation in the Virginia State

Assessment Program, June 2008

Page 52: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

52

Testing Accommodationsfor LEP Students

Testing Accommodations may include:

• Timing/Scheduling• Setting• Presentation• Response

Source: Limited English Proficient Students: Guidelines for Participation in the Virginia State Assessment Program, June 2008

Page 53: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

53

Testing Accommodationsfor LEP Students

Bilingual Dictionary

• LEP students who require a bilingual dictionary on statewide assessments may use only a paper dictionary.

• LEP students may use a bilingual dictionary on any SOL test based on their LEP student assessment participation plan.

• The use of electronic dictionaries and translators on statewide assessments is not allowed.

Source:

2007-2008 SOL Resource Manual, pp. 98-110

Page 54: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

54

Testing Accommodationsfor LEP Students

English Dictionary• For all students, an English dictionary without a thesaurus may

be used only on the SOL English: Writing Test, short paper component.

• If a bilingual dictionary is not available, an English dictionary may be used.

Source:

Spring 2008 Writing Manuals , Examiner's Manual - Grades 5, 8, and End-of-Course p. 23

Page 55: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

55

Testing Accommodationsfor LEP Students

Read-Aloud • ALLOWED

Students with a visual impairment, including blindness, and those students with a specific disability that severely limits or prevents them from decoding text at any level of difficulty, as determined by a diagnostic tool(s) or instrument(s) administered by a qualified professional, are allowed to use the read-aloud/audio accommodation on the statewide reading assessments.

Source:

SUPTS. MEMO NO. 235, October 27, 2006

Page 56: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

56

Testing Accommodationsfor LEP Students

Read-Aloud • NOT ALLOWED

Students with disabilities who are simply having difficulty reading text and/or are reading below grade level are not allowed to use the read-aloud/audio accommodation on the statewide reading assessments.

Source:

SUPTS. MEMO NO. 235, October 27, 2006

Page 57: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

57

Testing Accommodationsfor Post-Monitor Students

• A post-monitor student is no longer identified as a LEP student; therefore, he is no longer eligible for LEP accommodations.

• However if a post-monitor student is a student with a disability, he may receive accommodations for based upon his IEP or 504 plan.

Page 58: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

58

Questions?

Page 59: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

59

Contact Information

Robert FugateLEP Assessment Specialist

Office of Test Administration, Scoring, and Reporting

Virginia Department of Education

(804) 225-2107

[email protected]

Page 60: Virginia Department of Education Assessing English Language Learners Virginia Association of Test Directors 2008 Assessment Conference October 30, 2008

60

Contact Information

WIDA Customer Service866-276-7735

[email protected]

MetriTech, Inc.800-747-4868

[email protected]