Vince Verges NEFEC 1 12 16 › files › groups › 46 › files › FLDOE...• Grades 8–10/Retake FSA ELA Writing • Grades 4–10 FSA ELA Reading • Grade 4 Reading on computer

www.FLDOE.org© 2015, Florida Department of Education. All Rights Reserved.

Assessment Updates

January 12th, 2016


2

Computer‐Based Testing Updates


Computer‐Based Testing The following Spring 2016 assessments are computer‐based:• Grades 8–10/Retake FSA ELA Writing• Grades 4–10 FSA ELA Reading

• Grade 4 Reading on computer for the first time

• Grades 5–8 FSA Mathematics• FSA EOC Assessments (Algebra 1, Geometry, Algebra 2)

• NGSSS EOC Assessments (Algebra 1 Retake, Biology 1, Civics, U.S. History)

• FCAT 2.0 Reading Retake3


Computer‐Based TestingNew Student Interface shell for 2015–16• Universally accessible

• De‐emphasize navigation components by using lighter colors

• Item tools menu • All tools now consolidated in a single location under a menu button in the top right corner of the item.

4


Computer‐Based TestingItem Response Recovery• For FSA ELA Writing, students may restore previously‐saved versions of their writing responses (during the same sitting)

• Responses save every two minutes• Tool is also available on open response items for ELA Reading and Mathematics assessments

5


Computer‐Based Testing

FSA Session Transitions• Beginning with the Winter FSA EOCs, the process for moving from Session 1 to Session 2 includes the following changes:

• Students no longer have the option to click “Next” on the Session Review screen.

• Students will select “End Session” (to pause their tests) and test administrators will take no further action (other than to stop the session).

6


Computer‐Based TestingListening Items• Grades 4–10 ELA Reading• Listening items may appear in either or both sessions of the ELA Reading tests

• Schools must provide headphones/earbuds, or students may use their own

• Headphones/earbuds should be plugged in and system settings checked (e.g., volume not muted) PRIOR to launching the secure browser

• American Sign Language (ASL) Videos will be available for eligible students taking CBT or PBT accommodated ELA Reading tests

• PBT accommodated students will have access to listening items (audio) on a computer through a secure site

7


Computer‐Based Testing

• FDOE’s IT team is involved in overseeing all technology‐related processes and changes for AIR and Pearson.

• All system changes and improvements proposed by the contractor must be reviewed and approved by FDOE IT staff.

• FDOE will closely monitor testing to ensure that all systems work as expected, and to troubleshoot any issues that arise.

8


• FSA ELA Test Item Specifications—Slight revisions made to format and other minor details

• ELA Test Design Summary and Blueprint—Remove Grade 11; update Writing administration time to 120 minutes; update Technology‐Enhanced Item Descriptions for 2015–16; update language regarding the weighting of the ELA writing component; provide additional language regarding cognitive complexity

Additional Fall/Winter Updates

9


• Now available on the FSA Portal• Grade 4—Opinion; Grade 5—Informative; Grade 6—Informative; Grade 7—Argumentation; Grade 8—Informative; Grade 9—Argumentation; Grade 10—Informative

• Examples of student responses that represent various score‐point combinations

• Not intended to provide a full spectrum of examples• Do not necessarily represent highest or lowest examples of score points

• Passage sets are permissioned pieces and will be available via a hyperlink. (Printing is available via the URL.)

FSA ELA Writing Scoring Samplers

10


New FSA CBT Practice Tests• Now available on the FSA Portal • FSA practice tests available for each grade; replaces the Training Tests

• Online FSA Reading practice tests divided into two sessions to allow Test Administrators practice with logging students in and out of sessions

• SESSION LENGTH AND CONTENT ARE NOT REPRESENTATIVE OF THE OPERATIONAL ASSESSMENTS!

• CBT students required to participate in a practice test prior to testing

11


More FSA ELA Writing Practice Tests • Grade 4—Informative • Grade 5—Opinion• Grade 6—Informative• Grade 7—Argumentation • Grade 8—Informative• Grade 9—Argumentation• Grade 10—Informative

12


Accommodations • For students with IEP or 504 plan that specifies this accommodation, Text‐to‐Speech (TTS) functionality will be available for all computer‐based FSA ELA Reading and Writing components.

• Passages/text sets are not read to students.• Items and options are read to students.• Prompt wording is read to students.

• American Sign Language (ASL) videos provided for listening items on the CBT and PBT ELA Reading tests (SPRING 2016)

• Students with PBT accommodations have access to the listening items via a secure interface.

13


FSA ELA Writing Condition Codes• Totally blank – no valid ELA score because student did not attempt to take the Writing portion of the ELA assessment

• If “0” reported = attempt to respond, but response earned condition code resulting in zero points out of 10 points possible

• Entire response written in a language other than English = 0

• Totally illegible, incomprehensible, insufficient, or copied from the sources with no original writing = 0

• Totally off topic = conventions domain is still scored, resulting in 0, 1, or 2 points

14


FSA Writing Reminders to Students•Read prompt first! •Read the passage set carefully, taking notes• Think about the purpose, audience, and task.

•Reread the prompt.•Plan the response.•Draft a response, read your draft, then revise and edit as needed.

15


Handheld Calculators• FDOE provided an approved list of calculator models for the 2015–16 FSA assessments

• The list can be found in the following document on the FSA Portal: Calculator and Reference Sheet Policies for Florida Standards Assessments (FSA) Mathematics Assessments (shown on next slide as well)

• FDOE will review/approve additional models for the list once annually; however, districts may provide calculators if mathematics specialists in the district determine that they meet the published specifications (provided on later slides)

• Handheld calculators are OPTIONAL

16


Updated Calculator PolicyThe following handheld scientific calculators are FDOE‐approved calculators for the 2015–16 school year.

• Texas Instruments TI‐30Xa• Casio fx‐260 solar• Casio fx‐82 solar• Sharp EL‐510R• Sharp EL‐510RN


Updated Calculator Policy

• Schools may use calculators that are not on the approved list if district mathematics specialists determine they meet the required specifications.

• Students are not allowed to share calculators. Not every test item in the calculator section will require the use of a calculator.

• See the calculator and reference sheet policy on the portal.


Handheld Calculators• Calculators are allowed for certain grades and subjects, and for only certain FSA sessions:

• Grades 7 and 8 Mathematics – SESSIONS 2 and 3 ONLY• FSA EOCs – SESSION 2 ONLY• NGSSS EOCs (Algebra 1 Retake, Biology 1) – 4‐function handheld

• Tests for students who have access to a calculator during non‐calculator sessions OR who have access to a calculator with prohibited functionalities must be invalidated

19


Handheld Calculators


Handheld Calculators – Prohibited Functionality


FSA Calculator SummaryAssessment Calculator Permitted

Grades 3 and 4 Mathematics

PBT‐ None

Grades 5 and 6 Mathematics

CBT ‐ None

Grades 7 and 8 Algebra 1Algebra 2Geometry

Computer based scientific calculator or hand‐heldscientific calculator

PBT: Paper Based Test CBT: Computer Based Test


Practice Using the Online Calculator

The online scientific calculator for grades 7 and 8, and FSA EOCs can be found at:

http://fsassessments.org/resources/


Sign up

Updated !

Click here for….

Accessing Resources in the FSA Portal


Resources include: Equation editor item tutorial; FSA Mathematics policies and materials; FSA scientific calculator

Accessing Resources in the FSA Portal


26

Vince Verges

Assistant Deputy Commissioner, Accountability, Research, and Measurement

[email protected]

Questions About These Assessment Topics?


Florida Standards Alternate Assessment


Florida Standards Alternate Assessment

• IEP determines if:• The student has a significant cognitive disability• Even with appropriate and allowable instructional accommodations, assistive technology, or accessible instructional materials, the student requires modifications to grade level general state content standards

• The student requires direct instruction in academic areas of English language arts, mathematics, social studies, and science based on access points in order to acquire, generalize, and transfer skills across settings


2016 FSAA

• FSAA‐Performance Task• 99% of students meeting the criteria for needing instruction in Access Courses and being assessed on alternate achievement standards will participate in the performance task assessment

• FSAA‐Datafolio Trial Administration• designed to provide a second option for assessing students with the most significant cognitive disabilities for whom no formal mode of communication has been established.


Blueprints and Alignment

Study Summer 2014

Items Developed Winter‐

Summer 2015

Item Review CommitteeJune 2015

andJuly 2015

Construct Test Forms and ProductionSummer‐Fall

2015

Administer TestSpring 2016

Performance Task: Milestone Timeline

• New assessment blueprints developed for Mathematics, ELA, and HS Biology

• New blueprints for ELA and Mathematics are aligned to the Florida Standards Access Points

• New blueprint for Biology based on NGSSS• Alignment study determined which items currently in bank are aligned to new blueprints


Content Areas & Grades Assessed

• Civics EOC, US History EOC, and Algebra 2 portfolio introduced in 16‐17 • Operational field test for Writing in 2015‐16

Grade Level ELA Mathematics Science EOC

Algebra 1EOC

GeometryEOC

Biology

3 X X

4 X X

5 X X X

6 X X

7 X X

8 X X X

9 X

10 X

HS X X X


Performance Task Overview• Accessibility for all students:

• Universal Design concepts• Tactile/Braille materials – contracted and non‐contracted• Gradual transition to Unified English Braille• Tactile materials for non‐braille readers• American Sign Language videos in 16‐17

• Administration Modes• Paper administration in 2016 • Transition to optional online computer based administration 2017


Performance Task Design Overview

2016 Operational Field Test Design

• Goals of 2016 Operational Field Test• Test the item tiers and complexity assumptions• Establish the psychometric scale for future assessment

• Administration procedures will change• Each content will be separated into 2 or 3 sessions• Each session will follow different administration procedures


FSAA‐Datafolio Trial Administration

• FSAA—Datafolio Trial Administration• 120 participating teachers• 160 participating students

• Participating teachers will provide feedback throughout the process on:

• Training Materials, Samples and the Resource Guide (RG)

• Blueprints & Activity Choices• Participation Guidelines• Levels of Assistance• Scoring


Important Dates ‐ Resources

ResourcesAccommodated Materials Ordering Window• Tactile Graphic Materials• Uncontracted Braille/Tactile Graphic Materials• Contracted Braille/Tactile Graphic Materials• One-Sided Response Booklet Ordering

September 21 – November 2, 2015

Train the Trainer Resources available on the Measured Progress FTP Site

November 2, 1015 – April 3, 2015Website (URL): https://transfer.measuredprogress.org

Administration manuals (TAMs) arrive in districts

November 18-19, 2015


Important Dates ‐ Resources

ResourcesAdministration Training Modules and Support Documents posted to the FSAA Training Website

December 1, 2015

FSAA Online System’s Assessment Registration December 2 – 30, 2015

Print-based Practice Materials arrive in districts December 3 & 4, 2015Practice materials/tutorial available in the FSAA Online System

Mid- to late December 2015

Distribution of Object Exchange List and List ofCards and/or Strips and Teacher-Gathered Materials

No later than January 15, 2016

FSAA Online System training for AACs\Teachers January 20, 2016\February 1, 2016


FSAA Important Dates – Elementary and Middle

Elementary and Middle School (Grades 3-8)

Materials in Districts February 19 – 24, 2016

Student Testing Window February 29 – April 15, 2016

Student Responses Entered into Online System

No later than 11:59 PM EST on April 15, 2016

Return of Test Materials to PiedraData Services

No later than May 13, 2016


FSAA Important Dates – High School

High School ELA (Grades 9 & 10) , Algebra 1, Geometry, and Biology 1

Materials in Districts March 15 – 17, 2016 or March 21 – 23, 2016

Student Testing Window Upon receipt of materials through April 29, 2016

Student Responses Entered into Online System

No later than 11:59 PM EST on April 29, 2016

Return of Test Materials to Piedra Data Services

No later than May 13, 2016

Student Reports in districts Week of June 6, 2015


Standard Setting and Reporting

• Standard setting will be conducted after the 2015‐16 administration.

• Reports will be in schools the week of June 6• Until standard setting is conducted and cut scores determined, student reports will include student raw score and percentile ranking per content area


FSAA Contact Information

Angela Nathaniel

[email protected]

(850)245‐0972


Assessing Communication and Comprehension in English State‐to‐State for English Language Learners 2.0

(ACCESS for ELLs 2.0)


ACCESS for ELLs 2.0 Assessments• Based on the WIDA English Language Development Standards and are used to measure students’ progress in learning English.

Three components:

• Kindergarten ACCESS for ELLs, paper‐based assessment for Kindergarten

• ACCESS for ELLs 2.0 Paper, paper‐based assessment for Grades 1–12

• Alternate ACCESS for ELLs, paper‐based assessment for students in Grades 1–12 who have significant cognitive disabilities


Important ResourcesFlorida’s WIDA webpage: https://www.wida.us/membership/states/Florida.aspx

• Florida‐specific information regarding the administration of the ACCESS for ELLs 2.0.

WIDA Secure Portal: www.wida.us/login.aspx• Online training modules and certification to district and school personnel for the ACCESS for ELLs 2.0.

WIDA Assessment Management System (WIDA AMS): www.wida‐ams.us• Administrative portal is to order test materials, edit student demographic information and accommodations, and download the Spring 2016 ACCESS for ELLs 2.0 Score Reports.


Students to be TestedAll students enrolled in the district (grades K‐12) and classified ELL, with a code of “LY” on the 1st day of the test administration window, must be administered the ACCESS for ELLs 2.0.

Students with disabilities participate in the statewide assessment program by taking one of the following:

• ACCESS for ELLs 2.0 without accommodations,

• ACCESS for ELLs 2.0 with accommodations, or

• Alternate ACCESS for ELLs

Important: All determinations regarding participation and accommodations in the statewide assessment program must be documented in the student’s IEP or Section 504 Plan, and the student’s ELL Plan.


2015 – 2016 ACCESS for ELLs 2.0 ScheduleEvent Date

Delivery of 2016 Administration Materials January 15, 2016

2016 ACCESS for ELLs 2.0 Test Administration Window February 8, 2016 – March 25, 2016

Return of Materials February 9, 2016 – April 1, 2016

Pre‐Reporting Data Validation Window April 20, 2016 – April 26, 2016

Delivery of 2016 ACCESS for ELLs 2.0 Score Reports May 20, 2016

Post‐Reporting Data Validation Window May 23, 2016 – June 3, 2016

Final Data Available to State June 13, 2016

Bridge Study (conducted by Center for Applied Linguistics) June 14, 2016 – September 30, 2016

Standard Setting October 2016


Test Overview• Kindergarten ACCESS for ELLs is an individually administered, adaptive assessment designed to take an average of 45 minutes per student.

• The Test Administrator scores all sections, including the Writing test, on site.

• ACCESS for ELLs 2.0 Paper is available in three tiered forms within a grade‐level cluster. Tier refers to the form of the test administered that roughly correspondences to a student’s position along the second language continuum: Tier A (Beginning); Tier B (Intermediate); or Tier C (Advanced).

• Grade‐Level Clusters: 1, 2, 3, 4–5, 6–8, 9–12• The Speaking section is individually administered and scored by the Test Administrator.

• The Listening, Reading, and Writing sections can be group‐administered.

• Alternate ACCESS for ELLs is an individually administered, semi‐adaptive assessment.

• Grade‐Level Clusters: 1–2, 3–5, 6–8, 9–12• The Test Administrator scores all sections.

.


Training and Certification Requirements for Test Administrators via WIDA Secure PortalWIDA requires that all Test Administrators score 80% or higher on the appropriate quiz to become a certified Test Administrator. For some educators, one or more quizzes are required.

• Kindergarten ACCESS for ELLs: Kindergarten Training Module and take the Kindergarten quiz

• ACCESS for ELLs 2.0 Paper: Speaking Assessment Scoring Module and take the appropriate quiz

• There are five Speaking Assessment Scoring Modules that cover the grade‐level clusters (Grade 1, 2–3, 4–5, 6–8, 9–12), which takes approximately 90 minutes to complete all modules. These modules provide sample student responses for Test Administrators to practice scoring.

• The Speaking Quiz is provided in two grade‐level clusters (Grades 1–5 or 6–12).• Note: If a Test Administrator is not administering the Speaking section, the Speaking

quiz is not required.

• Alternate ACCESS for ELLs: Alternate ACCESS for ELLs Training Module and take the Alternate ACCESS for ELLs quiz


2016 ACCESS for ELLs 2.0 Regional Training Sessions

Location Assessment(s) Date

Tallahassee Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 14, 2015

Gainesville Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 15, 2015

Kissimmee Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper December 17, 2015

Kissimmee Alternate ACCESS for ELLs December 18, 2015

Boca Raton Kindergarten ACCESS for ELLsACCESS for ELLs 2.0 Paper January 11, 2016

Boca Raton Alternate ACCESS for ELLs January 12, 2016

Online TrainingKindergarten ACCESS for ELLs ACCESS for ELLs 2.0 PaperAlternate ACCESS for ELLs

October 5, 2015 – March 25, 2016


2016 ACCESS for ELLs 2.0 Score Reports• Individual Student Report (ISR): Scores are reported as Proficiency Levels and as Scale Scores of four individual language domains and combined domains.

• Note: For Alternate ACCESS for ELLs, the ISR is referred to as the Parent/Guardian Report.

• Student Roster Report: Lists individual scale scores along with their corresponding ELP levels for each grade according to grade‐level clusters.

• Teacher Report: Provided for Alternate ACCESS for ELLs.

• School Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified school.

• District Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified district.

Important: Districts are scheduled to receive one hardcopy of each score report on May 20, 2016, but additional reports can be printed via WIDA AMS.


Contact Information

Florida Department of Education Office of AssessmentSabrina Read, WIDA Florida ACCESS Test Trainer

• Telephone Number: 850‐245‐0843• Email: [email protected]