FY2015 Assessment Update CAO July 2014 Dr. Frank Rodriguez, Assistant Superintendent Mark Howard,...

FY2015 Assessment Update

CAOJuly 2014

Dr. Frank Rodriguez, Assistant SuperintendentMark Howard, Director

FY2015 Statewide Assessment Update

• What subjects and grades are tested?• Which tests are computer-based?• When will testing occur?• How and when will results be reported?• What is our plan to be prepared?

FY2015 Statewide Assessment Update

• What subjects and grades are tested?• Which tests are computers based?• When does testing occur?• How and when will results be reported?• What is our plan to be prepared

Florida Standards Assessments (FSA)TEST FY2015 FY2016 FY2017 FY2018

Grade 3 ELA PBT PBT PBT 1st year CBT Grade 3 Math PBT PBT 1st year CBT CBT Grade 4 ELA PBT 1st year CBT CBT CBT Grade 4 Math PBT PBT 1st year CBT CBT Grade 5 ELA 1st year CBT CBT CBT CBT Grade 5 Math CBT CBT CBT CBT Grade 6 ELA CBT CBT CBT CBT Grade 6 Math CBT CBT CBT CBT Grade 7 ELA CBT CBT CBT CBT Grade 7 Math 1st year CBT CBT CBT CBT Grade 8 ELA CBT CBT CBT CBT Grade 8 Math 1st year CBT CBT CBT CBT Grade 9 ELA CBT CBT CBT CBT Grade 10 ELA CBT CBT CBT CBT Grade 11 ELA New CBT CBT CBT CBT Algebra 1 EOC CBT CBT CBT CBT Geometry EOC CBT CBT CBT CBT Algebra 2 EOC New CBT CBT CBT CBT

Testing managed and administered by

American Institute for Research (AIR)

Florida Standards Assessments (FSA) TEST FY2015 FY2016 FY2017 FY2018

Grade 3 ELA PBT PBT PBT 1st year CBT Grade 3 Math PBT PBT 1st year CBT CBT Grade 4 ELA PBT 1st year CBT CBT CBT Grade 4 Math PBT PBT 1st year CBT CBT Grade 5 ELA 1st year CBT CBT CBT CBT Grade 5 Math CBT CBT CBT CBT Grade 6 ELA CBT CBT CBT CBT Grade 6 Math CBT CBT CBT CBT Grade 7 ELA CBT CBT CBT CBT Grade 7 Math 1st year CBT CBT CBT CBT Grade 8 ELA CBT CBT CBT CBT Grade 8 Math 1st year CBT CBT CBT CBT Grade 9 ELA CBT CBT CBT CBT Grade 10 ELA CBT CBT CBT CBT Grade 11 ELA New CBT CBT CBT CBT Algebra 1 EOC CBT CBT CBT CBT Geometry EOC CBT CBT CBT CBT Algebra 2 EOC New CBT CBT CBT CBT

NGSSS ASSESSMENTS TEST FY2015 FY2016 FY2017 FY2018

Grades 5 Science PBT PBT PBT PBT

Grade 8 Science PBT PBT PBT PBT

Algebra 1 EOC Retake CBT CBT CBT NLA

Geometry Retake CBT NLA NLA NLA

FCAT Reading Retake CBT CBT NLA NLA

FCAT Math Retake CBT NLA NLA NLA

Biology 1 EOC CBT CBT CBT CBT

Civics EOC CBT CBT CBT CBT

U.S. History EOC CBT CBT CBT CBT

Testing managed and administered by

Pearson

NGSSS ASSESSMENTSTEST FY2015 FY2016 FY2017 FY2018

Grades 5 Science PBT PBT PBT PBT

Grade 8 Science PBT PBT PBT PBT

Algebra 1 EOC Retake CBT CBT CBT NLA

Geometry Retake CBT NLA NLA NLA

FCAT Reading Retake CBT CBT NLA NLA

FCAT Math Retake CBT NLA NLA NLA

Biology 1 EOC CBT CBT CBT CBT

Civics EOC CBT CBT CBT CBT

U.S. History EOC CBT CBT CBT CBT

FY2015 Statewide Assessment Update

• What subjects and grades are tested?• Which tests are computers based?• When does testing occur?• How and when will results be reported?• What is our plan to be prepared?

FSA TEST SCHEDULEELA & MATH

Dates Assessment Grade Level

December 1-19, 2014 FSA English Language Arts — Writing Component Field Test (selected schools only) 4-11

March 2-13, 2015 FSA English Language Arts — Writing Component 4*, 5-11

March 23—April 10, 2015 FSA English Language Arts*/Mathematics* 3-4

April 13—May 8, 2015 FSA English Language Arts 5-11

April 13—May 8, 2015 FSA Mathematics 5-8

FSA End-of-Course AssessmentsDates Assessment

April 20—May 15, 2015 Algebra 1, Geometry, Algebra 2

* Paper-based Test

NGSSS TEST SCHEDULEFlorida Comprehensive Assessment Test® FCAT 2.0

Dates Assessment Grade Level

October 6-17, 2014March 23—April 10, 2015

FCAT Mathematics Retake (SSS)FCAT 2.0 Reading Retake Retained 10—AD

April 13—May 8, 2015 FCAT 2.0 Science* 5 and 8

NGSSS End-of-Course AssessmentsDates Assessment

September 15-26, 2014 Algebra 1 Retake, Biology 1, Civics, Geometry Retake, U.S. History

December 1-19, 2014 Algebra 1 Retake, Biology 1, Civics, Geometry Retake, U.S. History

March 23—April 10, 2015 Algebra 1 RetakeApril 20—May 22, 2015 Biology 1, Civics, U.S. HistoryJuly 13-24, 2015 Algebra 1 Retake, Biology 1, Civics, U.S. History

FY2015 Statewide Assessment Update

• What subjects and grades are tested?• Which tests are computers based?• When does testing occur?• How and when will results be reported?• What is our plan to be prepared?

Statewide Assessment & Accountability Results

• Florida Standards Assessments– Summer 2015 Cut Scores Established– Student Levels and School Results

• NGSSS Assessments– Summer 2015 Student and School Results

• School Grades• Fall FY2016 School Grades reported for All Schools• No consequences associated with school grades

FY2015 Statewide Assessment Update

• What subjects and grades are tested?• Which tests are computers based?• When does testing occur?• How and when will results be reported?• What is our plan to be prepared?

Florida Standard Assessment Portalhttp://www.fsassessments.org/

Florida Standard Assessment Portal

RESOURCES• Test Schedule• CBT Transition• Test Design Summary• Item Specifications• Training Tests

http://www.fsassessments.org/

FSA Test Design Summary/Blueprint

• What is a Test Design Summary• Why is it important?• What should we do?

Test Design Summary

• Detailed information about each assessment

• Assessed standards• Critical areas of focus • Number of test items• Percentage of raw-score

points that will be derived from each content category

Test Design SummaryTest Design Summary: Mathematics

• Detailed information about each assessment

• Assessed standards• Critical areas of focus • Percentage of raw-score

points that will be derived from each content category

• Number of test items

Test Design Summary

• Detailed information about each assessment

• Assessed standards• Critical areas of focus • Percentage of raw-score

points that will be derived from each content category

• Number of test items

Test Design SummaryTest Design Summary: English Language Arts

• Detailed information about each assessment

• Assessed standards• Critical areas of focus • Percentage of raw-score

points that will be derived from each content category

• Number of test items

QUESTIONS

Test Item Specifications

• What are they?• Why are they important?• What should we do?

Test Item SpecificationsDefine the content and format of the assessment and test items for each grade level and subject• Explain what students are expected to do• How students respond to the question• Define the range of content knowledge

and degree of difficulty • Describe characteristics from which a

student must answer a question• Defines types of stimulus materials • Align District/Teacher developed tests

Test Item Specification: Mathematics

Test Item Specification: ReadingTest Item SpecificationsDefine the content and format of the assessment and test items for each grade level and subject• Explain what students are expected to do• How students respond to the question• Define the range of content knowledge

and degree of difficulty • Describe characteristics from which a

student must answer a question• Defines types of stimulus materials • Align District/Teacher developed tests

Test Item Specification: ReadingTest Item SpecificationsDefine the content and format of the assessment and test items for each grade level and subject• Explain what students are expected to do• How students respond to the question• Define the range of content knowledge

and degree of difficulty • Describe characteristics from which a

student must answer a question• Defines types of stimulus materials • Align District/Teacher developed tests

Test Item Specification: Reading

Grade 4 ELA Writing

Test Item SpecificationsDefine the content and format of the assessment and test items for each grade level and subject• Explain what students are expected to do• How students respond to the question• Define the range of content knowledge

and degree of difficulty • Describe characteristics from which a

student must answer a question• Defines types of stimulus materials • Align District/Teacher developed tests

QUESTIONS

FY2015 District Diagnostic Assessments

• Increase value to inform instruction• Attempt to balance number of instructional days between tests• 2 Assessments• FSA Diagnostic #1 cover only standards taught to date per

District Scope• FSA Diagnostic #2 cover all tested standards• Provide immediate results for instructional adjustments

FY2015 District Diagnostic Assessments

Diagnostic #1• FSA Tests to cover standards aligned to District S & S• NGSSS Tests remain the same to provide predicted levels• October 6-31– 7 weeks of instruction prior to testing– 4 week testing window (18 days)• Accommodate additional computer-based tests• allows flexibility in scheduling

FY2015 District Diagnostic Assessments

Diagnostic #2• FSA Tests to cover all tested standards • NGSSS Tests remain the same to provide predicted levels• January 12 – February 6– 6 weeks of instruction prior to testing– 4 week testing window (18 days)• accommodate for additional computer-based tests• allows flexibility

FY2015 Assessment Reporting

• FSA Diagnostic Testing– School based scanning of Paper-based tests– Next day results for item analysis– Reteach immediately– T-score and Thirds

• NGSSS Diagnostic Testing– School based scanning of Paper-based tests– Next day results for item analysis– Reteach immediately– Predicted Levels

Online Assessment Platform

FY15 Comprehensive Assessment and Reporting Solution

Comprehensive Assessment System

• Diagnostic Assessments– District Created– Protected Item Bank

• Interim Assessments (standards based)– District Created– Protected Item Bank

• Teacher/School Assessments– Item Bank for Schools– Ability to Share within School

Principal Training for Performance Matters

• August 25, 26, 27, 29–Centralized location–2 trainings a day

• Assessment Development– Item Bank for Schools

• Reporting• Bulletins Forthcoming

Train-the-Trainer School Based Trainers

• September 2-5– Train-the-Trainer Model• 4 staff members from each school

–Online Assessment Contact– Coaches– School Tech– EDW Liaison

• 2 trainings per day• Bulletin Forthcoming

Scanning Devices

• Ricoh Copiers are now compatible with the online assessment platform

• All Assessments can be administered either online or with the plain paper scan sheets

• Pre-slugged answer sheets can be printed and scanned for reporting on plain paper using Ricoh Copier/Scanner

• STST/ITSA will be trained• Multiple copier/scanners in school will be configured

Comparing Prior and Current Elementary School Model

PriorReading Math Writing Science

Performance (100 points)

Performance (100 points)

Performance (100 Points)

Performance (100 Points)

Learning Gains (100 points)*

Learning Gains (100 points)*

Learning Gains of the Low 25% (100 points)*

Learning Gains of the Low 25% (100 points)*

A school grade is lowered one letter grade below what the point total indicates if:• Fewer than 50% of the Low 25% demonstrate gains in Reading

and Math (or show annual improvement)• Fewer than 25% of students are reading at or above grade level• Fewer than 95% of eligible students are tested, and the school

earned enough points for an “A”

CurrentEnglish/Language Arts

Math Science

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Learning Gains (0% to 100%)

Learning Gains (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

• School Grade based on the percentage of total points earned• Provisions raising or lowering a school’s grade beyond what

percentage of points indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments)

• Writing is included within the English/Language Arts Components

Grade based on total points on an

800 Point Scale Grade based on % of Total Points earned

*additional weights for certain types of gains (100 points)

Comparing Prior and Current Middle School Model

PriorReading Math Writing Science AccelerationPerformance (100 points)

Performance (100 points)

Performance (100 points)

Performance (100 points)

Participation and Performance on High School Level EOC Assessments and Industry Certifications (50 points for participation; 50 points for performance)

Learning Gains (100 points)*

Learning Gains (100 points)*

Learning Gains of the Low 25% (100 points)*

Learning Gains of the Low 25% (100 points)*

A school grade is lowered one letter grade below what the point total indicates if:• Fewer than 50% of the Low 25% demonstrate gains in Reading and Math (or

show annual improvement)• Fewer than 25% of students are reading at or above grade level• Fewer than 95% of eligible students are tested, and the school earned

enough points for an “A”

CurrentEnglish/Lang. Arts

Math Science Social Studies

Acceleration

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Learning Gains (0% to 100%)

Learning Gains (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

• School Grade based on the percentage of total points earned

• Provisions raising or lowering a school’s grade beyond what percentage of points indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments)

• Writing is included within the English/Language Arts Components

*additional weights for certain types of gains (100 points)

Grade based on total points on a 900 point scale

Grade based on % of Total Points

earned

Comparing Prior and Current High School Model

PriorAssessment Component (50%) “Other Components (50%)Reading Math

(EOC’s)Writing Science

(Biology EOC)

Acceleration

Grad. Rate

College Readiness

Social Studies (US History EOC)

Performance (100 points)

Performance (100 points)

Performance (100 points)

Performance (100 points)

Participation and Performance in AP, IB, AICE, Dual enrollment, and/or industry certification – with additional weights for multiple participation & performance (100 points for participation; 100 points for performance)

A total of four graduation rates

Overall 4-year (100 points), 5-year (100 points)

At-Risk, 4-year (50 points) At-Risk, 5-year (50 points)

Percent of graduates that are “college ready” based on SAT, ACT, and or PERT

Reading (100 points)

Math (100 points)

Performance on EOC (100 points)

Learning Gains (100 points)*

Learning Gains (100 points)*

Learning Gains of the Low 25% (100 points)*

Learning Gains of the Low 25% (100 points)*

A school grade is lowered one letter grade below what the point total indicates if:• Fewer than 50% of the Low 25% demonstrate gains in Reading and Math (or show annual improvement)• Fewer than 25% of students are reading at or above grade level• Fewer than 65% of at-risk students graduate from High School, and the school earned enough points for an “A”• Fewer than 95% of eligible students are tested, and the school earned enough points for an “A”

CurrentEnglish/Language Arts

Math (EOC’s)

Science (Biology EOC’s)

Social Studies (US History EOC)

Grad. Rate

Acceleration Success

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Performance (0% to 100%)

Overall, 4-year Graduation Rate (0% to 100%)

Percent of students eligible to earn college credit through AP, IB, AICE, dual enrollment or earning an industry certification (0% to 100%)

Learning Gains (0% to 100%)

Learning Gains (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

Learning Gain of the Low 25% (0% to 100%)

• School Grade based on the percentage of total points earned• Provisions raising or lowering a school’s grade beyond what percentage of points indicate are eliminated

(no additional requirements; no additional weights/bonus; no automatic adjustments)• Writing is included within the English/Language Arts Components

*additional weights for certain types of gains (100 points)

Grade based on

total points on

a 1600 point scale

Grade based on %

of Total Points earned

QUESTIONS