Florida Department of Education’s Teacher Evaluation System

Florida Department of Education’s Florida Department of Education’s Teacher Evaluation System

Student Learning GrowthStudent Learning Growth

Established by Student Success Act (SB 736) Teacher Evaluation System

• Evaluation Criteria for All Instructional Personnel and School Administrators– Professional Practice– Student Learning Growth

• JTEC & Principal Evaluation Committee

Apply Weights

IP = 60%SLG = 40%

InstructionalPractice (IP)

(4) Highly Effective

(3) Effective

(2) Needs Improvement

(1) Unsatisfactory

Student Learning Growth (SLG)

(4) Highly Effective(3) Effective(2) Needs Improvement(1) Unsatisfactory

Final Rating

HEEffNIU

Established by Student Success Act (SB 736)Teacher Evaluation System

VAM & Student Learning Growth

• Contribution to a change in a student’s achievement

• Calculated from a measure of student learning growth

What is the Student Learning Growth Score?

The difference between Current test score and

Predicted test score

What is the Predicted Student Score?


It is score you would predict a student to achieve based on the student’s performance on prior tests

and other information available on the student

FLDOE Value-Added Model Variables determining predicted score

• Two or more years of prior achievement scores • Gifted status • Class size • Student Attendance (Days)• Mobility (number of transitions) • Difference from modal age in grade (indicator of

retention) • The number of subject-relevant courses in which

the student is enrolled• Homogeneity of entering test scores in the class

FLDOE Value-Added Model Variables determining predicted score

• Students with Disabilities (SWD) status – Language impaired– Hearing impaired– Visually impaired– Emotional/behavioral– Specific learning disability– Dual sensory impaired– Autism spectrum disorder– Traumatic brain injury– Other health impaired– Intellectual disability

• English Language Learner (ELL) status – LY

FLDOE Value-Added Model Variables not determining predicted score

• Gender

• Race

• Ethnicity

• Socioeconomic status

What is the Student Learning Growth Score?

Predicted - Current

FLDOE Value-Added Model

Variables determining student learning growth

TERMSDistrict Data Base of All Student Records


PRIOR TEST

…100 200 300 400 500 600 700 800 900 1000…

(FY10 FCAT)

(FY

11 F

CA

T)


PRIOR TEST

900

800

700

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST

900

800

700

600

500

400

300

(FY10 FCAT)

W(F

Y11

FC

AT

)

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST

900

800

700

600

500

400

300

PREDICTED SCORE600

Answer:Average of

current scores of similar students

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…

Student Learning Growth is the Amount Above or Below Predicted Score

PRIOR TEST

900

800

700

600

500

400

300

PREDICTED SCORE600

Above Predicted Score

Below Predicted Score

ACTUAL SCORE

ACTUAL SCORE

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…

PRIOR TEST PRIOR TEST 10 20 30 40 50 60 70 80 90 100…

Based on Prior Achievement Only Based on Prior Achievement & ELL

What is the Predicted Student Score? Based on Prior Achievement

40050

600

800

70

90Each prior year test score has a

Predicted current year test score.

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…

FLDOE Value-Added Model Variables determining student learning growth

• Two or more years of prior achievement scores

• Attendance • Mobility (number of

transitions) • Difference from modal age in

grade (indicator of retention) • Class size • The number of subject-

relevant courses in which the student is enrolled

• Homogeneity of entering test scores in the class

• LY

• Gifted status • Language impaired• Hearing impaired• Visually impaired• Emotional/behavioral• Specific learning disability• Dual sensory impaired• Autism spectrum disorder• Traumatic brain injury• Other health impaired• Intellectual disability

Reading Grade 7Indicators Ranked By Statistical Significance

Indicator T-StatisticAchievement: Prior Year 75.667Achievement: Two Prior Years 38.167Enrolled in 2 or more courses 18.354Difference from Modal Age 15.977Attendance 13.571Number of students in Class 1 8.439Homogeneity of Class 2 Prior Year Test Scores 7.182Language Impaired 5.362Specific Learning Disability 5.013Homogeneity of Class 1 Prior Year Test Scores 4.750ELL Indicator 4.673Homogeneity of Class 3 Prior Year Test Scores 3.188Number of students in Class 5 2.385Enrolled in 2 or more class periods 2.289Mobility: Number of School Transfers 2.271Intellectual Disability 2.141

Illustrative Growth Points All other variables being equal

Variables Growth Points*Typical 100ELL 100 moreLow Attendance 100 points less

*adapted from AIR materials presented at August 2, 2011,meetingThese are illustrative values, not actual values

PRIOR TEST PRIOR TEST 10 20 30 40 50 60 70 80 90 100…



40050

600

800

70

90

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…

PRIOR TEST PRIOR TEST



400500

600

800

700

900

(FY10 FCAT)

(FY

11 F

CA

T)

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000…

PRIOR TEST PRIOR TEST

Based on Prior Achievement Only Based on Prior Achievement& Low Attendance


400

300

600

800

500

700

(FY10 FCAT)

(FY

11 F

CA

T)

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000…

How to calculate the student learning growth score?

PRIOR TEST DRE

The diagonal line is the predicted growth

observed among similar students.

(FY10 FCAT)

(FY

11 F

CA

T)

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST

Student PY CY Pred Growth

A 200 300 400 -100

B 30 55 45 10

C 40 40 50 -10

D 50 70 60 10

DRE(FY10 FCAT)

(FY

11 F

CA

T)

FY10 FY11 FY11 FY11FCAT FCAT FCAT FCAT

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST


A 200 300 400 -100

B

C 40 40 50 -10

D 50 70 60 10

DRE(FY10 FCAT)

(FY

11 F

CA

T)


300 550 450 100

W

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST


A 200 300 400 -100

B 300 550 450 100

C 400 400 500 -100

D 50 70 60 10

DRE(FY10 FCAT)

(FY

11 F

CA

T)


? ? ? ?

Y

…100 200 300 400 500 600 700 800 900 1000…


PRIOR TEST


A 200 300 400 -100

B 300 550 450 100

C 400 400 500 -100

D 500 700 600 100

DRE(FY10 FCAT)

(FY

11 F

CA

T)


…100 200 300 400 500 600 700 800 900 1000…

School Growth Score

PRIOR TEST DRE

Stdt PY CY Pred Growth

A 200 300 400 -100

B 300 550 450 100

C 400 400 500 -100

D 500 700 600 100

E 200 300 400 - 100

F 300 550 450 100

G 400 750 500 250

H 500 700 600 100

I 200 300 400 -100

J 300 250 450 - 200

K 400 400 500 -100

L 500 700 600 100

(FY10 FCAT)

(FY

11 F

CA

T)


…100 200 300 400 500 600 700 800 900 1000…

Calculating Teacher Value-Added ScorePart 1

DRE

Student Growth Scores

Teacher Effect School Component

Teacher VAM

FLDOE Teacher Value-Added Score Conceptual

.5 + ( X )=

DRE

( )TeacherEffect

School Component

A Real Picture is Worth a Thousand Words

SDPBC Teacher VAM (Grade 5 Subject: Reading)

Mean = 3.3N = 561

Class >= 10

State Teacher VAM (Grade 5 Subject: Reading)

Mean = 0.1N = 12182

Teacher VAM Distribution for Reading

What you need to receive a VAM score?

• Assigned students• 10 or more students with a learning

growth score• Instructional job code

– Reading/math– Class, school, district

37

Sample Elementary School

Reading MathAverage Reading

and Math

Art SchoolGrade 1 SchoolGrade 4 AssignedReading Assigned

Sample Middle School


and Math

English AssignedScience AssignedMath AssignedArt School

Sample High School


and Math

English AssignedScience AssignedMath AssignedArt School

Teachers Get What Score?JTEC

• Teacher receives the value-added score based on the students assigned to them in TERMS who have a student growth score. – teacher < 10 students assigned to them who have

a student growth score receive the school component score.

Teachers Get What Score?JTEC

• School indicates that the teacher receives the school component score. – Teacher assigned to one school receives school

component score. – Teacher assigned to two schools receives the

weighted average of the schools' component scores.

– Teacher assigned to more than two schools receives District component score.

School Component

SDPBC School ComponentGrade 5 Subject: Reading

Mean = 4.0N = 120

State School ComponentGrade 5 Subject: Reading

Mean = 0.02N = 2082

School ComponentDistribution for Reading

Apply Weights

IP = 60%SLG = 40%

InstructionalPractice (IP)

(4) Highly Effective

(3) Effective

(2) Needs Improvement

(1) Unsatisfactory

Student Learning Growth (SLG)

(4) Highly Effective(3) Effective(2) Needs Improvement(1) Unsatisfactory

Final Rating

HEEffNIU

Established by Student Success Act (SB 736)Teacher Evaluation System

VAM and School Component Estimated Distributions

Unsatisfactory(1)

Needs Improvement

(2)

Effective(3)

Highly Effective(4)

2% 13% 72% 13%

Highly Effective (13%)

Teachers in Florida

Effective (72%)

Teachers in Florida

Needs Improvement (13%)

Teachers in Florida

Unsatisfactory (2%)

Teachers in Florida

Summary: Student Learning Growth

• State Mandated• Student Learning Growth

–Difference between current score and predicted score

–Based on prior achievement and selected student characteristics

Summary: Student Learning Growth

• Some teachers get VAM score, which includes both teacher effect and school component

• Other teachers get school component score

• 72% teachers effective based on Student Learning Growth

Documents

Florida Department of Education’s Teacher Evaluation System