2016-17 Accountability Overview

Mary Batiwalla | Executive Director | Office of AccountabilityEvan Kramer | Project Manager | Office of Accountability

Objectives 2016-17 School Accountability (Reward Schools) 2016-17 District Accountability Common Questions and Additional Resources

Agenda

We will be able to:– Explain the methods for determining Reward schools– Identify the major components of district determinations– Contrast the district framework with previous iterations

Objectives

2016-17 School Accountability

Reward Performance: Top 5% of schools in terms of overall performance– Based on one-year success rate

Reward Progress: Top 5% of schools in terms of growth– Based on TVAAS composite indices

Note: The department will designate Priority and Focusschools using school grading framework in 2017-18.

Only Reward schools will be labeled in 2016-17.

Reward schools only– No Priority or Focus schools for 2016-17

Summary: School Accountability

2016-17 District Accountability

Redesigned framework as part of renewal of No Child Left Behind waiver in 2015

Every Student Succeeds Act nullifies waivers– Requires annual school identification

Few changes in current framework from waiver– Future changes to align with school grading system (2017-

18)

The district framework reflects feedback from stakeholders.

Major changes from previous framework:– Various pathways to meet, exceed expectations

• AMO targets• Relative rankings• TVAAS

– Aggregated content areas (e.g., 3-5 Math, HS ELA, etc.)– Subgroup performance rather than gap closure

The district framework offers multiple measures to demonstrate success.

There are four steps to calculate districts’ determinations.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

Step 1: Districts must meet minimum growth expectations.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

The Minimum Performance Goal expects minimum growth from districts.

Participation GoalDid the district achieve a 95% test participation rate for all

content areas and subgroups?

Achievement GoalDid the district increase its percent on track/mastered or maintain

its percentile rank for 25% of eligible content areas?

Value-Added GoalDid the district earn at least a TVAAS level 3 or make

comparable or greater gains compared to the state for 25% of eligible content areas?

Subgroup GoalDid the district reduce the percent of students scoring at the

lowest level of performance or other relevant rate for its Super Subgroup for 25% of eligible content areas?

In Need of Improvement

No

YesNo

Continue to Achievement,

Subgroup, and Final Determinations

Yes

Step 1: Minimum Performance Goal

Districts must test at least 95% of students to pass the Minimum Performance Goal.

Participation GoalDid the district achieve a 95% test participation rate for all

content areas and subgroups?

Achievement GoalDid the district increase its percent on track/mastered or maintain

its percentile rank for 25% of eligible content areas?

Value-Added GoalDid the district earn at least a TVAAS level 3 or make

comparable or greater gains compared to the state for 25% of eligible content areas?

Subgroup GoalDid the district reduce the percent of students scoring at the

lowest level of performance or other relevant rate for its Super Subgroup for 25% of eligible content areas?

In Need of Improvement

No

YesNo

Continue to Achievement,

Subgroup, and Final Determinations

Yes

Step 1: Minimum Performance Goal

Districts must meet all three goals to pass the Minimum Performance Goal.

Participation GoalDid the district achieve a 95% test participation rate for all

content areas and subgroups?

Achievement GoalDid the district increase its percent on track/mastered or maintain

its percentile rank for 25% of eligible content areas?

Value-Added GoalDid the district earn at least a TVAAS level 3 or make

comparable or greater gains compared to the state for 25% of eligible content areas?

Subgroup GoalDid the district reduce the percent of students scoring at the

lowest level of performance or other relevant rate for its Super Subgroup for 25% of eligible content areas?

In Need of Improvement

No

YesNo

Continue to Achievement,

Subgroup, and Final Determinations

Yes

Step 1: Minimum Performance Goal

Districts that do not show minimum growth are labeled In Need of Improvement.

Participation GoalDid the district achieve a 95% test participation rate for all

content areas and subgroups?

Achievement GoalDid the district increase its percent on track/mastered or maintain

its percentile rank for 25% of eligible content areas?

Value-Added GoalDid the district earn at least a TVAAS level 3 or make

comparable or greater gains compared to the state for 25% of eligible content areas?

Subgroup GoalDid the district reduce the percent of students scoring at the

lowest level of performance or other relevant rate for its Super Subgroup for 25% of eligible content areas?

In Need of Improvement

No

YesNo

Continue to Achievement,

Subgroup, and Final Determinations

Yes

Step 1: Minimum Performance Goal

Step 2: Districts are evaluated on the performance of all students.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

AMOs (HS only) Relative Achievement TVAAS

4Percent on track/mastered

equals/exceeds double AMO target

Percentile rank increases over prior year by more than 10 points

Level 5

3Percent on track/mastered

exceeds AMO target but is less than double AMO target

Percentile rank increases but by fewer than 10 points OR district has percentile rank of 95 or better in both

current and prior year

Level 4

2Percent on track/mastered or

confidence interval meets AMO target

Percentile rank stays the same or decreases by no more than 2 points

Level 3

1Confidence interval of percent on

track/mastered does not meet AMO target but is greater than

prior year

Percentile rank decreases but by no more than 10 points

Level 2

0 Confidence interval of percent on track/mastered is lower than prior

year

Percentile rank decreases by more than 10 points

Level 1

Districts earn between 0 and 4 points for each content area and pathway.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

Districts earn points for eight content areas, if eligible.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

Districts receive the best score among AMOs, relative achievement, and TVAAS.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

These best scores are averaged to calculate districts’ Achievement status.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

Districts earn points for eight content areas, if eligible.

Status Threshold DefinitionProgressing Below 2.0 District is improving on average but missing

growth expectationAchieving 2.0 to < 3.0 District is meeting growth expectation on

averageExemplary 3.0 and above District is exceeding growth expectation on

average

Districts’ scores correspond to statuses based on the following scale.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

Note: There are no AMO data for grades 3-8.

Content Area AMOs Relative Achievement

TVAAS Best Score

3-5 ELA 2 2 2

3-5 Math 0 1 1

6-8 ELA 3 3 3

6-8 Math 1 0 1

HS ELA 3 3 4 4

HS Math 3 2 2 3

ACT Composite 1 0 1 1

Graduation Rate 0 2 2

Achievement Status

2.13

Achieving

Note: There is no TVAAS for graduation rate.

Step 3: Districts are evaluated on subgroup performance.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

Content Area AMO Relative Achievement

TVAAS Best Score

3-5 ELA 2 3 3

3-5 Math 1 1 1

6-8 ELA 2 2 2

6-8 Math 3 1 3

HS ELA 2 0 0 2

HS Math 1 4 1 4

ACT Composite 2 2 2 2

Graduation Rate 3 1 3BHN Average 2.50

The process in step 2 is repeated for each historically underserved subgroup.

Content Area BHN ED EL SWD

3-5 ELA 3 3 3

3-5 Math 1 2 2

6-8 ELA 2 2 1

6-8 Math 3 2 2

HS ELA 2 3 2

HS Math 4 4 1

ACT Composite 2 2 1

Graduation Rate 3 2 2Subgroup Average

2.5 2.5 1.75

Subgroup Status

2.25

Achieving

These best scores and averages are combined to calculate Subgroup status.

Content Area BHN ED EL SWD

3-5 ELA 3 3 3

3-5 Math 1 2 2

6-8 ELA 2 2 1

6-8 Math 3 2 2

HS ELA 2 3 2

HS Math 4 4 1

ACT Composite 2 2 1

Graduation Rate 3 2 2Subgroup Average

2.5 2.5 1.75

Subgroup Status

2.25

Achieving

These best scores and averages are combined to calculate Subgroup status.

Content Area BHN ED EL SWD

3-5 ELA 3 3 3

3-5 Math 1 2 2

6-8 ELA 2 2 1

6-8 Math 3 2 2

HS ELA 2 3 2

HS Math 4 4 1

ACT Composite 2 2 1

Graduation Rate 3 2 2Subgroup Average

2.5 2.5 1.75

Subgroup Status

2.25

Achieving

The Subgroup status is calculated using the same scales as Achievement status.

Step 4: Districts’ final determinations reflect Achievement and Subgroup status.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

Districts receive one of four possible final determinations.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

Districts missing the Minimum Performance Goal are labeled In Need of Improvement.

Step 1: Minimum

Performance Goal

• 95% test participation rate

• Met minimum expectations on all goals for at least 25% of eligible content areas

Step 2: Achievement

Status

• Performance of all students based on AMOs, relative achievement, and TVAAS

Step 4: Final Determination

Average of Achievement and Subgroup status (steps 2 and 3)

Step 3: Subgroup

Status

• Performance of historically underserved subgroups based on AMOs, relative achievement, and TVAAS

Yes

No

In Need of Improvement Progressing Achieving Exemplary

Status Average Determination Overall Average

Final Determination

Achievement 2.13 Achieving2.19 AchievingSubgroup 2.25 Achieving

All other districts’ final determinations average Achievement and Subgroup status.

Minimum Performance Goal– 95% test participation rate– Growth in at least 25% of content areas for each goal

Achievement Status– Best score of three pathways for each of 8 content areas

Subgroup Status– Same process as Achievement for subgroups– Final Determination

• Average of Achievement and Subgroup status

Summary: District Accountability

Common Questions and Additional

Resources

How are ACT participation rates calculated?

– 𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁 𝑜𝑜𝑜𝑜 𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈 𝑤𝑤𝑤𝑤𝑤𝑤𝑤 𝑎𝑎 𝒗𝒗𝒈𝒈𝒗𝒗𝒗𝒗𝒈𝒈 𝑨𝑨𝑨𝑨𝑨𝑨/𝑺𝑺𝑨𝑨𝑨𝑨 𝒈𝒈𝒔𝒔𝒔𝒔𝒈𝒈𝒈𝒈 𝑤𝑤𝑖𝑖 𝑤𝑤𝑤𝑁𝑁 𝑝𝑝𝑁𝑁𝑤𝑤𝑜𝑜𝑁𝑁 𝑦𝑦𝑁𝑁𝑎𝑎𝑁𝑁 𝑐𝑐𝑜𝑜𝑤𝑜𝑜𝑁𝑁𝑤𝑤𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁𝑁 𝑜𝑜𝑜𝑜 𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈 𝑤𝑤𝑤𝑤𝑤𝑤𝑤 𝑎𝑎 𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒈𝒗𝒗𝒈𝒈𝒈𝒈 𝑑𝑑𝑤𝑤𝑝𝑝𝑑𝑑𝑜𝑜𝑁𝑁𝑎𝑎 𝑤𝑤𝑖𝑖 𝑤𝑤𝑤𝑁𝑁 𝑝𝑝𝑁𝑁𝑤𝑤𝑜𝑜𝑁𝑁 𝑦𝑦𝑁𝑁𝑎𝑎𝑁𝑁 𝑐𝑐𝑜𝑜𝑤𝑜𝑜𝑁𝑁𝑤𝑤

What is the required ACT participation rate for 2016-17 accountability?– 85%– 95% for 2017-18 and beyond

Note: ACT and graduation rate use lagged data (i.e., 2016 graduates in 2016-17 accountability).

Common Questions

What are the consequences for missing ACT participation rates?– Miss all ACT content area goals for MPG– Receive 0 points for ACT content area in Achievement and

Subgroup status

Do students who take advanced coursework instead of Algebra II or English III count in accountability?– Will substitute their state-day ACT subjects scores and

compare to college readiness benchmarks

Common Questions, Continued

Please reference the District Accountability Protocol for further questions (available here).

You may direct any questions not answered in the District Accountability Protocol to TNED.Accountability@tn.gov.

Additional Resources

Districts and schools in Tennessee will exemplify excellence and equity such that all

students are equipped with the knowledge and skills to successfully embark on their

chosen path in life.

Excellence | Optimism | Judgment | Courage | Teamwork