H I S D Becoming #GreatAllOver1

2015 Accountability Development

What do we know?What do we want to know?

March 4, 2014

H I S D Becoming #GreatAllOver 2

What do we KNOW?

2015

Accountability Development

Revised, extended phase-in schedule SAME Level II phase-in 1 cut scores in SY 2014-15 One added “stair step” to the phase-in schedule

• New Level II, phase-in 2 applies in SY 2015-16• New Level II, phase-in 3 applies in SY 2018-19• Final Level II cut scores to apply in SY 2021-22

New TEKS tested in grades 3-8 in mathematics- One-year delay in 5th and 8th grade math testing dates,

associated with no SSI-related retesting, raw scores

New STAAR Alternate 2 tests

Elimination of STAAR Modified and implementation of STAAR Accommodated

H I S D Becoming #GreatAllOver 3

What do we NOT KNOW?

2015

Accountability Development

Adjustments to targets

Availability v. inclusion of state assessment-related data

Implementation of new, required metrics related to high school postsecondary readiness

Recommendation for flexibility to meet standards on either Index 1 or Index 2

H I S D Becoming #GreatAllOver 4

When will we KNOW?

2015

Accountability

Development

Time Line for 2015 Accountability Decisions

ATAC Recommendations made on Feb. 5

Final APAC meeting was held on Monday, Feb. 23

Commissioner to announce final decisions at end of March

All discussion of key decision points is, of necessity, preliminary in nature!

H I S D Becoming #GreatAllOverTEA – Division of Performance Reporting; House Public Education Hearing – 2-17-16

ATAC PROPOSED 2015 INDEX TARGETS(Same as 2014)

Target = 55Target = 5th Percentile

Target = 28, 27, 31

(ISD = 28, ES = 28, MS = 27, HS = 31)

Target = 12, 13, 57

(STAAR Only Target = HS - 21,

ISD - 13)

H I S D Becoming #GreatAllOver 6

ATAC KEY RECOMMENDATIONS

2015

Accountability

Development

Index evaluations New proposed flexibility to meet standards on

Index 1 *or* on Index 2, plus both Indexes 3 & 4

Targets to hold steady (Index 2 determined by 5th percentile, so precise cut point is TBD)

STAAR grades 3-8 mathematics results “bridged” to the 2014 test standards

H I S D Becoming #GreatAllOver 7

ATAC KEY RECOMMENDATIONS

Student Achievement

Index I

STAAR Mathematics in grades 3-8 based on 2014 “bridged” results

STAAR Accommodated, STAAR Alternate 2 Included in Index 1 only Apply a hold-harmless provision - which adjusts

the accountability rating if the Index 1 outcome fails to meet the target solely due to the inclusion of these assessments.

ELLs in Yrs. 2-4 who take STAAR-Alt 2 will be included

H I S D Becoming #GreatAllOver 8

ATAC KEY RECOMMENDATIONSIndex I

H I S D Becoming #GreatAllOver 9

ATAC KEY RECOMMENDATIONS

Student Achievement

Index I

Minimum Size RequirementsIndicator All Students Student Groups

Index 1 STAAR Percent Met Level II None; Special Analysis (SA) < 10 students

N/A

Accountability Target: 55

Reading Math Writing Science SocialStudies Total % Met

Level II

Students Met Level II

50 + 38 + 19 + 10 + 19 = 13645% 45

Students Tested 100 + 100 + 42 + 40 + 23 = 305

Index Score 45

H I S D Becoming #GreatAllOver 10

ATAC KEY RECOMMENDATIONS

Student Progress

Index 2

New Reading / Math (Algebra I) / Writing Combined No progress measures for STAAR mathematics

in grades 3-8

New grade 7 writing progress data

Under consideration re: ELL group: Include M1s & M2s Include “parent denials” in Yrs. 2-4

H I S D Becoming #GreatAllOver 11

ATAC KEY RECOMMENDATIONSIndex 2

High schools were excluded in 2014 from Index 2ELL Progress measures are included at grade 3 reading, English I, and grade 4 writing

H I S D Becoming #GreatAllOver

STAAR Weighted Progress Rate

All Students

African Amer.

Amer. Indian Asian Hispanic Pacific

Islander WhiteTwo or More Races

Special Ed.

Total Points

Max.Points

Reading/Math/Writing Weighted Progress 100 120 175 84 479 800

Total 479 800

Index 2 Score (total points divided by maximum points) 60

12

ATAC KEY RECOMMENDATIONSStudent

Progress

Index 2

Accountability Target: 5th %-ile of State PerformanceSTAAR Weighted Progress Rate

AllStudents

African Amer.

Amer. Indian Asian Hispanic Pacific

Islander WhiteTwo or MoreRaces

Special Ed.

Total Points

Max.Points

Example Calculation for Reading/Math/Writing Number of Tests

100 50 40 30

Performance Results: Met or Exceeded Progress Number Percent

8080%

4080%

40100%

2067%

Exceeded Progress Number Percent

2020%

2040%

3075%

517%

Reading/Math/Writing Weighted Progress Rate 100 120 175 84 479 800

H I S D Becoming #GreatAllOver 13

ATAC KEY RECOMMENDATIONS

Closing Performance

Gaps

Index 3

No major changes in 2015

“Bridged” math data, as with other indexes

Possible inclusion of scores for ELLs in Years 2-4 in US schools, whose parents denied services

Possible total redesign of the index for 2016

H I S D Becoming #GreatAllOver 14

ATAC KEY RECOMMENDATIONSIndex 3

H I S D Becoming #GreatAllOver 15

STAAR Weighted Performance Rate for

Reading

Econ. Disadv. Lowest Performing Group - 1

Lowest Performing Group - 2

Total Points

Maximum Points

Number of Tests 80 40 25

Performance Results: Phase-in Level II and above Number Percent

80 100%

20 50%

25 100%

Level III Advanced (2014 and beyond) Number Percent

40 50%

0 0%

25 100%

Reading Weighted Performance

150 50 200 400 600

Minimum Size RequirementsIndicator All Students Student Groups

Index 3 STAAR Performance NA gap group: >= 25 tests in reading and math the prior year

Closing Performance

Gaps

Index 3

H I S D Becoming #GreatAllOver 16

Accountability Target: ISD = 28, ES = 28, MS = 27, HS = 31

STAAR Weighted

Performance Rate

Economically Disadvantaged

Lowest Performing Race/Ethnic Group - 1

Lowest Performing Race/Ethnic Group - 2

Total Points Maximum Points

Reading 150 50 200 400 600 Math 125 100 90 315 600 Writing 80 90 125 295 600 Science 120 40 90 250 600 Social Studies

50 40 80 170 600

Total 1430 3000 Index Score (total points divided by maximum points) 48

SCORING TABLE

Closing Performance

Gaps

Index 3

H I S D Becoming #GreatAllOver 17

ATAC KEY RECOMMENDATIONS

Post Secondary Readiness

Index 4

No major changes in 2015 for Elementary or Middle Schools. Meet postsecondary readiness standard (final

Level II on 2 or more tests)

H I S D Becoming #GreatAllOver 18

ATAC KEY RECOMMENDATIONS

Post Secondary Readiness

Index 4

Proposed 2015 Graduation Score: Combined performance across the

graduation and dropout rates for:

Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or

Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates Based on Longitudinal Cohort: All Students and race/ethnicity student groups.

STAAR Score: STAAR Percent Met Final Level ll on one or more tests for All Students and race/ethnicity student groups.

New expanded Postsecondary Indicator includes

College-Ready Graduates indicator based on meeting TSI criteria on TAKS, SAT, or ACT in both ELA and math;

Advanced/dual enrollment course completion; and

Enrolled and completed a CTE coherent sequence.

2014 Graduation Score: Combined performance across the

graduation and dropout rates for:

Grade 9-12 Four-Year Graduation Rate for All Students and all student groups; or

Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index.

RHSP/DAP Graduates Based on Longitudinal Cohort: All Students and race/ethnicity student groups.

STAAR Score: STAAR Percent Met Final Level ll on one or more tests for All Students and race/ethnicity student groups.

College-Ready Graduates indicator based on meeting TSI criteria on TAKS, SAT, or ACT in both ELA and math.

Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013)

Texas Success Initiative college readiness benchmarks.

Number of students who earn postsecondary credit required for a foundation high school program, an associate’s degree, or an industry certification.

2014 and 2015 Comparison

H I S D Becoming #GreatAllOver 19

ATAC KEY RECOMMENDATIONS

Postsecondary Readiness

Index 4

2015 Postsecondary Readiness IndicatorThe 2014 Postsecondary Indicator (College-Ready Graduates) is expanded to include additional credit for students in other postsecondary readiness activities.

The proposed 2015 Postsecondary Indicator is defined as the percent of annually reported graduates that meet any one of three criteria, detailed below.

Indicator definitionNumber of annual graduates reported for school year 2013–14 that either:

1) meet TSI criteria in both reading/ELA and mathematics on TAKS, SAT, or ACTOR

2) completed and received credit for at least one advanced/dual enrollment course OR

3) enrolled and completed credit for the CTE Coherent Sequence

-----------------------------------------------divided by-------------------------------------------------

Number of annual graduates reported for school year 2013–14

H I S D Becoming #GreatAllOver 20

High Schools with Graduation RatesIndex 4

Indicator All Students

African Amer.

Amer. Indian

Asian HispanicPacific Islande

rWhite

Two or MoreRaces

ELL Special Ed.

Total Points

Max.Points

STAAR Score*STAAR % MetFinal Level ll onTwo or More Tests

29% 16% 40% 23% 38% 36% 182 600

STAAR Score (STAAR total points divided by maximum points) 30

Graduation Score (Gr. 9-12)4-yr. graduation rate

84.3% 78.8% 78.8% 91.6% 86.0% 44.2% 69.8% 533.5 700

5-yr. graduation rate

85.1% 78.8% 80.0% 92.1% 84.0% 48.9% 77.5% 546.4 700

Highest Graduation Total 546.4 700Graduation Score (best of total graduation points divided by maximum points) 78.0

RHSP/DAP Score4-yr. graduationPercent RHSP/DAP

82.7% 76.4% 83.6% 83.0% 325.7 400

RHSP/DAP Score (total RHSP/DAP points divided by maximum points) 81.4

Aggregate Postsecondary Indicator ScorePercent PSR of Annual Graduates

82.0% 72.0% 78.0% 89.0% 321.0 400

Aggregate Postsecondary Indicator Score (total points divided by maximum points) 80.2

Overall Index ScoreSTAAR Score 30.0

Multiplyby

Weight

Graduation Score

78.0

RHSP/DAP Score

81.4

Postsecondary Score

80.2

Index Score (sum of weighted index scores)

H I S D Becoming #GreatAllOver 21

Accountability Target: Elementary:12; Middle:13

Indicator All African Amer.

Amer. Indian Asian Hispanic Pacific

Island. White Two or More ELL Special

Ed.Total

PointsMax.

PointsSTAAR % Met Level II Final on at least two tests

29% 16% 40% 23% 38% 36% 182 600

STAAR Score (STAAR total points divided by maximum points): 30

Minimum Size Requirements

Indicator All Students Student Groups Index 4 STAAR Percent Met Level II None; SA < 10 students >= 25

Elementary and Middle SchoolsPostsecondary

Readiness

Index 4

H I S D Becoming #GreatAllOver 22

ADDITIONAL ATAC RECOMMENDATIONSAccountability Development

STAAR-A and STAAR-Alt. 2 to be included in System Safeguards and Distinction Designation calculations

UPDATES to Distinctions Designations: Percent of students in special education

as a factor in determining campus groups Algebra I by Grade 8 participation will include enrolled

8th graders who have ever taken that EOC test Level III performance to be examined for ALL tested

grade levels, not just selected ones in Reading and Mathematics

H I S D Becoming #GreatAllOver 23

DISTINCTION DESIGNATIONS RECOMMENDATIONSAccountability Development

H I S D Becoming #GreatAllOver 24

SYSTEM SAFEGUARDS RECOMMENDATIONSAccountability Development

Safeguard Measures and Targets:

Reporting for system safeguards disaggregates performance by student group, performance level, and subject area.

Performance rates are calculated from the assessment results used to calculate Index 1: Student Achievement.

2015 targets for the disaggregated system-safeguard results:

STAAR performance target corresponds to Index 1 (TBD); STAAR participation target required by federal accountability (95%); Federal graduation rate targets and improvement calculations for 4-year

rate (83%) and 5-year rate (88%); and Federal limit on use of the STAAR Alternate 2 assessments (1%).

H I S D Becoming #GreatAllOver 25

CHANGES FOR 2013-2014 and BEYOND

Accountability System

Community/Student Engagement and Compliance Self Assessment Campus and district self-assessment on 8 locally-developed

criteria of community/student engagement and one indicator on compliance will be reported along with the accountability ratings. Fine arts Wellness & physical education Community & parental involvement 21st Century workforce development program Second language acquisition Digital learning environment Dropout prevention strategies Educational program for G/T students

H I S D Becoming #GreatAllOver 26

Questions:

Carla Stevens, Dee Carney

Research and Accountability

713-556-6700

Resources:

http://www.houstonisd.org/Page/90761

Accountability System