It’s All GrEEk to Me… Accountability for Beginners Kim Gilson Sr Consultant Data and...

It’s All GrEEk to Me…

Accountability for Beginners

Kim GilsonSr Consultant

Data and AccountabilityKim.gilson@region10.org

972-348-1480

Disclaimer

• All information in this presentation is subject to change as a result of State Legislation, ATAC/APAC recommendations, Commissioner Final Decisions, Federal Legislation, Alien Invasion or Natural Disasters, and might be voided following any TEA session this week.

• This training does not take the place of reading the manuals.

How Did We Get Here?

Then…

• Separate State and Federal Accountability Systems– “Recognized” by State– “Missed AYP” by Feds

• Federal Targets Rising Beyond Attainable Levels– Performance Standard of each student

group rapidly approaching 100%• Only measured students who passed

A Performance Index Framework Many Components, One Result

Now…..

Where Did It Come From???

Sources of Influence

• Your Assessment Answer Documents!!!

• Legislation!– State: In Session!– Feds: Discussing a NCLB Rewrite

• ATAC/APAC Advisory Committees• Commissioner of Education

– Commissioner’s Rules• Results summarized in the

Accountability Manual

ATAC and APAC

• Accountability Technical Advisory Committee

• Accountability Policy Advisory CommitteeReal People from Real Districts!They make recommendations to the CommissionerEXPECT CHANGES TO 2015 ACCOUNTABILITY RULES

Accountability Development Timeline

How Can I Keep Up????

For Legislative Action

• State news sources• Notifications through the Texas

Legislature website• Social Media

– #txlege– #txed– #STAAR– #HB___ or #SB___

• Service Center Updates

For Development Materials and Final Decisions from TEA

Some Basic Vocabulary….

Raw Score

• The number of questions the student must pass correctly to meet a goal

• Who Understands This?

Percentage Score

• The percent of items a student answered correctly, as if it were a chapter test graded by the teacher

• Who understands this?

Vertical Scale Score

• A vertical scale is a scale score system that allows for direct comparison of student test scores across grade levels within a content area. Vertical scaling refers to the process of placing test scores that measure similar content areas but at different grade levels onto a common scale.---TEA

• Different for every grade/subject• This is what the system is based on!• Who understands this?

Raw, Percent, and Vertical Scores• The number of questions a student

must answer correctly OR• The percentage of questions a

student must answer correctly to meet the standard

• CAN CHANGE FROM ONE YEAR TO THE NEXT, BUT…..

• The vertical scale score remains the same (assuming the same passing standard)

Target

• The number that must be attained by the campus or district in each Index– Example: Index 1 Target was 55 in 2014

Performance Levels

• Level I: Unsatisfactory– Did Not Pass

• Level II: Satisfactory– Passing

• Level III: Advanced– Demonstrating an extremely high level

of performance (“commended” in TAKS)

Phase-In Levels

• The Level II Satisfactory Standard was supposed to be “Phased in” to allow the system to adjust to the new expectations for STAAR

• We still haven’t adjusted to the new expectations of STAAR– Phase-in Level I was extended– We’re in our 4th, AND LAST, year of the

lowest phase-in Standard

• The Commissioner announced a new Phase-In Schedule in Fall of 2014

• From 3-4 Levels• Each new level for 3 years• Final Level II standards not changed• Advanced Level III not changed

Advanced Level III: No Changes

New STAAR Phase-In Schedule

ELL Progress Measure: A Different Standard Who understands this???

ELL Progress Measure in Layman’s Terms

• In layman’s terms….Given that it is more difficult for an ELL student to achieve the same passing standard as native English speakers– The ELL progress measure affords those students a

measure of “grace” (ie, reduced passing standard)– They are placed on a plan with varying passing

standards– The level of grace shown is based on a combination of 2

factors:• Years in US Schools• Composite Telpas Score

• It is used in various ways in each Index. See http://goo.gl/dU6vgb (Accountability Manual, Appendix I)

Performance Index Framework

Index 1 Index 2 Index 3 Index 4

Student Achievement

Student Progress

Closing Performance

Gaps

Postsecondary Readiness

Rating Based on 4 Performance

Indexes

Index 1Level II Satisfactory Performance

In Layman’s Terms…Who Passed?

# of Tests Passed# of Tests Taken

All Subjects. All Grades. All Students.

One Number.

Sample Index 1

Index 1 Target

• 50 in 2013• 55 in 2014• Proposal is to keep target of 55

New for 2015

• New Math TEKS According to Bridge Study– See http://goo.gl/1TD57v for more info– We’ll have bridge “scores” by mid June

• STAAR A and STAAR Alt 2– Index Calculated With and Without

These Tests• If they cause you to miss the target, then

they won’t be included• “Hold Harmless”

Federal Safeguards

• To satisfy Federal Accountability Concerns, performance by Student Groups is reported in Index 1– Done to ensure group performance doesn’t

mask students being left behind – 2015 Federal Safeguard is 83% (R/M Only)– Determined Focus and Priority Schools in 2013

• 3 year cohort– State Safeguards are same as Index Target (all

subjects)

Federal Accountability

• Bills are being developed at the Federal Level to change No Child Left Behind/AYP Requirements

• Stay Tuned!

Index 2Who Grew???

How?

This Year’s Vertical Scale ScoreMinus

Previous Year’s Vertical Scale Score

In Reading, Math….and 7th Grade Writing (NEW!)

(7th Grade Score Minus 4th Grade Score)

Weighted System

• 1 point for growing enough (“meeting growth measure”)

• 2 points for growing extra (“exceeding growth measure”)

• How much is “enough” or “extra?”– Depends on the grade and subject!– See “Calculating STAAR Progress Measure” or “A Parent’s

Guide to the STAAR Progress Measure” http://tea.texas.gov/student.assessment/staar/

But Not This Year…

• In 3-8 Math (because of New TEKS)

• And Never for English I– 8th Grade Test to English I doesn’t

compute

– So…Index 2 for High Schools is Algebra 1 and English II

Groups Contribute Points!

• All Students (as a group)• Each Race/Ethnicity (if they have 25

or more students)• Special Ed and ELL’s (if they have 25

or more students)

ELL Progress Measure

• Students have a set Met or Exceeds target that is not based on 2 years of consecutive scale scores– Soooo…..they can have progress

measures in grades that other students can’t• Example: 3rd grade Reading and English I

• AND 4TH GRADE WRITING!• AND 3-8 Math!• ATAC is Recommending No Math Index 2 for ELL’s

in Grades 3-8• Writing Still Included

Target

2014 Bottom 5%2015 Proposal is Bottom 5% Again

Old Calculation

Reading Index 2 Points + Math Index 2 Points

2

Each subject contributed 50% of the indexStudent Groups had to meet 25 tests within that

subject

But for 2015????

If you take the same approach, Reading = 1/3Math = 1/3 (even though it’s only Alg 1!)Writing = 1/3 (even though it’s only 7th grade and 4th ELL’s!)

So………..

New Proposed Calculation

Reading Progress + Algebra 1 Progress + Writing Progress

Total Available Points

Student Groups would need 25 TOTAL tests to contribute points! (NOT 25 for a subject!!!) It will be easier for a student group to meet

minimum size

Special Education and Spanish Tests• Proposal is to EXCLUDE STAAR A and

Alt 2 from Index 2• Reminder: Anyone who took an M

last year CANNOT receive a Progress Measure

• Students who change languages cannot receive a Progress Measure in Reading

• Students who took Spanish 4th Grade Writing cannot receive a 7th Grade Writing Progress Measure

Index 3Closing Performance Gaps

Index 3

• Focuses on Economically Disadvantaged Students

• AND Lowest Performing Race/Ethnicity Groups from Previous Year– Groups Must Meet Minimum Size of 25

Reading Tests AND 25 Math Tests last year AND this year

– Campuses could have 0, 1, or 2 Race/Ethnicity groups • (see accountability manual for details)

Calculation

• 1 point for Passing• 2 points for Advanced Level III• All Subjects

– Writing, Science, And Social Studies may not have data for some groups because there aren’t enough students to meet minimum size

• New Math TEKS Included Via Bridge Study

Target

• 2014 Bottom 5% Didn’t Meet the Target

• 2015 Proposal is to keep same target

Index 4Post-Secondary Readiness

Currently….

• 4 Indicators– STAAR Component

• Final Level II on 2 or more tests– (If they take at least 2 tests. If not, they

need to achieve that on the one they took)

• New Math TEKS Included Via Bridge Study• Elementary and Middle Schools Stop

Here

AND

3 Lagging Indicators for High Schools/Districts (Class of 2014 in 2015 Accountability)

• Graduation Rates• Graduation Plans (Add Foundation Plan)• Post-Secondary Indicator*

• *need to be redefined

Post-Secondary Indicator Change?• Proposal is to add new ways for a

student to count in the numerator, but keep the same denominator.

TSI on R AND Math from TAKS/SAT/ACTOR

Completed One Advanced CourseOR

Completed Credit CTE Coherent Sequence

Changes Are Coming to Index 4• TAKS Grads leave the system after

2015• Legislative requirements for

additional indicators• Foundation Plan/Endorsements

Proposal

• Keep Index 4 Targets the Same as 2014

PROPOSAL TO MEET STANDARD

MEET INDEX 1 OR 2And Index 3 And Index 4

Distinctions

• Each Campus is placed in a comparison group of 40 schools

• Campuses Evaluated – 4 Core Subject Peformance– Index 2– Index 3– Post-Secondary Readiness

• Districts Evaluated in Post-Secondary Readiness only

• Some indicators are attendance/participation and some are performance

• You get a Quartile ranking for each indicator– Number of Q1’s determines distinction

Comparison Data is Available

• See how your campus compares to the other schools like you in the Distinction Designation Data Overview Report

• Improvement Required Schools cannot earn distinctions, but they still have data!– http://ritter.tea.state.tx.us/perfreport/account/2014/srch.html?srch=C

Preview VocabularyTopics in 2015 Accountability Development Materials

Required Improvement

• Not to be confused with “Improvement Required”– Harkens back to AYP days– Can help a campus or district who

misses and index target, but improves enough from previous year

– Needs stability in the system before formulas can be created

– Possibly added in future cycles

The Bright Side?At least we’re never bored!