SchoolMatters.com

A Service of Standard & Poor’s School Evaluation Services (SES)

Michael StewartDirector of Research & Analytics

February 3, 2006

School improvement efforts have focused on data-driven decision-making, and the essential need for better databases.

But policy-makers don’t just need data-driven decision-making systems; they need performance management systems.

What’s the difference between data bases and knowledge bases?

Most databases include one or more broad categories of data: • Input data – such as financial and human resources• Contextual data – such such as demographics• Outcome data – such such as student achievement

These are often stored in fragmented - not integrated - systems.

Decision-Makers Need a Knowledge Base, Not Just a Better Data Base

A Knowledge Base:• Integrates different categories of data into a unified system• Interprets the data using performance benchmarks• Includes, but goes beyond, input, output, and demographic

data, by addressing the need for process data• Uses a data structure designed to address policy questions

Decision-makers can’t manage their way to better performance if they know their inputs and outcomes without knowing where to find better processes.

By providing tools to “mine” process data, a knowledge base can be used to improve – not merely audit – performance.

This isn’t a call to reinvent the wheel, but to integrate the components already available in order to build a knowledge base.

Student Performance• State test scores, participation rates, and

trends disaggregated by student group• College prep test scores & participation

(e.g., ACT, SAT, PSAT, AP)• Post-secondary patterns (as available)• Graduation rates• Dropout rates• Attendance rates

Return onResources

Relationship between student achievementand spending in demographic context

Spending and Revenue• Spending per student, by function, and

by program• How spending increases are

allocated over time• Local, state and federal revenue

• Operating margins• Compensation• Fund balance

• Taxes• Debt

School Environment• Student characteristics

(economically disadvantaged backgrounds, disabilities, limited English proficiency)

• Class size and school size• Teacher characteristics• School safety• Facilities, technology, infrastructure

Community Demographics

• Urban, suburban, rural locale• Adult education levels• Household income levels• Single parent households• Property values• Labor force, (un)employment • Other demographics

Performance Benchmarks

States compared to other states.

Districts compared to other districts in same state.

Schools compared other schools in same state.

Successful organizations continually search for new ideas by comparing themselves to other organizations to learn from their best practices.

This is known as benchmarking. It’s a data-driven process by which learning and innovation can trigger fundamental breakthroughs in thinking and practice

www.SchoolMatters.com

Standard & Poor's Observations Report is a written analysis on this district's Return on Resources.™ The report analyzes the district's academic and financial performance in demographic context. In addition to state comparisons, the report also compares the district with a composite of demographically similar peer districts.

Ann Arbor Public Schools

Standard & Poor's Observations Report is a written analysis on this district's Return on Resources.™ The report analyzes the district's academic and financial performance in demographic context. In addition to state comparisons, the report also compares the district with a composite of demographically similar peer districts.

Ann Arbor Public Schools

All Students

Economically Disadvantaged Students

Reading Proficiency Grade 4 Economically Disadvantaged

Outperformed for 2 YearsOutperformed for 1 Year

Outperformed for 3 Years

School improvement teams can use the workbook as a guide for collaborating with “better performers” to identify effective processes and adapt best practices.

Standard & Poor’s also offers professional development programs that provide training to school improvement teams in benchmarking methods.