Hazelwood School District

Program Evaluation

Mary Piper

Designing Evaluation How will information be gathered?

What is measured or assessed?

How will information be used?

Levels of Program Evaluation

Level DescriptionParticipants’

reactionsInitial Satisfaction

To improve program design and delivery

Levels of Program Evaluation

Level DescriptionParticipants’ learning

New Knowledge and Skills

To improve program content, format, and organization

Levels of Program Evaluation

Level DescriptionOrganization support

and change

Change AgentTo document, adopt, and inform future change efforts

Levels of Program Evaluation

Level DescriptionParticipants’ use of new knowledge and skills

ImplementationTo document and improve the implementation of program content

Levels of Program Evaluation

Level DescriptionStudent learning

outcomes

ImpactTo focus and improve all aspects of program design, implementation, and follow-up; to demonstrate the overall impact

Levels of Program Evaluation

Level DescriptionReturn on Investmen

t(ROI)

Value of trainingTo determine the value of the program in terms of resources (time, money, and/or people)

Evaluating Professional Development

Thomas Guskey

Assessing Impact:Evaluating Professional Development

JoEllen Killion

The Death and Life of theGreat American School System

Diane RavitchContext Move from a focus on accountability to a

focus on curriculum Evidence Common Core

Standards

A Chance to Make HistoryWendy Kopp

Context Transforming

public education

Evidence Teach for

America

MindsetCarol Dweck

Context Fixed Mindset Growth Mindset

Evidence Evaluation of Industrial Age programs needs to move to an Information Age model with ongoing evaluation which allows for rapid course

corrections

HSD Students 18,405 students in K-12 2nd largest in St. Louis

County 70.2% African American 26.4% Caucasian 1.2% Asian and Hispanic 46% free & reduced lunch 26 different languages 55% mobility

Inevitable: Mass Customized LearningTransformational Change

versus Tinkering Change 

Mass Customized

Learning is about transformational change.

    The Industrial Age is about mass producing education. The Information Age is about mass customizing learning

Inevitable: Mass Customized LearningWhere We Are

The reality in today’s Information Age, is......that it is now possible for:

anyone to learn anything from anywhere at any time in any way from worldwide experts from a specific teacher. 

Where We Need to Be The reality in today’s

Information Age, is......that it is now possible for:

anyone to learn anything from anywhere at any time in any way from worldwide experts from a specific teacher. 

Inevitable: Mass Customized Learning

Everybody is mass customizing; everybody – except education. 

iPhone: customize

music My Yahoo: news page Starbucks: coffee Facebook: contacts iPad & Google: sightseeing

Mass Customized Learning Meets every learner at his/her learning

level, Provides learning opportunities that sync

with the learner’s most effective learning styles, and

Allows the learner to study and learn skills and concepts using content that is relevant and interesting.

MASS CUSTOMIZED EVALUATION