Host: Don Pratt

Monday, April 11, 2011Monday, April 11, 2011

9:30 – 10:30 AM EDT 9:30 – 10:30 AM EDT

Performance Measures for PHCAST Demonstration Projects

Performance Measures for PHCAST Demonstration Projects 2

AgendaAgenda1.1. Performance measurement involves...Performance measurement involves...

2.2. Performance measure examplesPerformance measure examples

3.3. Anatomy of a performance measureAnatomy of a performance measure

4.4. Additional considerationsAdditional considerations

5.5. Group discussion: What can you track for your project?Group discussion: What can you track for your project?

Purpose of today’s session: Share information and ideas about what you are already measuring—and what you may be thinking of measuring—to assess the performance of your project. This session an opportunity to share in the process of identifying some common performance measures.

Performance Measures for PHCAST Demonstration Projects 3

Performance measurement involves...Performance measurement involves... Tracking work completed (activities/outputs) Tracking work completed (activities/outputs)

Measuring outcomes (usually “soft” Measuring outcomes (usually “soft” measures and short-term)measures and short-term)

Routine/cyclical data collectionRoutine/cyclical data collection

Comparing observed results to performance Comparing observed results to performance targetstargets

Using results to improve program Using results to improve program management and outcomesmanagement and outcomes

Performance Measures for PHCAST Demonstration Projects 4

Performance Measure ExamplesPerformance Measure Examples

Output: Develop new training curriculum aligned Output: Develop new training curriculum aligned with competency models (end of year one).with competency models (end of year one).

Output: Train Output: Train XX participants using new participants using new curriculum (middle of year two).curriculum (middle of year two).

Output: Collect feedback from participants and Output: Collect feedback from participants and instructors to assess implementation (middle of instructors to assess implementation (middle of year two).year two).

Outcome: Outcome: XX percent of trainees report training percent of trainees report training met their learning needs (end of year two).met their learning needs (end of year two).

Performance Measures for PHCAST Demonstration Projects 5

Output: Training X participants using new curriculum (middle of year two).

Anatomy of a Performance MeasureAnatomy of a Performance Measure

What will occur? Participants will be trained using new curriculum

How much will be accomplished? X participants will be trained

When will it occur? By middle of year two

Performance Measures for PHCAST Demonstration Projects 6

Additional ConsiderationsAdditional Considerations What schedule will you follow for data What schedule will you follow for data

collection, and who are the partners in this collection, and who are the partners in this process? (planning and logistics)process? (planning and logistics)

Who will provide the data? (data source)Who will provide the data? (data source) What evidence will you rely on to know if What evidence will you rely on to know if

results occurred? (indicators) results occurred? (indicators) What instruments will you use to collect the What instruments will you use to collect the

data? (tools)data? (tools) How will you ensure data quality?How will you ensure data quality?

(reliability, validity)(reliability, validity)

Performance Measures for PHCAST Demonstration Projects 7

What results do you currently track in the areas of curriculum, certification and trainees? How do you track these results?

Are there other results you don’t currently track but that you would like to track?

Performance Measures for PHCAST Demonstration Projects 8

How do you envision using this information to improve your program?

Performance Measures for PHCAST Demonstration Projects 9

What are some areas you think would be best addressed through more formal evaluation efforts (and why)?