22
Making An Evaluation Plan 1

4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Making An Evaluation Plan

1

Page 2: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Making An Evaluation Plan

• Evaluation question • What is needed to answer that question• Where are you going to get what you

need?• Data Collection Methods• Data Analysis Methods• Limitations

2

Page 3: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Evaluation Question

• What do they want to know?

3

Page 4: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Evaluation Question

• Clear and Specific• Fair and objective• Politically neutral• Measurable• Doable• Key Terms Defined – Scope, Timeframe

Population

4

Page 5: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• What do they want to know? (return to the stated goal!)

Reduce hunger by diverting surplus farmer’s market products from waste to local pantries

Did they? How could they do more?

5

Page 6: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• Specific research questions may be:

• Does food collected represent potential waste?

• Is it going to pantries?• Is it being distributed and eaten (valued)?• Is it therefore contributing to reducing

hunger?6

Page 7: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Information Required

• What do you need to answer the question?

7

Page 8: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Information Required

• Evidence – Physical, Testimonial, Documentary, Analytical

• Program criteria• Agency procedures• Participant rates• Cost information• Funding levels

8

Page 9: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• What do you need to answer the question?

• Information on actual food donated• Where it goes• What happens to it after delivery

9

Page 10: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• What do you need to answer the question?

• Type and amount of food• Collection and delivery process info• Data on which organizations receive it and

how they distribute• Who ultimately receives it and how they use it

10

Page 11: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Information Source(s)

• Where are you going to get it?

11

Page 12: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Information Source(s)

• Officials• Program participants• Inventory records• Data bases• Laws and regulations• Previous studies

12

Page 13: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• Where are you going to get it?

• Farmers• Farmer’s Market officials• Pantries• Clients

13

Page 14: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Data Collection Methods

• How are you going to get the information?

14

Page 15: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Data Collection Methods

• How are you going to get the information?

• Structured interviews• Focus groups• Structured questionnaires or surveys• Visual inspection• File/document review

15

Page 16: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• How are you going to get the information?

• Interview farmers, officials, pantry staff, clients

• Observe/document the entire process on random days

• Review farmer, market and pantry records• Client logs?

16

Page 17: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Data Analysis Methods

• What will you do with it once you get it?

17

Page 18: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Data Analysis Methods• What will you do with it once you get it?

• Descriptive statistics• Cost/benefit analysis• Inferential statistics• Qualitative analysis• T-test• Regression analysis

18

Page 19: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program• What will you do with it once you get it?

• Descriptive statistics - ✔• Cost/benefit analysis - ✔• Inferential statistics• Qualitative analysis - ✔• T-test• Regression analysis

19

Page 20: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Limitations

• What can’t you do (Caveats)?

20

Page 21: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

Limitations

• What can’t you do (Caveats)?

• Generalize• Data quality and reliability• Access to records• Staffing/travel constraints

21

Page 22: 4 Making An Evaluation Plan - UNC School of Government...Making An Evaluation Plan • Evaluation question • What is needed to answer that question • Where are you going to get

FM Food Donation Program

• What can’t you do? (Caveats)

• Generalize to other surplus food donation programs?

• Maybe no one tracks actual amounts

22

FM Food Donation Program• What can’t you do? (Caveats)

• Generalize to other surplus food donation programs?

• Maybe no one tracks actual amounts

11