It is my business to locate trouble… Making Evaluation Work

It is my business to locate trouble…Making Evaluation Work

http://www.winonaagency.com/blog/when_it_comes_to_reviewing_resumes_are_you_more_like_inspector_clouseau_or_the_fbi.aspx

Evaluation Cyclebeginning at the end

http://www.publispain.com/lapanterarosa/galeriadefotos06.htm

Using Resultsin many ways with many people who need to know

Who

needs

to know?

What do they

need to know?

http://www.clker.com/search/graphs/1

http://www.4-h.org/4-h-national-youth-science-day/science-experiments-projects/plan-science-day-event/

http://davedevine.wordpress.com/2011/05/

http://web420.com/blogs/2009/04/psychedelic-pink-panther/

Using Resultsto communicate with decision-making stakeholders

Demonstration

Advocacy

Accountability

Using Results to communicate with broader stakeholders

Marketing

Informing

Recruiting

Using Resultsto make improvements …with the help of participants

Program

Improvement

Participant

Engagement

Using Resultsto celebrate and encourage staff, volunteers, and participants

Participant

Recognition

Using Resultsto build capacity for staff and organizations

Training and Supervision

Organizational Improvement

Using Resultsto advance practice

Publications

Proposals

Using Resultsin multiple ways

Using Resultsto write a report

Accountability

Report Elementscomponents of a formal report

Accountability

Opportunity

Program Response

Impact

Problem/NeedResearch Base

-Local Needs

-National Trends

-Prior Research

Accountability

Opportunity

Program Response

Impact

Problem/Need

Program

Details

Research Base

-Local Needs

-National Trends

-Prior Research

Best Practice Strategy

-Audience

-Setting

-Activities

-

AccountabilityEvidence of

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

Research Base

-Local Needs

-National Trends

-Prior Research

-Audience

-Setting

-Activities

Changes in Key Indicators

relative to context and

expectations

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

Research Base

-Local Needs

-National Trends

-Prior Research

-Audience

-Setting

-Activities

relative to context and

expectations

Why?

Who

What

When

Where

How

What’s so?

So What?

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

Research Base90% of jobs require STEM skills

50% of local teachers cited need for

STEM

90% of jobs require STEM skills

STEM

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

500 youth…50 events…

60 volunteers

Partnering with schools,

businesses, civic clubs…

60 volunteers

STEM

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

60 volunteers

STEM

Survey: 82% of 345 youth…

Obs: 12 teams Excellent on Tech

Interview…

Records: Service, Training..

Interview…

Try to describe

your own program

Evidence of

Merit and

Worth

Evidence of

Merit and

Worth

Opportunity

Program Response

Impact

Problem/Need

Program

Details

60 volunteers

STEM

Interview…

http://www.ltisdschools.org/site/Default.aspx?PageID=436

Accountability

Opportunity

Program Response

Impact

Challenges

New Opportunities

Enhancements

Appendices

Problems,

Details,

Evidence

Obstacles,

Adjustments

Difficult Experiences30% had no transportation…

When the budget was cut…\

30% had no transportation…

Conclusions

Support

Materials

Program

Details

Report Elementscomponents of a formal evaluation

Accountability

Opportunity

Program Response

Impact

Challenges

New Opportunities

Enhancements

Appendices

Problems,

Details,

Evidence

Obstacles,

Adjustments Implications

Advanced training is needed…

Organization policy change…

Conclusions

Support

Materials

Program

Details

Accountability

Opportunity

Program Response

Impact

Challenges

New Opportunities

Enhancements

Appendices

Problems,

Details,

Evidence

Obstacles,

Illustrations

As shown in the Table …

One participant said…

Pictured in the photo are…

Conclusions

Support

Materials

Program

Details

Accountability

Opportunity

Program Response

Impact

Challenges

New Opportunities

Enhancements

Appendices

Problems,

Details,

Evidence

Obstacles,

Illustrations

Conclusions

Support

Materials

Program

Details

Additional Materials Program History… Organizational

Chart…

Detailed Budget…

Program History… Organizational

Chart…

Detailed Budget…

Report Elementscomponents of an detailed evaluation

So what would you

add to your report?

Opportunity

Program Response

Impact

Challenges

New Opportunities

Enhancements

Appendices

Problems,

Details,

Evidence

Problems,

Illustrations

Conclusions

Support

Materials

Program

Details

Additional Materials Program History… Organizational

Chart…

Detailed Budget…

Program History… Organizational

Chart…

Detailed Budget…

Evaluation and Researchpaws for thought

Research

Discovery of Knowledge

Evaluation

Evidence for Effectiveness

Evaluabilityis this the right time to ask?

Missing the Mark…or the Data

Focusingwhat difference was intended?

IndicatorsLevelPriorityPrecision

Big P, little Pwhat did you expect?

Big picturePurpose-drivenCommunity-drivenEvidence-drivenDriven to completion

Mapping Evaluationenjoying the journey

Program Plan of WorkLogic ModelQuality and OutcomesPurposes of Evaluation

Mapping Evaluationenjoying the journey

Program Plan of WorkLogic ModelQuality and OutcomesPurposes of Evaluation

The End

Bye

Reportingwhat do you have to say for yourself?

Annual Report: Program Impact

It is my business to locate trouble… Making Evaluation Work

Documents

Are you having trouble making a needed transformation? …ptgmedia.pearsoncmg.com/images/9780132044943/samplepages/... · Are you having trouble making a needed transformation? Are

MAY 13, 2015 MAKING SENSE OF IMMIGRATION LAW- GETTING DOWN TO BUSINESS, STAYING OUT OF TROUBLE

Making Digital Healthcare a Reality€¦ · *Accenture Business Technology Trends Report . Digital Healthcare ... Physician alert Locate available device Information on demand Continued

Trouble ahead for health costs: Doctors working less, making more

The Trouble With "The Trouble with Harry"

DOOLIN’S TROUBLE SHOOTERS BIBLE - scientia-books€¦ · DOOLIN’S TROUBLE SHOOTERS BIBLE 174. 175. 209. DOOLIN’S TROUBLE SHOOTERS BIBLE 210. 211. DOOLIN’S TROUBLE SHOOTERS

Decision-Making Poker - Captain Trouble · decision-making is not an option. ... There are three types of innovation-decisions that can occur with ... Decision-Making Poker is a tool

u-LOCATE Locate underground accurately

MAKING GOOD Planning CHOICES Instructionsouthernct.edu/academics/schools/education/student-services/student...Decisions chart to locate the corresponding answers. ... portfolio. Since

Bubble trouble making the final cut

Bubble, bubble – toil and trouble?toil and trouble?

I’m easily distracted! I have trouble following other people’s organizational plans! I have trouble making my own! NOW WHAT?

Security Locate

Trouble ahead, trouble behind: perceptions of social

Locate caller

Deconstructing! Wireframes!into!AEM! Templates!and! Components! · 2020-01-29 · • making use of AEM foundation supertypes Preparation: Locate the L3844 folder 1. Locate the L3844folder

25K-Loader (Halvorsen) Vehicle Management Codes: E935, E936 · Explain where to locate trouble shooting data and how to change a wheel or tire. 3.3. ... The loader is capable of air

Pages: 1 of 13 BMW Testable Coverage Now making new software, please waiting !!! System Subsystem Read Trouble Code Delete Trouble Codes Read Data Stream Adaptation Identif-ic ation

1st Grade Reading: Making inferences - Lipscomb University lesson guide.pdf · 1st Grade Reading: Making inferences ... may have more trouble explaining how they used text clues and

Geography Feud. Locate Japan A B Locate England