24
Success Measures: Transforming Outcome Evaluation Presentation to the National Rural Housing Conference December 6, 2012 Nancy Kopf, Senior Manager, Success Measures Evaluation Services [email protected]

C3 measuring impact nancy kopf - neighbor works

Embed Size (px)

DESCRIPTION

Many of us know the value of our work in the community, and investors and supporters think they know the value of our work in the community. Having an established method to collect and assess data that measures this value is a powerful tool. Participants will learn to anticipate which types of data they should collect, how to collect and assess it, and how to use it to improve productivity and show off their accomplishments.

Citation preview

Page 1: C3 measuring impact   nancy kopf - neighbor works

Success Measures: Transforming Outcome Evaluation

Presentation to the National Rural Housing ConferenceDecember 6, 2012Nancy Kopf, Senior Manager, Success Measures Evaluation [email protected]

Page 2: C3 measuring impact   nancy kopf - neighbor works

Success Measures is. . . Success Measures is. . . Participatory outcome evaluation

approach

Data collection tools measuring range of outcomes

Web-based data system

Training and TA program

Page 3: C3 measuring impact   nancy kopf - neighbor works

Let’s change the conversation!Let’s change the conversation!

What are some ways you can think about, talk about, and implement data collection that creates value for your organization?

What are some practical ways you can begin to create value from information?

Page 4: C3 measuring impact   nancy kopf - neighbor works

Evaluation is in your interest!Evaluation is in your interest!

Capitalize on the information you already collect—quality is critical.

Data that you collect should be useful for your organization and for engaging funders.

Determine how you are going to use data before you start collecting.

Think about how to communicate your value to different types of audiences.

Page 5: C3 measuring impact   nancy kopf - neighbor works

Outputs/Production/Performance Outputs/Production/Performance MeasurementMeasurementWhat you doHow you spend your fundingTypes of people you are servingParticipation rates for programs

Page 6: C3 measuring impact   nancy kopf - neighbor works

Success Measures is Outcome Success Measures is Outcome EvaluationEvaluationOutcomes are the benefits that occur as a result

of our work.Outcomes can be changes in:

Attitudes or valuesKnowledgeSkillBehaviorConditionsPolicies, laws, regulations, practices

Page 7: C3 measuring impact   nancy kopf - neighbor works

OutcomesOutcomes

Programs can have outcomes for Individuals Groups of people/families Communities Organizations

Page 8: C3 measuring impact   nancy kopf - neighbor works

Categories of Change in Our WorkCategories of Change in Our WorkChange in physical conditions

Observations of buildings, infrastructure, public spaces

Change in quality of life for individuals and the community Surveying residents who live in your properties,

broader community Key informant interviews

Economic impact Calculation tools

Page 9: C3 measuring impact   nancy kopf - neighbor works
Page 10: C3 measuring impact   nancy kopf - neighbor works

UseUse

To identify where to focus resourcesTo demonstrate accomplishmentsTo look at “spillover” effect

Page 11: C3 measuring impact   nancy kopf - neighbor works
Page 12: C3 measuring impact   nancy kopf - neighbor works

Samples from Community SurveySamples from Community Survey

Page 13: C3 measuring impact   nancy kopf - neighbor works
Page 14: C3 measuring impact   nancy kopf - neighbor works
Page 15: C3 measuring impact   nancy kopf - neighbor works

Success Measures at NeighborWorks America

A sample of data from the Wells Fargo evaluation effort.

Page 16: C3 measuring impact   nancy kopf - neighbor works

¿Cree usted que los siguientes son los problemas de su comunidad?

Do you think the following are issues in the community?

0% 10% 20% 30% 40% 50% 60% 70%

Dumping

Gatos callejeros / perros-Stray Cats/Dogs

Iluminación de las calles - Street Lighting

Vandalismo - Vandalism

Las drogas - Drugs

Basura - Trash

Graffiti

Tráfico/exceso de velocidad-Traffic/Speeding

Page 17: C3 measuring impact   nancy kopf - neighbor works

Is there Confidence in the Community’s Future?

Page 18: C3 measuring impact   nancy kopf - neighbor works
Page 19: C3 measuring impact   nancy kopf - neighbor works

Calculation: Local Economic Impact Calculation: Local Economic Impact of New Construction/Renovationof New Construction/RenovationWhat does the tool do? Estimates the total economic impact of a housing project as each dollar spent on

construction or rehabilitation flows through the local economy

How does it work? Uses mathematical calculations to trace the original investment through the

purchase of goods and services by the developer, construction workers, residents and the local government

Why use the tool? Demonstrate the benefits of community development efforts in housing projects

to the locality and society

Where did the tool’s framework and multiplier come from?

National Association of Homebuilders Multipliers used are from economic modeling done in 2002 Numbers were re-validated in 2008

Page 20: C3 measuring impact   nancy kopf - neighbor works

20 of 16

20 of 16

In 2007, within Randolph County, we built 10 units serving households with an average income of just over $11,000 each. Click each module to view the results.

Through the construction of those 10 units we:Contributed $790,000 to the local economySupported $430,000 in local business wagesGenerated $62,148 in local government taxes and fees paid.

Exple

Module A Module B Module C

Page 21: C3 measuring impact   nancy kopf - neighbor works

21 of 16

21 of 16

In 2007, within Randolph County, we built 10 units serving households with an average income of just over $11,000 each. Click each module to view the results.

The local government received more than $4000 in fees from the home sales transaction and sales generated $12,877 in local income to businesses.

Example

Module A Module B Module C

Page 22: C3 measuring impact   nancy kopf - neighbor works

22 of 16

22 of 16

In 2007, within Randolph County, we built 10 units serving households with an average income of just over $11,000 each. Click each module to view the results.

In their first year as homeowners, it is estimated these 10 low-income households generated income to the local economy of more than $11,000.

Example

Module A Module B Module C

Total local business income from construction, sales, and first year…

Page 23: C3 measuring impact   nancy kopf - neighbor works

Ways to Use FindingsWays to Use Findings

Demonstrate the local economic contributions of building or rehabbing affordable housing. – results can be analyzed by council district, ward, congressional district, etc.

Create a compelling case to a local jurisdiction considering new nonprofit development.

Demonstrate economic contribution of low income homeowners to the community.

Disseminate at press events such as groundbreaking ceremonies, in stakeholder communications, and annual reports.

Page 24: C3 measuring impact   nancy kopf - neighbor works