8
Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December 4, 2013

Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Embed Size (px)

Citation preview

Page 1: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Nonprofit Case Study – Working with External Evaluators

How a nonprofit worked with an external partner to grow its performance management capacity

December 4, 2013

Page 2: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Today’s PresentersMonique MilesDeputy Director of the Aspen Forum for Community Solutions Aspen Institute

Sean SegalChief Operating OfficerUrban Alliance

Dan TsinDirector of Evaluation Urban Alliance

Brett TheodosSenior Research AssociateUrban Institute

Page 3: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Urban AllianceUrban Alliance provides professional development to under-resourced youth through

a 10-month paid internship.

Job Skills Training

Job Placement

Career MentorshipPost-HS Coaching

Alumni Support

Page 4: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Urban Alliance’s History

1996: Serves 6 youth from 1 DC high school

2003: DC citywide expansion

2008: Expands to Baltimore after BCPS’s CEO invitation

2012: Expands to serve 70 youth in Chicago

2013: Expands to serve 35 youth in Virginia

Page 5: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

How Urban Alliance Works

ActivitiesShort-Term Outcomes

Intermediate-Term

Outcomes

Long-Term Outcomes

Pre-Work Training

Professional Internship

Skill Building

Post-High School Coaching

Alumni Services

Skill Set Growth

Post-Secondary Readiness

HS Graduation

Immediate college enrollment or employment

Youth remain “Connected” by continuing in school or earning a livable wage.

Youth are living self-sufficiently and contributing to society.

More than 700 hours of programming

Page 6: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Measuring SuccessUrban Alliance places heavy emphasis on program evaluation and continuous

learning to ensure the best outcomes for our youth.

Internal Program Evaluation

• Pre – and Post – Program Surveys• Hard and Soft Skill Exposure & Growth• Post-Secondary Readiness• College Enrollment and Persistence via the National Student Clearinghouse

External Program Evaluation

• 5 year Randomized Control Trial through the Urban Institute• Treatment vs Control comparisons on post-secondary success and job-readiness

Page 7: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Investment in Evaluation

2000 2002 2007 2012 Beyond

•Collection of weekly tracking notes and end of year reports on youth•Data unable to be aggregated

•Purchased Effort to Outcomes•Hard and Soft skills tracked •Aggregated data for Development

•World Bank/ Urban Institute East of River Initiative•Logic Model with long term outcomes development•1st Pre and Post Program Surveys•Creation of Alumni Services

•Full time Director of Evaluation•Investment in SalesForce for all organization data tracking•Urban Institute RCT•External data confirmation

•Increased capacity to track and follow alumni•Linking specific program inputs and activities to long term outcomes

Page 8: Nonprofit Case Study – Working with External Evaluators How a nonprofit worked with an external partner to grow its performance management capacity December

Q&AMonique MilesDeputy Director of the Aspen Forum for Community Solutions Aspen [email protected] 

Sean SegalChief Operating OfficerUrban [email protected]

Dan TsinDirector of Evaluation Urban [email protected]

Brett TheodosSenior Research AssociateUrban [email protected]