2010 Outcome Based Evaluation in Libraries

Outcome Based Evaluation (OBE) for Adult Library Services

Central Texas Library SystemWinter Membership Meeting

Friday, January 22, 2010

Presentation by Lisa M. Metzer

Libraries have the capacity to make a difference in their communities!

How do we share the impact of our work?

Outcome based evaluation is a powerful tool in reporting the

difference we make.

What has changed as a result of our work?

What is the impact on the people we serve?

Today’s Presentation

• Define OBE.• Explore outcomes-based planning.• Evaluate library programs and services.• Share our impact.

Outline

• Define Outcome Based Evaluation (OBE)• History• Benefits• Outcomes• Components / the Logic Model• Implementation• Example – Wells Branch Community Library• Today’s application

Definition

Diagram created using Curio 6 (http://www.zengobi.com/products/curio/)

History of outcome measurement

• Government Performance and Results Act (GPRA), 1993

• United Way outcome model, 1995

Benefits

Diagram created using Curio 6 (http://www.zengobi.com/products/curio/)

Outcomes

Diagram created using Curio 6 (http://www.zengobi.com/products/curio/)

Components / the Logic Model

Diagram created using Curio 6 (http://www.zengobi.com/products/curio/)

So, how do we use OBE in our public adult services to measure

the impact of our work?

Implementation

1. Identify need2. Consider options (e.g. program, club,

class, online tutorial, display)3. Outcome-based planning4. Delivery5. Measure impact

At the Wells Branch Community Library

Program Proposal

Program Proposal cont.

Program Evaluation

Final thoughts…

• Don’t have to do OBE every time.• Start small.• Can be challenging in small libraries.• OBE takes time and commitment.• Consider staff training.• OBE is worth it to advance libraries and share

our success our stories!

Today’s Application

Planning and evaluating an adult library program by a cookbook author.

Activity

Identify desired outcomes for today’s program.

Summary

• Define OBE.• Explore outcomes-based planning.• Evaluate library programs and services.• Share our impact.

ResourcesWeb sites ALA National Library Week Sloganhttp://www.ala.org/ala/aboutala/offices/pio/natlibraryweek/nlw.cfm Government Performance Results Act of 1993 http://www.whitehouse.gov/omb/mgmt-gpra_gplaw2m/ Outcome-Based Evaluation: New York State Library http://www.nysl.nysed.gov/libdev/obe/index.html Shaping Outcomes Project Websitehttp://shapingoutcomes.org/ United Way of America Outcome Measurement Resourceshttp://www.liveunited.org/Outcomes/Resources/index.cfm United Way’s Outcome Measurement Resource Networkhttp://www.liveunited.org/outcomes/

Resources cont.Books Demonstrating results: using outcome measurement in your library by Rhea Joyce Rubin, ALA, 2006. Measuring Program Outcomes: A Practical Approach. United Way of America, 1996.

Presentations & PDF Files Outcome-Based Evaluation for Technology Training Projects,

http://www.nysl.nysed.gov/libdev/obe/basic/index.html Perspectives on Outcome Based Evaluation for Libraries and Museums,

http://www.imls.gov/pdf/pubobe.pdf WILIS: Selected Outcome Based Evaluation (OBE),

http://www.wilis.unc.edu/docs/WILIS_OBE_bibliography.pdf

Resources cont.Podcasts, Webinars & Courses IMLS and Indiana University’s online course, “Shaping Outcomes”http://www.shapingoutcomes.org/ Librarian Live Podcast, “Outcome Based Evaluation for Libraries Explained”http://librarianlive.libsyn.com/index.php?post_id=562321 Texas State Library and Archives Commission archived webinar, “Demonstrating Impact: An

Introduction to Outcomes Based Evaluation”http://www.tsl.state.tx.us/ld/workshops/webinars/archived.html