Uncovering Measures that Matter: A Field-Wide Collaborative Exploration

Uncovering Measures that Matter: A Field-Wide Collaborative Exploration

Timothy Cherubini, Executive Director, Chief Officers of State Library Agencies

Georgia Libraries ConferenceColumbus, Georgia

October 4, 2017

• Welcome

• History and purpose of Measures that Matter (MtM)

• The COSLA and IMLS perspectives

• MtM logic model

• Progress to date

• Q & A

• Staying in touch

2

WELCOME AND TOPICS FOR TODAY

This project was made possible in part by the Institute of Museum and Library Services

RE-00-16-0181-16

[email protected]

Please take 5 minutes and using the oversize notecards on your tables, tell us:

What measures matter to you?

What would make your data collection efforts easier and more useful to you?

4

ACTIVITY

MtM is a one-year Cooperative Agreement between IMLS and COSLA that seeks

to engage stakeholders in creating a National Action Plan that when realized will:

• Reduce the burden of data collection

• Eliminate duplication of data collection efforts

• Improve the timeliness of data release

• Increase the uptake on sampling surveys

• Improve the quality of data collected

• Increase the capacity of public libraries to track and measure outcomes that

align with community-based measurement systems

5

MEASURES THAT MATTER: PURPOSE

MTM “WHO’S WHO”

Advisory Committee:

John Bertot (U of MD)

Larra Clark (PLA)

Mike Crandall (TASCHA)

Robin Dale (IMLS)

Denise Davis (Allen County

Public Library (IN))

Vailey Oehlke (Multnomah

County Library (OR))

Lee Rainie (Pew Research)

Kathy Rosa (ALA)

Project Team:

Core Project Team: Timothy Cherubini, Sue

Coliton, John Smith, Bill Vesneski, Jan Lathrop

Data Consultant: Joe Matthews

Writing and editing: John Smith. Sandy Nyberg

Webinar series design: Linda Hofschire

Webinar series presentation: Web Junction

Website & Communications: Georgia Public

Library Service; Laura Woodard; Karen Mellor

Meeting planning: Capitol Meeting Planning

Speakers and subject matter experts:

Rebecca Teasdale, John Bertot, Chantal

Stevens, Rebecca Jones

Working Group:

Ken Wiggin, Chair (CT)

Stacey Aldrich (HI)

Matt Birnbaum (IMLS)

Robin Dale (IMLS)

Kurt Kiefer (WI)

Jen Nelson (MN)

Annie Norman (DE)

7

MTM CONSTITUENTS:

MtM Project Team

• COSLA

• IMLS

• Working Group

• Advisory Committee

• Consultants

Library Community

• Academic and other librarians

• Allied organizations and data experts from other fields (e.g. ICMA; education

field, etc.)

• Library School Faculty & Students

• Library Support Organizations

• Practitioners

• Researchers

• State Library Agency Staff (SDCs, LSTA, etc.)

• Vendors

Create Data

LandscapeServe as key

resource to field

Advisory Committee

Ongoing, Regular Communication

Design and Hold Webinars

Build understanding of “librarydata”

Shared Responsibility

Investment, co-creation and positive change

National Data

Summit

Actively plan for future data collection

Increased Field Knowledge

Provide field with knowledge for action

(April 4, 2017)

National Data Action

Plan

Prepare for national implementation

IMLS & COSLAPartnership

Working Group

Key Assumption:

There is the need and desire for a national plan that specifies how public library data should be collected, stored, used and disseminated. The plan will engage all stakeholders and help validate the purpose and value of public libraries.

LONG TERM OUTCOMES

MEASURES THAT MATTER: NATIONAL LOGIC MODELGRANT PERIOD ACTIVITIES (ENDING DECEMBER 2017)

Stronger Role, Value and Impact

for Public Libraries

Activities Engagement Strategies Initial Outcomes Major Contributions to Field

Clear, Shared Vision

Sustainable Action

NewData Landscape

MTM PROJECT MILESTONES (8/31/2017)

MILESTONE CURRENT STATUS

1. Creation of Data Landscape

2. Development and Presentation of Webinar Series (public webinars)

4. Production of Summit

5. Creation and Dissemination of Action Plan

Completed.

Completed:

Completed.

In progress.

9

3. Launch website

measuresthatmatter.net

et

Completed

MEASURES THAT MATTER: WHAT’S COMING UP (2017):

MAY• Iterate Data Landscape

• Develop dedicated website

• Twitter launch

JUNE

JUNE 24ALA Presentation

JULY AUGUST• Finalize Data Landscape

• Prep webinar(s) for

summit attendees

(date(s) TBD)

SEPT DECEMBER• Action Plan development and

dissemination

SEPT 19-20

Data SummitDEC 30

Coop Agreement

completed,

but work continues…

MAY 23

Webinar 1

JUNE 13

Webinar 2JULY 26

Webinar 3

OCT 4

Webinar Series

• Purpose: Increase baseline understanding

• Topics:

◦ A view into the public library data landscape

◦ Telling data-based library stories

◦ Moving toward additional meaningful measures

• Recordings: Webjunction; MtM website

• Future prospects

11

MORE ON THE PROJECT MILESTONES …

12

“Data Landscape Doc”

• Purpose: Increase baseline understanding

• Topic: A view into the public library data landscape

• Access: MtM website

• Findings and response

13


14


“Data Landscape Doc”

• Inventory, not comparison

•Too much data

•Not as much overlap as thought

•Burden?

•A management framework will help

•Consider a PLS survey with parts (based on size of library)

•Continue to analyze states’ questions, discontinued efforts

http://measuresthatmatter.net/library-data-collection-efforts/

http://measuresthatmatter.net/library-data-collection-efforts/

15


Data Summit Goals:Develop a shared understanding among participants that:

• Our needs for library data have evolved as the role of libraries has shifted in the digital age.

• There are good models in other fields to learn from and experienced people who can help us.

• The solutions will result in better quality data that helps us improve our services, better serve our communities, and demonstrate our value to voters, legislators and funders.

• There is no quick fix to this complex problem, finding solutions will be an iterative process that takes place over time.

• Together, we need to develop and articulate an Action Plan that will move the field forward.

Create a clear, detailed plan on how data collection issues can be addressed

Develop commitment to work together to approve and advance the plan

16


Data Summit Structure:• Plenary Session Speakers:

o Chantal Stevens, Community Indicators Consortium

o Brooks Rainwater, National League of Cities

• Panel discussions featuring a number of attendees from within and

outside of the library field

o U.S. Department of Education

o Ed-Fi Alliance

o DataArts

• World Café and small group sessions

• Broadcast session

• Action planning

Data Summit Participants:Working Group, Advisory Committee, Project Team

Leadership of Library Support Organizations (ALA, ARSL, COSLA, IMLS, PLA, ULC)

Public Librarians (AR, CA, IL,IN, MA, MD, MN, MS, NY, OH, OR, SC, WA)

State Librarians (CT, DE, HI, MD, MN, TX, WI)

State Data Coordinators (CO, GA, NC)

Library School Students & Faculty (University of Maryland; University of Washington)

Professionals from other fields (Community Indicators Consortium; Dept. of Education; DataArts; Ed-Fi Alliance; National

League of Cities)

Allied Organizations (Aspen Institute, Association of Research Libraries; EveryLibrary; Libraries Without Borders; National

Library of Medicine; National Information Standards Organization; OCLC; Technology Policy Institute)

Public Service Sector (City of Baltimore, MD; City of Biwabik, MN)

Researchers (Institute of Museum and Library Services; University of Maryland; University of Washington’

independent consultants and researchers)

Funders (Institute of Museum and Library Services)

Vendors (Baker & Taylor; CIVICTechnologies; Counting Opinions; Gale Cengage; Innovative)

17


Data Summit – Some Observations:• Participation level – very high

• Recognition of scope, duration of effort

• Expressed commitment to working together

• Enthusiasm from outside the field

• Increase focus on using data

• Continue learning from users of all types

• Technology solutions exist for framework, business process

• Foster connections inside AND outside the field

• Manage expectations – This is a long haul

18


MEASURES THAT MATTER: WHAT’S COMING UP (2017):

MAY• Iterate Data Landscape

• Develop dedicated website

• Twitter launch

JUNE

JUNE 24ALA Presentation

JULY AUGUST• Finalize Data Landscape

• Prep webinar(s) for

summit attendees

(date(s) TBD)

SEPT DECEMBER• Action Plan development and

dissemination

SEPT 19-20

Data SummitDEC 30

Coop Agreement

completed,

but work continues…

MAY 23

Webinar 1

JUNE 13

Webinar 2JULY 26

Webinar 3

OCT 4

Q & A and Discussion

20

MEASURES THAT MATTER

Drafting and vetting of the Action Plan

Tim will communicate with GPLS and through Christina Trotter to invite attendees

of this afternoon’s session to review and comment on draft(s) of the plan.

Current cooperative agreement ends December (but “to be continued …”)

21

WHAT’S NEXT

Website: http://measuresthatmatter.net

Google Group:

https://www.surveymonkey.com/r/MtMEmailList

Twitter: @libmeasuresmtr

Email: [email protected] or [email protected]

Telephone: 859 514 9826 (Tim’s direct line)

22

STAY IN TOUCH

http://measuresthatmatter.net/

https://www.surveymonkey.com/r/MtMEmailList

mailto:[email protected]

mailto:[email protected]

Thank you!

[email protected]