30
LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham College

LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Embed Size (px)

Citation preview

Page 1: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

LibQual Analysis at a Liberal Arts College: a Journey

Sara Penhale

Tom Kirk, Christine Larson,

Shirley Smith, Janet Wagner,

and Jeannette Wilson

Earlham College

Page 2: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Earlham College

• Liberal arts college with approximately 1200 students and 130 teaching faculty

• Library focuses on the teaching & learning process

• Long-standing program of teaching information literacy skills

• Librarians well-integrated into the life of the college

Page 3: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Assessment in the Library

• Experience in assessment

• Limited expertise in large scale surveys and data sets

• Analyzing LibQual data becomes a new journey

Page 4: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Radar Chart

Page 5: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Image from NASA Total Ozone Mapping Spectrometer http://toms.gsfc.nasa.gov/ozone/ozone_v8.html

Page 6: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

A journey begun on familiar territory,continued over thin ice on an unclear path, but

heading toward a known destination

IMPROVED LIBRARY SERVICE

Page 7: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Our path thus far…

1. Considered survey comments

2. Examined data analysis provided by LibQual

3. Began our own data analysis, relevant to our own institution

Page 8: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Step 1. Considered survey comments

Page 9: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

• Dissatisfaction with handling of fines at the circulation desk

• Student workers contribute to the problem

Page 10: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Arriving at improved library service

• Improved training program for students workers

• Emphasis on checking in books properly, customer service attitude, etc.

Page 11: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Guideposts for survey comments

• Expect to receive opposing comments

• Look for corroboration of what you suspect

• Look for new insights and what’s missing

• Recognize the need to look further for conclusions

Page 12: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Our journey continues…

Step 1. Considered survey comments

Step 2. Examined data analysis provided by LibQual

Page 13: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Step 2. Analysis provided by LibQual

• Entire survey populationSub-groups, such as faculty or undergraduates

• Radar charts for core questions

• Data summaries, descriptive statistics

• Comparative norms

Page 14: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Earlham CollegeAggregate Results

Page 15: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Results for Core Survey QuestionsSeparate Survey Sub-Groups

Undergraduates Faculty

Page 16: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Results for Core Survey QuestionsFaculty

Page 17: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Significant differences between undergraduates and faculty on questions related to satisfaction

“How would you rate the overall quality of service provided by the library?”

Page 18: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Undergraduates 7.41Faculty 8.12

(on a scale of 1-9)

Page 19: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Arriving at improved library service

• Maintain good relationships with faculty

• Make effort to integrate new faculty

• Look to improve undergraduate experience

Page 20: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Guideposts for data analysis provided by LibQual

• Consider comments and data together

• Be aware of the limitations of the survey questions and the demographic categories

Page 21: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Our journey…

Step 1. Considered survey comments

Step 2. Examined data analysis provided by LibQual

Step 3. Began our own data analysis

Page 22: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Step 3. Our own data analysis

• Noted factors relevant to our own institution

• Considered what additional analyses would be of interest

• Found help and plunged in!

Page 23: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham
Page 24: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Factors relevant to our institution

• Course-integrated program of instruction in information literacy skills

• Our interest in the progress of undergraduates throughout their four years

Page 25: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Additional Analysis

• Assistance from Dr. Katherine Milar, Psychology Department

• Compared students from different years

• ANOVA – Analysis of Variance – on a variety of variables

Page 26: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham
Page 27: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Using this information to arrive at improved library service

• Note large change between end of first year and end of second year

• Lesser changes in later years

• Consider meaning in context of both library program and student development

• Work with faculty to plan and implement changes

Page 28: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Guideposts for doing your own LibQual analyses

• Add comparisons with other institutions

• Be selective in what you analyze

• Continue to focus on the destination

Page 29: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

Begin your own journey to improved library service

1. Start on familiar territory

2. Follow the map provided by LibQual

3. Chart new territory with your own analysis

Page 30: LibQual Analysis at a Liberal Arts College: a Journey Sara Penhale Tom Kirk, Christine Larson, Shirley Smith, Janet Wagner, and Jeannette Wilson Earlham

EARLHAM COLLEGE -- URL for Presentation

http://www.earlham.edu/~libr/library/publications.htm

Sara Penhale

Science Librarian

[email protected]

Tom Kirk

College Librarian

[email protected]