30
Making Data work for you The Library Impact Data Project Graham Stone Information Resources Manager This work is licensed under a Creative Commons Attributi on 3.0 Unported License #lidp #jiscLAM http://eprints.hud.ac.uk/1957

Making Data work for you The Library Impact Data Project Graham Stone Information Resources Manager This work is licensed under a Creative Commons Attribution

Embed Size (px)

Citation preview

Making Data work for youThe Library Impact Data Project

Graham Stone

Information Resources Manager

This work is licensed under a Creative Commons Attribution 3.0 Unported License

#lidp #jiscLAMPhttp://eprints.hud.ac.uk/19570

Library Impact Data Project

To support the hypothesis that…

“There is a statistically significant correlation across a number of universities between

library activity data and student attainment”

Library Impact Data Project 1Original data requirements

• For each student who graduated in a given year, the following data was required:– Final grade achieved– Number of books borrowed– Number of times e-resources were accessed – Number of times each student entered the library, e.g.

via a turnstile system that requires identity card access– School/Faculty

Library Impact Data Project

– Showed a statistical significance between:

• Final grade achieved• Number of books

borrowed• Number of times e-

resources were accessed

– Across all 8 partners– Not a cause and effect

relationship

Library Impact Data Project

Phase I looked at over 33,000 students across 8 universities

Phase II looked at around 2,000 FT undergraduate students at Huddersfield

Library Impact Data Project 2Additional data

• Demographics• Discipline• Retention• On/off campus use• Breadth and depth of e-

resource usage• UCAS points (entry data)• Correlations for Phase 1

Library usageAge

Library usageEthnicity

Library usageCountry of domicile

Library usageAggregated subject groups

Library usageRetention

• Looking at one year of data for every student• Using a cumulative measure of usage for the first two

terms of the 2010-11 academic year• Only looking at people who dropped out in term three• All the students included in this study were at the

university in the first two terms, and they have all had exactly the same opportunity to accumulate usage.

Library usageRetention

Going forward@Huddersfield

• Identifying retention issues and our impact on lowering them as part of a University dashboard

Engagement

Workload

Performance

Thanks to Lee for the inspiration for this image

Going forward@Huddersfield

• Identifying retention issues and our impact on lowering them as part of a University dashboard

• Look at specific subjects in order to work towards:– A best practice toolkit for information skills sessions– Further understanding by holding focus groups with target areas

• Create an action plan to engage with academic colleagues

• Showing value for money and the impact of the service on the student experience

Library Analytics Survey

We asked:

How important will analytics be to academic libraries now and in the future, and what is the potential for a service in

this area?

With thanks to the team at MIMAS for the initial survey analysis

How important will analytics be to academic libraries

• Significant appetite for analytics services among this sample– 96% were interested in the automated provision of analytics

demonstrating the relationship between student attainment and library usage

• Strong willingness to share a broad range of data– preference to be identified by JISC band (91%)– as opposed to named institution (47%)

Key strategic drivers

1. Enhancing the student experience

2. Demonstrating value for money

3. Supporting research excellence

JiscLAMPLibrary Analytics and Metrics Project

• Looking at the benefits of scale• To develop a prototype shared library analytics service

for UK academic libraries– Envisioned as a data dashboard– Enabling libraries to capitalise on the many types of data

they capture in day-to-day activities – To support the improvement and development of new

services and demonstrate value and impact in new ways across the institution

JiscLAMPLibrary Analytics and Metrics Project

JiscLAMPA brief word on ethics?

• Should we be holding and analyzing this kind of data– Data protection issues– ‘Big brother’

– All students pay the same fees – shouldn’t they be treated the same?

•  But what if we didn’t do this– What would the reaction be if it was found that we had this data but

didn’t act on it?

– We have a duty to care for the individual wellbeing of our students

JiscLAMPNormalisation of Data

JiscLAMPThe data dashboard

JiscLAMPThe data dashboard

JiscLAMPWhat can we do with the data?

• We can demonstrate usage by cohorts:

DepartmentDegree nameCourseCourse ‘type’?Gender/Ethnicity/Nationality/Disability/AgeLevel of attainmentAttendance mode (full time/part time)UCAS points

• We can demonstrate correlations between usage and attainment/usage and cohort)

JiscLAMPThe ugly prototype

JiscLAMPWhat could we do?

JiscLAMPWhere do we go from here?

• LAMP Phase 2– We have funding for Phase 2 – We start testing the ‘ugly’ prototype in late-March– Next steps include putting a project plan together

•  Key Use cases for next phase– NSS scores and how LAMP would enable analysis of the data– Individual usage data (possibly outside LAMP and wider Jisc analytics issue)– Financial data– eBooks content usage (possibly separate strand of work?)

JiscLAMPWhere do we go from here?

• Workshop with SCONUL (London 7 May 2014 tbc)– engaging the wider library community, specifically library directors

• Key contacts/relationships for next phase– HESA (NSS)– Shibboleth/Athens – SCONUL (performance group)

• Business case ideas– Possibility of a LAMP service which provides consultancy whereby institutions

could buy-in the analysis of data that they want

Thank you!

Ben Showers (Jisc)[email protected]

Graham Stone (Huddersfield)[email protected]

http://jisclamp.mimas.ac.uk

This work is licensed under a Creative Commons Attribution 3.0 Unported License

#lidp #jiscLAMPhttp://eprints.hud.ac.uk/19570