Straight from the user's mouth: Usability testing UNC's LibGuides

Straight from the User's Mouth:Usability Testing UNC's LibGuides

Sarah Arnold & Stephanie HsiehUNC Chapel Hill Libraries

OverviewWhat is usability? What is usability testing?

What is a subject guide?

Background & Planning ProcessApplying for Institutional Review Board

Survey

Usability tasks

Best Practices

Collaboration between Librarians & LIS Students

What is usability?When a user can do what they want to do, in the way they expect to do it, without hindrance or frustration(Definition adapted from the Handbook of Usability Testing by Jeff Rubin and Dana Chisnell)

*http://www.usability.gov/what-and-why/user-experience.html

What is usability testing?Evaluating how well a product meets some usability criteriaDefined by the designers, tested by usersGoal is to get recommendations for improving usabilityProduces mostly qualitative data

What does a usability test look like?5 participants*Complete tasks using the product“Talking aloud” about their process and thoughtsCan vary a lot in size, complexity, and depending on need

*https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

What is a subject guide?Subject guides: “a website created to give students an overview of books and article databases related to a specific topic. Some example topics include: Middle Eastern Cinemas & Film, Resources on Endangered Species, and How to Find Book Reviews.”

Made using LibGuidesUnderutilized resource

BackgroundMoved from Library á la Carte to LibGuides v. 1 in 2011Upgraded to LibGuides v. 2 in Summer 2014Current standards* combine best practices reported by other libraries and anecdotal information from studies not focused on LibGuidesIn general, subject guides are underutilized*http://guides.lib.unc.edu/usinglibguides/subjectguides

Planning processApply to UNC’s Institutional

Review Board for exemption

Create a survey to gather baseline data and recruit study participants

Come up with representative tasks for representative users*

*https://www.nngroup.com/articles/recruiting-test-participants-for-usability-studies

Institutional Review Board approvalCampus MassMailWhen you ask someone to do something, you are not exempt according to Institutional Review Board standardsApplication process and timing

SurveyGauge user understanding or opinion when exploring new initiativesMethodologyRecruitment toolQualtrics

Example questionsHave you ever used a subject guide?

When you see the term “subject guide,” what comes to mind?

What is one thing you DO/DON’T like about the design?

Do you have any other suggestions or comments about the subject guides you have seen today?

Heat maps

Based on this page, where would you go to find more information about Buildings and Maps in Orange County?

Usability tasksRepresentative users complete representative tasks while you listen

3 rounds of testing

5 users per round*

Specific focus each round

Top vs. side navigation

2 vs. 3 columns of information

3-5 vs. 6+ items (links, books, databases, etc.) per box

Top vs. side navigation

2 vs. 3 columns

3-5 vs. 6+ items

Usability tasks - DetailsRecording and staffing the testing sessionsSet up a representative guideObservation Guide + Participant handoutsDemographic and basic knowledge questionsFollow-up questions

Task 1: Talk me through what you’re thinking

Tasks 2-4: Locate specific items

Task 5: Accessing resources

Best PracticesPlan, plan, planTake advantage of resources on your campusTest your testReminder: You aren’t your user

Collaboration between Librarians & LIS StudentsProvide an opportunity for future librarians to explore traditional testing practices with guidance of someone with experienceEven if neither of you have experience, you have a partner

Collaboration between Librarians & LIS StudentsApply classroom learning to a real-world situationLearn more about how academic libraries function

Questions?For resources on user experience and usability, visit libux.web.unc.edu/resourcesStephanie HsiehCarolina Academic Library Associate (Graduate Assistant)syfh@live.unc.edu

Sarah ArnoldInstructional Technology Librarian, User Experiencesjarnold@email.unc.edu