24
Straight from the User's Mouth: Usability Testing UNC's LibGuides Sarah Arnold & Stephanie Hsieh UNC Chapel Hill Libraries

Straight from the user's mouth: Usability testing UNC's LibGuides

Embed Size (px)

Citation preview

Page 1: Straight from the user's mouth: Usability testing UNC's LibGuides

Straight from the User's Mouth:Usability Testing UNC's LibGuides

Sarah Arnold & Stephanie HsiehUNC Chapel Hill Libraries

Page 2: Straight from the user's mouth: Usability testing UNC's LibGuides

OverviewWhat is usability? What is usability testing?

What is a subject guide?

Background & Planning ProcessApplying for Institutional Review Board

Survey

Usability tasks

Best Practices

Collaboration between Librarians & LIS Students

Page 3: Straight from the user's mouth: Usability testing UNC's LibGuides

What is usability?When a user can do what they want to do, in the way they expect to do it, without hindrance or frustration(Definition adapted from the Handbook of Usability Testing by Jeff Rubin and Dana Chisnell)

*http://www.usability.gov/what-and-why/user-experience.html

Page 4: Straight from the user's mouth: Usability testing UNC's LibGuides

What is usability testing?Evaluating how well a product meets some usability criteriaDefined by the designers, tested by usersGoal is to get recommendations for improving usabilityProduces mostly qualitative data

Page 5: Straight from the user's mouth: Usability testing UNC's LibGuides

What does a usability test look like?5 participants*Complete tasks using the product“Talking aloud” about their process and thoughtsCan vary a lot in size, complexity, and depending on need

*https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/

Page 6: Straight from the user's mouth: Usability testing UNC's LibGuides

What is a subject guide?Subject guides: “a website created to give students an overview of books and article databases related to a specific topic. Some example topics include: Middle Eastern Cinemas & Film, Resources on Endangered Species, and How to Find Book Reviews.”

Made using LibGuidesUnderutilized resource

Page 7: Straight from the user's mouth: Usability testing UNC's LibGuides

BackgroundMoved from Library á la Carte to LibGuides v. 1 in 2011Upgraded to LibGuides v. 2 in Summer 2014Current standards* combine best practices reported by other libraries and anecdotal information from studies not focused on LibGuidesIn general, subject guides are underutilized*http://guides.lib.unc.edu/usinglibguides/subjectguides

Page 8: Straight from the user's mouth: Usability testing UNC's LibGuides

Planning processApply to UNC’s Institutional

Review Board for exemption

Create a survey to gather baseline data and recruit study participants

Come up with representative tasks for representative users*

*https://www.nngroup.com/articles/recruiting-test-participants-for-usability-studies

Page 9: Straight from the user's mouth: Usability testing UNC's LibGuides

Institutional Review Board approvalCampus MassMailWhen you ask someone to do something, you are not exempt according to Institutional Review Board standardsApplication process and timing

Page 10: Straight from the user's mouth: Usability testing UNC's LibGuides

SurveyGauge user understanding or opinion when exploring new initiativesMethodologyRecruitment toolQualtrics

Page 11: Straight from the user's mouth: Usability testing UNC's LibGuides

Example questionsHave you ever used a subject guide?

When you see the term “subject guide,” what comes to mind?

What is one thing you DO/DON’T like about the design?

Do you have any other suggestions or comments about the subject guides you have seen today?

Page 12: Straight from the user's mouth: Usability testing UNC's LibGuides

Heat maps

Based on this page, where would you go to find more information about Buildings and Maps in Orange County?

Page 13: Straight from the user's mouth: Usability testing UNC's LibGuides

Usability tasksRepresentative users complete representative tasks while you listen

3 rounds of testing

5 users per round*

Specific focus each round

Top vs. side navigation

2 vs. 3 columns of information

3-5 vs. 6+ items (links, books, databases, etc.) per box

Page 14: Straight from the user's mouth: Usability testing UNC's LibGuides

Top vs. side navigation

Page 15: Straight from the user's mouth: Usability testing UNC's LibGuides

2 vs. 3 columns

Page 16: Straight from the user's mouth: Usability testing UNC's LibGuides

3-5 vs. 6+ items

Page 17: Straight from the user's mouth: Usability testing UNC's LibGuides

Usability tasks - DetailsRecording and staffing the testing sessionsSet up a representative guideObservation Guide + Participant handoutsDemographic and basic knowledge questionsFollow-up questions

Page 18: Straight from the user's mouth: Usability testing UNC's LibGuides

Task 1: Talk me through what you’re thinking

Page 19: Straight from the user's mouth: Usability testing UNC's LibGuides

Tasks 2-4: Locate specific items

Page 20: Straight from the user's mouth: Usability testing UNC's LibGuides

Task 5: Accessing resources

Page 21: Straight from the user's mouth: Usability testing UNC's LibGuides

Best PracticesPlan, plan, planTake advantage of resources on your campusTest your testReminder: You aren’t your user

Page 22: Straight from the user's mouth: Usability testing UNC's LibGuides

Collaboration between Librarians & LIS StudentsProvide an opportunity for future librarians to explore traditional testing practices with guidance of someone with experienceEven if neither of you have experience, you have a partner

Page 23: Straight from the user's mouth: Usability testing UNC's LibGuides

Collaboration between Librarians & LIS StudentsApply classroom learning to a real-world situationLearn more about how academic libraries function

Page 24: Straight from the user's mouth: Usability testing UNC's LibGuides

Questions?For resources on user experience and usability, visit libux.web.unc.edu/resourcesStephanie HsiehCarolina Academic Library Associate (Graduate Assistant)[email protected]

Sarah ArnoldInstructional Technology Librarian, User [email protected]