Web Usability Practice in ARL Academic Libraries:

Issues and ChallengesYu-Hui Chen

Carol Anne GermainUniversity at Albany

Computers in Libraries 2010

Project OverviewOnline survey ARL academic libraries84 institutions participatedSurvey content

Policies/standards/guidelinesUsability testingResources (staff, time, training)

Libraries/universities with/without PSGs_____________________________________________________________________________________________

Library Web PSGs Library Web usability PSGs University Web usability PSGs _____________________________________________________________________________________________ No. of libraries (%) No. of libraries (%) No. of libraries (%) With 34 (40%) 25 (30%) 30 (36%) Without 50 (60%) 58 (69%) 31 (37%) Not sure 22 (26%) No Answer 1 (1%) 1 (1%) Total 84 (100%) 84 (100%) 84 (100%) ___________________________________________________________________________________________

Difficulty in implementing Web usability PSGs_____________________________________________________________________________________________

Library Web PSGs Library Web usability PSGs University Web usability (n = 34) (n = 25) PSGs (n* = 26) _____________________________________________________________________________________________ No. of libraries (%) No. of libraries (%) No. of libraries (%) Not difficult 5 (15%) 4 (16%) 12 (46%) Slightly difficult 8 (23%) 2 ( 8%) 8 (31%) Moderately difficult 16 (47%) 15 (60%) 5 (19%) Very difficult 3 ( 9%) 2 ( 8%) No answer 2 ( 6%) 2 ( 8%) 1 ( 4%) Total 34 (100%) 25 (100%) 26 (100%) _____________________________________________________________________________________________ Note. n = number of libraries reported that they have PSGs. n* = number of libraries reported that they followed their universities’ PSGs.

Rating on the importance of usability testing

__________________________________________________ Rating No. of libraries % _____________________________________________ Not important 2 2.3% Somewhat important 15 17.9% Important 21 25.0% Very important 34 40.5% Extremely important 7 8.3% No answer 5 6.0% Total 84 100% _____________________________________________

Libraries conducting Web usability testing______________________________________________________________

Conducted testing No. of libraries % ________________________________________________ Have 71 85% Have not 11 13% No answer 2 2% Total 84 100% ________________________________________________

Number of libraries testing on the three Web platforms: pre-, during, and post- design phases

Website OPAC Lower Level Pages

Pre During Post Pre During Post Pre During Post

1 15 12 16 8 9 11 11 11 12 2 13 16 11 6 6 10 9 18 11 3 9 11 9 2 4 4 7 7 10 4 1 2 2 1 1 2 1 3 4 5 or more 10 15 15 2 2 3 5 7 7 Sub Total 48 56 53 19 22 30 33 46 44 None 19 10 12 38 34 32 28 20 21 Total 67 66 65 57 56 62 61 66 65

Usability testing methods applied by libraries conducting usability tests

In-person Observation (86%)Thinking-Aloud (80%)Card Sorting (56%)Cognitive Walk-through (55%)Task Analysis (55%)Paper Prototyping (51%)

Libraries employing dedicated Web usability staff

____________________________________ No. of libraries % ____________________________________ With 24 28% Without 57 68% No answer 3 4% Total 84 100% ____________________________________

Types of Web usability training for dedicated staff

Training No. of dedicated staff __________________________________________________________ Human-Computer Interaction (HCI) 6 Web usability 14 Degree or certificate in Information Science 14 No specific training 5 Total 39* ____________________________________________________________ Note. *As multiple responses were allowed for this question, the total adds up to more than 24

Libraries with/without regular staff whose responsibilities include Web usability

No. of libraries % ______________________________________ With 51 60% Without 30 36% No answer 3 4% Total 84 100% ______________________________________

Types of training the regular staff had regarding Web usability

Training No. of regular staff __________________________________________________________ Human-Computer Interaction (HCI) 16 Web usability 36 Degree or certificate in Information Science 21 No specific training 10 Total 83* __________________________________________________________ Note. *As multiple responses were allowed for this question, the total adds up to more than 51

Future plans of participating libraries________________________________________________________ Plan No. of libraries Conduct usability testing 26 Redesign library Web site 14 Use alternative methods 9 (focus groups, interviews, surveys, click paths) Acquire resources (outside assistance, funding) 8 Conduct iterative testing 7 Add usability committee, personnel, task force 6 Test OPAC 6 Implement CMS 4 Establish policies 3 Test lower level pages 1 ________________________________________________________

Issues, Challenges, & RecommendationsReasons of difficulty with implementing PSGs. _____________________________________________________________________________________

Library Web PSGs Library Web University Web usability PSGs usability PSGs

_____________________________________________________________________________________ No. of libraries No. of libraries No. of libraries Enforcement/Agreement 13 7 2 Lack of skills/training 7 3 1 Resources 4 3 1 Getting informed 3 1 2 Resistance to change 2 2

Issues, Challenges, & RecommendationsStakeholders

Little knowledge of and support for usabilityLimited usability expertisePolitical agenda

ResourcesStaff and timeOrganizational knowledge

Reference & Contact InformationFor your reference

Chen, Y, Germain, C.A. & Yang, H. (2009). An exploration into the practices of library Web usability in ARL academic libraries. Journal of the American Society for Information Science and Technology, 60(5), 953-968.

Yu-Hui Chen ychen@uamail.albany.eduCarol Anne Germain cgermain@uamail.albany.edu