Embed Size (px)
DESCRIPTION
StatsQUAL™. Webmetrics Workshop. Martha Kyrillidou Director, ARL Statistics and Measurement Program Association of Research Libraries. American Library Association Chicago, IL June 24, 2004. www.statsqual.org. ARL Roles. ARL Statistics and Measurement. - PowerPoint PPT Presentation
Citation preview
Webmetrics Workshop
American Library AssociationChicago, IL
June 24, 2004
Martha KyrillidouDirector, ARL Statistics and Measurement Program
Association of Research Libraries
www.statsqual.org
StatsQUAL™
www.statsqual.org
ARL Roles
www.statsqual.org
ARL Statistics and Measurement
…To describe and measure the performance of research libraries and their
contribution to
teaching, research, scholarship and community
service …
www.statsqual.org
Web Presence
www.statsqual.org
Future of New Measures Initiative
• Incorporation of some new data elements in traditional surveys
• Development of workshops and consulting services for performance measures
• Establishment of data gathering and statistical analysis tools
www.statsqual.org
What do we mean by E-Metrics within ARL?
• DigiQUAL
• MINES for Libraries
• ARL Supplementary Statistics
• Project COUNTER
www.statsqual.org
It’s…? “familiar” and digital
www.statsqual.org
Developing DigiQUAL Survey Items
• Background: ServQUAL ->LibQUAL ->DigiQUAL– LibQUAL dimensions of library service quality
DigiQUAL: 12 themes of DL service quality
Accessibility Collection building DL as community for users Copyright
Navigability Resource use ...developers Role of federations
Interoperability Evaluating collections ...reviewers DL sustainability
www.statsqual.org
Building a Survey (cont.)
CustomizeSurvey
Issue: Flexibility vs. Standardization
www.statsqual.org
Implementing Survey - Incentives
Issues: must be easily transferable, requires email address - clear IRB
www.statsqual.org
What is MINES for Libraries™
• MINES is a research methodology consisting of a web-based survey form and a sampling plan.
• MINES measures who is using electronic resources, where users
are located at the time of use, and their purpose of use.
• MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003.
• MINES is different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC Guidelines, ISO and NISO standards) or measure how well a library makes electronic resources accessible (LibQual+TM).
www.statsqual.org
MINES for Libraries™ Methodology
• A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library.
• Random moment/web-based surveys are employed at each site.
• Participation is usually mandatory, negating non-respondent bias, and is based on actual use in real-time.
• Libraries with database-to-web gateways or proxy re-writers offer the most comprehensive networking solution for surveying all networked services users during survey periods.
www.statsqual.org
www.statsqual.org
What do we mean by E-Metrics within ARL?
• DigiQUAL
• MINES for Libraries
• ARL Supplementary Statistics
• Project COUNTER
www.statsqual.org
BackendDatabase
o Data Extraction & Normalization
o Library and Vendor Profiles
o Report Request and Generation
o Usage Aggregation
o Comparison
User Interface
VariousData
Elements
DatabaseQuery &
DataRetrieval
Figure1. Key Processes for a Central Repository for Vendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
www.statsqual.org
BackendDatabases
o Data Extraction & Normalization
o Library and Vendor Profiles
o Report Request and Generation
o Usage Aggregation
o Comparison
User Interfaces
VariousData
Elements
VariousData
Elements
DatabaseQuery &
DataRetrieval
Figure2. Key Processes for Decentralized Repositories forVendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
o Report Request and Generation
o Usage Aggregation
o Comparison
o Data Extraction & Normalization
o Library and Vendor Profiles
DatabaseQuery &
DataRetrieval
www.statsqual.org
o Report Request and Generation
o Usage Aggregation
o Comparison
DatabaseVendors
User Interface
Figure 3. Key Processes for Distributed Access to Vendor Usage Statistics
UsageStatistics
UsageStatistics
UsageStatistics
UsageStatistics
Gateway
GatewayWeb Service Request &
Data Retrieval
Gateway
Gateway
www.statsqual.org
Interpreting results from individual libraries in the context of other sites
Analysis & Reporting - Issues
www.statsqual.org
