Primoz Juznic, University of Ljubljana, Slovenia 1 Using a decision grid process to evaluate library collections on the way to post-print times Primoz

Primoz Juznic, University of LjubljanPrimoz Juznic, University of Ljubljana, Sloveniaa, Slovenia

11

Using a decision grid Using a decision grid process to evaluate process to evaluate

library collections on the library collections on the way to post-print timesway to post-print times

Primoz Juznic, University of Ljubljana, Primoz Juznic, University of Ljubljana, SloveniaSlovenia

Presented at Presented at LIBRARIES IN THE DIGITAL LIBRARIES IN THE DIGITAL AGE (LIDA) AGE (LIDA) Dubrovnik Dubrovnik 20072007


22

ChangeChange

Scholarly journal systems, as the basis of Scholarly journal systems, as the basis of a broader science information and a broader science information and communication system, are undergoing communication system, are undergoing tremendous change. Electronic versions tremendous change. Electronic versions of traditional journals change the of traditional journals change the publication system at the least by publication system at the least by merely providing more convenient merely providing more convenient access to subscription-based journals. access to subscription-based journals. They also change the way how the They also change the way how the journals can be purchased or users given journals can be purchased or users given access to it.access to it.


33

LibrariesLibraries

The new library environments, which have The new library environments, which have evolved as technology has developed, evolved as technology has developed, require new models of functioning and require new models of functioning and service provision. Libraries cannot continue service provision. Libraries cannot continue to make isolated and to make isolated and ad hocad hoc changes when changes when deemed necessary without considering the deemed necessary without considering the larger context and systemic changes. With larger context and systemic changes. With expanding demands for a full complement of expanding demands for a full complement of information and technology services, information and technology services, libraries are organized to ensure that their libraries are organized to ensure that their goals and purposes are achieved in the most goals and purposes are achieved in the most effective and economical manner.effective and economical manner.


44

Library budgetsLibrary budgets

With steady increases in the price of With steady increases in the price of journals journals subscriptions, the number of subscriptions, the number of subscriptions has declined subscriptions has declined correspondingly. Budget cuts are a correspondingly. Budget cuts are a steady and continuing reality for all steady and continuing reality for all research libraries. The vicious cycle of research libraries. The vicious cycle of cancelled journal subscriptions, leading cancelled journal subscriptions, leading to journal subscription price increases, to journal subscription price increases, leading to cancelled journal leading to cancelled journal subscription subscription ad infinitumad infinitum is well- is well-known... known...


55

UsersUsers

The most important cause for change in The most important cause for change in research libraries are its users. Many research libraries are its users. Many studies over the past decade show that the studies over the past decade show that the adoption rate for electronic journals, the adoption rate for electronic journals, the viability of alternatives to the traditional viability of alternatives to the traditional print peer-reviewed journal system, and print peer-reviewed journal system, and the pace of change, vary considerably by the pace of change, vary considerably by field, tasks, age or country. It is, therefore, field, tasks, age or country. It is, therefore, interesting and timely to see how much interesting and timely to see how much impact electronic alternatives have had on impact electronic alternatives have had on research library users and to compare their research library users and to compare their information seeking, their reading patterns information seeking, their reading patterns and their adoption rates. and their adoption rates.


66

User studiesUser studies

Several studies have also been found that Several studies have also been found that users from different subject disciplines users from different subject disciplines search differently for both electronic and search differently for both electronic and print material. Indeed, task, discipline, and print material. Indeed, task, discipline, and relevance of the collection appear to be relevance of the collection appear to be the main factors in explaining patterns of the main factors in explaining patterns of use. Consequently, print journals are use. Consequently, print journals are coupling, and more often, are being coupling, and more often, are being replaced by their electronic counterparts. replaced by their electronic counterparts. The shift from academic journal use in print The shift from academic journal use in print form to use of these materials in electronic form to use of these materials in electronic form by academics and researchers is form by academics and researchers is already well-known and documented.already well-known and documented.


77

New business modelsNew business models

Setting prices for serials has always been Setting prices for serials has always been an art rather than a science. Well an art rather than a science. Well perhaps the word art isn’t the most perhaps the word art isn’t the most accurate term. Instead it might be more accurate term. Instead it might be more accurate to say that how prices are set accurate to say that how prices are set for serials by publishes has continued to for serials by publishes has continued to be a mystery to librarians, and a most be a mystery to librarians, and a most unpredictable and frustrating mystery at unpredictable and frustrating mystery at that. While we know how it is done how that. While we know how it is done how the final price is arrived at remain black the final price is arrived at remain black hole. hole.


88

How to change it?How to change it?

The traditional journal subscription has The traditional journal subscription has served both publishers and librarians well, served both publishers and librarians well, but it is inflexible and unresponsive to but it is inflexible and unresponsive to changes in the complex and increasingly changes in the complex and increasingly changing library environment. The advent changing library environment. The advent of online information delivery has provided of online information delivery has provided publishers and librarians with the publishers and librarians with the opportunity to remodel the way they do opportunity to remodel the way they do business with each other. Valuing the business with each other. Valuing the content of the journal literature is not about content of the journal literature is not about what publishers think it is worth or what it what publishers think it is worth or what it has cost to produce the journal. Rather it is has cost to produce the journal. Rather it is about the value placed on it by their about the value placed on it by their customers in the communities they serve. customers in the communities they serve.


99

Selection/deselectionSelection/deselection

Librarians have struggled with how to best Librarians have struggled with how to best determine the value of a journal in the determine the value of a journal in the context of a library collection. For this one context of a library collection. For this one must factor in both the type of library and must factor in both the type of library and the needs of its users. the needs of its users. JJournals (and data ournals (and data bases) were evaluated based on different bases) were evaluated based on different criteria: money requirements and local criteria: money requirements and local issues (including accessibility, user needs, issues (including accessibility, user needs, etc.). Journals were then either given etc.). Journals were then either given grades or mapped into categories. This grades or mapped into categories. This evaluation was then used to justify evaluation was then used to justify selection decisions. selection decisions.


1010

Financing perspectiveFinancing perspective

In this paper a slightly different approach In this paper a slightly different approach is presented. The entire process, the is presented. The entire process, the criteria for collection evaluation, is criteria for collection evaluation, is presented from the financing presented from the financing perspective. The quantitative decision perspective. The quantitative decision grid evaluation process used by the grid evaluation process used by the national research financial body, the national research financial body, the Slovenian Research Agency (ARRSSlovenian Research Agency (ARRS)), , established in 2004, is described. established in 2004, is described.


1111

ARRSARRS

ARRS performs professional, ARRS performs professional, development and executive tasks development and executive tasks related to the National Research and related to the National Research and Development Programme. This is in Development Programme. This is in line with its status within the national line with its status within the national budget as well as other work it budget as well as other work it undertakes to promote research and undertakes to promote research and development activities in accordance development activities in accordance with its founding statute. with its founding statute.


1212

Advisory BoardAdvisory Board

AlthoughAlthough individual individual libraries were faced libraries were faced with the task of identifying which part of with the task of identifying which part of their resources subscriptions for their resources subscriptions for possible candidates for cancellation due possible candidates for cancellation due to the financial restraints, and how to to the financial restraints, and how to diminish any other costs, the Agency diminish any other costs, the Agency Had also the obligation to assure that Had also the obligation to assure that the best use of its funds are made. A the best use of its funds are made. A special special AAdvisory board was established, dvisory board was established, with ten members, all experts in the with ten members, all experts in the fields.fields.


1313

The goals were defined as:The goals were defined as:

Transparency,Transparency, Increased use of consortia and Increased use of consortia and

availability of electronic resources,availability of electronic resources, Improvement of library systems and Improvement of library systems and

the quality of service,the quality of service, Better funding.Better funding.


1414

CriteriaCriteria

Following these goals the criteria for evaluating Following these goals the criteria for evaluating libraries and their collections were proposed. libraries and their collections were proposed. These were discussed through different These were discussed through different Committees of the Agency, approved and Committees of the Agency, approved and published. Different quantitative evaluation published. Different quantitative evaluation elements were chosen. The decisive points elements were chosen. The decisive points were given to the quality of the collection but were given to the quality of the collection but some elements also measure the quality of some elements also measure the quality of library services. Special care was given to library services. Special care was given to encourage cooperation and the encourage cooperation and the establishment of consortia.establishment of consortia.


1515

QUANTITATIVE EVALUATION QUANTITATIVE EVALUATION ELEMENTSELEMENTS

AvailabilityAvailability UseUse Continuity of ordersContinuity of orders Professional staff to work with usersProfessional staff to work with users Additional founding form other (non-state Additional founding form other (non-state

funds)funds) Quality and importance of serial Quality and importance of serial

publicationspublications Economically and rationalityEconomically and rationality InfrastructureInfrastructure ConsortiaConsortia


1616

ResultsResults

For the For the thirdthird year in the row, new decision year in the row, new decision grid was used to evaluate the proposals for grid was used to evaluate the proposals for financing and library collections of almost financing and library collections of almost 100 research libraries in Slovenia. Each 100 research libraries in Slovenia. Each year the list of quantitative evaluation year the list of quantitative evaluation elements are prepared and they are the elements are prepared and they are the basis for funding decisions. The results are basis for funding decisions. The results are so far positiveso far positive.. CCriteria has stirred the riteria has stirred the consortia involvement and participation, consortia involvement and participation, selection/deselection on the basis of the selection/deselection on the basis of the quality of journals and moving to electronic quality of journals and moving to electronic journal collections.journal collections.

Documents

Primoz Juznic, University of Ljubljana, Slovenia 1 Using a decision grid process to evaluate library collections on the way to post-print times Primoz