Library Automation Library Automation Challenges for the Next Challenges for the Next GenerationGeneration

Tuesday 26 August 2008

Tias building, room TZ 9)

Marshall BreedingMarshall BreedingDirector for Innovative Technologies and ResearchDirector for Innovative Technologies and ResearchVanderbilt UniversityVanderbilt University

http://staffweb.library.vanderbilt.edu/breedinghttp://www.librarytechnology.org/

AbstractAbstract

As libraries shift toward collections of ever higher proportions of digital content, As libraries shift toward collections of ever higher proportions of digital content, automation systems must likewise take a new form. This lecture will review the automation systems must likewise take a new form. This lecture will review the current state of library automation systems and the business climate among the current state of library automation systems and the business climate among the companies that provide them.companies that provide them.

Recent rounds of industry consolidation resulted in an uncomfortable narrowing of Recent rounds of industry consolidation resulted in an uncomfortable narrowing of products from the traditional automation vendors. A harsh business climate products from the traditional automation vendors. A harsh business climate contributed to the rise of the open source movement which has introduced a new contributed to the rise of the open source movement which has introduced a new dynamic in the marketplace. Open source library automation has now entered the dynamic in the marketplace. Open source library automation has now entered the mainstream, with support options available from a new breed of companies. mainstream, with support options available from a new breed of companies. Traditional automation vendors face new competition. Libraries themselves have Traditional automation vendors face new competition. Libraries themselves have also become involved through initiatives to produce open source products, also become involved through initiatives to produce open source products, contributing new alternatives to the mix.contributing new alternatives to the mix.

A new generation of library interfaces has begun to emerge that promise to put a A new generation of library interfaces has begun to emerge that promise to put a modern face on the library’s collections and services on the Web. Libraries also modern face on the library’s collections and services on the Web. Libraries also demand better tools for managing electronic resources behind-the-scenes, fueling demand better tools for managing electronic resources behind-the-scenes, fueling demand for electronic management systems. In broader terms, the molds of the demand for electronic management systems. In broader terms, the molds of the library automation systems in place today were cast decades ago.library automation systems in place today were cast decades ago.

The presentation will explore the characteristics that a generation of library The presentation will explore the characteristics that a generation of library automation systems built anew for today’s libraries moving forward would automation systems built anew for today’s libraries moving forward would embrace. embrace.

Part I. Part I. Broad Industry and Broad Industry and Product TrendsProduct Trends

UpheavalsUpheavals

Industry ConsolidationIndustry Consolidation Abrupt transitions for major library Abrupt transitions for major library

automation productsautomation products Increased industry control by external Increased industry control by external

financial investorsfinancial investors Demise of the traditional OPACDemise of the traditional OPAC Frustration with ILS products and Frustration with ILS products and

vendorsvendors Open Source alternatives hit the Open Source alternatives hit the

mainstreammainstreamBreeding, Marshall: Perceptions 2007 an international survey of library automation. http://www.librarytechnology.org/perceptions2007.pl January 2008.

LJ Automation System LJ Automation System MarketplaceMarketplace Annual Industry report published in Annual Industry report published in

Library JournalLibrary Journal 2008: Opportunity out of turmoil 2008: Opportunity out of turmoil 2007: An industry redefined 2007: An industry redefined 2006: Reshuffling the deck 2006: Reshuffling the deck 2005: Gradual evolution 2005: Gradual evolution 2004: Migration down, innovation up 2004: Migration down, innovation up 2003: The competition heats up 2003: The competition heats up 2002: Capturing the migrating customer 2002: Capturing the migrating customer

ILS Industry in ILS Industry in TransitionTransition

Consolidation through mergers and Consolidation through mergers and acquisitions have resulted in a fewer acquisitions have resulted in a fewer number of players; larger companiesnumber of players; larger companies

Uncomfortable level of product Uncomfortable level of product narrowingnarrowing

Increased ownership by external Increased ownership by external interestsinterests

Yet: Some companies and products Yet: Some companies and products continue on solid groundcontinue on solid ground

Breeding, Marshall “Automation system marketplace 2008: Opportunity Out of Turmoil” Library Journal. April 1, 2008.

Library Automation Library Automation M&A HistoryM&A History

Product and Product and Technology TrendsTechnology Trends Innovation below expectationsInnovation below expectations Conventional ILS less tenableConventional ILS less tenable Proliferation of products related Proliferation of products related

to e-content managementto e-content management New genre of discovery-layer New genre of discovery-layer

interfacesinterfaces

Web 2.0 / Web 2.0 / Collaborative Collaborative ComputingComputing

Currently implemented ad hocCurrently implemented ad hoc Many libraries putting up blogs, wikis, and Many libraries putting up blogs, wikis, and

fostering engagement in social networking fostering engagement in social networking sitessites

Proliferation of silos with no integration or Proliferation of silos with no integration or interoperability with larger library Web interoperability with larger library Web presencepresence

Next Gen: Build social and collaborative Next Gen: Build social and collaborative features into core automation componentsfeatures into core automation components

Part II. A Mandate Part II. A Mandate for Opennessfor Openness

Opportunities for Opportunities for OpennessOpenness

Open SourceOpen Source– Alternative to traditionally licensed softwareAlternative to traditionally licensed software

Open SystemsOpen Systems– Software that doesn’t hold data hostageSoftware that doesn’t hold data hostage

Open ContentOpen Content– Open access platforms for scholarly contentOpen access platforms for scholarly content– Institutional RepositoriesInstitutional Repositories– Bibliographic Services (OpenLibrary)Bibliographic Services (OpenLibrary)– Open content communities for tags, cover art, Open content communities for tags, cover art,

reviews (LibraryThing)reviews (LibraryThing)– OpenURL / ERMS Knowledgebases? (JAKE)OpenURL / ERMS Knowledgebases? (JAKE)

Open Source AlternativesOpen Source Alternatives

Explosive interest in Open Source driven Explosive interest in Open Source driven by disillusionment with current vendors by disillusionment with current vendors and near-evangelical promotion of this and near-evangelical promotion of this software licensing modelsoftware licensing model

Beginning to emerge as a practical optionBeginning to emerge as a practical option TOC (Total Cost of Ownership) still roughly TOC (Total Cost of Ownership) still roughly

equal to proprietary commercial modelequal to proprietary commercial model Still a risky strategy for libraries – Still a risky strategy for libraries –

traditional licensing also riskytraditional licensing also risky

A result of industry A result of industry turmoilturmoil Disruptions and business decisions Disruptions and business decisions

to narrow options have fueled the to narrow options have fueled the open source movementopen source movement

Benefit to libraries in having Benefit to libraries in having additional optionsadditional options

Traditionally licensed and open Traditionally licensed and open source ILS alternatives will coexist source ILS alternatives will coexist in the ILS arenain the ILS arena

Open Source ILS enters Open Source ILS enters the mainstreamthe mainstream

Earlier era of pioneering efforts to Earlier era of pioneering efforts to ILS shifting into one where open ILS shifting into one where open source alternatives fall in the source alternatives fall in the mainstreammainstream

Off-the-shelf, commercially Off-the-shelf, commercially supported product availablesupported product available

Still a minority player, but gaining Still a minority player, but gaining groundground

Open Source ILS Open Source ILS optionsoptions KohaKoha

– Commercial support from LibLimeCommercial support from LibLime EvergreenEvergreen

– Commercial support from Equinox Commercial support from Equinox SoftwareSoftware

OPALSOPALS– Commercial support from Media FlexCommercial support from Media Flex

NewGenLibNewGenLib– Open Source ILS for the developing worldOpen Source ILS for the developing world

Business case for Open Business case for Open Source ILSSource ILS

Comparative total cost of ownershipComparative total cost of ownership Evaluate features and functionalityEvaluate features and functionality Evaluate technology platform and Evaluate technology platform and

conceptual modelsconceptual models Are they next-generation systems or Are they next-generation systems or

open source version of legacy open source version of legacy models?models?

“Making a Business Case for Open Source ILS.” Marshall Breeding, Computers in Libraries March 2008http://www.librarytechnology.org/ltg-displaytext.pl?RC=13134

Software Software Development ModelsDevelopment Models

How do companies approach software How do companies approach software development:development:– Ongoing maintenance work on existing Ongoing maintenance work on existing

products (enhancement requests, bug fixes)products (enhancement requests, bug fixes)– R&D toward future products (capital R&D toward future products (capital

investment)investment)– Sponsored Development: contracted Sponsored Development: contracted

custom development paid for by individual custom development paid for by individual sites, code shared with current and future sites, code shared with current and future implementers.implementers.

Observations on Open Observations on Open Source ILSSource ILS

Current Open Source ILS products similar in modular Current Open Source ILS products similar in modular organization and functionality to existing systems. organization and functionality to existing systems. Evolving to achieve the same level of features and Evolving to achieve the same level of features and capacity present in established commercial systems.capacity present in established commercial systems.

Initial wave of Open Source ILS commitments Initial wave of Open Source ILS commitments happened in the public library arena. Recent activity happened in the public library arena. Recent activity among academic libraries:among academic libraries:– WALDO Consortium (Voyager > Koha)WALDO Consortium (Voyager > Koha)– University of Prince Edward Island (Unicorn > Evergreen) University of Prince Edward Island (Unicorn > Evergreen)

Do the current open source ILS products provide a Do the current open source ILS products provide a new model of automation, or an open source version new model of automation, or an open source version of what we already have?of what we already have?

JISC – SCONUL study did not show strong interest in JISC – SCONUL study did not show strong interest in open source ILS in the UK.open source ILS in the UK.

Impact of Open Source Impact of Open Source ILSILS Library automation industry cannot be Library automation industry cannot be

complacentcomplacent Some libraries moving from traditionally Some libraries moving from traditionally

licensed products to open source licensed products to open source products with commercial support plansproducts with commercial support plans

Disruption of ILS industryDisruption of ILS industry– new pressures on incumbent vendors to new pressures on incumbent vendors to

deliver more innovation and to satisfy deliver more innovation and to satisfy concerns for opennessconcerns for openness

New competition / More options New competition / More options

More Open SystemsMore Open Systems

Pressure for traditionally licensed products to become Pressure for traditionally licensed products to become more openmore open

APIs (Application Programming Interfaces) let libraries APIs (Application Programming Interfaces) let libraries access and manipulate their data outside of delivered access and manipulate their data outside of delivered softwaresoftware

A comprehensive set of APIs potentially give libraries A comprehensive set of APIs potentially give libraries more flexibility and control in accessing data and more flexibility and control in accessing data and services and in extending functionality than having services and in extending functionality than having access to the source code.access to the source code.

Customer access to APIs does not involve as much risk Customer access to APIs does not involve as much risk to breaking core system functions, avoids issues of to breaking core system functions, avoids issues of version management and code forking associated with version management and code forking associated with open source models.open source models.

A Continuum of A Continuum of OpennessOpenness

Closed SystemsClosed Systems

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

No programmable Access to the system.

Captive to the userInterfaces supplied by the developer

Programmer access:

Standard RDBM Standard RDBM SystemsSystems

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Database administrators can access data stores involved with the system:

Read-only?Read/write?

Developer shares database schema

Programmer access:

Open Source ModelOpen Source Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

All aspects of the system available to inspection and modification.

Programmer access:

Open API ModelOpen API Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Core application closed.

Third party developers code against the published APIs or RDBMS tables.

Programmer access:

Published APIs

Open Source / Open Open Source / Open API ModelAPI Model

Circulation AcquisitionsCataloging

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

Core application closed.

Third party developers code against the published APIs or RDBMS tables.

Programmer access:

Published APIs

Depth of OpennessDepth of Openness

Evaluate level of access to a products data Evaluate level of access to a products data stores and functional elements:stores and functional elements:– Open source vs Traditional licensesOpen source vs Traditional licenses

Some traditional vendors have well Some traditional vendors have well established API implementationsestablished API implementations– SirsiDynix Unicorn (API available to authorized SirsiDynix Unicorn (API available to authorized

customer sites that take training program)customer sites that take training program)– Ex Libris: consistent deployment of APIs in major Ex Libris: consistent deployment of APIs in major

products, recent strategic initiative: “Open products, recent strategic initiative: “Open Platform Program”Platform Program”

– Innovative Interfaces: Patron APIInnovative Interfaces: Patron API

Universal open APIs?Universal open APIs?

Some progress on API to support discovery layer Some progress on API to support discovery layer interfaces, but no comprehensive framework yet.interfaces, but no comprehensive framework yet.

Many industry protocols work like APIs: Many industry protocols work like APIs: – Z39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etdZ39.50, SRU/W, NCIP, OAI-PMH, OpenURL, etd

It would be ideal if there were an open set of APIs that It would be ideal if there were an open set of APIs that were implemented by all automation system products.were implemented by all automation system products.– Third party components and add-ons would then work Third party components and add-ons would then work

across all products.across all products. DLF ILS-Discovery Interface protocol. Targets DLF ILS-Discovery Interface protocol. Targets

interoperability between ILS and new genre of interoperability between ILS and new genre of interfacesinterfaces

AKA: Berkeley AccordsAKA: Berkeley Accords

Opportunity out of the Opportunity out of the UpheavalsUpheavals

More optionsMore options– Commercial + Open SourceCommercial + Open Source

More vendorsMore vendors– New open source support companies provide New open source support companies provide

new competitionnew competition More library involvementMore library involvement

– Libraries re-energized to make significant Libraries re-energized to make significant contributions to the body of library automation contributions to the body of library automation softwaresoftware

Traditionally licensed and open source Traditionally licensed and open source automation systems will co-exist. We have automation systems will co-exist. We have an interest in the success of both an interest in the success of both alternatives.alternatives.

Part III. Moving Part III. Moving toward new toward new generation of library generation of library automationautomation

Rethinking the ILSRethinking the ILS

Fundamental assumption: Print + Digital = Hybrid Fundamental assumption: Print + Digital = Hybrid librarieslibraries

Traditional ILS model not adequate for hybrid Traditional ILS model not adequate for hybrid librarieslibraries

Libraries currently moving toward surrounding core Libraries currently moving toward surrounding core ILS with additional modules to handle electronic ILS with additional modules to handle electronic contentcontent

New discovery layer interfaces replacing or New discovery layer interfaces replacing or supplementing ILS OPACSsupplementing ILS OPACS

Working toward a new model of library automationWorking toward a new model of library automation– Monolithic legacy architectures replaced by fabric of SOA Monolithic legacy architectures replaced by fabric of SOA

applicationsapplications– Comprehensive Resource ManagementComprehensive Resource Management

“It's Time to Break the Mold of the Original ILS” Computers in Libraries Nov/Dec 2007

ILS: a legacy concept?ILS: a legacy concept?

ILS = Integrated Library System ILS = Integrated Library System (Cataloging + Circulation + OPAC + Serials + (Cataloging + Circulation + OPAC + Serials +

Acquisitions)Acquisitions) Focused on print and physical inventoryFocused on print and physical inventory Electronic content at the Journal Title or Electronic content at the Journal Title or

collection levelcollection level Emerged in the 1960’s – 1970’sEmerged in the 1960’s – 1970’s Functionality has evolved and expanded, but Functionality has evolved and expanded, but

basic concepts and modules remain intactbasic concepts and modules remain intact Note: Some companies work toward evolving the Note: Some companies work toward evolving the

ILS to competently handle both print and digital ILS to competently handle both print and digital content (e.g. Innovative Interfaces)content (e.g. Innovative Interfaces)

ILS: ever diminishing ILS: ever diminishing rolerole Many libraries putting much less emphasis Many libraries putting much less emphasis

on ILSon ILS Just an inventory system for physical Just an inventory system for physical

materialsmaterials Investments in electronic content increasingInvestments in electronic content increasing Management of e-content handled outside of Management of e-content handled outside of

the ILSthe ILS Yet: libraries need comprehensive business Yet: libraries need comprehensive business

automation more than ever. Mandate for automation more than ever. Mandate for more efficient operations. Do more with less.more efficient operations. Do more with less.

Dis-integration of Library Dis-integration of Library Automation FunctionalityAutomation Functionality

ILS -- Print and Physical inventoryILS -- Print and Physical inventory OpenURL Link resolverOpenURL Link resolver Federated SearchFederated Search Electronic Resource Management Electronic Resource Management

ModuleModule Discovery layer interfaceDiscovery layer interface

Is non-integrated Is non-integrated automation sustainable?automation sustainable?

Major burden on library personnelMajor burden on library personnel Serial procurement / installation / Serial procurement / installation /

configuration / maintenance cycles take configuration / maintenance cycles take many years to result in a many years to result in a comprehensive environmentcomprehensive environment

Inefficient data modelsInefficient data models Disjointed interfaces for library usersDisjointed interfaces for library users Very long cycle to gain comprehensive Very long cycle to gain comprehensive

automationautomation

New genre of discovery New genre of discovery layer interfaceslayer interfaces

Traditional ILS OPAC inadequate for Traditional ILS OPAC inadequate for today’s Web-savvy library userstoday’s Web-savvy library users

Scope too narrowScope too narrow Complex, non-intuitive interfaceComplex, non-intuitive interface Yet: Necessary for some types of Yet: Necessary for some types of

researchresearch Working toward a single point of Working toward a single point of

entry for all the content and services entry for all the content and services offered by the libraryoffered by the library

Common Next-Gen Common Next-Gen Interface featuresInterface features

Decoupled interfaceDecoupled interface Advanced search enginesAdvanced search engines Relevancy ranked resultsRelevancy ranked results Faceted NavigationFaceted Navigation Graphically enriched displaysGraphically enriched displays Real-time interaction with ILSReal-time interaction with ILS Advanced user services and Advanced user services and

information delivery featuresinformation delivery features

Current ProductsCurrent Products

Aquabrowser (Medialab, Bowker / Serials Solutions)Aquabrowser (Medialab, Bowker / Serials Solutions) Primo (Ex Libris)Primo (Ex Libris) Encore (Innovative Interfaces)Encore (Innovative Interfaces) WorldCat Local (OCLC)WorldCat Local (OCLC) BiblioCommonsBiblioCommons Visualizer (VTLS)Visualizer (VTLS) eXtensive Catalog (University of Rochester)eXtensive Catalog (University of Rochester) VUFind (open source / Villanova University)VUFind (open source / Villanova University) Scriblio (open source)Scriblio (open source)

http://www.librarytechnology.org/discovery.plhttp://www.librarytechnology.org/discovery.pl

Deep searchDeep search

Entering post-metadata search eraEntering post-metadata search era Increasing opportunities to search the full contentsIncreasing opportunities to search the full contents

– Google Library Print, Google Publisher, Open Content Alliance, Google Library Print, Google Publisher, Open Content Alliance, Microsoft Live Book Search, etc.Microsoft Live Book Search, etc.

– High-quality metadata will improve search precisionHigh-quality metadata will improve search precision Commercial search providers already offer “search inside the Commercial search providers already offer “search inside the

book”book” No comprehensive full text search for books quite yetNo comprehensive full text search for books quite yet Beginning to appear in library search environmentsBeginning to appear in library search environments

– U of Mich (U of Mich (http://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.htmlhttp://mblog.lib.umich.edu/blt/archives/2008/05/search_full-tex.html ) ) Deep search highly improved by high-quality metadataDeep search highly improved by high-quality metadata

See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: See: Systems Librarian, May 2008 “Beyond the current generation of next-generation interfaces: deeper search”deeper search”

Architecture and Architecture and StandardsStandards Need to have an standard approach for Need to have an standard approach for

connecting new generation interfaces with connecting new generation interfaces with ILS and other repositoriesILS and other repositories

Proprietary and Proprietary and ad hocad hoc methods currently methods currently prevailprevail

Digital Library FederationDigital Library Federation– ILS-Discovery Interface GroupILS-Discovery Interface Grouphttp://www.librarytechnology.org/blog.pl?ThreadID=43 http://www.librarytechnology.org/blog.pl?ThreadID=43

Initial foray into a broader set of protocols Initial foray into a broader set of protocols that open up other aspects of the ILSthat open up other aspects of the ILS

Moving toward a new Moving toward a new Generation of Library Generation of Library AutomationAutomation Are Legacy ILS concepts Are Legacy ILS concepts

sustainable?sustainable? New automation environment New automation environment

based on current library realities based on current library realities and modern technology platformsand modern technology platforms

Equal footing for digital and printEqual footing for digital and print Service oriented architectureService oriented architecture

Breaking down the Breaking down the modulesmodules Traditional ILSTraditional ILS

– CatalogingCataloging– CirculationCirculation– Online CatalogOnline Catalog– AcquisitionsAcquisitions– Serials controlSerials control– ReportingReporting

Modern approach: SOAModern approach: SOA

Service Oriented Service Oriented ArchitectureArchitecture

http://www.sun.com/products/soa/benefits.jsp

Legacy ILS + e-Legacy ILS + e-content modulescontent modules

FederatedSearch

FederatedSearch

Circulation Acquisitions

Cataloging Serials

OpenURLLinking

OpenURLLinking

Electronic Resource

MgmtSystem

Electronic Resource

MgmtSystem

Staff Interfaces:

End User Interfaces:

Data Stores:

Functionalmodules:

SOA model for business SOA model for business automationautomation

Underlying data repositoriesUnderlying data repositories– Local or GlobalLocal or Global

Reusable business servicesReusable business services Composite business applicationsComposite business applications

SOA for library workflow SOA for library workflow processesprocesses

Data Stores:

ReusableBusiness Services

CompositeApplications

Granulartasks:

Comprehensive Comprehensive Resource Management Resource Management

Broad conceptual approach that proposes a Broad conceptual approach that proposes a library automation environment that spans library automation environment that spans all types of content that comprise library all types of content that comprise library collections.collections.

Traditional ILS vendors: Under development Traditional ILS vendors: Under development but no public announcementsbut no public announcements

Open Source projects in early phasesOpen Source projects in early phases Projection: 2-3 years until we begin see Projection: 2-3 years until we begin see

library automation systems that follow this library automation systems that follow this approach. 5-7 years for wider adoption.approach. 5-7 years for wider adoption.

Open Library Open Library Environment (OLE) Environment (OLE) projectproject Andrew W. Mellon Foundation Andrew W. Mellon Foundation

– Research in Information Technology programResearch in Information Technology program– Solicited proposal / Lead institutionSolicited proposal / Lead institution

Duke University selected to lead projectDuke University selected to lead project Core Participants: Kansas University, Lehigh Core Participants: Kansas University, Lehigh

University, National Library of Australia, Library and University, National Library of Australia, Library and Archives Canada, University of Pennsylvania, Marshall Archives Canada, University of Pennsylvania, Marshall BreedingBreeding

Advisory Participants: University of Chicago, Wittier Advisory Participants: University of Chicago, Wittier College, University of Maryland, ORBIS Cascade College, University of Maryland, ORBIS Cascade Alliance, Rutgers UniversityAlliance, Rutgers University

Status: Proposal complete, pending formal approval Status: Proposal complete, pending formal approval from the Andrew W. Mellon Foundationfrom the Andrew W. Mellon Foundation

http://oleproject.org

Preparing for next Preparing for next generation library generation library automationautomation

Reassess workflowsReassess workflows Separate streams for print and digital?Separate streams for print and digital? Integrated processing of print and Integrated processing of print and

digital?digital? Opportunities to take advantage of Opportunities to take advantage of

SOA-based composite business SOA-based composite business applicationsapplications

Assemble a more ideal set of tools for Assemble a more ideal set of tools for managing serials and periodicalsmanaging serials and periodicals

Practical implicationsPractical implications

Determine the level of openness your Determine the level of openness your library requireslibrary requires

Off-the-shelf, traditionally licensed systems Off-the-shelf, traditionally licensed systems preferred in many librariespreferred in many libraries

Identify issues:Identify issues:– Vendor vulnerabilityVendor vulnerability– Flexibility to reprogramFlexibility to reprogram– Special reporting needsSpecial reporting needs

Cost of operationCost of operation Software-as-a-serviceSoftware-as-a-service Research and Development toward next-Research and Development toward next-

generation automation systemsgeneration automation systems

Questions and Questions and DiscussionDiscussion