38
© 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

Embed Size (px)

Citation preview

Page 1: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc.

Taking the Library Back from Google

Abe Lederman, President and CTODeep Web TechnologiesMay 12, 2010

Page 2: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 2

The “Google Myth”

Page 3: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 3

Why Do Students LikeGoogle and Google

Scholar?

•It’s fast•It’s easy to use•It’s relevant•It’s FREE

Page 4: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 4

Library vs. Internet

“Nearly three-quarters (73%) of college students say they use the Internet more than the library, while only 9% said they use the library more than the Internet for information searching.” *Pew & Internet American Life, 2002

“Nearly three-quarters (73%) of college students say they use the Internet more than the library, while only 9% said they use the library more than the Internet for information searching.” *Pew & Internet American Life, 2002

Students Looking for Information

Page 5: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 5

Page 6: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 6

Page 7: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 7

What Students Don’t Know

1. Links for many articles on Google Scholar require subscriber login or an access fee.

2. Many libraries have already paid for subscriptions.

3. Other content may be more relevant to the topic.

4. Google Scholar advanced search is not very powerful.

Page 8: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 8

So Why NOT Google Scholar?

• “Scholarly content” intermixed with “non-scholarly” content

• Spotty coverage, requires publisher cooperation

• Poor relevance (citation counts don’t seem to help)

• Unable to limit searching to specific sources

• Difficult to find the needles in the haystack

Page 9: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 9

Bringing Relevance Back to the Library

Checking the Library Website…–Reference Libraries–Deep Web Databases–Specialized Search Directories–Specialized Search Engines–Subscription Databases–Library Catalogs

“Ask A Librarian!”

Page 10: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 10

Federated Search…

Page 11: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 11

Intranet

Journals

In Other Words…One Search, Many Sources

IP Authenticated

Small Publishers

eBooks

OPACS

Enter Your Search…Begin Search

Advanced Search

LibraryCatalog

Public Web Sources Blogs

Wikis

News Sources

Page 12: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 12

Tennant’s Tenets

• Only librarians like to search, everyone else likes to find.

• All things being equal, one place to search is better than two or more.

• Services should be placed as close to the user as possible.

Roy Tennant: Internationally known speaker and writer on library and information technology issues.

Page 13: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 13

Tennant’s Tenets (cont.)

•“Good enough” is often just that.•Our ability to create effective one-

stop searching is dependent on our ability to appropriately target user needs.

•The size of the result set doesn’t matter as much as how the results are presented. (‘the Google Lesson’)

Page 14: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 14

How can Federated Search Help Your Users?

Page 15: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 15

Benefits of Federated Search

•One-Stop Access•Support of More Efficient

Research•Consolidated, Formatted Results•Authentication and Access

Control

Page 16: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 16

One-Stop Access

Single query search across multiple disparate sources in real-time:

–Subscription services (journals, bibliographic databases, etc.)

–In-house databases

–Unstructured data (white papers, theses, reports, etc.)

–Catalogs (web-based OPAC)

–Publicly available databases

Information Discovery

Page 17: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 17

Support of More Efficient Research

Results across all selected sources are:

–Merged–Presented in relevance-

ranked order–Sorted–Clustered

Page 18: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 18

Consolidated, Formatted Results

•Filter and remove duplicates•Rank by relevance•Display results by source•Permit results to be

– Downloaded– Printed– Automatically emailed using Alerts

Page 19: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 19

Authentication and Access Control

•Authorization based on:– IP address– User ID and password

•Implementation using:– Proxy server– Link resolver– Management of session cookies

•Different access levels for different user groups

– Search Builder

Page 20: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 20

#1 Benefit to Libraries

Page 21: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 21

What does Federated Search look like?

wastewater treatment

Page 22: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 22

Automatic Alerts

Page 23: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 23

Smart Clustering

Filter and Sort Results

Page 24: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 24

Page 25: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 25

Page 26: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 26

Page 27: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 27

Page 28: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 28

Page 29: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 29

Bringing Federated Search

to Your Users•Search box on:

–Library web pages–Department websites–Course web page–Subject guides–Blogs–Facebook

Page 30: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 30

Search Builder

•Create custom search boxes and search pages easily

•Enable/disable collections and search fields

•Automatically generate search widget HTML

Page 31: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 31

Page 32: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 32

Page 33: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 33

Page 34: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 34

Not All Federated Search Engines Are Created Equal

• Easy-to-Use, Customizable Interface• Complete Source Coverage• Incremental display of real-time and

indexed results• Clustering• Relevance ranking of results on-the-fly• Support Boolean and fielded searching• Access sources via multiple protocols

(XML gateway, HTTP, Web Services, Z39.50)

Page 35: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 35

The Future of Federated Search

•Multi-Lingual Searching•Personal Libraries•Automated Source Selection•Integration with Social Networks

Page 36: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 36

Conclusion

•Help Users to…–Improve their search–Find what they need–Access scholarly sources

–Return to your library

for information

Page 37: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 37

Further Reading

Federated Search Bloghttp://www.federatedsearchblog.com

Page 38: © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

© 2010 Deep Web Technologies, Inc. 38

Thank You!

Abe [email protected]

Marieke [email protected]