90
How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox [email protected] CC CS DLRL Internet TIC Virginia Tech, Blacksburg, VA, USA

How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox [email protected] CC CS DLRL Internet TIC

Embed Size (px)

Citation preview

Page 1: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

How to Build Digital Libraries: A Methodology

and Examples (NDLTD, CSTC)

Kyoto UniversityJuly 22, 1999

Edward A. Fox [email protected]

CC CS DLRL Internet TIC

Virginia Tech, Blacksburg, VA, USA

Page 2: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Acknowledgements (Selected)

Trip Support: NAIST, NEC, Ricoh, ULIS

Sponsors: ACM, Adobe, IBM, Microsoft, NSF, OCLC, US Dept. of Education, …

Co-PIs: Marc Abrams, Robert Akscyn, John Eaton, Brian Kleiner, Gail McMillan

Students: Fernando Das Neves, Robert France, Neill Kipp, Paul Mather, Constantinos Phanouriou, James Powell, Ohm Sornil, David Watkins, Chang Zhang, Jianxin Zhao

Page 3: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Remember!

5S (to understand and build DLs)

NDLTD (join! support!)

NUDL (help with matching efforts)

CSTC, CRIM (add to, use)

Page 4: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 5: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

How do universities anddigital libraries relate?

Each U. will have its own digital library. Hence there will be large numbers (i.e., critical mass).

All students will learn how to use and how to “feed” digital libraries (and bring those habits to future work as needs and skills).

All digital library problems (esp. federation, flexibility, personalization) appear at U’s (so they are a good type of testbed, with willing collaborators in-place for developing solutions).

Page 6: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Digital Libraries --- Virginia Tech MARIAN (NLM) CS DL Prototype - ENVISION (NSF, ACM) TULIP (Elsevier, OCLC) DL for CS Education - EI (NSF, ACM) WATERS, NCSTRL (NSF) NDLTD (SURA, US Dept. of Education) CSTC (NSF, ACM) CRIM (NSF, SIGMM) WCA (Log) Repository (W3C) VT-PetaPlex-1 (Knowledge Systems)

Page 7: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Virginia Tech Background Largest university in Virginia, land-grant, town population

35K plus 25K students Blacksburg Electronic Village, since 1992, with 80% of

community on Internet Net.Work.Virginia, largest ATM network, with over 600 sites,

for education, research, govt LMDS, Local Multipoint Distribution Service, gigabit wireless

networking - 1/3 of Virginia Math Emporium, 500 workstations Faculty Development Initiative, round 2

Page 8: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Supporting Authors (Teachers and Learners)

FacultyDevelop.Initiative

ETDSupport

Virginia TechDigital Library

UniversityLibraries

Classifying/Cataloging/Preserving

Collaboration

Visualization

MM

IR

EPub

HCI

Model Classroom of the 21st CenturyTechnology Showcase ATM Video Conf. Develop MM

New MediaCenter

ScholarlyPublishing

Page 9: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

ACITC Advanced Communications and Information Technology

Center, opening summer 2000 Connects to the library, with a focus on IT 1/3 high-tech (multimedia) classrooms 1/3 digital/electronic library (reading room) 1/3 research labs: 10, including:

– Digital Library Research Laboratory (DLRL)– Center for Applied Technologies in the Humanities– HCI; HPC; Multimedia; Visualization (CAVE), ...

Page 10: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Digital Libraries --- Objectives

World Lit.: 24hr / 7day / from desktop Integrated “super” information systems: 5S: streams,

structures, spaces, scenarios, societies Ubiquitous, Higher Quality, Lower Cost Education, Knowledge Sharing, Discovery Disintermediation -> Collaboration Universities Reclaim Property Interactive Courseware, Student Works Scalable, Sustainable, Usable, Useful

Page 11: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 12: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

DLs: Why of Global Interest? National projects can preserve antiquities and heritage:

cultural, historical, linguistic, scholarly Knowledge and information are essential to economic and

technological growth, education DL - a domain for international collaboration

– wherein all can contribute and benefit

– which leverages investment in networking

– which provides useful content on Internet & WWW

– which will tie nations and peoples together more strongly and through deeper understanding

Page 13: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

NUDL

1/15/99 NUDL proposal to NSF under DLI2 international program– VT: Library, Grad School, Industrial&Systems Eng.– Partners: UK (2) , Singapore, Russia, Korea, Greece, Germany,

plus Iberoamerican group (Spain, Portugal, Argentina, Brazil, Chile, Mexico)

– Problems: Multilingual search, multimedia submissions, requirements/usability, …

Start with ETDs, then expand to other student works, portfolios, data sets, (CS) courseware, ...

Page 14: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

National Coverage (red/white)

Page 15: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

NUDL Partners

Ricardo A. Baeza-Yates, Universidad de Chile, Chile José Luis Brinquete Borbinha, Biblioteca Nacional, Portugal José Hilario Canós Cerdá, Universidad Politécnica de Valencia, Spain Stavros Christodoulakis, Technical University of Crete, Greece Lautaro Guerra Genskowsky, Universidad Técnica Federico Santa Maria,Chile Juan José Goldschtein, Univesidad de Belgrano, Argentina Peter Diepold, Humboldt University, Germany Francisco Javier Jaén Martinez, Spain Sung Hyon Myaeng, Chungnam National University, Korea Ana Maria Beltran Pavani, Prédio Cardeal Leme, Brazil Lim Ee Peng, Nanyang Technological University, Singapore Alexander I. Plemnek, St.-Petersburg State Technical University, Russia J. Alfredo Sánchez, Universidad de las Américas-Puebla, Mexico

Page 16: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 17: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

How to Build a Digital Library

Understand the problem (using the 5S

Framework)

Solve the problem (using the Star

Methodology)

– design, develop, evaluate,

– refine, operate

Page 18: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

5S Layers

Societies

Scenarios

Spaces

Structures

Streams

Page 19: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Definition: Digital Libraries are complex systems that

help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)

Page 20: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Definition: 5S Framework Societies: interacting people (, computers) Scenarios: services, functions, operations, methods Spaces: domains + constraints (e.g., distance,

adjacency): 2D, vector, probability Structures: relations, trees, nodes and arcs Streams: sequences of items (text, audio, video,

network traffic) (5 Element System: Fire, Wood, Earth, Metal, Water)

Page 21: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

5S: Components

Societies: roles, rituals, reasons, relationships, artifacts Scenarios: acquire, index, consult, administer, preserve Spaces: physical, temporal, functional, presentational,

conceptual Structures: architectures, taxonomies, schema,

grammars, links, objects Streams: granularities, protocols, paths, flows,

turbulences

Page 22: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

5S: Combinations

Societies + Scenarios = user model Societies + Scenarios + Spaces = user

interface Streams + Structures = markup Streams + Structures + Scenarios = object Structures + Scenarios = DBMS

Page 23: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Star Methodology

Page 24: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Neill Kipp Dissertation

Training interested groups about 5S and the Star Methodology, refining the Framework to have solid mathematical foundation

Case studies of projects at Virginia Tech or involving VT staff/students: CSTC, NDLTD, NARA (National Archives, with SAIC), Lexis, ...

Open also to study DL projects elsewhere Focusing too on the design artifacts developed and related

issues of efficient description and representation (esp. with markup, hypermedia)

Page 25: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 26: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

A Digital Library Case StudyDomain: graduate education,

researchGenre:ETDs=electronic

theses & dissertationsSubmission: http://etd.vt.eduCollection:

http://www.theses.org

Project: Networked Digital Library of Theses & Dissertations (NDLTD) http:// www.ndltd.org

Page 27: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

ETDInitiative

SGML (1985)

PDF(1992)

DL (1994)

LibraryCancellations

(1988)

UniversityScholarlyElectronic

Pub. (1988)

Info.Literacy(1995)

GraduateEducation

Internet(1984)

WWW(1994)

Multimedia(1986)

Page 28: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Media

ETD Web Sitehttp://www.ndltd.org/

ETDs Got Your Interest?

Graduate Students

Singapore AMChronicle of Higher Ed.National Public RadioNY Times ...

U. Laval

Page 29: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Key Ideas: Networked infrastructure

Scalability

Education is the rationale

University collaboration

Workflow, automation

Authors must submitMaximal access

PDF, SGML, MMStandards

Federated search

8th graders vs. grads

MARC, DC, URNs

Page 30: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

What led to today’s meeting? 1987 mtg in Ann Arbor: UMI, VT, … 1992 mtg in Washington: CNI, CGS, UMI, VT and 10

universities with 3 reps each 1993 mtg in Atlanta to start Monticello Electronic Library

(MEL): SURA, SOLINET 1994 mtg in Blacksburg re ETD project: std of PDF + SGML

+ multimedia objects 1996 funding by SURA, US Dept. of Education (FIPSE) for

regional, national projects 1997 meetings in UK, Germany, ...

Page 31: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Aiding universities to enhance grad educ., publishing and IPR efforts

Helping improve the availability and content of theses and dissertations

Educating ALL future scholars so they can publish electronically and effectively use digital libraries (i.e., are Information Literate and can be more expressive)

What are we doing?

Page 32: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

What are the long term goals? 400K US students / year getting grad degrees are

exposed / involved 200K/yr rich hypermedia ETDs that may turn into

electronic portfolios Dramatic increase in knowledge sharing: lit.

reviews, bibliographies, … Services providing lifelong access for students:

browse, search, prior searches, citation links

Page 33: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

NDLTD

Computer Resources

Research

Literature

Student Prepares Thesis or Dissertation

Page 34: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Student Defends and Finalizes ETD

My Thesis

ETD

Page 35: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Student Gets Committee Signatures and Submits ETD

Signed

Grad School

Page 36: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Graduate School Approves ETD Student is Graduated

Ph.D.

Page 37: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Library Catalogs ETD and New StudentsHave Access to the New Research

WWW

NDLTD

Page 38: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Status of the Local Project Approved by university governance Spring

1996; required starting 1/1/97 Submission & access software in place Submission workshops for students (and

faculty) occur often: beginner/adv. Faculty training as part of Faculty

Development Initiative Over 2000 ETDs in collection

Page 39: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 40: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Institutional Members

Coalition for Networked Information (CNI)Committee on Inst. Coop. (CIC)Diplomica.comDissertation.comNational Library of PortugalUNESCO

Page 41: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

US University Members U. of Iowa U. of Maine U. of Oklahoma U. of South Florida U. of Tennessee, Knoxville U. of Tennessee, Memphis U. of Texas at Austin U. of Virginia U. Wisconsin - Madison Vanderbilt U. Virginia Tech - required since 1/97 West Virginia U. - required beginning fall 1998 Worcester Polytechnic Inst.

Air University (Alabama)Cal TechClemson UniversityCollege of William & MaryConcordia University (Illinois)East Tenn. State UniversityFlorida Institute of Tech.Florida International UniversityMichigan TechNaval Postgraduate School (CA)North Carolina State U.Penn. State UniversityRochester Institute of Tech.U. of FloridaU. of GeorgiaUniversity of Hawaii, Manoa

Page 42: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Australian Project Members

U. New South Wales (lead institution)U. of MelbourneU. of QueenslandU. of SydneyAustralian National UniversityCurtin U. of TechnologyGriffith U.

Page 43: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

German Project Members

Humboldt University (lead institution)3 other universities5 learned societies1 computing center2 major libraries

Page 44: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Other International MembersChinese University of Hong KongChungnam National U., Dept of CS (S. Korea)City University, London (UK)Darmstadt U. of Tech. (Germany)Free University of Berlin (Germany - Vet. Med.)Gyeongsang National U. (Korea)India Institute of Technology, Bombay (India)Nanyang Technological U. (Singapore, part)National U. of Singapore (Singapore, part)*National Library of PortugalPolytechnic University of Valencia (Spain)Rhodes U. (South Africa)St. Petersburg St. Tech.U (Russia)Univ. de las Américas Puebla (Mexico)U. Laval; U. of Guelph; U. Waterloo; Wilfrid Laurier U. (Canada)

Page 45: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Access Statistics

1996 1997 1998

Total successful requests: 37,171 247,573 628,401Av. successful requests/day: 102 685 1,690Requests for .PDF files: 4,600 72, 854 343,236Requests for .HTML file 28,225 129,831 215,896Distinct hosts served 9,015 22,725 36,724Total data transferred: 3,229M 25,953M 74,051MAv. data transferred/day: 9M 73M 222M

Page 46: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Popular Works 1996458 Seevers, Gary L. Identification of Criteria for Delivery of Theological Education Through Distance Education: An International Delphi Study (Ph.D., Educational Research and Evaluation, April 1993; 1353Kb)

432 Hohauser, Robyn Lisa. The Social Construction of Technology: The Case of LSD (MS in Science and Technology Studies, Feb. 1995; 244Kb)

390 Childress, Vincent William. The Effects of Technology Education, Science, and Mathematics Integration Upon Eighth Grader's Technological Problem-Solving Ability (Ph.D. in Vocational and Technical Education, July 1994; 285Kb)

310 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2Mb)

287 Sprague, Milo D. A High Performance DSP Based System Architecture for Motor Drive Control ( MS in Electrical Engineering, May 1993; 878Kb)

165 Wallace, Richard A. Regional Differences in the Treatment of Karl Marx by the Founders of American Academic Sociology (MS in Sociology, Nov. 1993; 479Kb)

150 McKeel, Scott Andrew. Numerical Simulation of the Transition Region in Hypersonic Flow (Ph.D. in Aerospace Engineering, Feb. 1996; 3Mb)

Page 47: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Popular Works 19979920 Liu, Xiangdong. Analysis and Reduction of Moire Patterns in Scanned Halftone Pictures (Ph.D. in Computer Science, May 1996; 6.6Mb)

7656 Petrus, Paul. Novel Adaptive Array Algorithms and Their Impact on Cellular System Capacity (Ph.D. in Electrical Engineering, March 1997; 5Mb)

2781 Agnes, Gregory Stephen. Performance of Nonlinear Mechanical, Resonant-Shunted Piezoelectric, and Electronic Vibration Absorbers for Multi-Degree-of-Freedom Structures (Ph.D. in Engineering Mechanics, Sept. 1997; ? + 7926Kb)

2492 Gonzalez, Reinaldo J. Raman, Infrared, X-ray, and EELS Studies of Nanophase Titania (Ph.D. in Physics, July 1996; 4607Kb)

1877 Shih, Po-Jen. On-Line Consolidation of Thermoplastic Composites (Ph.D. in Engineering Mechanics, Feb. 1997; 3.3Mb)

1791 Saldanha, Kevin J. Performance Evaluation of DECT in Different Radio Environments (MS in Electrical Engineering, Aug. 1996; 3.2Mb)

1431 DeVaux, David. A Tutorial on Authorware (MS in CS, April 1996; 2.3Mb)

1394 Kuhn, William B. Design of Integrated, Low Power, Radio Receivers in BiCMOS Technologies (Ph.D. in Electrical Engineering, Dec. 1995; 2518Kb)

Page 48: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Popular Works 1998

K-accesses Mbytes Degree Year Dept Tables/Figures Author

75, 12, PhD, 1997, ME, 38/174, Maillard 56, 6.5, PhD, 1996, CS, 8/93, Liu 20, 3.9, PhD, 1997, EE, 9/121, Laster 15, 4.9, PhD, 1997, CpE, 17/127, Tripathi 12, 6.6, MS, 1997, EE, 7/96, Nicoloso 6.7, 4.6, PhD, 1996, Physics, 8/62 (32 color),

Gonzalez

Page 49: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

International Use 1996 1997 1998 850 2992 8170 United Kingdom 608 2,501 4223 Australia 346 2378 7373 Germany 713 2367 3970 Canada 387 1264 2201 South Korea 463 1161 4431 France 250 725 2553 Italy 191 867 2781 Netherlands 183 1130 1449 Brazil 22 967 1089 Thailand 83 958 1414 Greece

Page 50: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Who are sponsors / cooperators? Funding, Donations of hardware/software

– SURA– US Dept. of Education (FIPSE)– Adobe Systems– IBM– Microsoft– OCLC

Others Serving on Steering Committee– National/Regional Projects: Australia, French

speaking group, Germany, IberoAmerica (ISTEC), UK (UTOG)

– CGS, National Lib. Canada, NSF, OAS, SOLINET, UMI, UNESCO, ...

Page 51: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

How does this relate to UMI?

1987 UMI workshop to explore ETDs Support letter for US Dept. of Ed. proposal Steering and technical committee membership ProQuest Direct pilot of scanning works started

1/1/97, free 2 yr access to front part Collaborating on:

– accepting electronic author submissions– standards (e.g., representation), research

Page 52: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

ETD Initiative (and UMI)

StudentsLearn aboutDL, EPub

TDsbecome more

expressive

N. Amer. (T)Ds areaccessible, archived

Global TDsbecome more

accessible,archived

UMI

Universities

Page 53: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

User Search Support(multilingual, XML)

NDLTD W orld FederatedSearch

Virg in ia Tech ...(un iv)

U M I ...(corporate)

C IC ...(un iv group)

Portugese N L ...(national lib)

Austra lia(regional)

UserInterface

Note: All groups shown are connected with NDLTD.

Page 54: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Interoperability Tests Planned IBM DL: donated equipment, technical support,

powerful IPR (see TOIS, D-Lib) Z39.50: OCLC SiteSearch / VT tailored s/w

– university libraries w. catalogs of freely shared MARC records pointing to archival copies

– via URNs: handles & PURLs Dienst / NCSTRL - www.ncstrl.org: CS depts.,

DARPA, NSF, CNRI, Cornell - UVA is working on extensions for ETDs - Portugal is studying use for Europe - VT is working on Dienst to Z39.50 gateway

Page 55: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Access Approaches

Goal: Maximize access and services, e.g., by encouraging:

UMI centralized services Distributed service: Dienst, Z39.50 Regional services (e.g., OhioLink, AZ/NM) Local servers with browse, search

– From local catalogs to local archives WWW robot indexing and search services

Page 56: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Why might your university want to be involved?

To improve graduate education / better prepare your students / increase their knowledge and visibility

To unlock university information To save money for students and for the

university / improve workflow To build an important digital library

Page 57: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

How can a university get involved?

Select planning/implementation team– Graduate School– Library– Computing / Information Technology– Institutional Research / Educ. Tech.

Send us letter, give us contact names Adapt Virginia Tech solution

– Build interest and consensus– Start trial / allow optional submission

Page 58: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Contact Our Project Team

[email protected]

Phone CallVisit

Video Tape

Page 59: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Convene Local Planning Group

ETD

Page 60: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Build Local ETD Site

Digital Library

Policies

Inspection/Approval

Workshop/Training

ETD

ETD

Page 61: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Type 1 Members University Requires ETDs

Adobe Acrobat and/or XML/SGML tools Automated submission & processing Archive/access through UMI, (OCLC,)

Virginia Tech, ... (Local) WWW site, publicity (Local) Assistance provided as requested:

email, phone, listserv(s)

Page 62: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Type 2 Members University Agrees to Require ETDs

Like Type 1 but set date not reached Usually has an option or pilot May: wait for new AY; start with all who enter

after; … Build grass roots support

– Advisory committee: representative? expert?– Champions to spread by word of mouth– Approval: Senates, Commissions, Deans, Students– Publicity to reach community

Page 63: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

NDLTD Members, Types 3-7

3. Part of university requires ETDs4. University allows ETDs5. University investigating, has pilot6. University consortium joins:

– CIC (Big 10 coordinating body)7. Non-university organization joins

– CNI (Coalition for Networked Info.)

Page 64: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 65: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Support Services Developed

WWW site with > 300 Mb, CD, videotape Automated submission system (MySQL, UNIX,

WWW scripts - grad school/library) Student guidelines, style sheets, multimedia training

materials, FAQs, press info SGML and XML DTDs for ETDs SGML to HTML (web generator) LaTeX, Word templates, converters

Page 66: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Accessibility Activities / Plans

Interface design (simple, 3D, VR) Usability studies Generic multi-lingual support Support for those with disabilities Hybrid collection (paper, MARC,

abstracts, full-text, multimedia) Disciplinary classifications, tools Visualization of results, collection

Page 67: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC
Page 68: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

SPIRE Visualization

Page 69: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Support Offered

Software, documentation, tech support Email, listservs ([email protected], -eval, -

grad, -library, -technical) Donations: Adobe, Microsoft Evaluation: instruments, analysis

http://scholar.lib.vt.edu - solutions/statistics (Temporary storage / archiving; aid - in setting up

an int’l service & archive)

Page 70: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

PetaPlex

Digital Library Machine (“super” object store)

Parallel computer / storage utility for scale of 1000 to 1,000,000 gigabytes (terabyte/petabyte)

Knowledge Systems Incorporated is supplying VT-PetaPlex-1 with

– high speed backbone connection (OC-12)

– 2.5 terabytes through 100 “Nanoservers”:

– Network connection + IBM 25GB disk + 233 MHz Pentium II + Linux

Page 71: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Sornil & Mather Dissertations

VT-PetaPlex-1 delivered, being installed Mather: efficiently handling very large numbers of objects

of varying sizes Sornil: efficiently handling IR for very large collections,

large numbers of users, high transaction rates, large inverted files– modeling and simulation– data organization (partitioning)– parallelization of algorithms, alone and in combination for

retrieval (related) tasks

Page 72: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Enhancements

Dublin Core spec, MARC crosswalk DTDs for SGML, XML(+ <discipline>ML) Annotation system (author, friends, notes) Routing system (based on Sift) Multilingual WWW site, training materials (Spanish

recently done in Valencia) Better federated search (w. Z39.50, planned with

Dienst and Harvest - maybe MARIAN)

Page 73: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Relationship with publishers

Concern of faculty and students that still wish to publish books or journal articles, voiced: campus, Chronicle, NPR, Times

Solution: Approval Form gives students, faculty choices on access, when to change access condition; use IPR controls in DL

Solution: by case, work with publishers and publisher associations to increase access– AAP, AAUP– AAAS, ACM, ACS, Elsevier, ...

Page 74: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Some responses from publishers

ACM: need to acknowledge copyright Elsevier: need to acknowledge copyright IEEE-CS: endorse initiative ACS: After first publication, can release Textbook publishers: different market,

manuscript significantly reworked General: restricting access to local campus will

not cause any problems

Page 75: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

For Professional Societies

Like “writing across the curriculum” Besides writing: computing/communications,

information literacy, personal digital library management, tool use, research methods, collaboration, archiving/preservation

Data sets, communities of users of them Classification systems / browsing / searching NRC’s “On becoming a researcher”

Page 76: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 77: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

SMETE Library(from www.dlib.org)

Context: Global movement toward Digital Libraries (see April 1998 CACM)

NSF effort: Science, Mathematics, Engineering, and Technology Education Digital Library (focussed on undergraduates)– 3 workshops, yearly increasing funds / new calls

SMETE Library likely to operate as distributed federation, with separate parts for each key discipline, and to lead to a global effort

Page 78: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

MARIAN

Multiple Access Retrieval of Information with Annotations

(Marian the Librarian …) Evolved from CODER system to a distributed

Online Public Access Catalog (OPAC), then DL backend, now becoming a full DL system

From C/C++ to Java Future: NDLTD, NUDL, PetaPlex

Page 79: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

MARIAN Layers

Database Layer

Search Engine Layer

User Information Layer

User Interface Layer

User User User User

Page 80: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

ENVISION

NSF “A User-Centered Database from the Computer Science Literature” (1991-93)

Collected bib/typesetter data, converted to SGML Scanned thousands of page images MARIAN search engine - can be made available (also

applied to the Virginia Tech library catalog) used as part of a prototype object-based DL, with tailored visualization interface (L. Nowell dissertation)

Page 81: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

NSF Education Innovation (EI) NSF “Interactive Learning with a Digital Library in

Computer Science” (1993-98) 45 online courses (esp. Internet, IR, MM,

Professionalism, overall EI project pages): 100+K accesses/wk

Tools: SWAN (visualization), QUIZIT Evaluation

– traditional– network logging and analysis– tools for visualization

Page 82: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Digital Library Courseware

http://ei.cs.vt.edu/~dlib/ WWW pages or large PDF copy files Online quizzes based on book by Michael Lesk

(Morgan Kaufmann Publishers) Contents based on book, with several other popular

topics added (e.g., agents) Separate pages to supplement: Definitions,

Resources (People, Projects), and References

Page 83: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

CS -> CSTC -> CRIM NSF and ACM Education Committee are funding a 2

year project “A Computer Science Teaching Center” - CSTC - http://www.cstc.org/

College of NJ, U. Ill. Springfield, Virginia Tech Focus initially on labs, visualization, multimedia Multimedia part is also supported by a 2nd grant to

Virginia Tech and The George Washington University: http://www.cstc.org/~crim/ (with curricular guidelines also under development)

Page 84: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

CS Teaching Center (CSTC) Instead of building large, expensive multimedia packages,

that become obsolete and are difficult to re-use, concentrate on small knowledge units.

Learners benefit from having well-crafted modules that have been reviewed and tested.

Use digital libraries to build a powerful base of support for learners, upon which a variety of courses, self-study tutorials & reference resources can be built. (See NSF SMETE-Lib Study at http://www.dlib.org/smete/public/smete-public.html)

Page 85: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

OUTLINE Introduction Global digital libraries, for education Building digital libraries NDLTD

– Overview, History– Members, Collection– Support, Extensions

CSTC, CRIM Conclusion

Page 86: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Solution Decomposition

ETDsE le c tro n icT h e se s &

D isse rta tio n s

C o u rse w a reK n o w . M o d u les

(In te ra c tiveM u ltim e d ia )

H yp e rm e d iaResources

N D L T DN e tw o rke dD L T h e ses

D isse rta tio n s

C R IMC u rricu lu mR e so u rce sIn te r. M M

C S T CC S

T e a ch ingC e n te r

NUD LN e tw o rke dU n ive rs ity

D L

DigitalLibraries

D L U se :B ro w se ,S e a rch ,R e trie ve

A u th o ring(te x t,

m a rku p ,h yp e rm e d ia )

S u b m itE T D

(M e tad a ta ,P D F , X M L)

U s in gIn te ra c tiveM u ltim e d ia

C o u rse w a re

In te ra c tiveExperiences

E n h an cedL earn ing

Page 87: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Future Work - 1 of 3 Working with publishers to increase level of access as

much as possible Interoperability tests among universities and with UMI

to provide integrated services Study with testbed that emerges, to improve

information retrieval, browsing, interface, and other types of user support

Evaluation, improving learning experience, spread to worldwide initiative, sustainable support and coordination

Page 88: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Future Work - 2 of 3 Adding services currently prototyped

– annotation and SDI (routing) capabilities– Dublic Core metadata, crosswalk to MARC– support with IBM DL, OCLC SiteSearch

Adding other services planned– building and using citation database (w. SFX)– implementing plagiarism check (like “SCAM”)

Developing NUDL as a sustainable self governing global institution (w. committees)

Page 89: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Future Work - 3 of 3 Working with ACM on a journal to supplement

CSTC Extending the human infrastructure for CSTC

– integrate demos etc. into submission process solicitation, review, improvement

– description (metadata), certification (quality)

– selection, adaptation, reuse

Publish an agreed-upon curriculum for IM

Page 90: How to Build Digital Libraries: A Methodology and Examples (NDLTD, CSTC) Kyoto University July 22, 1999 Edward A. Fox fox@vt.edu CC CS DLRL Internet TIC

Remember!

5S (to understand and build DLs)

NDLTD (join! support!)

NUDL (help with matching efforts)

CSTC, CRIM (add to, use)