Procedures for Bulk Loading:

Authority, Bibliographic, Holdings, and Purchase Order Records into Voyager

Planning

Who needs to be involved?SystemsCatalogingAcquisitionsPublic ServicesRSCVendors

Planning

Decide how you want to load the records

Add UnconditionallyReplaceMergeCreate Mfhds, purchase orders, items?

Planning

Where will holdings information come from?VendorCreate during PrebulkCreate during Bulk ImportCreate holdings tag with MarcEdit

Duplicate Detection Profileshttp://www.library.yale.edu/lso/databaseadmin/dbloads/dupdetect.htm

Choose how you want the records loaded (add-unconditionally, replace, merge)Define which fields (tags) to use as a match point between incoming records and records in the databaseFor merge profile, indicate which tags should be copied from the existing database record and merged with the incoming record.

Bulk Import Rules

http://www.library.yale.edu/lso/databaseadmin/dbloads/bulkimport.htm

• The loader pulls information from the Bulk Import Rules for the specific load.

• Type of records being loaded: bibs, auths, mfhds, P.O.’s, items, or a combination of these

• Duplicate Detection profile to use• Item types, call number hierarchy, mapping locations,

barcodes, and P.O. information

Preprocessing Programs

tagchangernew.jarcjkloadernew.jartag949buildernew.jaraddlocalyale.jar

addmfhdindicators.jaraddmultiple 866.jarMarcEditPrebulk

Decide which preprocessing programs will be needed in order to load, match, and display the records correctly.

Uses for Prebulkhttp://www.library.yale.edu/lso/databaseadmin/

dbloads/prebulk.htm

Remove bad records from file before loadingStrip fields from recordsCreate an interleaved file of bibs and mfhds for loadingRecord count in file

Configuration Files

Configuration profiles are used by Prebulk to determine how records are to be preprocessed before being loaded into production by the Bulk Import program. Configuration files are written using the vi editor on the server because they must be tab delimited.

•http://www.library.yale.edu/lso/databaseadmin/dbloads/configfile.htm

Database Loads Page(a work in progress)

http://www.library.yale.edu/lso/databaseadmin/dbloads/loads.htm

Includes detail for each database load we are currently runningMore detail on Duplicate Detection profiles, Prebulk, and Bulk ImportYUL Tag Table updates notesDatabase loads scheduleMore to come!

Questions?