1

Copy and paste your photo into your opening and closing slide

Aleph Parallel Indexing

Jerry SpechtSenior Support AnalystJerry.specht@exlibrisgroup.com

22

Copyright Statement

All of the information and material inclusive of text, images, logos, product names is either the property of, or used with permission by Ex Libris Ltd. The information may not be distributed, modified, displayed, reproduced – in whole or in part – without the prior written permission of Ex Libris Ltd.

TRADEMARKS

Ex Libris, the Ex Libris logo, Aleph, Alma, SFX, SFXIT, MetaLib, DigiTool, Verde, Primo, Voyager, MetaSearch, MetaIndex and other Ex Libris products and services referenced herein are trademarks of Ex Libris, and may be registered in certain jurisdictions. All other product names, company names, marks and logos referenced may be trademarks of their respective owners.

DISCLAIMER

The information contained in this document is compiled from various sources and provided on an "AS IS" basis for general information purposes only without any representations, conditions or warranties whether express or implied, including any implied warranties of satisfactory quality, completeness, accuracy or fitness for a particular purpose.

Ex Libris, its subsidiaries and related corporations ("Ex Libris Group") disclaim any and all liability for all use of this information, including losses, damages, claims or expenses any person may incur as a result of the use of this information, even if advised of the possibility of such loss or damage.

© Ex Libris Ltd., 2012

33

AgendaOutline of presentation

44

Documents on Technical Seminar CD

I have included the following on the CD:

• this Powerpoint (TS2012_Aleph_Parallel_Indexing.ppt)• Parallel Indexing.pdf (from Ex Libris

Documentation Center > Aleph > Technical Documentation >How To >Indexing)

• How To Run Index Jobs (from Ex Libris Documentation Center > Aleph > Support > How To from Support by subject > Indexing_filing_and_expand_procedures

• How to Open a New Library for Parallel Indexing.doc

55

1. Choose parallel library name

• In this session, LAW01 is being used as the

actual library, and LAW04 as the indexing library.

• The LAWnn libraries are a subset of Lawrence University Library’s records, consisting of 5,000 bib records and the associated item, acq, HOL records, etc. The patron records have been anonymized. 

66

2.Open New Library for ParallelIndexing

• The Parallel Indexing document has the following Step 1: “Open a new BIB library, parallel to the library that is going to be indexed.”

•  There’s a How to Open a New Library document which could be used for this purpose, but that document has many steps unnecessary for Parallel libraries and fails to include steps unique to Parallel libraries. Thus, I have created a How to Open a New Library for Parallel Indexing document (included on the Technical Seminar CD).

• <discussion of How to Open a New Library for Parallel Indexing doc.>

• Step 2 of Parallel Indexing (“Add the Indexing Library to library relation”) is augmented by section 3.2.1 of the How to Open a New Library for Parallel Indexing document.

77

3. Synonyms

• Drop the xxxnn z00, z103, z0102, and z970 in law04, as described in Parallel Indexing. Be sure to do the “select count(*) from Z00” test before doing the drop.

• Then do util a/17/5/2 in law04 to create the synonyms.

88

4. Check the Library’s Z52 Table 

• Step 4 of Parallel Indexing is “Adjust the Library’s Z52 Table”. We find, in the law04 util g/2, that the open_new_library proc has set these counters to a value of “0” .

99

5. Check the indexing library’s $data_tab

• Step 5 of Parallel Indexing is “Set up Indexing Configuration Tables”. We find, in the law04 $data_tab, that the open_new_library proc has copied the Aleph tables from the law01 template library.

1010

6. Run util e/5/1 in the law01 library to save z07’s for later reindexing

• While the indexing jobs are running, new and updated records in the actual library are indexed, through the ue_01 and Z07 mechanism, on the old indexes. These Z07 records must be saved, for re-indexing after the new indexes have been built.

•  util e/5/1 does this.

1111

7. Run the indexing jobs

• Parallel indexing is normally used for the long-running Words and Headings indexing jobs, but it can be used for other jobs (such as p_manage_05, p_manage_07, p_manage_27, p_manage_35, etc.) as well.

 • We will run:• p_manage_01 (Words) and • the Headings sequence (p_manage_102,

p_manage_02, p_manage_105, p_manage_17, and p_manage_35) in the law04 parallel library.

1212

8. Generate z07 indexing activity in law01

• We will generate some z07 indexing requests in law01, to be processed by the law01 ue_01, while the parallel indexing is occurring in law04.

1313

9. Check the new indexes

Parallel Indexing, Step 8 / Appendix A.

1414

10. Applying the New Indexes: Option 1 vs. Option 2

• Parallel Indexing, Step 9, describes two Options for implementing the new indexes:

 • Option 1: Logical synonyms• Option 2: Oracle Import

1515

10a. Applying New Indexes: Option 1: Logical synonyms • With this method, you leave the index tables in the law04

library, drop the tables in the law01 library, and create synonyms in law01 to point to law04. We will do this for the z01, z02, and z0102 tables. This is described in detail in Parallel Indexing, Step 9.

• Before dropping the tables in law01 you should save them, as described in “Restoring Old Index” below.

1616

10b. Applying New Indexes: Option 2: Oracle Import• With this method you export the index tables

from law04 using the oracle_expdp_table proc and then import them into law01 with the oracle_impdp_table proc. We will do this for the z95, z97, and z98. There is no util menu for these procs; they must be executed via the commands shown below.

•  (Note: Though p_file_03 might be used to export the table from law04, and p_file_04 to import the table in law01, the p_file_04 import of the z98 has taken as long as 24 hours for the z98 of a 500,000-record bib library. Therefore, we suggest using the Data Pump instead….)

1717

10b. Oracle Import (Continued)• csh -f $aleph_proc/oracle_expdp_table

LAW04,z98 > & oracle_expdp_table.js.log &•  Copy the LAW01_Z98 directory from law04

$data_files to law01 $data_files. Then:•  csh -f $aleph_proc/oracle_impdp_table

LAW01,z98 > & oracle_impdp_table.js.log &•  p_manage_01 zeroes out the z980 table. Rather

than doing an export of this (empty) law04 table we do util a/17/1 for the law01 z980 table. 

1818

10c. Applying New Indexes: Backing-up/Restoring Old Index

• To enable restoration of the old (law01) indexes, you should back them up using the Data Pump before applying the new (law04) indexes:

• csh -f $aleph_proc/oracle_expdp_table LAW01,z95 > & oracle_expdp_table.js.log &

• csh -f $aleph_proc/oracle_expdp_table LAW01,z97 > & oracle_expdp_table.js.log &

• csh -f $aleph_proc/oracle_expdp_table LAW01,z98 > & oracle_expdp_table.js.log &

• csh -f $aleph_proc/oracle_expdp_table LAW01,z980 > & oracle_expdp_table.js.log & 

• .

1919

10c. Backing-up/Restoring Old Index (Cont.)

• Then rename the directories:cd $data_filesmv LAW01_Z95 LAW01_Z95.save mv LAW01_Z97 LAW01_Z97.save mv LAW01_Z98 LAW01_Z98.save mv LAW01_Z980 LAW01_Z980.save

•  To restore, you would remove the “.save” from the name and do “oracle_impdp_table”

2020

11. Updating law01 with law04 util g/2 and $data_tab values

• Parallel Indexing Step 10 has details on updating law01with law04 util g/2 and $data_tab values. (Note: the title for Step 10 is incorrect. It should be “Updating util g/2 and $data_tab values”.)

• Any law04 util g/2 counter which has a non-zero value needs to be updated in law01. And any law04 $data_tab tables which were updated for indexing need to be copied to law01.

2121

12. Index records updated in the interim

• [Parallel Indexing Step 11]• In order to include records that were updated

while indexing was running in the indexing library, perform UTIL/E/5/2 in the actual library (law01). This copies the saved Z07H records to Z07, deleting duplicate entries. The ongoing UTIL E/1 (ue_01) process in the actual library re-indexes the records stored in Z07.

 • Important: ue_01, ue_08, etc., never run in

the indexing library; their processing is always done in the actual library.

2222

Al Rykhus’ Method:Use of separate server for parallel indexing

Better/simpler if you have:• a separate server with space to duplicate your

entire database and • a DBA familiar with cloning databases.

• Contact: alan.rykhus@mnsu.edu .

2323

RecapRecap …

and

Thank you!

Jerry.specht@exlibrisgroup.com