Europeana Newspapers Aggregation and Indexing Plan

Europeana Newspapers WP 4

Aggregation & Indexing Plan

Anastasia Gacia and Markus Muhr

2

Agenda

● Customer Relationship Management● Aggregation Workflow - Metadata

• Aggregation Workflow - Full-text and Images

• Newspaper Content Browser Options

• Viewing Images

• Delivery to Europeana / Zeitschriftendatenbank

• Aggregation and Indexing Plan

• Questions

3

Customer Relationship Management

• SugarCRM

• Management of all administrative information• Organisations, contacts, datasets, projects, etc.

• Important features for project handling• Newspaper collections• Cases per specific collection• Aggregation and Indexing Plan• Automatic reporting

4

Customer Relationship Management

5

Aggregation Workflow – Metadata

● Scheduling of ingestion● Datasets ready for harvesting● Create case in CRM: case # to provider● Harvesting metadata (OAI-PMH, FTP, ...)● Enhance metadata (VIAF, Geonames, MACS,...)● Indexing in acceptance portal ● E-mail to provider to accept dataset● Live index = live portal● Delivery to Europeana● Enhancing and publishing in Europeana

6

Aggregation Workflow - Full-text and Images

● Hard-disk delivery by UIBK/CSS● Hard-disk delivery to ULCC● Ingestion and alignment of fulltext and images with

harvested metadata● JPEG 2000 generation for hosted IIP image server● Enrichment with named entities from KB – Not Yet● Indexing into content browser● Adaptations of image viewer for external image servers

• E-mail to partner

7

Newspaper Content Browser Options

• Questionnaire to content providers determined how the content would appear in newspaper content browser

• Option 1 - Images and full-text (NLL, NLF)• Option 2 - Snippets of images and full-text (LFT)• Option 3 - Full-text only – Not supported (Nobody selected)• Option 4 - Metadata only – Not supported yet • Option 5 - Option 1 via external image server (ONB)• Option 6 - Option 2 via external image server – Not supported yet

8

Browser Option 1

9

Browser Option 2

10

Browser Option 5

11

Delivery to Europeana / Zeitschriftendatenbank

● Metadata from Full and Associate Partners should go into Newspapers content browser, Europeana portal and Zeitschriftendatenbank / Union Catalogue of Serials

● EDM to Europeana● Duplin Core to Zeitschriftendatenbank

● Europeana Data Model delivery should be finalised soon

12

Europeana Data Model

13

Dublin Core

14

Aggregation and Indexing Plan – Q3 2013

15

Aggregation and Indexing Plan – Q3 2013

● Österreichische Nationalbibliothek / Austrian National Library – Option 5

● Kansalliskirjasto / National Library of Finland – Option 1 (new)● Numbers are not matching hundred percent

16

Aggregation and Indexing Plan – Q4 2013

17

Aggregation and Indexing Plan – Q4 2013

18

Aggregation and Indexing Plan – Q4 2013

● Landesbibliothek Dr. Friedrich Teßmann / Teßmann Library – Option 2● Missing links to original at partner library

● Österreichische Nationalbibliothek / Austrian National Library – Option 5 and 4● Metadata only is missing

19

Aggregation and Indexing Plan – Q4 2014

● Bibliotheque Nationale de France / National Library France – Option 6● Moved to Q1 2014

● Latvijas Nacionala Biblitoteka / National Library of Latvia – Option 1● Missing links to original at partner library

20

Aggregation and Indexing Plan – Q4 2013

● Landsbókasafn Íslands - Háskólabókasafn / National and Univeristy Library of Iceland – Associated Partner

● National Library of Spain – Associated Partner

● Bibliothèque nationale de Luxembourg / National Library of

Luxembourg – Associated Partner● Working on it, problems with format

21

Aggregation and Indexing Plan – Q1 2014

● Bibliotheque Nationale de France / National Library France – Option 6

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

● Milli Kutuphane Baskanligi / National Library of Turkey – Option 4

22

Aggregation and Indexing Plan – Q1 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Univerzitet u Beogradu / University Library of Belgrade – Option 1

23

Aggregation and Indexing Plan – Q1 2014

● National Library of Wales – Associated Partner

● National Library and University Library in Zagreb – Associated Partner

24

Aggregation and Indexing Plan – Q1 2014

● St. Cyril and Methodius National Library / The National Library of Bulgaria – Associated Partner

● National Library of Czech Republic – Associated Partner

25

Aggregation and Indexing Plan – Q2 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

26

Aggregation and Indexing Plan – Q2 2014

● Biblioteka Narodowa / National Library of Poland – Option 2

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Koninklijke Bibliotheek / National Library of the Netherlands – Option 5

27

Aggregation and Indexing Plan – Q2 2014

● Narodna in univerzitetna knjižnica / National and University Library of Slovenia – Associated Partner

● National Library of Portugal – Associated Partner

● National Library of Romania – Associated Partner

28

Aggregation and Indexing Plan – Q3 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

29

Aggregation and Indexing Plan – Q3 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

30

Aggregation and Indexing Plan – Q4 2014

● Bibliotheque Nationale de France / National Library France – Option 5

● Eesti Rahvusraamatukogu / Estonian National Library – Option 1

31

Aggregation and Indexing Plan – Q4 2014

● Staatsbibliothek zu Berlin / Berlin State Library – Option 1

● Staats- und Universitätsbibliothek Hamburg / State and University Library Hamburg – Option 1

● Kansalliskirjasto / National Library of Finland – Option 1

32

Operations Officer

Anastasia Gasia

Junior Operations Officer

anastasia.gasia@kb.nl

Operations Mailbox: collections@theeuropeanlibrary.org

Thank you for your attention!

Markus Muhr (markus.muhr@kb.nl)

www.europeana-newspapers.eu

34

Customer Relationship Management

35

Customer Relationship Management

36

Aggregation Workflow – Metadata

37

Viewing Images

● The European Library hosts images for Option 1 and 2 ● IIP Image Server with JPEG 2000● Viewing images transformed into JPEG 2000● Ingestion workflow includes transformation step for tifs and

jpgs● Time-demanding operation● Image viewer is IIPMooViewer● Open source projects ● Europeana Regia

http://www.theeuropeanlibrary.org/tel4/virtual/regia

38

Viewing Images

● External image servers for Option 5 and 6 ● Current support of external viewers via iframe

● Alignment and highlighting not available● Improved usage of content browser via integrated image

viewer● Adaptations for each different kind of image server● Time-demanding task● Existing viewer that can be easily embedded in the

Newspaper Content Browser are preferable● Technical support at partner libraries is necessary

39

Aggregation and Indexing Plan

● Plan includes aggregation of partners and 11 associated partners

● Q3 first quarter with indexing work● Aggregation and indexing is aligned with deliveries from

UIBK/CCS● Deliveries to Europeana & Zeitschriftendatenbank from Q4

onwards● Aggregation and indexing is split over multiple quarters for

some partners