Europeana Newspapers

…in a nutshell

Newspapers in Europe and the Digital Agenda for Europe - Final Workshop

29 September 2014, London, British Library

Clemens Neudecker, State Library Berlin

@cneudecker

Copyright: Olmsted County Historical Society

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp 2

Facts & Figures

• Europeana Newspapers – EU ICT-PSP Best Practice Network

• Started in February 2012 and will run until January 2015

• 18 partners, 11 associated partners, 22 networking partners(28 countries involved)

• Total budget: €5.16M – EC contribution: €4.12M

• Project coordination: State Library Berlin / Preußischer Kulturbesitz

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Europeana Newspapers is all over Europe…and beyond

3

Red = Project Partners

Blue = AssociatedPartners

Green = NetworkingPartners

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Refinement - we‘re scaling it up!

• 8 million pages refined with Optical Character Recognition (OCR)

• 2 million pages refined with Optical Layout Recognition (OLR)

• Technical resources for Named Entity Recognition (NER) in three languages (Dutch, German, French)

• Metadata for >18 million pages ingested to Europeana

In comparison: currently provides access to 8,056,532 pages

4

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Quality & Performance

5

82.4% 85.3%80.9%

75.9%

67.5%

83.4% 84.1%

68.1%

93.1%

57.6%

87.0%

68.3%76.1%

82.6%

54.1%

32.7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Succ

ess

Rate

Language Setting

Bag of Words OCR EvaluationPer Language

71.9%74.3%

50%

55%

60%

65%

70%

75%

80%

Index based Count based

Succ

ess

Rate

Bag of Words OCR EvaluationIndex based rate vs. count based rate

79.1%

62.2%55.9%

58.8%

94.7%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Keywordsearch

Phrase search Access viacontent

structure

Print/ebookon demand

Contentbased image

retrieval

Succ

ess

Rate

(har

mon

ic,

area

bas

ed)

Evaluation Profile

Layout Analysis PerformancePer evaluation profile

67.3%

81.4%

64.0%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Gothic Normal Mixed

Succ

ess

Rate

Font

Bag of Words OCR EvaluationPer Font

75.3%

53.78%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Succ

ess

Rat

e (

cou

nt

bas

ed

)

OCR Engine

Bag of Words OCR EvaluationFineReader vs. Tesseract

FineReader Tesseract

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Access via TEL & Europeana

• Full text search in TEL Historic Newspapers Browser:

http://www.theeuropeanlibrary.org/tel4/newspapers(recently updated following usability testing)

• Metadata search in Europeana:

http://www.europeana.eu/portal(now with embedded object presentation via TEL)

6

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Full-text search

7

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Browse by date

8

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Explore on a map

9

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Title list

10

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp 11

Embedded TEL Viewer in Europeana!

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Metadata Best Practices

• Europeana Newspapers METS/ALTO Profile (ENMAP)

• Contributions to ALTO standard v2.x, v3.0

• Structural metadata with tool support - Structify

12

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Media, News, Events

13

This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp

Lots of opportunities for research & reuse

• Metadata for >18M pages licensed CC0

• Images & full-text for 10M pages licensed public domain

• See also: http://www.europeana-newspapers.eu/category/interviews-with-researchers/

yet another way to reuse newspapers…

14

Thank you for your attention!@eurnews

http://www.europeana-newspapers.eu

http://www.theeuropeanlibrary.org/tel4/newspapers

http://www.europeana.eu/