8
Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text ACL LaTeCH 2011

Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

Embed Size (px)

Citation preview

Page 1: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

Agata Cybulska, Piek Vossen Computational Lexicology and Terminology

Lab, Faculty of Arts, Free University Amsterdam

Historical Event Extraction from Text

ACL LaTeCH 2011

Page 2: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

Museum Application of the Historical Event Extraction Module

Browsing exhibits of the Rijksmuseum through historical events eg.photo’s related to the Bosnian War

and more…

ACL LaTeCH 2011

Page 3: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

Location

Participants

Time

Actions

Modeling Historical Events in Text

HISTORICALEVENT

Srebrenica

Bosnian soldiersMoslim man and boys

On 11 July 1995

murder

Page 4: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

Museum Application of the Historical Event Extraction Module

Browsing exhibits of the Rijksmuseum through historical events eg.- photo’s related to the Bosnian War- art pieces referring to a president, general etc.- within a time periode- geographic area

-> inferences aboutevent parts

-> relations between events

ACL LaTeCH 2011

Page 5: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

5

Development of the Historical Event Extraction Module

No annotated data available

Our approach - development set of (only!) 5 texts manually annotated with Historical Events

Event extraction based on patterns of structural and semantic properties

ACL LaTeCH 2011

Page 6: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

6

Comparison with an evaluation set tagged by two Independent annotators

MeasurementRelations

Gold Standard Triplets

System Triplets

Correct System Triplets

Recall %

Precision %

Time 17 20 13 76% 65%

Location 31 23 10 32% 43%

Participant 98 95 57 58% 60%

Evaluation Results

•Actions extracted with 67.94% recall and 51.96% precision

ACL LaTeCH 2011

Page 7: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

How did we manage to achieve such good resultsusing only a very limited set of annotated data?

ACL LaTeCH 2011

How did we do it ??

Page 8: Agata Cybulska, Piek Vossen Computational Lexicology and Terminology Lab, Faculty of Arts, Free University Amsterdam Historical Event Extraction from Text

8ACL LaTeCH 2011

Come to our poster to find out more!

[email protected]