Summarizing Entity Descriptions for Effective and Efficient Human-centered Entity Linking

Summarizing Entity Descriptions for Effective and

EfficientHuman-centered Entity

Linking

Gong Cheng, Danyun Xu, Yuzhong Qu

Websoft Research GroupState Key Laboratory for Novel Software Technology

Nanjing University, China

Entity Linking (EL)

But with the release of the iPhone 6 and the 6 Plus phablet, Apple has finally gone into big-screen territory, giving Samsung a challenge in the category that the company has been dominating for some time now.

Text Knowledge Base

iPhone 6- type: Smartphone- ...

Samsung Electronics- type: IT Company- ...

Apple (Inc.)- type: Company- type: IT company- product: iPhone 5- ...

Apple (Fruit)- type: Fruit- genus: Malus- ...

Candidate entities

Human-centered EL is needed

Text Knowledge Base

Candidate entities

• for defining gold standard,• for crowdsourced EL.

entity description:set of property-value pairs (called features)

Text Knowledge Base

Candidate entities

Entity descriptions are long.

Short, extractive summaries are adequate for human-centered EL.

Apple (Inc.)- type: Company- product: iPhone 5

Apple (Corps)- type: Company- product: Let It Be

Apple (Fruit)- type: Fruit

summary of k candidate entity descriptions: k subsets of features (subject to a length limit)

?… Apple

Short, extractive summaries are adequate for human-centered EL.

?… Apple

summarizing entity descriptions combinatorial optimization

summary of k candidate entity descriptions: k subsets of features (subject to a length limit)

Optimization goal (1)+characterizing power, -information overlap• Characterizing power of a feature (ch)

ch(type: IT company) < ch(product: iPhone 5)

Apple (Inc.)

Samsung Electronics

Optimization goal (1)+characterizing power, -information overlap• Characterizing power of a feature (ch)

ch(type: IT company) < ch(product: iPhone 5)

Apple (Inc.)

Samsung Electronics

h𝑐 ( 𝑓 )=−log number of entities having 𝑓number of all entities Apple (Inc.)

- type: Company- type: IT company- product: iPhone 5- ...

Optimization goal (1)+characterizing power, -information overlap• Information overlap between features (ov)

a) logical inferenceentailment = maximized ov

ov(type: IT company, type: Company) = MAX

b) string/numerical similarity

a) logical inferenceentailment maximized ov

b) string/numerical similarity

a) logical inferenceentailment maximized ov

b) string/numerical similarityov = max{similarity between properties, similarity between values}

ov(type: IT company, product: iPhone 5) = SMALL

Optimization goal (1)+characterizing power, -information overlap• Formulated as k Quadratic Knapsack Problems

weight of a feature: lengthprofit of a pair of features:

to maximize characterizing powerto minimize information overlap

Optimization goal (2): +differentiating power

• Differentiating power of a pair of features (di)

a) string/numerical dissimilaritydi = property’s value uniqueness * dissimilarity between values

di(type: IT company, type: Fruit) = SMALL*LARGE = MEDIUM

(Single-valued properties are more useful.)

b) logical inferenceentailment = minimized di

di(type: IT company, type: Company) = MIN

a) string/numerical dissimilaritydi = dissimilarity between values * property’s value uniqueness

di(type: IT company, type: Fruit) = LARGE*SMALL = MEDIUM

b) logical inferenceentailment = minimized di

a) string/numerical dissimilaritydi = dissimilarity between values * property’s value uniqueness

di(type: IT company, type: Fruit) = LARGE*SMALL = MEDIUM

b) logical inferenceentailment minimized di

• Formulated as a Quadratic Multidimensional Knapsack Problem (QMKP)

weight of a feature: lengthprofit of a pair of features: differentiating power

Optimization goal (3): +relevance to context

• Relevance of a feature to the context of entity mention• cosine similarity in the class vector model (cs)

Vector(context) = {Smarphone, IT company}Vector(type: Fruit) = {Fruit}Vector(product: iPhone 5) = {Smartphone}

cs(context, product: iPhone 5) = HIGH

• class weighting: class frequency – inverse instance frequency (CF-IIF)

Text Knowledge Base

Candidate entities

Text Knowledge Base

Candidate entities

Text Knowledge Base

Candidate entities

Text Knowledge Base

Candidate entities

Text Knowledge Base

Candidate entities

• Solved by k Maximizing Marginal Relevance (MMR) frameworks• Features are iteratively selected.• In each iteration, candidate features are re-ranked by

• relevance to context• dissimilarity to selected features

Optimization goal (1+2+3)

• Formulated as a Quadratic Multidimensional Knapsack Problem (QMKP)

Experiments: data sets

• Text corpora (with entity mentions linked to Wikipedia)• AQUAINT• IITB

• Knowledge base• DBpedia

• Gold-standard links• entity mentions Wikipedia articles DBpedia entities

Experiments: EL tasks

?..., Apple has finally gone into big-screen territory, …

1 target entity• gold-standard

2 (very challenging) noise entities• sharing a common name with the target entity,

obtained from Wikipedia’s disambiguation pages

Experiments: approaches

• Proposed approaches• CHR: +characterizing power, -information overlap• DFF: +differentiating power• CNT: +relevance to context• COMB: CHR+DFF+CNT

• Baseline approaches• DESC: returns entire entity descriptions• RELIN: a state-of-the-art entity summarization approach for

generic purposes

• average length of entity descriptions: 680 characters• length limit for summaries: 100 characters (14.7%)

Experiments: extrinsic evaluation• COMB is the only approach that achieved the following

statistically significant results on both data sets:• accuracy (% of correct answers): COMB = DESC• time: COMB < DESC (22-23% faster)

Experiments: intrinsic evaluation• Statistically significant results on both data sets:

• human ratings: COMB > CHR > other approaches

Future work

• More extensive experiments• to test with not-in-the-list

• Summaries for automatic EL

Questions?

Summarizing Entity Descriptions for Effective and Efficient Human-centered Entity Linking

Presentations & Public Speaking

Combining Word and Entity Embeddings for Entity Linkingpl1515/files/Reading Circle.pdfENTITY LINKING Entity Linking (or Entity Disambiguation) task consists of connecting an entity

Entity Linking - College of Engineering and Physical Sciencesdietz/entitylinking/entity-linking-tutorial-slides.pdf"Large-scale named entity disambiguation based on wikipedia data."

Babelfy: Entity Linking meets Word Sense Disambiguation

Enhancing Entity Linking by Combining NER Modelsgiusepperizzo.github.io/publications/Plu_Rizzo-ESWC2016Challenges.pdfEnhancing Entity Linking by Combining NER Models Julien Plu1, Giuseppe

Entity Linking meets Word Sense Disambiguation: a Unied ...navigli/pubs/TACL_2014_Babelfy.pdf · Entity Linking meets Word Sense Disambiguation: a Unied Approach Andrea Moro, Alessandro

Entity Linking: Finding Extracted Entities in a Knowledge Base

PhD Day: Entity Linking using Ontology Modularization

Design Challenges for Entity Linking - GitHub Pagesxiaoling.github.io/pubs/ling-tacl15-slides.pdf · 2018-05-18 · Design Challenges for Entity Linking Xiao Ling, Sameer Singh, Daniel

SEMANTIC INDEXING (ENTITY LINKING)ai.fon.bg.ac.rs/wp-content/uploads/2015/04/Entity-Linking-eng.pdf · – Semantic Indexing / Entity Linking ... dbpedia:Kashmir_(song) – 1975 song

PhD Day: Adaptive Entity Linking

Entity Linking on Microblogs with Spatial and Temporal Signals · the problem of entity linking. In this paper, we pro-pose a novel spatiotemporal framework for entity linking, building

Relational Entity Linking with Cross Document Coreference

Can Deep Learning Techniques Improve Entity Linking?

XREF: Entity Linking for Chinese News Comments with

Entity Linking - GATE.ac.uk - index.html...What is Entity Linking • Entity linking is the task of identifying all mentions in text of a specific entity from a database or ontology

Crowdsourcing Named Entity Recognition and Entity Linking ... · Crowdsourcing Named Entity Recognition and Entity Linking Corpora 3 Fig. 1 The methodological framework for crowdsourcing

KBP2014 Entity Linking Scorer

Combining Similarities and Regression for Entity Linking

Entity Linking - GATE · What is Entity Linking • Entity linking is the task of identifying all mentions in text of a specific entity from a database or ontology • Also referred

Natural Language Processing Discourse, Entity Linking, and Pragmatics