Embed Size (px)
DESCRIPTION
DEANNA: Natural Language Questions for the Web of Data. “Classical” QA . “ Who played in Casablanca and was married to a writer born in Rome? ”. “Classical” QA . “ Who played in Casablanca and was married to a writer born in Rome? ”. - PowerPoint PPT Presentation
Citation preview
DEANNA: Natural Language Questions for the Web of Data
Mohamed Yahya† Klaus Berberich† Shady Elbassiousni*
Maya Ramanath‡ Volker Tresp# Gerhard Weikum†
† Max Planck Institute for Informatics
*Qatar ComputingResearch Institute
‡IIT Delhi # Siemens
Natural Language Questions for the Web of Data - Yahya et al. 2
“Who played in Casablanca and was married to a writer born in Rome?”
“Classical” QA
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 3
“Who played in Casablanca and was married to a writer born in Rome?”
“Classical” QA
EMNLPJuly 12, 2012
Ingrid Bergman (29 August 1915 – 29 August 1982) was a Swedish actress who starred in a variety of European and American films. She won three Academy Awards, two Emmy Awards, and the Tony Award for Best Actress. She is ranked as the fourth greatest female star of American cinema of all time by the American Film Institute. She is best remembered for her roles as Ilsa Lund in Casablanca (1942), a World War II drama co-starring Humphrey Bogart and as Alicia Huberman in Notorious (1946), an Alfred Hitchcock thriller co-starring Cary Grant.
Natural Language Questions for the Web of Data - Yahya et al. 4
“Who played in Casablanca and was married to a writer born in Rome?”
“Classical” QA
EMNLPJuly 12, 2012
Ingrid Bergman (29 August 1915 – 29 August 1982) was a Swedish actress who starred in a variety of European and American films. She won three Academy Awards, two Emmy Awards, and the Tony Award for Best Actress. She is ranked as the fourth greatest female star of American cinema of all time by the American Film Institute. She is best remembered for her roles as Ilsa Lund in Casablanca (1942), a World War II drama co-starring Humphrey Bogart and as Alicia Huberman in Notorious (1946), an Alfred Hitchcock thriller co-starring Cary Grant.
In 1950, after a decade of stardom in American films, she starred in the Italian film Stromboli, which led to a love affair with director Roberto Rossellini while they were both already married. The affair and then marriage with Rossellini created a scandal that forced her to remain in Europe until 1956, when she made a successful Hollywood return in Anastasia, for which she won her second Academy Award, as well as the forgiveness of her fans. Many of her personal and film documents can be seen in the Wesleyan University Cinema Archives.[4]
Natural Language Questions for the Web of Data - Yahya et al. 5
“Who played in Casablanca and was married to a writer born in Rome?”
“Classical” QA
EMNLPJuly 12, 2012
Ingrid Bergman (29 August 1915 – 29 August 1982) was a Swedish actress who starred in a variety of European and American films. She won three Academy Awards, two Emmy Awards, and the Tony Award for Best Actress. She is ranked as the fourth greatest female star of American cinema of all time by the American Film Institute. She is best remembered for her roles as Ilsa Lund in Casablanca (1942), a World War II drama co-starring Humphrey Bogart and as Alicia Huberman in Notorious (1946), an Alfred Hitchcock thriller co-starring Cary Grant.
In 1950, after a decade of stardom in American films, she starred in the Italian film Stromboli, which led to a love affair with director Roberto Rossellini while they were both already married. The affair and then marriage with Rossellini created a scandal that forced her to remain in Europe until 1956, when she made a successful Hollywood return in Anastasia, for which she won her second Academy Award, as well as the forgiveness of her fans. Many of her personal and film documents can be seen in the Wesleyan University Cinema Archives.[4]
Roberto Gastone Zeffiro Rossellini (8 May 1906 – 3 June 1977) was an Italian film director and screenwriter. Rossellini was one of the directors of the Italian neorealist cinema, contributing films such as Roma città aperta (Rome, Open City 1945) to the movement.
Natural Language Questions for the Web of Data - Yahya et al. 6
“Who played in Casablanca and was married to a writer born in Rome?”
“Classical” QA
EMNLPJuly 12, 2012
Ingrid Bergman (29 August 1915 – 29 August 1982) was a Swedish actress who starred in a variety of European and American films. She won three Academy Awards, two Emmy Awards, and the Tony Award for Best Actress. She is ranked as the fourth greatest female star of American cinema of all time by the American Film Institute. She is best remembered for her roles as Ilsa Lund in Casablanca (1942), a World War II drama co-starring Humphrey Bogart and as Alicia Huberman in Notorious (1946), an Alfred Hitchcock thriller co-starring Cary Grant.
In 1950, after a decade of stardom in American films, she starred in the Italian film Stromboli, which led to a love affair with director Roberto Rossellini while they were both already married. The affair and then marriage with Rossellini created a scandal that forced her to remain in Europe until 1956, when she made a successful Hollywood return in Anastasia, for which she won her second Academy Award, as well as the forgiveness of her fans. Many of her personal and film documents can be seen in the Wesleyan University Cinema Archives.[4]
Roberto Gastone Zeffiro Rossellini (8 May 1906 – 3 June 1977) was an Italian film director and screenwriter. Rossellini was one of the directors of the Italian neorealist cinema, contributing films such as Roma città aperta (Rome, Open City 1945) to the movement.
Rossellini was born in Rome. His mother, Elettra (née Bellan), was a housewife, and his father, Angiolo Giuseppe "Beppino" Rossellini, owned a construction firm. His mother was of part French descent, from immigrants who had arrived in Italy during the Napoleonic Wars. He lived on the Via Ludovisi, whereBenito Mussolini had his first Roman hotel in 1922 when Fascism obtained power in Italy.
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 7
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 8
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 9
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 10
Subject Predicate ObjectRome isA citycity subclassOf locationRoberto_Rossellini mariedTo Ingrid_Bergman
WordNet+
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 11
Subject Predicate ObjectRome isA citycity subclassOf locationRoberto_Rossellini mariedTo Ingrid_Bergman
WordNet+
YAGO2: 120 million facts on 10 million entities
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 12
Subject Predicate ObjectRome isA citycity subclassOf locationRoberto_Rossellini mariedTo Ingrid_Bergman
WordNet+
YAGO2: 120 million facts on 10 million entities
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 13
Subject Predicate ObjectRome isA citycity subclassOf locationRoberto_Rossellini mariedTo Ingrid_Bergman
WordNet+
YAGO2: 120 million facts on 10 million entities
Natural Language Questions for the Web of Data - Yahya et al.
QA, meet the (semantic) Web of Data
EMNLPJuly 12, 2012 14
Subject Predicate ObjectRome isA citycity subclassOf locationRoberto_Rossellini mariedTo Ingrid_Bergman
WordNet+
YAGO2: 120 million facts on 10 million entities
LOD: > 31 BILLION triples
Natural Language Questions for the Web of Data - Yahya et al. 15
Semantics Types
EMNLPJuly 12, 2012
U.S. CitiesITS LARGEST AIRPORT WAS
NAMED FOR A WORLD WAR II HERO; ITS SECOND LARGEST, FOR A WORLD
WAR II BATTLE
What is Toronto???
Natural Language Questions for the Web of Data - Yahya et al. 16
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 17
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQL
Natural Language Questions for the Web of Data - Yahya et al. 18
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQLProjection Variable
Natural Language Questions for the Web of Data - Yahya et al. 19
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
Dot: conjunction
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQLProjection Variable
Natural Language Questions for the Web of Data - Yahya et al. 20
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
Dot: conjunction ?p, ?w: variables to be bound
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQLProjection Variable
Natural Language Questions for the Web of Data - Yahya et al. 21
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
Dot: conjunction ?p, ?w: variables to be bound Same variable same binding (join)
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQLProjection Variable
Natural Language Questions for the Web of Data - Yahya et al. 22
Crash Course: Querying the Web of Data
“Who played in Casablanca and was married to a writer born in Rome?”
Dot: conjunction ?p, ?w: variables to be bound Same variable same binding (join)
EMNLPJuly 12, 2012
SELECT ?p WHERE{ ?p type person . ?p actedIn Casablanca_(film). ?p isMarriedTo ?w . ?w type writer . ?w bornIn Rome }
SPARQL
?p ?w
Projection Variable
Natural Language Questions for the Web of Data - Yahya et al.
What is DEANNA?
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers23
Natural Language Questions for the Web of Data - Yahya et al.
What is DEANNA?
EMNLPJuly 12, 2012
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers24
Natural Language Questions for the Web of Data - Yahya et al.
What is DEANNA?
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome .
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers25
Natural Language Questions for the Web of Data - Yahya et al.
What is DEANNA?
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome .
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers26
Natural Language Questions for the Web of Data - Yahya et al.
What is DEANNA?
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome .
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers27
Natural Language Questions for the Web of Data - Yahya et al. 28
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Natural Language Questions for the Web of Data - Yahya et al. 29
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 30
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 31
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 32
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 33
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 34
Inside DEANNA
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
Natural Language Questions for the Web of Data - Yahya et al. 35
Structured Query Generation
EMNLPJuly 12, 2012
SELECT ?p WHERE { ?p type person. ?p actedIn Casablanca_(film). ?p isMarriedTo ?w. ?w type writer . ?w bornIn Rome }
q1
q2
q3
a writer
Casablanca
played in
Who
was married to
was born
Rome
c:writer
r:bornInPlace
e:Rome
e:Casablanca_(film)
r:actedIn
c:person
r:isMarriedTo
Natural Language Questions for the Web of Data - Yahya et al. 36
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
Disambiguation graph construction
Disambiguation graph processing
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 37
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 38
Phrase Detection
EMNLPJuly 12, 2012
• Concepts: entities & classes: Dictionary-based
• Relations:Mainly use Reverb [Fader et al. EMNLP’11]: V | VP | VW*P… was/VBD married/VBN to/TO a/DT…
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
… …
Natural Language Questions for the Web of Data - Yahya et al. 39
Phrase Detection
EMNLPJuly 12, 2012
Casablanca
played
played in
Who
married
married to
was married to
a writer
• Concepts: entities & classes: Dictionary-based
• Relations:Mainly use Reverb [Fader et al. EMNLP’11]: V | VP | VW*P… was/VBD married/VBN to/TO a/DT…
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
… …
Natural Language Questions for the Web of Data - Yahya et al. 40
Phrase Detection
EMNLPJuly 12, 2012
Casablanca
played
played in
Who
married
married to
was married to
a writer
• Concepts: entities & classes: Dictionary-based
• Relations:Mainly use Reverb [Fader et al. EMNLP’11]: V | VP | VW*P… was/VBD married/VBN to/TO a/DT…
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
… …
Natural Language Questions for the Web of Data - Yahya et al. 41
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 42
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al.
Phrase Mapping
EMNLPJuly 12, 2012
Casablanca
played
played in
43
Natural Language Questions for the Web of Data - Yahya et al.
Phrase Mapping
EMNLPJuly 12, 2012
Casablanca
played
played in
44
Concepts: entities & classes: Dictionary-based
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
Played_(film) Played
Natural Language Questions for the Web of Data - Yahya et al.
Phrase Mapping
EMNLPJuly 12, 2012
Casablanca
played
played in
e:White_Housee:Casablanca
e:Casablanca_(film)e:Played_(film)
45
Concepts: entities & classes: Dictionary-based
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
Played_(film) Played
Natural Language Questions for the Web of Data - Yahya et al.
Phrase Mapping
EMNLPJuly 12, 2012
Casablanca
played
played in
e:White_Housee:Casablanca
e:Casablanca_(film)e:Played_(film)
46
Concepts: entities & classes: Dictionary-based
• Relations: Dictionary -based
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
Played_(film) Played
Relation Phrase
actedIn acted in
actedIn played in
hasMusicalRole plays
hasMusicalRole mastered
Natural Language Questions for the Web of Data - Yahya et al.
Phrase Mapping
EMNLPJuly 12, 2012
Casablanca
played
played in
e:White_Housee:Casablanca
e:Casablanca_(film)e:Played_(film)
r:actedIn
r:hasMusicalRole
47
Concepts: entities & classes: Dictionary-based
• Relations: Dictionary -based
Concept Phrase
Casablanca Casablanca
Casablanca Casablanca, Morocco
Casablanca_(film) Casablanca the film
Casablanca_(film) Casablanca
Played_(film) Played
Relation Phrase
actedIn acted in
actedIn played in
hasMusicalRole plays
hasMusicalRole mastered
Natural Language Questions for the Web of Data - Yahya et al. 48
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 49
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 50
Dependency Detection
EMNLPJuly 12, 2012
Look for specific patterns in dependency parses [de Marneffe et al. LREC’06]
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
Natural Language Questions for the Web of Data - Yahya et al. 51
Dependency Detection
EMNLPJuly 12, 2012
Look for specific patterns in dependency parses [de Marneffe et al. LREC’06]
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
Natural Language Questions for the Web of Data - Yahya et al. 52
Dependency Detection
EMNLPJuly 12, 2012
Look for specific patterns in dependency parses [de Marneffe et al. LREC’06]
writer
in
born
Rome
partmod
prep
pobj
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
Natural Language Questions for the Web of Data - Yahya et al. 53
Dependency Detection
EMNLPJuly 12, 2012
Look for specific patterns in dependency parses [de Marneffe et al. LREC’06]
writer
in
born
Rome
partmod
prep
pobj
q1
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
Natural Language Questions for the Web of Data - Yahya et al. 54
RESULT
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 55
Disambiguation Graph
EMNLPJuly 12, 2012
q1
q2
q3
a writer
Casablanca
played
played in
Who
married
married to
was married to
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
e:White_Housee:Casablanca
e:Casablanca_(film)e:Played_(film)
r:actedInr:hasMusicalRole
c:person
e:Married_(series)
c: married_personr:isMarriedTo
q-nodes
Phrase-nodesSemantic nodes
Natural Language Questions for the Web of Data - Yahya et al. 56
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 57
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 58
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 59
Joint Disambiguation - ILP
• ILP: Integer Linear Programming• maximize α Σi,j wi,jYi,j + β Σk,l vk,l Zk,l + …• Subject to:
No token in multiple phrases, Triples observe type constraints, …
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 60
Joint Disambiguation – Objective
α Σi,j wi,jYi,j + β Σk,l vk,l Zk,l
EMNLPJuly 12, 2012
Semantic nodes
q1
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
q-nodes
Phrase nodesCoherence Edges
Similarity Edges
Prior
Natural Language Questions for the Web of Data - Yahya et al. 61
Joint Disambiguation – Objective
α Σi,j wi,jYi,j + β Σk,l vk,l Zk,l
EMNLPJuly 12, 2012
Semantic nodes
Coherence
q1
a writer
was born
born
Rome
c:writerr:bornInPlacer:bornOnDate
e:Max_Borne:Born_(film)
e:Sydne_Romee:Rome
q-nodes
Phrase nodes Similarity Edges
Coherence Edges
Natural Language Questions for the Web of Data - Yahya et al. 62
Joint Disambiguation – Constraints
A phrase node can be assigned to one semantic node:
EMNLPJuly 12, 2012
Casablanca
e:White_House
e:Casablanca
e:Casablanca_(film)
Phrase nodes
Semantic nodes
a
1
2
3
Ya,1
Ya,2
Ya,3
α Σi,j wi,jYi,j + β Σk,l vk,l Zk,l
Natural Language Questions for the Web of Data - Yahya et al. 63
Joint Disambiguation – Constraints
A phrase node can be assigned to one semantic node:
EMNLPJuly 12, 2012
Casablanca
e:White_House
e:Casablanca
e:Casablanca_(film)
Phrase nodes
Semantic nodes
a
1
2
3
Ya,1
Ya,2
Ya,3
α Σi,j wi,jYi,j + β Σk,l vk,l Zk,l
Natural Language Questions for the Web of Data - Yahya et al. 64
Joint Disambiguation – ConstraintsClasses translate to type-constrained variables
Every semantic triple should have a class to join & project!
person actedIn Casablanca_(film)▼
?x type person . ?x actedIn Casablanca_(film)
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 65
Joint Disambiguation – ConstraintsClasses translate to type-constrained variables
Every semantic triple should have a class to join & project!
person actedIn Casablanca_(film)▼
?x type person . ?x actedIn Casablanca_(film)
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 66
Joint Disambiguation – ConstraintsClasses translate to type-constrained variables
Every semantic triple should have a class to join & project!
person actedIn Casablanca_(film)▼
?x type person . ?x actedIn Casablanca_(film)
EMNLPJuly 12, 2012
q1
a writer
was born
Rome
c:writer
r:bornInPlace
r:bornOnDate
e:Sydne_Rome
e:Rome
q-nodes
e:The_Writer (magazine)
Phrase nodes Semantic nodes
Natural Language Questions for the Web of Data - Yahya et al. 67
Joint Disambiguation – ConstraintsClasses translate to type-constrained variables
Every semantic triple should have a class to join & project!
person actedIn Casablanca_(film)▼
?x type person . ?x actedIn Casablanca_(film)
EMNLPJuly 12, 2012
q1
a writer
was born
Rome
c:writer
r:bornInPlace
r:bornOnDate
e:Sydne_Rome
e:Rome
q-nodes
e:The_Writer (magazine)
Phrase nodes Semantic nodes
Natural Language Questions for the Web of Data - Yahya et al. 68
Joint Disambiguation – ConstraintsClasses translate to type-constrained variables
Every semantic triple should have a class to join & project!
person actedIn Casablanca_(film)▼
?x type person . ?x actedIn Casablanca_(film)
EMNLPJuly 12, 2012
q1
a writer
was born
Rome
c:writer
r:bornInPlace
r:bornOnDate
e:Sydne_Rome
e:Rome
q-nodes
e:The_Writer (magazine)
Phrase nodes Semantic nodes
Natural Language Questions for the Web of Data - Yahya et al. 69
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 70
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 71
Structured Query Generation
EMNLPJuly 12, 2012
SELECT ?p WHERE { ?w type writer . ?w bornIn Rome . ?p type person. ?p actedIn Casablanca_(film). ?p isMarriedTo ?w }
q1
q2
q3
a writer
Casablanca
played in
Who
was married to
was born
Rome
c:writer
r:bornIn
e:Rome
e:Casablanca_(film)
r:actedIn
c:person
r:isMarriedTo
Natural Language Questions for the Web of Data - Yahya et al. 72
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 73
Outline
EMNLPJuly 12, 2012
5 Experiments & Results
DEANNA
Question
SPARQL
KB
Phrase detection
Phrase mapping
Dependencydetection
Joint Disambig.
QueryGeneration
1
2
3
4
Natural Language Questions for the Web of Data - Yahya et al. 74
Evaluation Methodology
• 3-stage evaluation for more insight:1. Disambiguation2. Query generation3. Query answering
• We rely on human judges
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 75
Datasets
• QALD-1 YAGO2 27/50 questions within scope “Which software has been published by Mean Hamster
Software?”
• NAGA [Elbassuoni et al. CIKM’09] YAGO+IMDB 44/87 questions within scope “Which director has won the Academy Award for Best
director and is married to an actress that has won the Academy Award for Best Actress?”
EMNLPJuly 12, 2012
Natural Language Questions for the Web of Data - Yahya et al. 76
Results 1/3: Disambiguation
EMNLPJuly 12, 2012
Benchmark QALD-1 NAGA
covmacro 0.973 0.934
precmacro 1.000 0.934
covmicro 0.963 0.945
precmicro 1.000 0.941
cov = correct/idealprec = correct / retrieved
Casablanca
e:White_House
e:Casablanca
e:Casablanca_(film)
Natural Language Questions for the Web of Data - Yahya et al. 77
Results 2/3: Query Generation
EMNLPJuly 12, 2012
Benchmark QALD-1 NAGA
covmacro 0.975 0.894
precmacro 1.000 0.941
covmicro 0.963 0.847
precmicro 1.000 0.906
cov = #correct triples/#ideal triplesprec = #correct triples/#retrieved triples
Issues:•Incorrect disambiguation•Incorrect dependencies.
Natural Language Questions for the Web of Data - Yahya et al. 78
Results 3/3: Answering
EMNLPJuly 12, 2012
Benchmark QALD-1 NAGA
#questions 27 44
#queries 20 41
#satisfactory 10 15
#relaxed +3 +3
Natural Language Questions for the Web of Data - Yahya et al. 79
Results 3/3: Answering
EMNLPJuly 12, 2012
Benchmark QALD-1 NAGA
#questions 27 44
#queries 20 41
#satisfactory 10 15
#relaxed +3 +3
unsatisfactory: main problem is empty result set
Natural Language Questions for the Web of Data - Yahya et al. 80
Results 3/3: Answering
EMNLPJuly 12, 2012
Benchmark QALD-1 NAGA
#questions 27 44
#queries 20 41
#satisfactory 10 15
#relaxed +3 +3
unsatisfactory: main problem is empty result set
Relaxation: Keep type constraints, everything else to keywords?x type writer . ?x bornIn Rome
▼?x type writer . ?x bornIn ?y [“Rome”]
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
DEANNA
Question
SPARQL
KB
Answers81
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers82
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers83
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers84
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers85
Rome isA citycity subclassOf locationRossellini mariedTo Bergman
Natural Language Questions for the Web of Data - Yahya et al.
Wrap-up
EMNLPJuly 12, 2012
?p type person.?p actedIn Casablanca_(film).?p isMarriedTo ?w.?w type writer .?w bornIn Rome
“Who played in Casablanca and was married to a writer born in Rome?”
DEANNA
Question
SPARQL
KB
Answers86
Rome isA citycity subclassOf locationRossellini mariedTo Bergman
87
QUESTIONS/COMMENTS?Thank you.
EMNLPJuly 12, 2012 Natural Language Questions for the Web of Data - Yahya et al.
bit.ly/mpi-deanna
![4XHVWLRQ $QVZHULQJ*HQHUDWLRQ &OR]H* …...cloze questions into natural questions using an un-supervised cloze-to-natural question translator. The conversion of cloze questions into](https://img.pdfslide.us/doc/110x75/606d7581d75319756603d92b/4xhvwlrq-qvzhulqjhqhudwlrq-orh-cloze-questions-into-natural-questions.jpg)
