Building Wordnets Piek Vossen, Irion Technologies.

  • Published on

  • View

  • Download

Embed Size (px)


  • Slide 1

Building Wordnets Piek Vossen, Irion Technologies Slide 2 Overview Starting points Semantic framework Process overview Methodologies in other projects Multilinguality Slide 3 Starting points Purpose of the wordnet database: education, science, applications formal ontology or linguistic ontology making inferences or lexical substitution conceptual density or large coverage Distributed development Reproducability Available resources Language-specific features (Cross-language) compatibility Exploit cummunity resources by projecting conceptual relations on a target wordnet Slide 4 Semantic framework Slide 5 Differences in wordnet structures voorwerp {object} lepel {spoon} werktuig {tool} tas {bag} bak {box} blok {block} lichaam {body} Wordnet1.5Dutch Wordnet bag spoon box object natural object (an object occurring naturally) artifact, artefact (a man-made object) instrumentality blockbody container device implement tool instrument - Artificial Classes versus Lexicalized Classes: instrumentality; natural object - Lexicalization differences of classes: container and artifact (object) are not lexicalized in Dutch Slide 6 Linguistic versus conceptual ontologies Conceptual ontology: A particular level or structuring may be required to achieve a better control or performance, or a more compact and coherent structure. Introduce artificial levels for concepts which are not lexicalized in a language (e.g. instrumentality, hand tool), Neglect levels which are lexicalized but not relevant for the purpose of the ontology (e.g. tableware, silverware, merchandise ). What properties can we infer for spoons? spoon -> container; artifact; hand tool; object; made of metal or plastic; for eating, pouring or cooking Linguistic ontology: Exactly reflects the relations between all the lexicalized words and expressions in a language. Valuable information about the lexical capacity of languages: what is the available fund of words and expressions in a language. What words can be used to name spoons? spoon -> object, tableware, silverware, merchandise, cutlery, Slide 7 Wordnets as Linguistic Ontologies Classical Substitution Principle: Any word that is used to refer to something can be replaced by its synonyms, hyperonyms and hyponyms: horse stallion, mare, pony, mammal, animal, being. It cannot be referred to by co-hyponyms and co-hyponyms of its hyperonyms: horseXcat, dog, camel, fish, plant, person, object. Conceptual Distance Measurement: Number of hierarchical nodes between words is a measurement of closeness, where the level and the local density of nodes are additional factors. Main purpose is to predict what words can be used as substitutes in language, considering all the lexicalized words in a language. Slide 8 Define a semantic framework Definition of relations Diagnostic frames (Cruse 1986) Examples and corpus data Top-level ontology Constraints on relations Type consistency Large scale validation Slide 9 Process overview Slide 10 Techniques Manual encoding and verification Automatic extraction: definitions synonyms distribution and similarity patterns in copora defining contexts, e.g. cats and other pets parallel corpora, e.g. bible translations morphological structure bilingual dictionaries Encode source and status of data: who, when, based on what algorithm, validated, final Slide 11 Encoding cycle 1. Collecting data Vocabulary: what is the list of words of a language? Concepts: what is the list of concepts related to the vocabulary? 2. Encoding data: Defining synsets Defining language internal relations: hyponymy, meronymy roles, causal relations Defining equivalence relations to English Defining other relations,e.g. Ontology types, Domains 3. Validation 4. Go to 1. Slide 12 Where to start? How to get a first selection: Words (alphabetic, frequency) -> concepts -> relations Concept (hyperonym, domain, semantic feature) -> words - > concepts -> relations How to get a complete overview of words and expressions that belong to a segment of a wordnet? Up to 20 hyperonyms for instrumentality: instrument, instrumentality, means, tool, device, machine, apparatus,.... iterative process: collect, structure, collect, restructure... using multiple sources of evidence comparing results, e.g. tri-cycle is a toy or a vehicle Slide 13 Synonymy as a basis? Synsets are the core unit of a wordnet database Synonymy is only vaguely defined: substitution in a context. Synonyms are very hard to detect Other relations (role relations, causal relations): easier to detect and encode easier to validate within a formal framework easier to validate in a corpus Rich set of relations per concept help alignment with other resources Slide 14 Diagnostic frames and examples Agent Involvement (A/an) X is the one/that who/which does the Y, typically intentionally. Conditions:- X is a noun - Y is a verb in the gerundive form Example: A teacher is the one who does the teaching intentionally Effect: {to teach} (Y) INVOLVED_AGENT {teacher} (X) Patient Involvement (A/an) X is the one/that who/which undergoes the Y Conditions:- X is a noun - Y is a verb in the gerundive form Example: A learner is the one who undergoes the learning Effect: {to learn} (Y) INVOLVED_PATIENT {learner} (X) Slide 15 Diagnostic frames and examples Result Involvement A/an) X is comes into existence as a result of Y, where X is a noun and Y is a verb in the gerundive form and a hyponym of make, produce, generate. Example: A crystal comes into existence as a result of crystalizing A crystal is the result of crystalizing A crystal is created by crystalizing Effect: {to crystalize} (Y) INVOLVED_RESULT {crystal} (X) Comments: Special kind of patient relation. The entity is not jut changed or affected but it comes into existence as a result of the event: Only applies to concrete entities (1stOrder) or mental objects such as ideas (3rdOrder). Situations that result from other situations are related by the CAUSE relation. Slide 16 Hyponymy overloading (Guarino 1998, Vossen and Bloksma 1998). The vocabulary does not clearly differentiate between orthogonal roles and disjoint types: role: passenger, teacher, student type: dog; cat ?: knife ->weapon, cutlery; spoon -> container, cutlery food materialhouse, church, school provide a formal and explicit semantics Validate the core wordnet: does it include the most frequent words? are semantic constraints violated? Extend the core wordnet: (5,000 synsets or more): automatic techniques for more specific concepts with high- confidence results add other levels of hyponymy add specific domains add easy derivational words add easy translation equivalence Validate the complete wordnet Slide 23 Developing a core wordnet Define a set of concepts(so-called Base Concepts) that play an important role in wordnets: high position in the hierarchy & high connectivity represented as English WordNet synsets Common base concepts: shared by various wordnets in different languages Local base concepts: not shared EuroWordNet: 1024 synsets, shared by 2 or more languages BalkaNet: 5000 synsets (including 1024) Common semantic framework for all Base Concepts, in the form of a Top-Ontology Manually translate all Base Concepts (English Wordnet synsets) to synsets in the local languages (was applied for 13 Wordnets) Manually build and verify the hypernym relations for the Base Concepts All 13 Wordnets are developed from a similar semantic core closely related to the English Wordnet Slide 24 63TCs 1024 CBCs First Level Hyponyms Remaining Hyponyms Hypero nyms CBC Represen- tatives Local BCs WMs related via non-hypo nymy Top-Ontology Inter-Lingual-Index Remaining Hyponyms Hypero nyms CBC Repre- senta. Local BCs WMs related via non-hypo nymy First Level Hyponyms Remaining WordNet1.5 Synsets Top-down methodology Slide 25 Domain Named Entities Next Level Hyponyms Sumo Ontology WordNet Synsets SBC Hyper nyms ABC EuroWordNet BalkaNet Base Concepts 5000 Synsets English Arabic Lexicon teach - darrasa WordNet Domains Domain chemics WordNet Synsets English Wordnet Arabic Wordnet Arabic word frequency Arabic roots & derivation rules Top-down methodology More Hyponyms Easy Translations Named Entities 1000 Synsets = Core wordnet 5000 synsets CBC WordNet Synsets 1045678-v {teach} WordNet Synsets 1045678-v {darrasa} Slide 26 Advantages of the approach Well-defined semantics that can be inherited down to more specific concepts Apply consistency checks Automatic techniques can use semantic basis Most frequent concepts and words are covered High overlap and compatibility with other wordnets Manual effort is focussed on the most difficult concepts and words Slide 27 Distribution over the top ontology clusters Slide 28 Wordnet DomainsConceptsProportion Wordnet DomainsConceptsProportion acoustics1040.092%linguistics15451.363% administration29742.624%literature6860.605% aeronautic1540.136%mathematics5750.507% agriculture3060.270%mechanics5320.469% alimentation280.025%medicine26902.374% anatomy27052.387%merchant_navy4850.428% anthropology8960.791%meteorology2310.204% applied_science280.025%metrology14091.243% archaeology680.060%military14901.315% archery50.004%money6240.551% architecture2550.225%mountaineering280.025% art4200.371%music9850.869% artisanship1480.131%mythology3140.277% astrology170.015%number2200.194% astronautics290.026%numismatics430.038% astronomy3760.332%occultism520.046% athletics220.019%oceanography100.009% Slide 29 EWN Interlingual Relations EQ_SYNONYM: there is a direct match between a synset and an ILI-record EQ_NEAR_SYNONYM: a synset matches multiple ILI-records simultaneously, HAS_EQ_HYPERONYM: a synset is more specific than any available ILI-record. HAS_EQ_HYPONYM: a synset can only be linked to more specific ILI-records. other relations:CAUSES/IS_CAUSED_BY, EQ_SUBEVENT/EQ_ROLE, EQ_IS_STATE_OF/EQ_BE_IN_STATE Slide 30 Multilinguality Slide 31 Complex equivalence relations eq_near_synonym 1. Multiple Targets One sense for Dutch schoonmaken (to clean) which simultaneously matches with at least 4 senses of clean in WordNet1.5: {make clean by removing dirt, filth, or unwanted substances from} {remove unwanted substances from, such as feathers or pits, as of chickens or fruit} (remove in making clean; "Clean the spots off the rug") {remove unwanted substances from - (as in chemistry)} The Dutch synset schoonmaken will thus be linked with an eq_near_synonym relation to all these sense of clean. 2. Multiple Source meanings Synsets inter-linked by a near_synonym relation can be linked to same target ILI- record(s), either with an eq_synonym or an eq_near_synonym relation: Dutch wordnet: toestel near_synonym apparaat ILI-records:{machine}; {device}; {apparatus}; {tool} Slide 32 Complex equivalence relations has_eq_hyperonym Typically used for gaps in WordNet1.5 or in English: genuine, cultural gaps for things not known in English culture, e.g. citroenjenever, which is a kind of gin made out of lemon skin, pragmatic, in the sense that the concept is known but is not expressed by a single lexicalized form in English, e.g.: Dutch hoofd only refers to human head and Dutch kop only refers to animal head, English uses head for both. has_eq_hyponym Used when wordnet1.5 only provides more narrow terms. In this case there can only be a pragmatic difference, not a genuine cultural gap, e.g.: Spanish dedo can be used to refer to both finger and toe. Slide 33 Overview of equivalence relations to the ILI RelationPOSSources: TargetsExample eq_synonymsame1:1auto : voiture car eq_near_synonymanymany : manyapparaat, machine, toestel: apparatus, machine, device eq_hyperonymsamemany : 1 (usually)citroenjenever: gin eq_hyponymsame(usually) 1 : manydedo : toe, finger eq_metonymysamemany/1 : 1universiteit, universiteitsgebouw: university eq_diathesissamemany/1 : 1raken (cause), raken: hit eq_generalizationsamemany/1 : 1schoonmaken : clean Slide 34 Filling gaps in the ILI Types of GAPS 1. genuine, cultural gaps for things not known in English culture, e.g. citroenjenever, which is a kind of gin made out of lemon skin, Non-productive Non-compositional 2. pragmatic, in the sense that the concept is known but is not expressed by a single lexicalized form in English, e.g.: container, borrower, cajera (female cashier) Productive Compositional 3. Universality of gaps: Concepts occurring in at least 2 languages Slide 35 Productive and Predictable Lexicalizations exhaustively linked to the ILI beat stamp {doodslaan V } NL {cajera N } ES {doodschoppen V } NL {doodstampen V } NL kill kick {tottrampeln V } DE {totschlagen V } DE hypernym cashier female young fish {casire} NL {alevn N } ES in_state hypernym Slide 36


View more >