Tel More Telugu Morphological Generator Madhavi Ganapathiraju and Lori Levin Language Technologies Institute Carnegie Mellon University Pittsburgh USA

Tel MoreTel MoreTelugu Morphological Telugu Morphological

GeneratorGenerator

Madhavi Ganapathiraju and Lori Levin

Language Technologies InstituteCarnegie Mellon University

Pittsburgh USA

ICUDL 2006: Second International Conference on Universal Digital LibraryAlexandria, Egypt

November 17-19, 2006

19th Nov, 2006 ICUDL2006: TelMore - Telugu Morphological Generator 2

machine translationmachine translation

summarizationsummarization

Information retrievalInformation retrieval

Interface designInterface design digital storagedigital storage

OCROCR

U D L


machine translation

Rani gave the book to my mother1. Output from English Lexical analysis

gave Verb past, root give the book Noun phrase, singular, neutral

mother noun, singular, femininemy possessive, root I

…

2. English – Telugu Dictionary for root forms of nouns and verbsgive ichchut’abook pustakamumother talli, ammaI neinu

3. TelMore: Morphological generator for Telugu

ichchut’a ichchaad’u (past masc), ichchinadi (past fem), ... Istun’di (future fem), istaad’u (future masc)pustakamu pustakamu, pustakamutoo (with pustakamu), pustakamu loo (in pustakamu)…amma ammaki (to amma), amma cheita (by amma)I naa (possessive)

3. TelMore: Morphological generator for Telugu

1. Phrase match in EBMT Gave to <noun> <noun> ki ichchaad’u

OR


TelMore

Generates morphological forms for nouns and verbs

when the root word is given


About Telugu

2nd largest spoken language in India (?)• 70 M native speakers• World ranking 13-17

– with Korean, Vietnamese, Marathi and Tamil

• 7th century AD recorded origin• literary language in 11th century AD


Parts of Speech: Noun

• Number: singular, plural• Gender: male, female, neutral• Morphological forms: (vibhaktulu)

– nominative, genitive, dative, accusative, vocative, instrumental and locative

14 forms for each noun


Plural formation

General rule is to add “lu” as a suffix;

A series of rules are then applied to yield final form of :

©Õ (lu), ©Õx (llu), @ÁÙ} (l’l’u) or ¢œ¿Õx (n’d’lu)


Parts of Speech: Verb• Number: singular, plural• Gender: male, female, neutral• Voice: 1st person, 2nd person, 3rd person• Morphological forms:

– Present, past, future, aorist affirmative, aorist negative, imperative and prohibitive

– Present participle, past participle : affirmative and negative

• Number of forms: 2 x 3 x 3 x 7 + 4

130 forms for each verb


Features in TelMore (v.1)

• Morphological form generation– Nouns– Verbs

• System– Library module for integration elsewhere– Flat file input & output (plain text or html)– User-interactive through command line– Web interface for data addition with user validation

• Web Interface


Current Data Size

words have been created by native speakers upon request

Nouns

Number of Unique Stems

Number of Morph Forms

1 247 34582 541 75743 28 392

3.2 14 1963.3 8 1123.4 18 2523.5 6 84

Verbs1 55 4180

Total 917 16248







Linguistic Knowledge

• The linguistic rules are taken from a book by C.P. Brown – Rules are demonstrated through examples– No formal description


Noun: First Declension Morphs


Noun: Second Declension


Noun: Third Declension


Noun: Third Declension:Irregular 2


Noun: Third Declension: Irregular 3






Verb: First Conjugation


Verb: Second Conjugation


Verb: Third Conjugation


Alternate dialects and spellings

Telugu is spoken in many dialects– Andhra Pradesh has long

borders with 4 states each of which speaks a different language, and one long coastal region

– Dialects in each of these regions is different

– learned and the others speak different dialects

– Urdu influence in Hyderabad due to Muslim rule

– pure/poetic formal/informal

Telugu is written the way it is spoken

Hence the different dialects result in different spellings of the words


Future work for this tool

• Causative, middle and passive voices to be added

• Morphology of adjectives, etc

• Integration of Om native font integration for flat file processing

• Integration with English Lexicon to be of real use in multilingual applications


Acknowledgemen

Acknowledgemen

tsts Prof. Lori LevinLinguistics Advisor

Prof. Raj ReddyProf. N. Balakrishnan

UDL Advisors

R. HarshaNaveena YanamalaWeb-interface creation

Data Creation …V. Mythili ShyamG. Padmasree

V. AbhinayB.V. Prashanth

G. Ramana LakshmiG. PadmavathyV. Nava Mallika


http://linzer.blm.cs.cmu.edu/morph/http://linzer.blm.cs.cmu.edu/morph/www.cs.cmu.edu/~madhaviwww.cs.cmu.edu/~madhavi

Documents

Tel More Telugu Morphological Generator Madhavi Ganapathiraju and Lori Levin Language Technologies Institute Carnegie Mellon University Pittsburgh USA