Translation and Paraphrasing

Embed Size (px)

Citation preview

  • 8/9/2019 Translation and Paraphrasing

    1/29

  • 8/9/2019 Translation and Paraphrasing

    2/29

    OverviewThe ever changing counter-detection landscape

    Paraphrasing versus textualentailment

    Ways to paraphrase

    Tools of the trade

  • 8/9/2019 Translation and Paraphrasing

    3/29

    M any Roads to

    PlagiarismThe old fashioned way

  • 8/9/2019 Translation and Paraphrasing

    4/29

    M any Roads to

    PlagiarismTranslated plagiarism.

  • 8/9/2019 Translation and Paraphrasing

    5/29

    M any Roads to

    PlagiarismTranslated plagiarism.

  • 8/9/2019 Translation and Paraphrasing

    6/29

    M any Roads to

    PlagiarismParaphrased plagiarism

    Paraphrased plagiarism is not new either. However, there are newtools to aid in automatically paraphrasing text which are acceleratingthis form of detection avoidance.

    Back-translation: the latest form of plagiarismMichael Jones University of Wollongong, Australia

    4 th Asia Pacific Conference on Educational Integrity ( 4 APCEI) 2830 September 2009

    Paraphrase plagiat n'est pas nouveau non plus. Toutefois, il existede nouveaux outils pour l'aide dans le texte paraphrase

    automatiquement qui sont l'acclration de cette forme d'vasion dedtection.

    Paraphrase plagiarism is not new either. However, there arenew tools to help in paraphrasing the text automatically, which areaccelerating this form of escape detection.

  • 8/9/2019 Translation and Paraphrasing

    7/29

    M any Roads to

    PlagiarismParaphrased plagiarism

  • 8/9/2019 Translation and Paraphrasing

    8/29

    M any Roads to

    PlagiarismParaphrased plagiarism

  • 8/9/2019 Translation and Paraphrasing

    9/29

    Paraphrasing vs Textual

    EntailmentTwo sentences are paraphrased if

    they mean the same thing:1) Similarity: they share asubstantial amount of information

    2) Dissimilarities are extraneous: if extra information in the sentencesexists, the effect of its removal is

    not signicant.

  • 8/9/2019 Translation and Paraphrasing

    10/29

    Paraphrasing vs Textual

    Entailment A paraphrase is a special case of textual entailment. A paraphrase isreflexive whereas textual entailmentindicates that two sentences overlap

    to a degree with one sentence beingsubsumed by the other.

  • 8/9/2019 Translation and Paraphrasing

    11/29

    Ways to ParaphraseLexical substitution/synonymy

    Hypo/Syno/Hyper-nym replacement: article,

    paper or red, crimson Acronym replacement: M r., mister

    Contractions: do not, dont

    Compounding/decompounding: ballgame,ball game

    Numeric/Alphabetic numbers: 11, eleven;12/1/2010, December first two-thousand-ten

  • 8/9/2019 Translation and Paraphrasing

    12/29

    Ways to Paraphrase

    Active and passive exchange

    The gangster killed 3 innocentpeople. vs Three innocent peopleare killed by the gangster.

    Re-ordering of sentence componentsTuesday they met vs They metTuesday

    Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    13/29

    Ways to Paraphrase

    Realization in different syntacticcomponents

    Palestinian leader Arafat vs Arafat, Palestinian leader

    Prepositional phrase attachmentThe Alabama plant vs

    A plant in AlabamaZhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    14/29

    Ways to ParaphraseChange into different sentencetypes

    Who drew this picture? vsTell me who drew this picture.

    M orphological derivation

    He is a good teacher. vsHe teaches well. vsHe is good at teaching.

    Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    15/29

    Ways to Paraphrase

    Light verb construction

    The film impressed him. vsThe film made an impression onhim.

    Comparatives vs. superlativesHe is smarter than everyone else.vs He is the smartest one.

    Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    16/29

    Ways to Paraphrase

    Converse word substitution

    John is M ary's husband. vsM ary is John's wife.

    Verb nominalization

    He wrote the book. vsHe was the author of the book.

    Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    17/29

    Ways to Paraphrase

    Substitution using words withoverlapping meanings

    Bob excels at mathematics. vsBob studies mathematics well.

    InferenceHe died of cancer. vsCancer killed him.

    Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    18/29

    Ways to ParaphraseDifferent semantic role realization

    He enjoyed the game. vsThe game pleased him.

    Subordinate clauses vs separatesentences lined by anaphoricpronouns.

    The tree healed its wounds bygrowing new bark. vsThe tree healed its wounds. Itgrew new bark.Zhou, M ing and Niu, Cheng. Principled Approach to Paraphrasing. U.S. Patent 11,93 4 ,010. 1 Nov 2007.

  • 8/9/2019 Translation and Paraphrasing

    19/29

    Tools of the TradeM icrosoft paraphrase corpus

    Used to test algorithms

    WordNet: English only :(

    Synonyms, hypernyms,

    hyponyms, and antonyms. Algorithms: Finite State Transducers(FSTs) and/or iterative Longest

    Common Sequence (LCS) on sets.

  • 8/9/2019 Translation and Paraphrasing

    20/29

    Tools of the Trade

    Stemming or lemmatization

    am, are, is be

    car, cars, car's, cars' car

  • 8/9/2019 Translation and Paraphrasing

    21/29

    Word Alignment Examples According to the M S paraphrase corpus:

    This is a paraphrase

    Not Paraphrased (However, the first sentence is textually entailed by thesecond. Turnitin would currently match this.)

    12/1 4 = 86%12/16 = 75%

    18/19 = 95%18/26 = 69%

  • 8/9/2019 Translation and Paraphrasing

    22/29

    Slippery SlopeWhen does textual entailment become arbitrary/noise?

    14 /4 8 = 29%14 /34 = 4 1%

  • 8/9/2019 Translation and Paraphrasing

    23/29

    Slippery SlopeWhen does textual entailment become arbitrary/noise?

    13/2 4 = 5 4 %

    13/21 = 62%

  • 8/9/2019 Translation and Paraphrasing

    24/29

    Translated Plagiarism

    Non-English markets, in particular,are concerned about their Englishas a second language studentssubmitting English documents that

    have been translated to their nativelanguage.

  • 8/9/2019 Translation and Paraphrasing

    25/29

    Translated Plagiarism

    Initial approach:

    Non-English documents searchedas they are now

    Additional search performed:

    Translate document to English,search English documents, andthen display English matches withtranslations (or vice versa)

  • 8/9/2019 Translation and Paraphrasing

    26/29

    Translated PlagiarismOur new strategic partner:

    On demand SaaS statistical machinetranslation

  • 8/9/2019 Translation and Paraphrasing

    27/29

    Translated Plagiarism:

    Need for Paraphrasing?M achines and humans translate textin many different ways.

    Paraphrase detection allows us tomatch the variations.

    Google translate: The zeitgeist is thinking and feeling one age. The term describes the

    characteristics of a particular period, or an attempt to remind us it. The German word Zeitgeist is transferred through English as a loanword into numerous other languages been.

    Bing translate: Zeitgeist is thinking and feeling how an age. Is the nature of a particular era or trying to understand them. The German word Zeitgeist is taken from English as a loanword inmany other languages.

    http://de.wikipedia.org/wiki/Zeitgeist

  • 8/9/2019 Translation and Paraphrasing

    28/29

    Possible Turnitin UI

  • 8/9/2019 Translation and Paraphrasing

    29/29

    Finis

    Thank you for listening!

    Questions?