48
s Andrejs Vasiļjevs [email protected] MT Showcase | LocWorld2014 | Dublin | 04.06.2014 MT applications in the EU public sector

TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Embed Size (px)

DESCRIPTION

This presentation is a part of the MosesCore project that encourages the development and usage of open source machine translation tools, notably the Moses statistical MT toolkit. MosesCore is supported by the European Commission Grant Number 288487 under the 7th Framework Programme. For the latest updates go to http://www.statmt.org/mosescore/ or follow us on Twitter - #MosesCore

Citation preview

Page 1: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

s

Andrejs Vasiļ[email protected]

MT Showcase | LocWorld2014 | Dublin | 04.06.2014

MT applications in the EU public sector

Page 2: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

• Language technology developer

• Localization service provider

• Leadership in smaller languages

• Offices in Riga (Latvia), Tallinn (Estonia) and Vilnius (Lithuania)

• 130 employees

• Strong R&D team

• 9 PhDs and candidates

• Trusted partner of the EU for significant research projects

Page 3: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

G2CGovernment to Citizens

G2CGovernment to Businesses

G2EGovernment to Employees

G2GGovernment to Governments

C2GCitizens to GovernmentseGovernment

Page 4: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

• Better business environment

• Customers on-line, NOT in line

• Improving efficiency

• Increase participation

• Reach marginalized groupsGoals of

e-Government

Page 5: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

80European languages

24 official languages

1.1B EUREU spends per annum on translation services

Multilingual Europe

Page 6: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

The five most widely spoken foreign languages in Europe

38%

12% 11%7% 5%

0%

5%

10%

15%

20%

25%

30%

35%

40%

English French German Spanish Russian

% of European Union population

Page 7: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Europeans able to hold a conversation in additional language

54%

25%

10%0%

10%

20%

30%

40%

50%

60%

at least one at least two at least three

% of European Union population

Page 8: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

98%Luxembourg

95% Latvia

94%Netherlands

93%Malta

92%SloveniaLithuania

91%Sweden

EU countries where people can speak at least one language in addition to their mother tongue

Page 9: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

65%Hungary

62% Italy

61%United Kingdom

Portugal

60%Ireland

EU countries where majority of people can not speak anyforeign language

Page 10: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

What role does translation playin your everyday life?

is translation important

?

43

16

30

% of EU population

important

very important

no role

Page 11: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

‘‘The language of Europe istranslation’’

Umberto Eco

Page 12: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Preserving the European cultural and linguistic diversity

Securing at affordable costs the free flow of information and thought across language boundaries

Providing each language community with the most advanced technologies

… so that maintaining their mother tongue does not turn into a disadvantage

Credits: Hans Uszkoreit

Page 13: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

EU MULTILINGUALITYIN PRACTICE:CASE STUDY

In October 2010, a Spanish lawyer turned to the Ombudsman, complaining that many public consultations are only published

in English, for example, consultations concerning a new partnership to help small and medium-sized enterprises and

concerning the freedom of movement of workers.

Page 14: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 15: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 16: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

“The Commission should ensure that all European citizens are able to understand its public consultations, which should [..] be published in all the official languages. Its failure to do so is an instance of maladministration.”

4 October 2012The European Ombudsman, P. Nikiforos Diamandouros

Page 17: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

[European] Commission [has] to ensure that every EU citizen's right to address the EU institutions in any of the EU official languages is fully respected and implemented by ensuring that public consultations are available in all EU official languages,[..] and that there is no language-based

discrimination [..]European Parliament resolution 2012/2676(RSP)

Page 18: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Fulfill the vision ofe-Government

AND

the promise oflanguage diversityThe e-Government

Challenge

Page 19: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

machine translation

machine translation

Page 20: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

What MT serves best

Short shelf life

Immediacy

Large volume

Multiple languages

Page 21: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Where it works

Embedded in webpages

Multilingual onlineservices

Social media

Multi-lingual chat

Mobile devices

Page 22: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Customizable, trainable

Domain specific

On-demand

In the cloud

Real –time

Security

PrivacySpecificrequirements

Page 23: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Case Study:LATVIA

Case study: MT for eGov in Latvia

Page 24: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Population 2,1 M

1,6 million native Latvianspeakers

Large Russian speakingpopulation (36%)

Lack of parallel data

Complex language structure

Highly inflected

Languagesituation in

Latvia

Page 25: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

• To provide e-services to all the population / linguistic groups

• To develop technologies for supporting Latvian in information society

• To facilitate access to the information of European Union institutions

• To integrate in the infrastructure of EU multilingual servicesGOAL

MT @ eGov.LV

Page 26: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Online translationservice

Translation widget forintegration in eGovservice sites

Standardized API foruniversal integratability

INTEGRATABILITYMT @ eGov.LV

Page 27: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

MT@

eGov.LV

Page 28: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

custommachine

translationas easy

and affordable

as a cup

of coffee

Page 29: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

• upload your dataTMX, XLIFF, DOC, PPTX, XLSX, PDF, XLZ, TXT

• combine it with the data on the LetsMT public repository

• generate your custom MT with a few mouse clicks

• run your MT system on the LetsMT cloud

• use it in your CAT tool with LetsMT plug-in

• integrate through LetsMT APIin online or desktop app

Page 30: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 31: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

2,4 billionparallel sentences

5,8 billionmonolingual sentences

126languages

548MT systems

currently provided

Page 32: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Recently added:EUBookshop data

3.6 billions of words

from

135,000 documents

48 languages

>10 million parallel sentences

for some language pairs

Page 33: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Data for SMT training

Page 34: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

customterminology

incremental data

customMT

Page 35: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Online Terminology Services

Translation

Training

SMT System Training and adaptation

Online Translation Service

Input Text for Translation

Parallel corpus

Monolingual corpus

Bilingual term collections

Monolingual Term

Extraction

Trained SMT

Model

Bilingual Term

Extraction

Translated Text

Page 36: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Multiple translation options

• copy texts into the online translator

• upload entire files and documents

• or translate in your own work environment (CAT tools)

Page 37: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 38: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

.

Page 39: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 40: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Use case: MT to support EU Presidency

Page 41: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Case Study:LATVIA

Case study: MT as a Public Service inLithuania

Page 42: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

25.1%

28.5%

Czech Polish

32.9%

Latvian

Productivity evaluation

Productivity evaluation

Page 43: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Estonian

Public

MT

Page 44: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde
Page 45: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Better than Google

Better than Google & Bing

37,38

44,15

28,8

38,42

24,22

37,97

35,04

42,92

18,59

32,56

21,45

35,3

26,95

37,32

16,86

33,09

17,42

30,14

16,7

26,11

0

5

10

15

20

25

30

35

40

45

50

English-Latvian Latvian-English English-Lithuanian Lithuanian-English English-Estonian Estonian-English

Tilde Google Microsoft Tartu Uni

Page 46: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Deliver the strategic vision, functional, technical and operational specifications of the infrastructure for EU public service for automated translation and other multilingual services and resources

Design a sustainable governance model for the multilingual infrastructure

Foster multi-stakeholders alliances to ensure its commitment and support for the deployment of the MLiand its usage

Towards the EU Public MT Infrastructure

Page 47: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

Machine translation

bringing governments and citizens closer

Page 48: TAUS MT Showcace, MT Applications in the EU Public Sector, Adrejs Vasiljevs, Tilde

[email protected]

Au

tho

r: -

Co

pyr

igh

t: S

tock

lib©

Ro

ber

t W

ilso

n