Click to edit Master title style

Evaluation of Electronic Translation Tools Through Quality Parameters

Vlasta Kučiš University of Maribor, Department of Translation Studies

Sanja Seljan, Ksenija Klasnić University of Zagreb

*Department of Information Sciences**Department of Sociology

Click to edit Master title styleOverview

Theoretical part– EU & multilingualism– Education for translators – EMT (European Master’s in Translation)

Empirical part– Research (goal, sample, tools)– Evaluation

Results

Conclusion

Click to edit Master title styleHow to make Multilingual Communication & Translation in the 21.st century…

???

Click to edit Master title style Translation and the EU• EU - communication in 23 official languages

Increased translation demands

• Multilingualism policy unique in the world all languages = equal status

• DGT the biggest translation service 8.000 pages per day / 6.000 translators

• Changes in translation profession development of language technologies

• Education for translators - EMT

Click to edit Master title styleDGT brings the EU closer to the

citizens

Click to edit Master title styleMultilingualism is about building bridges, between people and across policies.

• Efficient and pragmatic internal

language regimes

Access to institutions, rights and obligations

Interaction between citizens

Dimensions:

Click to edit Master title style Official EU languages 1958-2008

24.Croatian 2012 ???

Click to edit Master title styleEvolution of the translation service

in the European Commission

1958 2008 Increase

Languages 4 23 X 6

Management 4 118 X 30

Staff 25 2500 X 100

Pages translated

17 000 1 800 000 X 100

Click to edit Master title styleEuropean Master’s EMT

• High-quality training for professional translators experts in multilingual communication

• Enhance the status of translation as a profession criteria of excellence

• Competences: language, intercultural, thematic, technological, organisational

Click to edit Master title styleII RESEARCH

• Sample N=51 student all 4 years (convenient sample)• Department of Translation Studies, University of Maribor• 2 EU-texts of similar length

– text 1 =159 words / group A; – text 2 = 140 words / group B

• German - Slovene• 45 minutes • Evaluation - by professional bilingual translator (German

+ Slovene as mother tongues)

Click to edit Master title styleTools

Group A • traditional• electronic dictionary

Ger-Slo(Debenjak)• online dict. Duden

www.duden.de• search engines

(Google + Yahoo )

Group B• Slov. Evrokorpus

www.evrokorpus.gov.si• Slov. Evroterm

www.evroterm.gov.si• Terminology base

integrated into SDL Trados

Click to edit Master title styleMistake categories:

1. Lexical mistakes

2. Spelling & punctuation mistakes

3. Syntactic & stylistic mistakes

Click to edit Master title styleResults

• Total number of mistakes and paired samples statistics

p<0.001 – average number of all mistakes has statistically significantly decreased

Click to edit Master title styleLexical mistakes

Statistically significant difference al level p<.001, df=50

Click to edit Master title styleSpelling & punctuation mistakes

- no. of spelling mistakes: A) 243 B) 131- coefficient of variability – bigger in B) -> need for adequate education for use of translation tools

Statistically significant difference al level p<.001, df=50

Click to edit Master title styleSyntactic & stilistic mistakes

- no. of spelling mistakes: A) 236 B) 138- coefficient of variability – bigger in B) -> need for adequate education for use of translation tools

Use of translation tools has at statistically significant level decreased number of syntactic and stylistic mistakes with p<.001, df=50

t=4.43

Click to edit Master title styleImprovements in %

Click to edit Master title style CONCLUSION

• Introduction of CAT tools significantly influence the quality

• coefficient of variability – bigger in B) -> need for adequate education for use of translation tools

• T-tests – statistically significant difference at all levels with p<0.001

• Acceptance of hypothesis: – Online translation tools contribute to the quality and

consistency of technical translations at all 3 levels

• facing new challenges in education, business, cooperation