26
Elena Tarasheva, PhD New Bulgarian University

Corpora in assessing students’ writing

  • Upload
    jamese

  • View
    25

  • Download
    0

Embed Size (px)

DESCRIPTION

Corpora in assessing students’ writing. Elena Tarasheva, PhD New Bulgarian University. Conclusions at last year’s BETA conference. Method and effect of the previous study. 2 corpora: students’ writing – film analysis; 1 st & 2 nd draft - PowerPoint PPT Presentation

Citation preview

Page 1: Corpora in assessing students’ writing

Elena Tarasheva, PhDNew Bulgarian University

Page 2: Corpora in assessing students’ writing

Conclusions at last year’s BETA conference

Page 3: Corpora in assessing students’ writing

Method and effect of the previous study2 corpora: students’ writing – film analysis; 1st &

2nd draft

Analysis of the message of Michael Palin’s Travel series about Eastern Europe

The first draft corpus revealed features of informal style, lack of cohesive devices through Key words; Concordancing revealed racial language.

The second draft showed improvement

Page 4: Corpora in assessing students’ writing

Corpora and method for this studyStudents’ summaries of a text; 300 words

longThe text for the summary

Key words for the summaries are compared to the key words for the text

Concordancing reveals how each key word is used for the summaries and in the original

Word lists suggest common mistakes in the writing

Page 5: Corpora in assessing students’ writing

The corpora13 student summaries1st year students at Sofia UniversityLanguage proficiency – C1Taught about cohesion, coherence, linking

devices, text flow4 hours of teaching per weekThe summary was set as a homework. The

work was submitted via the electronic platform Moodle

Page 6: Corpora in assessing students’ writing

statisticstokens (running words) in text 2,667 types (distinct words) 729type/token ratio (TTR) 27.33standardised TTR basis 1,000mean word length (in characters) 4.99sentences 2,792 mean (in words) 18.99paragraphs 377 mean (in words) 100.93

Page 7: Corpora in assessing students’ writing

Key wordsCalculated via a statistical procedureAn automatic function of The Word SmithCompares the frequency list of a task corpus

to the frequency list of a balanced corpus – in this case: the British National Corpus

The words with a frequency higher than in the balanced corpus tend to show the ‘about-ness’ of a text, specific language idiosyncrasies, particulars of the style etc.

The words with a frequency lower than in the balanced corpus show what the author avoided

Page 8: Corpora in assessing students’ writing

Key words in the original

Key words in the summaries

RhetoricWeWritingRadicalWriterTowardOur ConservativeStudentCompositionHonestCoherenceLearns

RhetoricWritingConservativeWriterRadicalLiberalCoherenceTextCompositionExamplesAuthorDoesns

Page 9: Corpora in assessing students’ writing

ConcordancingAll the cases when a word is used in the

corpus The word is highlightedThe context to the left and right is shownThe concordances can be arranged to criteria

pre-set by the researcher – L or R, -2, +3 etc.

Page 10: Corpora in assessing students’ writing

The degree of formality

Page 11: Corpora in assessing students’ writing

The possessive ‘s

Page 12: Corpora in assessing students’ writing

The Use of linking devices

Page 13: Corpora in assessing students’ writing

Linking devices

Page 14: Corpora in assessing students’ writing

Linking devices

Page 15: Corpora in assessing students’ writing

Clusters Automatically calculated by the Word SmithWords which occur togetherThe number of words can be pre-set – 3, for

this study, but it can be 4, 5, 6

Page 16: Corpora in assessing students’ writing

Major key words in contextOriginal collocates Summary collocates

Page 17: Corpora in assessing students’ writing

A missing key word

Page 18: Corpora in assessing students’ writing

concordancingIn this case – arranged according to -L1Because the word is a noun and we are

interested in the attributes used with itIf it was a verb and we wanted to see what

objects follow, then we would arrange for +R1

Page 19: Corpora in assessing students’ writing
Page 20: Corpora in assessing students’ writing
Page 21: Corpora in assessing students’ writing

Relative clauses

Page 22: Corpora in assessing students’ writing

Relative clauses

Page 23: Corpora in assessing students’ writing

Language Functions

Page 24: Corpora in assessing students’ writing

Language functions

Page 25: Corpora in assessing students’ writing

Negative keyness

original summary

Page 26: Corpora in assessing students’ writing

Conclusions

Comparing the key word lists of a text and its summary reveal whether the gist of the text has been grasped

Concordances show differences in focus, suggests possible misunderstandings

Word lists allow assessing the acquisition of grammatical features, such as relative clauses, linking words etc.

High key-ness can reveal language functionsWord lists also reveal adherence to a style