44
Assessing Reading EFL Learners

Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Embed Size (px)

Citation preview

Page 1: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Assessing Reading

EFL Learners

Page 2: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

DefinitionBeing able to reading is being able to

understand, use and reflect on written texts, in order to:

achieve…one’s goals,

to develop…one’s knowledge and potential

and to participatein society.

John H.A.L. de Jong

Page 3: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Texts we read, teach and test Fill in a chart.

Page 4: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

? ?

Page 5: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

? ?

Page 6: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

??

Page 7: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

? ??

Page 8: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

? ?

Page 9: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

??

Page 10: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Retrieving information

Interpreting text

Reflection &

Evaluation

Page 11: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Why do we read Complete a chart.

Page 12: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Let’s look at ReadingThere are four main elements in the activity of reading:

Page 13: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Let’s look at ReadingThere are four main elements in the activity of reading:

1.there is a reader2.there is a text (author?)

(the author is part of the text, but not present in the activity)

3.the reader has a goal (who decides?)(a self-chosen reason for reading the text)

4.the reading activity will have a result (what?)(a change in the reader: more knowledge, satisfaction, etc )

Which elements are observable? Assessable?

Page 14: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

These elements should be relevant to the intended traitThese elements should interfere the least possible

• refers to (part of) a text• sets task pertaining to the text,

requiring particular subskill(s)

• specifies format for overt response demonstrating application of subskill

• specifies rules for scoring response

A Reading item

• may require to link information from the text to prior knowledge and experience

Only then are score differences likely to reflect differences in true ability on the intended trait: i.e. reliable and valid

Page 15: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Skills used in reading. Microskills Macroskills

Page 16: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Reading Strategies (microskills) Bottom-up processing (decoding)

which employs micro-skills Discrimination of graphemes &

orthographic patterns Recognition & interpretation of words,

word classes, patterns, rules, etc. Cohesive devices Making use of formal schema to

decode the written text

Page 17: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Reading Strategies (macroskills) Top-down processing which

employs macro-skills Recognition of rhetorical forms and

communicative functions Using background knowledge to

make inferences Scanning and skimming, guessing

meaning of words from context, activating relevant schemata

Page 18: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Types of Reading Tasks (1) Perceptive:

Bottom-up processing Decoding…

letters, words, graphemic symbols, etc. Tasks…

Reading aloud, picture-cued word or sentence identification, etc. (Brown 190-93)

Page 19: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Picture-cued criteria

Page 20: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Picture-cued criteria

Page 21: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Types of Reading Tasks (2) Selective:

A combination of…bottom-up and top-down processing

Formal aspects of language..lexical and grammatical

Tasks including…multiple-choice, matching, gap-filling

Page 22: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Form-focused criteria

Page 23: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Form-focused criteria

Page 24: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Meaning-focused criteria

Page 25: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Meaning-focused criteria

Page 26: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Meaning-focused criteria

Page 27: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Types of Reading Tasks (3) Interactive:

Shift to processing that is mostly… Top-down (with some instances of bottom-up)

More lengthy reading means the reader… must interact with the textgoes through a process of negotiating meaning

Focus includes both form-focused and meaning-focused (but more

emphasis on meaning comprehension) Task types…

Cloze, comprehension Qs, editing, short answers, scanning, ordering, info. transfer (graphics interpretation)

Page 28: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Editing tasks – multiple choice

Page 29: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Contextualized editing tasks

Page 30: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Ordering tasks

Page 31: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze Taylor, W.L. (1953). "Cloze procedure: A

new tool for measuring readability." Journalism Quarterly, 30, 415-433.

Based on gestalt theory:

Page 32: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

What do you see?

Page 33: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

What do you see?

Page 34: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

What do you see?

Page 35: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

How did you feel? A common human reaction:

a release of tension because it has been possible to assimilate a previously non-sensical image into a frame of reference.

Gestalt emphasises that the mind abhors non-sense. And a whole is different than the sum of its parts

Page 36: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze – fixed ratio deletion

Page 37: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze –rational deletion

Page 38: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze – C-test Klein-Braily, C & Raatz, U. (1984). A

survey of research on the C-Test. In: Language Testing, Vol.1, (2), pp. 134-146.

Page 39: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze – C-test

Page 40: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Cloze-elide test

Page 41: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Types of Reading Tasks (4) Extensive:

Processing is top-down

Requires an understanding of a text that isGlobal

Tasks…Skimming, summarizing and responding, note-taking and outlining

Page 42: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Skimming

Page 43: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Summarizing

Page 44: Language Assessment - Assessing Reading Full Description with Picture and Chart (H. Douglas Brown)

Test design considerations Types of reading by Length

(short, medium, long), Focus

(form and meaning), and process

(bottom-up vs. top-down)

(Brown, 2003)