10
'J \ ry w "t ,j 't \ ,l a Trslrrrrc nru o EvnLUATIoN INTRODUCTION Basic Terminology. Match each term-to its definition. Define "fluency". Do you find the following definition from Random House Webster's appropriate? Can you lmprove it? "1 "^t, "fluency = ability to speak or write smoothly, easily, oi readily" " ,,| " ': ,'..-* , .' 1: According to research, less than haif of the variability of academic achievement is explicable in terms of cognitive aptitude. (Sarah Zafar Khan, 1969). What does this entail? The number of types of language tests is directly proportional to the number of purposes for which language tests are developed, Some tests serve a variety of purposes while others are more restricted in their applicabilily. There are a lot of brgad categories of tests, rnany of which stand in opposition to one another, but they are at the same lime bi- or muiti-polar, which indicates few of them are entirely adequate in and of themselves. . ::t \ q 6 Cloze test is designed to test the ability of students with different language training bq;kgrounds orto show if students are able to use a language in a specific area. 'ttl Diagnostic test X . # one that requires filling in the blanks in a passage from which there have been fiystematic or random deletions. Usuaily every fifth or sevenlh word has been qfpoeA from the passage beginning at a randomized starting point. Proficiency test /! J- designed to provide information 'about specific strengths and weaknesses of \ne test taker. It is usually designed to guide remedial instruction. \ Standardized test is Fn array of similar tests intended for use together, Test Battery ,, G one that fias 6een administered to a large group of exarninees from a target i-boputation, often more than 1000 persons, and has been analyzed and normed "$0, ,r" with other samples from that population. Test Item ,.? pny unit of a test that elicits responses which can be scored separately and gelated to the skills the test is measuring as a whole. t' \ Selecting, rejecting or Erouping (of people, objects, ideas) by systematic examination

Testing and Evaluation Part I v. Preda

Embed Size (px)

Citation preview

Page 1: Testing and Evaluation Part I v. Preda

'J\

ryw

"t

,j

't\

,l

a

Trslrrrrc nru o EvnLUATIoN

INTRODUCTION

Basic Terminology. Match each term-to its definition.

Define "fluency".

Do you find the following definition from Random House Webster's appropriate? Can you lmprove it?

"1 "^t,

"fluency = ability to speak or write smoothly, easily, oi readily"

" ,,|

" ': ,'..-*, .' 1:

According to research, less than haif of the variability of academic achievement is explicable in terms ofcognitive aptitude. (Sarah Zafar Khan, 1969). What does this entail?

The number of types of language tests is directly proportional to the number of purposes for which

language tests are developed, Some tests serve a variety of purposes while others are more restricted in

their applicabilily. There are a lot of brgad categories of tests, rnany of which stand in opposition to one

another, but they are at the same lime bi- or muiti-polar, which indicates few of them are entirely

adequate in and of themselves. . ::t \

q

6

Cloze test is designed to test the ability of students with different language trainingbq;kgrounds orto show if students are able to use a language in a specific area.'ttl

Diagnostic test

X

. # one that requires filling in the blanks in a passage from which there have been

fiystematic or random deletions. Usuaily every fifth or sevenlh word has been

qfpoeA from the passage beginning at a randomized starting point.

Proficiency test /! J- designed to provide information 'about specific strengths and weaknesses of

\ne test taker. It is usually designed to guide remedial instruction.\

Standardized test is Fn array of similar tests intended for use together,

Test Battery ,,G one that fias 6een administered to a large group of exarninees from a targeti-boputation, often more than 1000 persons, and has been analyzed and normed

"$0, ,r" with other samples from that population.

Test Item

,.?

pny unit of a test that elicits responses which can be scored separately and

gelated to the skills the test is measuring as a whole.

t'

\Selecting, rejecting or Erouping (of people, objects, ideas) by systematicexamination

Page 2: Testing and Evaluation Part I v. Preda

BASICS ON TEST COFESTRUCTTON

What factors influence test construction?

- THE PURPOSE

-DIAGNOSIS AND FEEDBACK

-scREENTNG AND sELEcrrcN ^ ayrt,tvp la&7

-PLAcEMENT - f'"af1oe'-n &-pRocRAM EVALUATIoN AJu'tt"**-*J ItA

- WHAT SHOULD BE TESTED AND TC WHAT STANDARDS

-WHO IS THE TARGET POPULATiON

-INSTRUCTIONS FOR EXAMTNEES AND FOR EXAMINTRS

.FOLLOW-UP/INTERPRETING TEST SCORES

BROAD CATEGOREES SF TESTS

-CRITERlON- or DOMAIN-REFERENCED vs NORM-REFERENCED or STANDARDIZED TESTS

'1JSPTTO VS POWER TESTS

A check!ist for test evaiuation

i{ame of iestPurpose intendeci

EVALUATION OF TESTS

-THE PURPOSE OF THE TEST /

-CHARACERISTiCS OF THE EXAMINEES /

-ACCUMCY OF MEASURFMENT /

-THE SU]TABIL]W OF FORMAT AND FEATURES/

-THE DEVELOPMENTAL SAMPLE /

-AVAILABILITY OF EQU TVALENT/

-SCORING AND REPORTING OF SCORES I

-THE COST I "

.THE PROCUREMENTi

-THE POLITICAL ACCEPTABILITY /

Ia8r3

7

a *(a.r---t-"/ ki 't* L gtve-' {aAaf:',,;' e- / T o'? ( t'-d4 *^a c{t ".-h'

4- G <e-t.<_z-+e_t

T€st Characteristic

1. VALIDITY

2. DIFFICULTY

3. RFLIAB]LiTY

4. APPLICABlLITY

5, RELEVANCE

6, R.EPLICABILITY

7, INTERPRETABILITY

8, ECONOMY

9. AVAILABILIW

I"O, ACCEPTABILITY

lqtotJ_q

R / ror,nl

inadequaLe, i0=

;-lry-nt tuoA 4, , *"./(lrr*w",U t{tvio/" il'a-,^, r^}oo

{r*ta-;tt (7c*->t-.e "1 @1

/ur'o4/ * < (' ^.t(4 r-*r"l

r^".d€'

*,"*/ C

Page 3: Testing and Evaluation Part I v. Preda

.w

'iit-r,[

:

j

:"1":

4'r J

ffi

&1*(:::

;r-: - I{l}' 5:.;.," Gi

'S"r ffiP

Ss &Ht

ffiw$9" mI"ffi ffiI{s} K,:

h"q,"t

{ffi trt-i[#

,ffish*

- q"Js_-

SJ

" tpt

h*ffiSEL-msth

f,"D

"i*[J,{*ffiIqft

*1,*{,.}{ffi

m

lm$.

ffir

ffio

ft:ffi,|

ffi*#T

ffi:{\$

i,ffi

f*

.ffi{,m

&"dfitrsts

q,J i

ffumffi,ffi H trfi #*xH H.bm h

,*".,sffi--s#5# tr,5 ih;3.il'xl #*HHx ffi:$ ;g'HHTi#ffiHffiff ;f:#&} "H.trsii H^*-iH# q:fiH.h:"fri :fimm; ffi:Iil;,ffin ffi : Ji t H'; [{ $ ,S H - H g:yX :3 $"{ .0.,.' rUl#ii: f5;i5i#r,H-n fr'ffi# ff il *'i5t^i,"o'ffifi-r*: h; H t yl S ff r-

sr'HHH.fiHfi 4q:ffifr I

,-j ',l ;j,"i". o* :y rur fir , $ I *,"* "l.\ Ll L." t{) /4 t-b tJr\ E } : '":: floff+j frH&;; "ffi:mnH H _l','fr (n H p "n : $ :.H

e$

.# H ** "#.'* S $ H ; ffi : g l;, :.?t H T{ u * e # ffi *; l{ .,: Fr ;{,fl'"*i ifril; "'3*:,*il" HHt54r##H',H,+*ffiHH'ilffi'g4H+,ffi;*'ffi k /\ *r.}S fl-c 6 :J u" *' ;}"qrC?.H*jH-Lr,&4$.-4 ul T*": [- ""h #s{ tu .._ ifr tr1

T "* .g ffi : ffi : ftj H; ffi",.{l. H *, H

HFffitrHfi$-# tr:e ''i T*";-,nHtr#$i H.ffi .jrrc.r ffL rn ru tu rt! ffi & Hl : ry

*m4d prffiHp ffi:HH '+t.*#h\kL':*ffi-ffimWffi tr'il"u ilj u P)'#F ffi -w ffi ffur-r G

ffis#Bq H $tr HfiF# Fss g nEE+ Hr # s H H s &

f E;* il#$

(r {,n c) Ci)>.4i&rlJdi-Fifi ;*i Li ;i.!,

I l-:l "l;. n!:n r$ -" tnnflu)u:gbPh;r: fi "$flJ .Tr ^!n -i: muinrrodF:;:;g$

-l@

.b. H 'd -* {w L,'r(rFHffiSOiiUtr,ir{rib,;#S:. flJ :t P :H ffi:lli;Fq Fhxr["{)fi ffi;Il _. Ll) u) t- -r,' ;; (:r () ffi't {t$

.: lL, a\r" ;-.

",i, i..; *. F a-H,na) l_ dr r& f{#;,.-HI;, fiHt-, rt - tr m F

;i ii H "." ffi "$*

,j t": g ii tu tr ffirl \..Y ii -{.) Pgffiir, a. +J t,i't ,* ,4 4{i.: i; bi .FH#C.ld:.'1..gmt",r:jl :i :c *.um,l ;". .Sl H, tu ilx S. Fr Un ff #i; s' tl [rs; ffiffiffi$'c';fr^d rffiHoi"l'+-6Ji:9.1 ;igt)&w:-.+t(l{uH qrHili PH,;ruct'sr'rr,;3 $E trffi.: H:' '": I" A qL

"&,

,; : sE $ $ffiH H'..; li .g t'' or k q (J sJ*. ".'i r:l :l F Lt (l" fie di,ii;i=.u:i"; Ho[0".x*$ns.,F 5&mftH.nii6.Gs{nry$rFH fi E € $ # # il fi6;rsllf:f4z.se'itr=Aihg-3,;asl E &sHE: {: : s H f; Z IL - =

pO-c'Jlq.PuIlUuJuIb.g'U,hFITTIioc-oOnFFFF

cr_n-#(n

H5c)

o)-cpi)(o

P

lJ,5s$p(JfLttco(J

n5mm(r!

ftq,U}

kOJ

m

'>

"s{J

ffi

tuTJ

hq,

ffi5bs,*x

B

ffi

auq)tJt

{D

nqJ

t(\GE

I r"l

X,ts'-l

[*tf,tLi

il

[J..1Ir!q{:)trr)ffic(Jc"\fr.*

r"/)tLr:*("-)*';X-

ffin*1.,t,,"

{:I*,*fi

{"\ff

(')u)o>. l-i 6Jpb5*:'iltlt i I

i: :*L{a

():+=. F: \

,uyv (JqEEF_tuts-0Pdrlu

u

rgu \.-

$.]rubfi,q d:S()c\'ffd)p,++ _# s,H'iHlu(rcl b.liiu

-{f}mfl:MU:a ffiC) H (J-,-irm f': {i.}

+r (' ::r(n 1""€iii n-:-:f0 Li !r&r ,'\"i ;b

qJ(J nr p ,rY,,U+- ijt" _n.

LJ :-. L-

.lJ /, 4),yf\tuxf

WF

ux(E1-.

S P [i-rrv.S Lr s"* t::@;-. l.ll u,)U'"%--rh

f: T'! F'r'fi.H$-Tlpr1-lI7 iu *-l:nro te

V(U

EHEO 0J+g a o

J(l)S-c_^o!v,,. {-*U

(u,x:cloJ(I)O-c-o

Page 4: Testing and Evaluation Part I v. Preda

The text used i*r tl-ie cioze iest shouid be lons e nci-:gh to aiiorv a

reasonable number of eieietions - icieaiiy 4* cr 5*-bia;:kslfn* :licrc bianks

contained in ihe text, the more reiiabie ihe ricz* iesi1!'iil qerzernilY p{cVr.There are tlvo :-nelnCdS *f sccring a ci*zt ltsi: ci.re n-rark mav be

arvarde'j t"cr e ach arce ptsbis afiswer or els* c'i':e i::aik :-nat' be a*'ardeLj icreach e.rlct answer, *cli: r:leihcGs ha-'ts been l-*un{i rei!a!rle : 30;'*e ai-quc

that ths fcrrner mrthoii is verrv litt!e b*ri-*i thai: ihe iaiter an'j d*es n*treallv justiiy thc adCiticila! \."'Grk Ei:la!led ii: definir-lg what cc11.5iil;itc:c 3n

acceprabie un.trer f*r eacl: item. ld-*ver:hel*-cs. it appeais a. itirrr it:t Ncr

the stucient if anv reasanable eQui'raie*i is acc*:;i*i. in arlditi*n' nc

stucjenr shci.lici be penalised fcr rniss*eiiir:gs x*l*ss a wcrd is sc cacl!','sp*lt

that it j1inilOf 'ne underuiO**. Gramnia:ical errcrs. h*'"veve r, Shcuid be

penali:*C i;: ihcse ciaze i*sis lvhich are cicsig:.red lo. {Eeasi-irc lamiiiaritirvith thc granimar of tiie lane',.:age ralher than re arilng'

\\'he*re poss!b!e , siuicnis shculd be requirei t* fiii in each biank in lh';

rcxr ir>clf. Tirs pr*cedure approximatcs !-nl}tr cir;s*l,t t* the reai-iife,iasks

involr.c.i rhan an1,rneth*d which r.--quires therri i,.> wrii*:he deilted iiems

On a Sr.ir:lritlc an:\\,er -sheei or llst. lt f he te xt;h*s*r fcr a ci+zc lesi

cclniain: I itt{ i;f iacis r:r ii it c,.xiccilrs 3 parlicuiai subject. sorfie stuCeit"t:

may bt lble it': n:ak-e 'rhc;*quirccl ccrnPlet-i+;:s frorn rh*ir backgrcund

kno11'ie,.jee riiihui-i: uncerslanding miieh ai the iexi" Cct:Sequentl)/. ii !s

essenti.rllR cittzc irsii {'ds in clher ivpe: r:f re aCing iestsi l*'iraw uF*n it

subjccr r.r'*icn is n:,:ti:ii in batli cCfiIsnI and la*guag* ve;le t'i.used". F!naiir '

it is ahiuv-c i,.dvaniagr-ous t* provide a'!ead-ir:': thus *c deieti*ns shcuic n-'

maijc in inc fir-st fc.'v seniCn.cs:c ihai ihe :iuder:i-q have a chencE t*beconic iarniliar iviih ihe .:rutiror"s siv!e and aupr*ach ia ihe si;bjett *i thc

tt'*t'a,.',=* p;ucei.rrt as it iltfasure oi i-eadine difficuily anC iei;'Cing

comprchcn,t!r--n u,iii le ircatec briefiy in the ieieva*: secii*n <;f ti:e chaptc:-

cln t.lsiing reading c,Jn,Frehe r.sion. *.estaich stuGi*s" h*ws';el" hai'e sh{rtr.n

thar pciforman.. on cioze ies-is ccrreiai*s i":ighiv rvitn li-:e iist*aing" rvritirrg

anct ipeaking ah:iiries. !r: cther w*rcS, c!*z* ie:i:ng is a gcod indiealcr cfgcneral linguis-tic abiiitv. i;rciuding ti:e ability lo use iai:gi-:age arprcpriate iriccurciing io pariicuiar l:s.:g"L:islic and sit*at!*i:ai c**lrxis, 1t ls arg'tiec-{hrtthree i-.,'pes oi k*i:vyie dge ar* reqr:ireci in ,:rd*r t* perl*:r* silce*ss{":iir"- on a

cloze trir: iinguislir kn*wierlge, :*xtual kn*rviedge . and kncv;itCge E",-i ihe

wOrld.: As ir resuit *isl-:iir*seareh fi;.iringS. ei,;z*:fSiS ar* n'+ii/ uSCf nCi

Oniy in ge ncral achicvc;-*e::i a*d pra*cie :-:c1' :*StS b*i aisc il-: scrfl*classrcom piace me -t ies:s anri diagnosiic iests.

Dictaticn, ai!$Lhci ;najcr ivpe *f inlegraiivc ifsi. r.'as previcusivregarcied suici'v e: a i-n€iiils Of rneasur'ir:g stude*is'skills cf llste::ing

_g.e*1plebgq-*rq+. T"L+t, +tg:g:l-i::glv*i in t*sts of diciaticr;1;re rc€ar:tti. Tfi.F;::Geraied-s^ffi1sTnvof6were larqe iy cve rlc*ked until tairiy r*eer:liy. grated skliis lnvoivei

in tests or ciiciati':* !nciude a'*ditcry dis;rr:-et!n,;iice-r. lhe audiic-:r].' fi:rffis]r3'

Span. spe liing, t.hr ree*g::igio* *f s*ui:d sf,gIl"i*i:is, a fan:iliaritV wiqh tne

grammatical a*d l*>:icalpatlelning of thrc iang*age, arld *v*rali iextualIomprehension. Ur:f*rtunately, hc*-€\'er" ther* is nc re liable way cfasscssing the re lar!";* imFarlance cf ihe diffe re nt abiiilics requir*d, a:td

each e :-ror in the <iicta'ii*l-r is usuaily penaiis** ir: exeetiy :he sarn* waY"

Dictaticr: r*sts ean prave ga*d predi*t*rs cf gi*bai lang"'-lag* a*iiityCven tholigh s*rr:e rcfent r*searenz i:as f*r':qtd that dieqatlc:: t=*gids i*measufe iower-*rd*r ianguag* ski{!s s::13: as siraighEf**;aard

2

Page 5: Testing and Evaluation Part I v. Preda

comprel]eftsicir :"ati:cr tlian the i:ig]:er-*r*9er ski!!s sr:*h as rnferer:ce. Thedictatiq:n *f l*nser p:cees cf cllsc*urse {i"*. ? t* i* iv*rds at a tin're} isrecorilme nded as b*ing preferabi* i* thc dicsaai** *i shcrter wcrd gr*L:ps(i.e. three tc flve w*rcis at a iime i as ir: ihe traditi*nal diclarians *f thepast. Used in lhis wa_n*. cictatio* lr:v*lves a riynanlic process of ar:alysis b3,

synthesis. Cra*'ir:g *sl a Learner's'grairlmar cf expectancv'r and resulting inthe construct!ve pr*e*ssi*g *f thc rc'!essagf h*ard"

if ther* is s:* ci*se relati*nshil betv*cen ihe s*uiiels cf a ianguage ancthe symbcis r*pr*sests;cg thern" it r:;*y b* **ssibi* i* u:":rj*istand ivhat is

beingspcken wilh*ut be!*g abie :* +;riie lt d*w;":* F€*n"'rever. in F,*giish,whe re there is a iairi3,' ei*se r*laiic:r:ship b*twee* :i:e s,}u*ds asid ih*spelllng syst€r*, rt is s*n:*tin":cs p*ssible t* r*r*g*ise ti:* is:diviCual scur:deleme nts v''itt":*r-it fxiii' a:ncierstandi::g ih* crlcaning +f v;har is spoken.Indeed" s#$le ag:pli*ei ii-i:guists..and t*achr*rs arg** tha" dict:ationcncourages rh* siuel*nt tc facus his *r h*r ali*:'lti*:-: a** rnuch *n th*indivicjual s*Ll*ds raihcr lhan *n ii"i* mea::!ng cf ti:c text as 3 "rr':i11;ig" Sr:ei-i

conccr:iratio:"i *n sing!* scunci segffiei-!is ici Eise li is guff,cient tc i:=apair theauditcr3r *1e:r:Liril spa*" thius rnaking !l iiiff,cuEt f*r th* st*d*nts tc r*iaineverything thev h*ar"

Wiren dielaii*;: !s given. i: is advlsilbi* t* iead ti:r::r:gh the whci*dictaiicn pas$age at appr{.}achi*g i:*rir:a! c**vcrs*ti*nii sp**d first *t aii.Next, the teac*;r sh*uld begln t* iiietai* {eichcr *nc* ':r t*'ie*} inmeanimgf*l u;"airs *f sulfieieni ie*qrh t* eliailr:r:g* rh.s s;ud*: :'g sl:*rt-t*rr::memory span" {S*rc"e* leachers r::islal:*niv ie*i ghat :he '; *a:: rnake ih*dictati*r: easi*r l;y l*adil:g oL:i the i*x-' .'-r,*rd b:.' rE*r,J: ihis Frccedure ,;a*

be extremeiS;1*.*fr-:l ar:d *nl3 seivri l* i-';reas* i?r* iiffir*ity +f ihsdictarrc:: b'v *bsrurii-:s ti:* mcar";ing *i e ::e h *hras*.; Fi*aii"v. afte r lhedictaei*::. the rvhuie passaEe ls r*ad *i:c* i{r*r* a: siightiy si*wer thar:norr*al spced

The falic.,r'i;:g is an exampl* *f part *f a dietati*n pa"ssage, suitabie f*ruse at a:: inte rsneC:aie Lrr fairlv ;riivanceri i*ve l" Tlle cbiique strck*s d*n*iethe u::its tvhlci: ih* examiner r*usi Lr'bsflrv* "uvhen ciietatir:g"

Before th* seccr:C haif of the n!n*t**nih .:enturyr / the ta;i*st *iseks *fcffices .l wei'* **i5, thre* *r faur s?-.=i=*y= hrgh il A-s bi-:sincss expand*c;tand the *s*d fcr off!*s ace*rnm***i!+n g:"*rtu' ru:*rc and rn*re acui.*;erchiie*t* b*San i* rBa* ta!ie r"bi.:i1cir-'gs. -,'f W**d *r"rd ir*s-:, hcuvever. ir

w*re ri*l srr*r:* *ne LFgh rn*qerlals fr*r* u.'n;cL i.r rcnstr***i tal! buiidi;:g;"'!'Fr-.irth*rrc'l*t"s, :h* iriventi*n *f *?*el fi*'va.' med* it p*ssibi* ltc c*r:str*ctfrantes sc str*n*;rth*? th€'V w'*i:i,j eir-p*ri the ver',u'galiest nf br":i!din#s"lil

.,]

Page 6: Testing and Evaluation Part I v. Preda

EXAMPTE OF TEST DESCRIPTISNS {quaiitative modes cf assessinent, perfcrmance levels, etc}

WnlTfEN Ei\jGl-151-i

Paper 1 - Am*rrg tht iterns te be tesied are: writlng nf fcrma{finformal

ffi i n iti ati r-: i{efi * rs a g-r d'resp* nd i n g t* th erci ; v,'r!t! n g ** n:tecte d

proSe, Sfr tcpics rele',i*sti {C anY C=r:dldei*'s sitr-:sti*n, i* th* f*rn'r *fmessages, ncticas, signs, p*Stc*rds' lists' *t*"

Paper 2 - Amang th* iten-rs to b* tesied are: th* us* *f a dieti*l-:e ry;

auiiltv {"c fill in r*rn':s; e bility tc fciicro instructior':s, to r*cd far"thc

general r-Ir€ani*g *f * tc>:i" tc read i* *rde r t* se!set specifie i*fcrmaiion

SPOKEN Ei\JC;-]--qF,

Section i *Scciai EnGi;sh

Candidates t-nus: re :*ie tc-(a) ftead and write nurnbers, leit+r's, anfi eCrnr:':*r.t **hreviati*s:s"

tb) Partlcipaie E* sh*1i and simpie cued r*ilvers6t!*;-c, p*ssibiy using

visuai sti:nu11-

{c} Respand appr*prietely ta everyday si:uatians d*scc-ibed in very

simPle tei'ri^,s.

{d} Answer quest;ans i* a ciireeted sltuaii*n"

Sectian 2 * Coryglghensi*nCa"aidet"-s rt=t:sg b€ el-:i* {t::

{ai undersl*nd th* *xfi{: me ening *f a sEmpi* *F"cs *f spe***, a*d

i ndic*te this coi-:-:rr*heilsisn bY ;

- r-lrarking a fi:#P, Pien, cg griri;

--.**-4hrs0-qfu1+€he;::c*s1apprc.p;.ieta-*f-.gS,*-f drllqrigi=;-*** stating wl-leih*r" or R*:, or h*..eJ, t!'t* *'..:l*i st!n:uir-:s reiaies t* the

visual;- answering si:nri* questicns"

ib) Understanitf-u *asie and *sssntic: rr:eanis"rg *f e piece *f s$*ech t**diffie uit t*- L,* unii*rsi**d *crr'p:*t*iv

Sectian 3 - Exte nded SPeaxirrg

e#Hffi i* spc*xf*r 45*** =ee*s:ds ic": a *it**ti*n *r

situatie ns iik*ly tc b* aprr*pr!aie !* re*E li€* f*r a sp*ak*r *t thEs ievei'

This nray ine iudc *xpi*neti*n, adv;C*, rsq**s?s, *ry*lcgi*s, *tc" n'*t tcvii!

nCIt dfifi":er:d any e-:s* cf the le*gr.rage i* *ih*r tn'** nt**decle anc

pressing ei:-eum*iairces. 9t is assum*d *€ this 1*vei lhai: r':* cand:e ate

would speak at !*ir6th !i-i r*ai iife u*E**; ir *v*i* r*aiiv n*ee=s*rY. sil t:14*t,

far exampl*, n*rr*iiv* qrs*uirj net he expeeib* exe*pi in €he e*nt*xt *fsometi-ring ilke *n *Npian*ti*n *;'ap*i*gy.

11

Page 7: Testing and Evaluation Part I v. Preda

EXAMPLE OF OPERATISNS, TEXT TYPES AND FORMATS W'{iCq-I FORM Th{€ BASES OF A TEST

{BASTC TEVETTESTS OF READTNG AilrD SPEAKING}

TESTS OF READING

Operations * Basic levela. Scan text to tocale specific information'b. Search through text to decide whether the whole or part is re!evant to

an established need.c. Search through text ta estabiish which pari is relevant tc an

established need.d. Search through text to eveiuate the content in te:"ms of previously

received !nforrnati o n.

Text Types an_Q Tcpics - Easic Level

FormLeaf letGuide

-frrno' YPU

XnGu, nce rn enin^-^.;^+;^-I'JC-Jur luLrulJ

Com mentAnecdote!okeBeporr/Summary

Adver-tisemeRt f'iarrationLetterPostcar-dFormSet of instruciionsDiary entryTimetableMaplFlan

Forlnqta. One paper of 1 frcur. in eCditior:, candirjates ai-e allo'uved ten minut€s

before the start ci ihe examinatlon t* familierise ihenrselv*s with the

contents cf the scuree material' The q:Jest;CIn paDer musl not be

looked' at during th!s time-b. Candidates w!li be provicied with scurce rnatsr"ia! in the fcr*r cf

authentic booklets, brcchures, ete. This materi*i may be the sarne at

all levels.c. Ouestions wll! be cf the following forms.

i) Multiple chciceii] True Faiseiii) Write-in {single wcrd or ph:'ase}

d. Mcnoiingr.:al *r biiingual-dictionaries maY be used freely'

*)

Page 8: Testing and Evaluation Part I v. Preda

TEST OF ORAL IT.JTERACTICN

Onerations * Basic Levei

Expressing: thanksrequirementsooinionsccmmentattiludeconfirmatisnapologywantlneedinformation

sequence of evenis

infcrmaticndirectionsservice{ancj all areas abcve}

Types of Text,4t all level"s canciidat€s rnay be expected tctaka part in dialogue and

mu lti-pa r-tici pa nt i nteractions'

The interactions will narmally be oi a {aee-to-face neture but telephone

conversations are n+t exciucied'

The candidate may be asked tc taks parl in a slmulaticn of any

interacticn derived frorn the list of generai areas cf language use'

Howeve;-, he'will nst be asked io assume speciaiised ar fantasy e"oles'

FormatThe farmat wi{l ne-iire same at each levei'

a. -lesrs are divided into three parts. Each part isobserved by an

assessor ncnrinetec bg 15* Bcerd. Ths assesscr evaluates and scsr€

the candidar,e's perfci-mance .bui,

takes no parl in the conduct of the

tpct

b. Part lconsists cf an :nteracti0n between the candidate and an

interlocutor';"*h* will nornraiiy be a r€Fresentetive *f ihe schacl or

centres where the test is hetd and wi!{ normally be krrown t* the

candidate. -l-his interacti*n w!il norri-:ally be faee-to-face but teiephc*

formatsarenotexcluded.TinreapprcximstelYSmiE:t":tes.c. Part i1 canslsts cf an interacti*n between eandidates in pairs {or

exceptionaiiy in thr*es or w'ith cne *f tne pair a ncn-€xarninatisn

candidatel. Again tl-ris will ncrmally be face-tc-face but teiephone

forrnats uru nlt exclucied. Tinre approximately 5 nrinutes"

-*_J,* p-ag-tu*q-o + *iqi1-ql-gJgpgfggi*I1 c ',If id

ate s t c t h e i n te rl o cu tc r

iwho has b;;;;E;;nt frcmTlte rc Pa"rrit--

Ti.nre aPPrcxinratelY 5 minutes'

Narrattng:

Elicitir:g:

b

Page 9: Testing and Evaluation Part I v. Preda

SprctrrcnloNs FOR Trsr WRrrrRs:

1. What is the purpase of the test? Look at the fciiowing examples:

Teer A is ux*d ne:th* r.rEd *t $h,* **c.*eld 1r*r* $.f ri ihi'**;-pri{{r.. }lsshsjsn *i.F-.*{riradr}* ol*trp*r cu,*rxr f$r.ifi{:*r'n!itpr ii*tr** c* }iragnLli n. sr F.**r:r:i.f,n

La;rgrr:lge. Tt asr*.s*;es nlttrfrer stiidents has* gufficixrli ctrmplti:rce iilE{{g}tf;h tu pr*,;erd r* t**;hirq pr*crir:* isr th* finsl y+ar: t.# sftrd}..€ru.+l*n,.tn '*.h:* f-s,il thx tr*r.l'riii .hsre en npp*murit:y r* rc.'*ii a p*ra.ile{

'r,*ryir*n taw rasrarls$ ls,rer" trf eh.ey -rubx<<r1uex*y *,ri! t&*p. wiil 3:ayE t*rrp4a€ th* src*nd 1'*sr Eiagi.lrh EH,l:€I'F.e., Rir$*ug.ih. {lr+ tsss xdral** fr: rii:eF:ng:iicil e+xght i.sr tb* $rrt Fivri :isr.*i- [t ie * pr*.fia:ierus;'resi, nrrr ai3'i*.rsu.r* *f achm,r.***.*rrf" Aitri is i:.tlt intr:ndrd t+ rrt,f*:tr rhe lrSill.+hn;.

:S.fi

T+*t Itr i;+ e gr.lnc*m*.Rg N#;i:r d*.*igri*r3 nr. Iilii+.ls silriir,st-+ aFpil'.tir+j :f.*.t:

I*ngu*g* coi.ri'&** *r ri*rs .&i}j*;-r** Frar:iq'xi:;* i.s.r* i:l*sses s-pptr3pr!.{rir, tothc ir }:-irguugr lesel.

C{:'

T";sr r.l in im*nde d tfl did$fi{}s.{ lt::rx:,gt:irx eild. wr.a&.nsr*,i.*; r:?i fr:iurrli:. yt+lrr+ertrei*r,.! r{lnx } prtpiiv; in fktirr;rer ii,,*,r,,=,un.

2. What sort of learner wii! be-taking the test? iConsider age, sex, level of proficiency/stage oflearning, first ianguage, culturai background, eountry of crigin, level and nature cf edueation,reason for taking ihe test, professional interests, iikely levels of background {wonld}knowledge)

3. How many seetiotls/papers should the iest have?

4. What target language situaiion is envisaged fsr the test?

5. What text tyBes should be chosen * written *nd/*r sBaken? iConside r sources, difficulty,length, functions)

6. What language ski//s shoulei be tested?

7. What language elernenfs should be tested?

8. What sort of f*sks is required?

9. How many items are requir'Ed for eaeh section and what is their relative weight?

10.What test methads are to be used? {eonsider multipie clrciee, gap filling, matching,transformation, short answer questisn, piciure deseription, role play with cue cards, essay,structured writing)

11,What rubries are to be used as instruetions f*r candidates?

12.What criteria wi!l be used for assessm€nt by markers?

Page 10: Testing and Evaluation Part I v. Preda

z

'-*rri:*S itill&:l:.lq:$: t'igg i+i;-: iij l. S?,l+'tr .i.+i i:iil;i.+ 1::+ +ti llFlritr'i"]r}!:]i:3jF:if i?r$ }i3.{tf,B}r1{11}},r: {F1.,}j 'jiriir!$.&,.,1,.r1b ;{t, t}:}3 ijir{,\:l j,:-3 +i1:iui.tiri}4rt i'ilg ?t/+iylilfit9.}l r,If.1i3 ;ite*; '3p,j'+3.j i+iil.'4$ 'jl:.1;rr4jvrq J:\jilvtt{r

r.lrir4i '.1.3iF.$ i*il.ie{"nb, +sitrl #<ri*€an Ll-+;.rv /j *ri*4 J'i} {r+ $iE"€,rT4E:J:ll.r+:: 1 i$$; Ur.ritiVSS

^:.ir (li k+;;iit;:,cj.$iji fji.*fviiJt ii ti *j8tj.i*w.{j4fi&f

'QKlRlllRi# 4itt11;rg44 i6,{tl '.;}}t-l:: ;i}4e ;$titv,$:i*L:Y] frrprrrr"iE t{;sr:ii s}rj 'i;itiuli; lsae 3i} {a{t{r;a:ttr-: <:{r} ,4ir*.J gjiqrL'n rars{li

3W.!* qqLi f{ffn#r-d3*.1d i+ .i{tei.* ,}Lc++v

,i*ri,:Ii r**f:irr:i1+V+t: j{r _:-+,i{t*i i..:r _iji14,i

**:::,j,**'si#g,j:nil+,i;s"+ titE'rl*j:: {i::!{ti..k $i-iirtrilli

id I i\Uf\+'+il!; gi'llL<grrliil;+ $1.,ii :r;li;r;'., ;5, #1.,ii ;r-';',-ic::+, ir.li1

$i ;.4.Is-*:li +]Y;.;ilr;;it.i5 3l-,:t;ii,;.i,i.:'

:fsulrrr.rr;i.1i +rs";;1

$i?iiil:rij .:.qi.ir.qt .:r+t:,I :trir#J.l r,iji;:il ,tr{,l ,+i:$i:t" t:r {i-e;i? ijtirr.lr"$i

,.,J+:ii...i+. iLj,+l:

't#6$ Egi$;i-e,ij,t tr$,$r.B I'*4 I*b:€i+ts

'sigari{4++;{li.ntfr * rsFtj:d.-jd p.iii*{S:*.qsEJFt gi*}i 'S.i+Sq.Jgrs,1.;+r11lr*ri4r"'jr':l :d,i,., .n.: j,j,4 ;ri{J i,,+ili}i.t}g:i{:i n:} r.i;t,.: i!;ti:.li q.r:ti:: i:.t-..r V\:!>4. ).r::

ilt{'tl !:i9;: i-ii+]r3 iis;i.ir:qrie fti.}il {{'*..ai i!;ft,fii}..Sl: r3il #.,rfi, it*b}**.rJ $r::l:n+yt{:S+ S}l;t]vf ltii$R,si r;i,i$,? j}: . sr,]i/ri: ili fu:]f?:-il(ii-\;d$t -. fj.:.i5ijt

*"* F;Ur ,Xn,t4]-B.id4*{ $ii}lrJ*3,Fflituy $r+_t_ fia*ii}iivi:j €ii.t ;s+ijg} s}.ssl

{tjs*+|i gili illgii*r^iqd{,: R+;H i{F.}s{.l {ffi{B :i(t.r .QJf frf;i}F (j*r.r, J+ +LyJ lu>.d} {i$r s4r.j4?!9,4

c -$lr":Fa1ri* {4 .&l p,{r*r{sr :{ii*i};{:, !-;#.1- .*A+c*

Rsr51i!,t^+4iiiiq$ fii4g*sj*ti! .i*r ,A!{ir.r; .R} rt:ii:* Bl {J"}tgr*, t}F.r+'ie ..vjr}f63}:it: '{.q*+i i<i.h.S ,i5;{.€-€+ Sg.si

'9i';t'+Sit:i'tl 'lt 1, {;E i:si{n F#r.}.S t;,i.}ish,}+ xtf*ise;1 .er.G ii., tfii-,iiBel j:i1j.J'

aryir ru.:{tii ,-jU

,)J$:.+t!r t:t:+5xit s-w.-+t ljv

.{€}:t3F g+H$r*&a}s.d3

ltt r.rtqg:+*l+;ii etli F!$s .i*ls.{r€.€1ipi,$$} ie* qi$.e: is{*}isr#{Feig1 .i*t}S*ti.1r 1{:3i}c n*8r }r}* "*!uijt r:i#a.l{J1ti ,+i}

*ec>"tfj(! rtq tl}lii}{.t:+ r.s.is".xi$s.?d'i;ti1$.qg lt 4ri1g a*t +rf '*? Ff* Fr*ligglfi t$++S:rf

'sij.4C+3$t+ ]g€J F.}*t 's4l*e,jHr18.i .161*..ltu.ro|} *q ll$*q{ 9l+R (4lt^'lxi3,{,sixiiii$: * i.$.$;1 ijl}jr-.cst{:j {ir..s*.s ;.$ i$lr{q$6,vfi

e 'r"d*]n*{ * l* isilir}'9} *:.&tr s{,(ri#. if$}s{r fiil {}}re ,,:$rlrw g6:uu;:x.*$ffi

'*.(Ii l1,r;it1*rllit]:: :tfr.lr} rat++b}]:r*;tir t{a: +$t} #1d;rfifir; lfj.:s .f;t4$Irs

"'de.rijllfj l3;g;',;r.rr:*;E*il-S., iii:\:gi ilirji. a.t?{ r#.{i"-.*'Jt.i* liui $\ .+Vttu}}:+i

ii,4.ixr:i i+$r rllj).ii !ft4i. gliri:j'niF{.r""l .rF ii?:l{}$i.s.,lni*,i+iit #.tJ r^,.}vj{

s{j *is+t*.*:.$$* *r* i*,*fAa, *r:jq+$iF *n$*srs;t i{{sr€*}lp w{jfr ,,}*vqrt$4 V.l3ilt ;ti{i.ir[ $r} !i$4 O;Sstcorf Su:pe},s Jr-*c..} :$*j DFrs$} r.v+ti[

eri.,bx tr"*i,,*.rn= s, .i*sr,,*is's -ifl:+S.;I; fr1nffifil-,*ff,ffffi{l{iRrp*"F.trsrspsB *q

=ftjJ}1,{s B+fie}.Fsb* tlif 'ffii,nef Et$ r*fpi rh.gitiryi} l*r!r:Jili {ei$' '#i.3rr{i{'r_!t iiitii{$1t1trfi*{F .ifril ,$Jriiiruii pu* ++rg::r*<lu.vilgjr+1g,iiii.i+.rr si {+ii fi+i(]., I4iF, r}:il .r;:.Bjt:itr: .g,f**,it*,io +.i'.fri.o+o..i**,,liUU*.iO:sr"f:i1ri!r,".}.sij i*nsl*€j {gJn*j+d t$4i:.''}fr :jluJ*:il}m'.S. i*'*HSi j6 +<w*ftf

rr**$::,+iriils ii* uti+i.t]{rr iar*s"r*n*,,."o" * u],*' iiiH}*i]fi [rt,+. sF iBs .5h{

irtsr,t\q*qie;.a:*&sijvf tvi{irirtr fU-*l#*p,or {}+r-CrAliJ$9 itc. i.tillirri pr;i:;;a1*;.f+1^';111-E3SJsF:,rr ii

]d:*ii,$:i. i,i({J3 i,fii+.e4 lqliii.i,;yji.in.;i.r wrt *i1+ fttg*rF4i (riiJqiBirtirip'! i(lr€ 3r€+:w q::.i:$t#i tejpl$'}* . ffi+;r{ii.r.,<* j;$1ji iri+.;{r.rthi:tr (j*:r4*1i.lEi.n}t}ir *

{rr:ijtJr.di} L:j;*t4ii)v; {irriufilffsws{$ th

.trtj {rii iltrr.Jlin,.:..! ti!f*a*ia** {qflrr;u'u"nn {tr

.5r+rqi;i::.3,v*;,i;*..r!p+rrr$,rjrjn*,irr''il,tXl?l;,iffi iijlt.1J$S:-[&1ffi*i iir*l.tsi*i 1}*lis1rlr*st3t g,; rl':i,,rr.+ .irir,ilrr

-$zrr $'.]ir,.].li* t3$\{39st

'e"l.qi;rtqi;{;r}l iiFr}; +;,+,lt}${u i}${i j*uJt$tJf4,ith}$ di..r?,t$g iif$l i:rt$F4$s1*

'*iR:J* Xlil$SJrrgii,iir.i,:ia:i ltlFj,:T Si,:g*r**g ,qq#,1:; *i* p ,r, .ri )t ;+,xAftt l.t \s$&-V $qi.-ji $f.l :4ilt.qe; i1r+i ,'*i{il $11 ,lf;'tjj.f}i?se f,r*ll;*+.i irt li}xErl *i{l t.ir}$ry JsFt

.Il-irri, +u* ;$hB$*iF ial*{t!.

ta#t gr|lfre8&

-_e).tsi.Jil;'31. *+ ia u;tf+ -j,+J slfrllg*_d.i:**r3* .i* 3*$Ii$+rtj#lgr'+" s ,Jj:it*i ',::{**,;.;i'i*r;,:33;i.:4 +*,#r.x+;.i rrs:: i;-$,}i}c3f {aers.i#{;i}9.;

*;.gxp.*<$*

i;*tr,r*i.tt"l::]:t JtJt-l ,qd'''\'l"r'r.,-***.,

r.t$.vsi srs,I i$ sq$t{$tF d.ixiit#fi e;"tt

$*alexst trssn *qJ

'q,'/\',., '. , *., ili:tii{.r5 ti$ ,c, .i,i*rtll{t.}$.1Ji. i.lr{, iai tlrJ*i *qi:C$:?r&111{i -t1ti+:rrla.i/; t aJ..,.. -, . .*S*,

f*r#ij $,li:t{i} &frt{i l*'*tgtl$;}; *l}..{dt3 rr;{*r*S}ii:'**)*Ui i41*U+31 *t$lt}E "$pfi,}:i

t{iiJfti:4$}? is i,Sll]'s{+ Fi$};rit?fiS$ $s }!rtt},F'r$*}tJEti {:i {rt4q sq {iri li.?*.Fj:i

+cisi*t$fi* s,(:r:'r;: irilii.i tijLisp#?Fr lt+i,*.{i.,i} .*l .{,.€*xq *{j}, #i }lilt; #r;.i

€, j*4r6s#*diistsFr'Bilsil,Gii:'.:*tJt-iy',iffi 'i*#,ffi J.Tt#ff',S#e{ ,xkpr in{f,i iri}* t,t3i1rid1rif;' ,{'J} 4ll+ d€J ts*r*rj frf.rJ$ rr}u i;p t{ilfr.r;tl*Sx*r, 1* $**,i+t+;c:d "*Y**5iiit:l iltij*,i:i €3r4t -r+l+?€s* 1ri p6r.rfi;*{:p

,*e*: .1tr{r} tr s. .+*}F.n:i* *}s*re}ft s"r.{.i ,.Eit t{, ir. itC }<! lti;li i+ri

=.rspd:nr$ gqr 1,t.ss.Br*l*tg 1vrnu*€'

1t,+: *?]:i#tsei #i+i,ir.# *:1j{,4{#.+sJsad*

$*i:€f..3-{9 S.4;H*#k'Si*e*'*d # d Hi*}{. .#d d# "LSHJ.