Embed Size (px)
Citation preview
Understanding test scores
Gad S. Lim
What every teacher should know
Who are you?
A. I’m a teacher.B. I’m the Co-ordinator/Director of
Studies.C. I’m a learner.D. I’m a parent.
Why are you here?
A. I need evidence of Continuous Professional Development
B. I want to earn an Open BadgeC. I want to know more about
test scoresD. Other
Understanding test scores
What every teacher should know
Gad S. Lim
to answer your questions about test scores
to explain some of the thinking behind test scores
to understand why test scores are the way they are
Our aims today
Is 70% the pass mark for Cambridge English: Preliminary?
Is 60% the pass mark for Cambridge English: First?
Is 60% the pass mark for Cambridge English: Advanced?
~ 60%~ 70%
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
Easy
Difficult
QuestionWhat would happen if you created an exam where the pass mark was 10%?
QuestionWhat would happen if you created an exam where the pass mark was 10%?
a. Candidates may pass simply by guessing.b. Candidates may not bother to finish the
test.c. Both of the above.
QuestionWhat would happen if you created an exam where the pass mark was 100%?
QuestionWhat would happen if you created an exam where the pass mark was 100%?a. If a candidate’s mind wandered
momentarily during the Listening test, they would fail the exam.
b. It could be discouraging for the learner.c. It would be seen as a very difficult exam.d. All of the above.
Easy
Difficult
Easy
Difficult
Easy
Difficult
norm referenced
criterion referenced
norm referenced
criterion referenced
norm referenced
criterion referenced
TaskFor each example below, decide if the situation requires a norm‐referenced or a criterion‐referenced decision.
• interviewing applicants for a job• granting someone a commercial pilot’s licence• determining your students’ course grades
TaskFor each example below, decide if the situation requires a norm‐referenced or a criterion‐referenced decision.
• interviewing applicants for a job• granting someone a commercial pilot’s licence• determining your students’ course grades
TaskFor each example below, decide if the situation requires a norm‐referenced or a criterion‐referenced decision.
• interviewing applicants for a job• granting someone a commercial pilot’s licence• determining your students’ course grades
TaskFor each example below, decide if the situation requires a norm‐referenced or a criterion‐referenced decision.
• interviewing applicants for a job• granting someone a commercial pilot’s licence• determining your students’ course grades
Now:
One year from now:
Interviewing applicants for a job
Interview Task A
Interview Task B
Now:
One year from now:
Interviewing applicants for a job
Interview Task A
Interview Task B
≠
Now:
One year from now:
Test A
Test B≠
Testing candidates’ English language proficiency
Should someone who got 7 out of 10 in Test A get the same credit as someone who got 7 out of 10 in Test B?
Testing candidates’ English language proficiency
© Tupungato / Shutterstock.com
Knightsbridge GreenPark
LeicesterSquare
King’s Cross
CoventGarden
SouthKensington
Hyde ParkCorner
RussellSquare
Holborn
Piccadilly Circus
Gloucester Road
GloucesterRoad
Knightsbridge GreenPark
LeicesterSquare
CoventGarden
SouthKensington
Hyde ParkCorner
RussellSquare
Holborn
StationsGloucester Road‐Piccadilly Circus 5Piccadilly Circus‐King’s Cross
Piccadilly Circus
King’sCross
GloucesterRoad
GreenPark
LeicesterSquare
CoventGarden
SouthKensington
Hyde ParkCorner
RussellSquare
Holborn
StationsGloucester Road‐Piccadilly Circus 5Piccadilly Circus‐King’s Cross 5
Piccadilly Circus
Knightsbridge
King’sCross
© Christian Mueller
Stations StepsGloucester Road‐Piccadilly Circus 5 5,200Piccadilly Circus‐King’s Cross 5 4,100
GloucesterRoad
GreenPark
LeicesterSquare
King’s Cross
CoventGarden
SouthKensington
Hyde ParkCorner
PiccadillyCircus
RussellSquare
HolbornKnightsbridge
stations = items correct / raw score
steps = item response theory / scaled score
Writing and Speaking
‘How is Writing assessed in Cambridge English: First, Advanced and Proficiency?’
‘A webinar on marking the Writing element of Cambridge English: First and Advanced would be really helpful.’
www.youtube.com/cambridgeenglishtv
TheCambridge English
Scale
http://www.cambridgeenglish.org/exams/cambridge‐english‐scale/
Why is the maximum score 230?
Question:
Is 100 a good score?
Type yes or no.
Question:
Is 100 a good score?
Answer yes or no.
N.B. The scale is 0 to 1,000.
Scale Score
0 to 1 0.1
0 to 10 1
0 to 100 10
0 to 1,000 100
0 to 10,000 1,000
0 to 2,000 200
0 to 200 20
0 to 20 2
0 to 2 0.2
© Rob Hyrons
Scale Score
0 to 1 0.1
0 to 10 1
0 to 100 10
0 to 1,000 100
0 to 10,000 1,000
0 to 2,000 200
0 to 200 20
0 to 20 2
0 to 2 0.2
Why is the maximum score 230? If it had just been 100 or even 200, it would have been much easier to translate into a percentage mark.
http://www.cambridgeenglish.org/exams/cambridge‐english‐scale/
How do I convert marks on practice tests to the Cambridge English Scale?
~ 60~ 70 %
Writing andSpeaking
The Cambridge English
Scale
Further information
Teaching English
Sample papers, handbooks, lesson plans and teacher guides
Free resources for teachers
For new and experienced teachers
Teaching Qualifications
Helps you assess which stage you are at in your professional development and work out where you want to get to next
Teaching Framework
About our exams and teaching
Webinars
www.cambridgeenglish.org/teaching-english
www.cambridgeenglish.org/silt
Further information
University of CambridgeCambridge English Language Assessment1 Hills Road, Cambridge CB1 2EU, UKTel: +44 (0)1223 553997Fax: +44 (0)1223 553621Email: [email protected]
Keep up to date with what’s new via the Cambridge English Language Assessment website:www.cambridgeenglish.org
For information on Cambridge English webinars for teachers:www.cambridgeenglish.org/webinars
Understanding writing assessment: what every teacher should know12 and 14 December 2016
