Recording observational data using rating scales and rating errors

RECORDING RECORDING OBSERVATIONAL OBSERVATIONAL

DATA USING DATA USING RATING SCALESRATING SCALES

CHAPTER 18CHAPTER 18

GLADYS T. AMBUYATBSED III - ENGLISH

Source: Measuring and Evaluating Learning Outcomes: A Textbook in Assessment of Learning 1 & 2

Rating scales are often used in recording results of observations. They can easily be applied in collecting self – observation of self –report data.

Three types of rating scales :

NUMERICAL SCALESGRAPHI SCALESCHECKLIST

A numerical scale is sometimes called a score card. This is because it consists of a number of scale values each of which has its equivalent in numerical forms.Sample:

DIRECTIONS : The items on this scale are to be rated on the basis of 1 for poor, 2 for below average, 3 for average, 4 for above average, and 5 for outstanding. Encircle the number that corresponds to your rating of this student for each of the following:

A. Tolerance in considering in the opinion of others 1 2 3 4 5

B. Participation in group activities 1 2 3 4 5

C. Sharing project materials with others 1 2 3 4 5

Sample: students’ behaviour during classroom discussion

BEHAVIOUR

STUDENTS

REYGLYZZ

AJIM GAB MAE

VOLUNTEERS INFORMATION

MONOPOLIZES DISCUSSION

INTERRUPTS OTHERS

TACTFUL IN DISAGREEING WITH OTHERS

STICKS TO POINTS UNDER DISCUSSION

Sample:

UNSATISFACTORY ITEMS IN WOOD WORK PROJECT

______1. Knots______2. Lack of filling______3. Core of Glue______4. Joint Shrinkage______5. Veneer Sand-through______6. Glaze or Burnish

RATING ERRORSRATING ERRORS

CHAPTER 18CHAPTER 18

GLADYS T. AMBUYATBSED III - ENGLISH

Rating errors despite the numerous advantages associated with the use of rating scales, these are different kinds of errors in their application: AMBIGUITY LENIENCY CENTRAL TENDENCY HALO LOGICAL CONTRAST PROXIMITY

AmbiguityThe tendency to have different raters interpret rating terms in different ways.

LeniencyThe tendency to rate or evaluate favourably those whom they know well higher than they should. This kind of error is greatest when the rater must face the rates with the results.

Central TendencyThe reluctance to give extreme ratings. Sometimes raters are reluctant to take extreme positions, either positive or negative. This tends to cause ratings to cluster up in the middle of the scale.

HaloA gross undifferentiated rating on a specific trait or behaviour which is biased on an overall or total general attitude.

LogicalThe tendency to give similar rating to traits that seem to be logically related in the mind of the rater. If one views self-confidence and aggressiveness to be part of the same personality dimension then they might rate an individual similarly just on the basis rather than the behaviour under observation.

ContrastSome raters valuate or describe ratees in a direction opposite of themselves. “Considering that I am a very well organized individual; no one can recognized as I am.”

ProximityNearness in time or location on a rating form. Traits to be rated on the same page tend to correlate higher than if they were rated on different pages.