EVALUATIONIN

EDUCATION

Abdul RasheedM.ed Morning

Roll no : 0102/02/2015

Evaluation

· What is evaluation?

· Why to evaluate?

· How it is done?

What is evaluation?Evaluation is systemic determination of merit,

worth and significance of something or someone using criteria against a set of standard.(en.wikippedia.org/wiki/evaluation)

Evaluation is the process of determining to what extend the educational objectives are being realized • Ralph Tyler

Evaluation is the process of making judgment based on criteria and evidence.(www.sbctc.edu/College/e-assessglossary)

Why to Evaluate….

· Measures the effectiveness of the instructor

· Measures the effectiveness of impact in meeting objectives

· Provide feedback to students

· Provides students gratification and motivation...........

To be Known before

How to EVALUATE ?For

Quality Evaluation

Quality Evaluation

Criteria Questions

TechniquesMethods

Quality

How the evaluation will be done

Criteria

Certain standard on which the

achievements of a learner

is measured

Good Quality Criteria

· Validity

· Reliability· Reproducibility

· Sensitive

· Specific

(VRRSS)

Types of Evaluation

· As per Quality of Evaluation· Quantitative

· Qualitative

· As per Time of Evaluation· Formative

· Summative

Formative v/s Summative Evaluation

Quality Formative Summative

Purpose detect strengths & weakness

Overall achievements

Frequency During or end of unit In end – point of certification, promotion

Area covered One unit/no. of units Course contentAdministrative utility

Advisory, not always for permanent record

Decisive, for permanent record

Feedback to students

Done immediately Inform regarding pass or fail

Feedback to faculty If significant no. shows error than weakness in instruction

Overall pass or fail

Questions

Evaluation Questions should Include Each level of Evaluation

*Levels of EvaluationLevel I – Reaction

How did the student react to the class?

Level - II Learning √ What has the student learned?

Level III – Skill √How much did the student retain?

Level – IV Impact √What is the final impact or practical application of

this learning?

Methodologies Project Assignments Observation

Simple Observation Think-aloud (let the examinee explain) Constructive Interaction

Query via Interviews Focal Group Discussion (FGD) Questionnaires

Combinations of methodologies should be used

Summary of MethodologiesType Strengths Weaknesses

Project Assignment CreativitySkill Judgment

Time ConsumingAnalysis is Difficult

Observational Skill JudgmentIn DepthLess Planning require

Time ConsumingAnalysis is Difficult

Interview DepthHigh ResponseCommunication skill

Extensive PlanningTime ConsumingAnalysis Difficult

Focus group discussion (FGD)

Group EnergyCommunication skillInterpersonal Relationship

Extensive PlanningAnalysis Difficult

Questionnaire Extensive in UseIn DepthEasy Analysis

Extensive Planning

Tests

WrittenQuestionnaire

Practical Project Assignment, Case

Study, Observation, Interview, FGD

OralInterview, FGD

24

Written Tests

Multiple ChoiceTrue/FalseMatchingCompletion or fill in the blankEssay

Short Notes Long Essay

25

How to EVALUATION

Process of Evaluation

Process of Evaluation(9 Steps)

Step 1. Define Purpose & ScopeStep 2. Specify Evaluation QuestionStep 3. Specify Evaluation DesignStep 4. Create Data Collection Action Plan

Planning

Implementation

Step 5. Data Collection Step 6. Data analysisStep 7. Finding data Inference

Step 8. Disseminate Information Step 9. Feedback for improvement

Feedback

Data Collection Action PlanDecide level of EvaluationType of EvaluationType of Evaluation Technique What Evaluation Questions ?From whom/Data Sources ?By whom ?When Collected ?How Collected ?How Data are to be Analyzed ?

Accreditation Council for GraduateMedical Education (ACGME)

· Six General Competencies:Patient CareMedical KnowledgePractice-Based Learning Interpersonal and Communication SkillsProfessionalismSystems-Based Practice

Choosing an Evaluation Method

why in process: Purpose of evaluationWhen in process: Formative vs. Summative

style of evaluation: laboratory vs. field

type of measures: qualitative vs. quantitative

level of information: high level vs. low level

resources available: time, subjects, tools & equipment, expertise etc.

Example

· Which type of test is most commonly used for state or national certifications?

A. True/FalseB. MatchingC. Multiple choiceD. Fill in the blank

39

Goal of Evaluation

Status Evaluation

Feedback

“If you can not measure it, you can not improve it.”

soEvaluation is important.

Be Sweet, Like honeyAbdul RasheedM.ed MorningRoll no: 01