Blog - Evaluation Research - Social Research Methods

8/13/2019 Blog - Evaluation Research - Social Research Methods

1/7

Friday, November 26, 2010

20101127 - Evaluation Research

(SocialResearchMethods.net)

One specific form of social research -- evaluation research -- is of particular interest here. The Introduction

to Evaluation Researchpresents an overview of what evaluation is and how it differs from social research

generally. We also introduce several evaluation models to give you some perspective on the evaluation

endeavor. Evaluation should not be considered in a vacuum. Here we consider evaluation as embedded

within a larger !lanning-Evaluation "ycle.

Evaluation can be a threatening activity. #any groups and organi$ations struggle with how to build a good

evaluation capability into their everyday activities and procedures. This is essentially an organi$ationalculture issue. Here we consider some of the issues a group or organi$ation needs to address in order to

develop an evaluation culturethat wor%s in their conte&t.

'ource( http())www.socialresearchmethods.net)%b)evaluation.php

Introduction to

Evaluation

Search This Blog

'earch

LinsMobile Learning portal [prototype]WAP Blog: Mobile Learning & Usability

Blog !rchive* 2010 (144)

+ e!e"ber (4)

* #o$e"ber (%)

Mobile 'W''* pros & !ons

Mobile P+one is "ore !on$enient t+an #oteboo,-o"p...

rea/ing Bible on Mobile p+one in !+r!+

2010112 -on!eptal3'+eoreti!al ra"e5or,(5i,ip...

Usability ra"e5or, (6+a!,el)

2010112 !on!epts & /e7intions o7 $alation res...

2010112 $alation resear!+3"et+o/ (Patton)

2010112 $alation *esear!+ (Wi,ipe/ia)

2010112 $alation *esear!+ (Po5ell)

2010112 $alati$e *esear!+ (Winsett8 #A'-9)

2010112 '+e Planning$alation -y!le (6o!ial*e...

2010112 $alation *esear!+(6o!ial*esear!+Met+...

2010112 iagra" o!s rop as a ;alitati$e ...

2010112 Pee, & ot+ergill8 Using o!s rops 7...

Share 0 #ore ,e&t log valve/oem0gmail.com 1ashboard 'ign Out

Michael "ea#...$h% &andidate

Page 1 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reseach !"ocialReseachMethods.net#

2$%1%201&http:%%'ichael(eap.)logspot.co'%2010%11%2010112*-evaluation-eseach.ht'l


2/7


3/7


4/7

P 5 f 7Mi h l Y PhD C did t 20101127 E l ti R h "# i lR hM th d t$


5/7

F meta-analysisintegrates the outcome estimates from multiple studies to arrive at an overall orsummary udgement on an evaluation &uestion

Evaluation Questions and MethodsEvaluators ask many different kinds of &uestions and use a variety of methods to address them. These areconsidered within the framework of formative and summative evaluation as presented above.

In formative research the major questions and methodologies are:

What is the definition and scope of the problem or issue, or what's the question?

Formulating and conceptualizing methods might be used including brainstorming, focus

groups, nominal group techni&ues, Delphi methods, brainwriting, stakeholder analysis, synectics,lateral thinking, input!output analysis, and concept mapping.

Where is the problem and how big or serious is it?

The most common method used here is "needs assessment"which can include% analysis of

e$isting data sources, and the use of sample surveys, interviews of constituent populations, &ualitative

research, e$pert testimony, and focus groups.

How should the program or technolog be deli!ered to address the problem?

*ome of the methods already listed apply here, as do detailing methodologies like simulation

techni&ues, or multivariate methods like multiattribute utility theory or e$ploratory causal modeling;

decision!making methods; and proect planning and implementation methods like flow charting,

/E3T4/5, and proect scheduling.

How well is the program or technolog deli!ered?

ualitati!e and quantitati!e monitoring techniques, the use of management information

sstems, and implementation assessmentwould be appropriate methodologies here.

he questions and methods addressed under summative evaluation include:

What tpe of e!aluation is feasible?

Page 5 of 7Michael Yeap...PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod.net$

2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&2010112+-evaluation-!eea!ch.ht(l

Page 6 of 7Michael Yeap PhD Candidate: 20101127 Evaluation Reea!ch "#ocialReea!chMethod net$


6/7

Evaluability assessmentcan be used here, as well as standard approaches for selecting an

appropriate evaluation design.

What was the effectiveness of the program or technology?

One would choose from observational and correlational methodsfor demonstrating whether

desired effects occurred, and quasi-experimental and experimental designs for determining

whether observed effects can reasonably be attributed to the intervention and not to other sources.

What is the net impact of the program?

Econometric methods for assessing cost effectiveness and cost/benefitswould apply here,along with qualitative methods that enable us to summarize the full range of intended and unintended

impacts.

Clearly, this introduction is not meant to be exhaustive. Each of these methods, and the many not

mentioned, are supported by an extensive methodological research literature. This is a formidable set of

tools. ut the need to improve, update and adapt these methods to changing circumstances means that

methodological research and development needs to have a ma!or place in evaluation wor".

#ource$ http$%%www.socialresearchmethods.net%"b%intreval.phpPosted by Michael "ISO" at 5:53 PMLabels: evaluation research, research method, SocialResearchMethods.net

No comments:

Post a Comment


2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&20101126-evaluation-!eea!ch.ht(l

Page 7 of 7Michael Yeap PhD Candidate: 20101127 - Evaluation Reea!ch "#ocialReea!chMethod net$


7/7

e!er Post Older Post

Sign out

Notify me

Enter your comment...

Comment as: Michael Valve

Publish Preview

Links to this post

reate a Lin#

$ome

Subscribe to: Post omments %&tom'


2%&1&201'http:&&(ichael)eap.*logpot.co(&2010&11&20101126-evaluation-!eea!ch.ht(l

Documents

Blog - Evaluation Research - Social Research Methods