How to Focus an Evaluation Final

8/6/2019 How to Focus an Evaluation Final

1/38


2/38

Sl .

No.

Approach Emphasis Focusing Issues Evaluators

role

1. Experimental Research

design

What effects result from

programme activities and

can they be generalized.

Expert/Scientis

ts

2. Good Oriented Goal &

Objectives

What are the programs

goals and objectives andhow can they be measured?

Measurement

specialist

3. Decision

focused

Decision

making

Which decisions need to be

made and what information

will be relevant?

Decision

support person

4. Use Oriented Information

Users

Who are the intended

information users and what

information will be most

useful

Collaborator

5. Responsive Personal

understandi

ng

which people have a stake

in the program and what

are their points of view?

Counselor/Faci

litator


3/38

Important aspects to be studied:- Clients

Goals

Process

Organization

Pattern of enquires will include:- To serve immediate purposes

To serve long term expectations

To know future concerns & interests

To know the role of other groups and factors for the programs success

or failureConstraints which limit the evaluation work:- Budget

Schedule

Availability of respondents / interaction

Additional resource crush


4/38

Sl. No. Approach Special information needs

1. Experimental a) Outcome measures

b) Client characteristics

c) Variation in treatments

d) Other influences on clients

e) Availability of control groups

2. Goal oriented a) Specific program objectives

b) Criterion referenced outcome measures.

3. Decision focused a) Stage of program development

b) Cycle of decision making

c) Date gathering and reporting routines

4. User oriented a) Personal and organizational dynamicsb) Group information needs

c) Program history

d) Intended uses of information

5. Responsive a) Variation in individual and group perspectives

b) Stakeholder concerns

c) Program history

d) Variation in occasions and sites


5/38

1. Program components (what)

2. Issues questions (why)3. Constraints & difficulties

4. Evaluation procedures

5. Priority areas concerns & issues

6. Costs & Resources


6/38

a) Population

b) Purposes

c) Recordsd) Operations

e) Indicators (Particular emphasis)


7/38

a) Generation of support base

b) Prior / current situations (Agency /

funds)c) Outcomes


8/38

a) Time - planb) Budget planc) Staff pland) Work-plane) Rapport planf) Respondent plang) Record plan etc.

Plan for

P Personnel & respondentsR Respondent and ReportE - EvaluationP ProcessA AdministrationR Record for documentationA Action planT TimeI InstrumentsV ValueE Effectiveness Cost


9/38

a) Support base for maximize impact / effect.

b) Cost effectiveness of the programc) Impact analysis

d) I.E.C. received for future effect / impact benefits.


10/38

a) Immediate (short terms)

b) Long term

c) Future pland) Role of others


11/38

a) Primary & Secondary (additional) etc.


12/38

(a)Delphi technique :

Written questionnaires instead of face to face discussion.

Individuals rank their responses to a numerical scale and provide at times explanations forthat.

After tabulation of all participants responses again the respondent is asked to change hisoptions or stick to it with explanations. The procedure is repeated to point of a consensus ordiminishing returns.

(b)Q-sort or pile-sorting :

A list of items on cards and numbered. Each individual is to sort the cards into piles as per acriterion under a structured instruction. Then the process is repeated to get a consequence of thegroup on categorization.

(c)Nominal group technique (small going):

1st researcher Options / 2nd complete list of group responses / ranking of options byindividual members or a note / explanations by facilitator / and consensus approach is arrived atHealth Education, a new Approach.


13/38

1. KAP Knowledge + Attitude + Practice Cognitive

2. AAA Awareness + Attitude + Action Effective

3. KAB Knowledge + Attitude + Behaviour Responsive

The various influences bearing on the patient to motivate him or discourage him from seeking some remedial measures: -

(Health Belief Model)

Demographic Socio-psychological

personality, Peer group, social

classes variables

Perceived benefit of perceived action

(minus) perceived barrier to preventive

action

Perceived susceptibilityand severity

Perceived threat ofDisease

Livelihood of taking

recommended health action

Closer to action mass media advice from

others illness of family members, friends


14/38

Factors affecting group dynamics or interactions in any community:-1. Demographic characteristics Age, sex, caste / class composition, density and mobility

2. Value system folkways, mores and values

3. A social stratification according to class /caste groups and relationships rich, poor, high /

general caste, low / sch. Caste or tribe etc.

4. Interpersonal relationship mutual contacts, conflicts between groups, informal leadership,

and social control.

5. Power structure referring to persons or groups in authority dominating over other groups.

6. Institutional structure organizational and functional group

Focus group discussion :-1. Initiation of contribution

2. Information seeking

3. Information giving

4. Opinion seeking

5. Opinion giving

6. Elaboration or Elucidation

7. Co-ordination

8. Recording and Documentation

9. Orientation

10. Encouraging and Energizing

11. Observation

12. Evaluation

13. Transcribing and report writing.


15/38

1. Identification of problems and educational diagnosis

2. Setting the objectives

3. Studying the resources of background situation4. Evolving strategies or various courses of action

5. Selecting suitable strategy

6. Implementation

7. Monitoring and Evaluation

8. Feed-back

9. Recourse strategy / Implementation procedures.

10. Impact study.


16/38

1. Diagnostic studies

2. Action oriented studies or operational Research

3. Evaluation or Assessment Studies

4. Cost-benefit or effectiveness studies

5. Developmental studies pertaining to educational aids or methods,

training modules, implementation strategy etc.

6. KAP studies Baselines & End line

7. Communication Studies

8. Evaluation & impact Studies


17/38

1. Observation of problems or events on a phenomenon.

2. Description and formulation of problems

3. Formulation of hypotheses and strategies for the solution

of problems.4. Formation of a research design and decision of type of

data to be collected Qualitative or Quantitative etc.

5. Date collection

6. Data processing and Analysis

7. Interpretation of findings8. Report writing


18/38

Themes:-

1. Naturalistic Enquiry

2. Inductive analysis

3. Direct program contact

4. Holistic perspective

5. Dynamic / Developmental perspective

6. Case studies


19/38

1. Extreme or deviant case sampling

2. Maximum variation sampling

3. Homogeneous sampling

4. Typical case sampling

5. Critical case sampling6. Criterion sampling

7. Confirmatory and disconformities case sampling

8. Political case sampling

9. Snowball or chain sampling

10. Convenience sampling

11. Opportunistic sampling


20/38

1. Data triangulation

2. Investigator triangulation

3. Methodological triangulation4. Theoretical triangulation


21/38

1). Pure Hypothetical Deductive approach to Evaluation :Experimental Design, quantitative data and statistical analysis

(Quantitative).

2). Pure qualitative strategy :Naturalistic inquiry, qualitative data and content analysis

(Qualitative)3). Mixed form: More Qualitative, less quantitative)Experimental Deign, qualitative data collection and content

analysis.(More Qualitative, less quantitative)4). Mixed form :Naturalistic inquiry, qualitative data collection, and statistical

analysis.(More qualitative, less quantitative)5). Mixed form:Experimental design, qualitative data collection and statistical

analysis. (Less qualitative ,more quantitative)6). Mixed form :Naturalistic inquiry, quantitative measurement and statistical

analysis. (Less qualitative. more quantitative)


22/38

1. Observationa) Participant (a) covert

b) Non-participant (b) covert

2. In depth interviews.a) The informal conversational interview

b) The general interview guide approach

c) The standardized open-ended interviewd) Closed quantitative interview

Question types:

1. Experience / Behaviour questions

2. Opinion / Belief questions

3. Feeling / sentimental questions

4. Knowledge questions

5. Practice questions6. Sensory questions

7. Background / Demographic questions

3. Focus group discussion / interview


23/38

a) Case analysis

b) Content analysisc) Inductive analysis

d) Logical analysis


24/38

a) Causes

b) Effects or consequences

c) Relationships or net workingd) System study


25/38

1. Extreme cases

2. Typical cases3. Negative cases

4. Rival / opposite cases


26/38

1. Area (sq.km) 622.002. Population 103,382

3. Density of population 1664. Sex-ratio 9725. Growth rate 31.06. ST % - 52.0%7.

SC % - 38.218. Literacy Total 15.12%9. Literacy female 7.92%10. No. of SC 32


27/38

*In Orissa more than 70% pregnant women are anemic

and suffer from I /F deficiency, perhaps, in turn, lead tolow weight babies.

% distribution of deaths due to 10 selected important

diseases Anaemia (Highest)

1991 (10.51)1992 (8.91)

1991/92 Annual Report No. 23 Jan. 1992 office of the

R.G.

N.D. Survey of causes of Deaths (rural) Annual Report1991 series 3 pro. 24 Dec. 1992.


28/38

Most of the factors of high IMR in Orissa were

maternal in origin.

They include:-1. Inadequate dietary intake of mothers

2. Poor health of mother

3. Low birth weight of baby

4. Labour complications

5. Poor health of the child6. Inadequate supplementary feeding

7. Lack of proper immunization

8. Unsafe drinking water

9. Poor housing conditions

10. Low income

The anemic prophecies are programmes need to begiven special emphasis including the cases of mass

deficiencies in potects reported to endemic and

parasitic infestation.


29/38

Tribal / rural womens dietary intake is insufficient as

well as pseudo modern adopting harmful dietarypractices of urban people in several instances.

So, HNE with IGA should be the major focus with area.


30/38

AMALNUTRITION & ANAEMIA

W.H.O. has developed a new index namely DALYs (disability Adjusted LifeYears)

Rates of malnutrition among women and girls are higher than men and boysin the same age group.

Due to insufficient care during antenatal / natal, post natal periods thewoman suffer from malnourishment resulting in Anemia.

I.C. M.R. Study95% girls between 6-14 years in Kolkata are anemic70% Delhi and Hyderabad20% Chennai


31/38

More than 60% women suffer from Anaemia in India. Diet restrictions during

pregnancy and lactational stages further deplete the nutritional intake of

women resulting in Anaemia.

Malnourishment leading to Anaemia is not a result of poverty but more a resultof discrimination by gender.

Anaemia not only depletes physical resistance to disease but also results in

failure to achieve genetic potential in physical growth and development.

This has serious implications on work performance as well as reproductive

success, and also affects the next generation through low birth weight and poorgrowth and development of the children that these women bear.

Higher loss of pregnancies as foetal wastage and among the children as deaths

in childhood encourages higher fertility resulting in further depletion of the

health of women.

Poor performance in maternity and childbirth results in other health problems

implying perpetuations of poor quality of population at each generation.Dr. Gopalam, the internationally known nutritionist says that family planning

cannot be substitute for better health programmes. Current population, control

programmes that concentrate on the size (quantity) of the population

neglecting its quality, therefore, needs to be resolved seriously.


32/38

Women in tribal areas take longer duration and work very hard to fetch food,

fule ,water and fodder. It auguments their problems and results in Anaemia.

Technological improvements mostly benefited the mans job rather than the

womens job rural / tribal areas. So many of these conditions are exacerbated

by malnutrition, anaemia and child bearing.

Mal-nutrition unequal access to health care, adverse sex ratio, faulty family

planning strategy professional prejudices and minimized role of women and

gender gap in health and survival, womens status in Indian society add to the

health problems of women and during pregnancy and /or lactations they areexposed to poor health status and susceptible to anaemia. Control may be

difficult unless and until these above factors are taken care of.

Professional Prejudices:-Instead of 13:1 ratio of Nurse to Doctor is India it should be ideal as 3:1. The

ANMs low work status, money, recognition, job satisfaction, monitory and

labour creates problems for them and as mothers and wives they are also

burdened with work. State policies to minimize the population growth through

ANMs to work only for Women (the only target) creates an impossible took

assignment foe Women in the community.


33/38

Due to Iron Deficiency

3 stages of Iron deficiency have been descried:-

(a)1st stage characterized by decreased shortage of iron without any other, detectableabnormalities.

(b)An intermediate stage of Latent Iron deficiency i.e. iron stores are exhausted butanaemia has not occurred as yet.

Its recognition depends upon measurement of serum feritin levels. The percentagesaturation of transferring falls from a normal value of 30% to less than 15%.

This stage is the mostly prevalent stage in India.(c)The 3rd stage is that of overt iron deficiency when there is a decrease in the

concentration of circulating haemoglobinic due to impaired hemoglobin synthesis.


34/38

The end result of iron deficiency is Nutritional anaemia which is not a disease

entity. It is rather a syndrome caused by malnutrition in its widest sense.

Besides, Anaemia, there may be other functional disturbances such as

impaired cell mediated immunity, reduced resistance to infection, increased

morbidity and mortality and diminished work performance.


35/38

Nutritional Anaemia is a disease syndrome caused by malnutrition in its widestsense. It has been defined by WHO as a condition in which the hemoglobincontent of blood is lower than normal as a result of a deficiency of one or moreessential nutrients, regardless of the cause of such deficiency. Anaemia isestablished of the hemoglobin in below the cut off points recommended by

WHO. By far the most frequent cause of Nutritional Anaemia is iron deficiencyand less frequently folate or vitamin B12.

The problem:-

WORLD Nutritional Anaemia is a world-wide problem with the highest

prevalence in developing countries. It is found especially among women ofchild- bearing age, young children and during pregnancy and lactation. It isestimated to affect nearly two-thirds of pregnant and one-half of non-pregnant women in developing countries. The populations of developed


36/38

countries are not by any means completely free of anaemia, and a significant

percentage of women of child bearing age (estimated between 4 and 12%)

suffer from Anaemia.

INDIA:

Iron deficiency anemia is a major nutrition problem in India and many other

developing countries. In addition, many subjects have iron-deficiency without

anaemia. The incidence of anaemia is highest among women and young

children, varying between 60 to 70%. Recent surveys indicate that a rural

India anaemia is much more wide spread than hitherto believed, even amongmen.

Iron deficiency can arise either due to inadequate intake or poor bio-

availability of dietary iron or due to excessive losses of iron from the body.

Although most habitual diets contain seemingly adequate amounts of iron,

only a small amount (less than 5%) is absorbed. This poor bio-availability isconsidered to be a major reason for the widespread iron deficiency. Women

lose a considerable amount of iron especially during menstruation. Some of

the other factors leading to anaemia are malaria and hook worm infestations.

In addition mothers who have born children at close intervals became

anaemia due to the additional demands of the rapid pregnancies and the loss


37/38

of blood in each delivery.

In some areas of India, it has been shown that folate deficiency anaemia affects

25 to 50% of pregnant women attending hospital clinics, present evidencesuggests that a high prevalence of folate deficiency anaemia in pregnancy is a

universal phenomenon and is not associated simply with the economically

under privileged.

Detrimental effects:-

1. Risk of maternal and foetal mortality and morbidity (In India 20-40% of

maternal deaths)

2. Cause or aggregate infectious parasitic diseases like malaria or other worm

infestations3. Impairment of maximal work capacity (specifically to women) reducing the

income levels of households.


38/38

Interventions

(I)An estimation of hemoglobin contents should be done to assess the degree of

anemia If the anaemia is severe (-10g/dl) high doses of iron or blood transfusion

may be necessary. If hemoglobin content is between 10-12g/dl the other

interventions are :

(II)Short term measures (a) Iron and folic acid supplementation (b)Iron

fortification ( All these are short-term measures)

(c)Other strategies like (Long term measures)

i. Changing of dietary habits

ii. Control of parasites

iii. Nutrition Education

Documents

How to Focus an Evaluation Final