Embed Size (px)
Citation preview
April 20, 2023UNAIDS
Monitoring and Evaluation of Monitoring and Evaluation of HIV Programs for MSMHIV Programs for MSM
Linking data to Program Planning, Implementation, and AdvocacyLinking data to Program Planning, Implementation, and Advocacy
UN
AID
S/S
.NO
OR
AN
I
Mauricio CysneInternational Conference on HIV Infection
in Hidden GroupsLisbon, March 28 2011
April 20, 2023UNAIDS
Global M&E - UNGASS 2010
Among 180 countries reporting globally this year to UNAIDS
MSM (along with IDU and SW indicator data) rankamong the lowest in number countries reporting when
compared with other general population indicators
Improving the number of countries reporting quality MSM (as well as IDU and SW data) is urgently needed to inform HIV prevention programmes
April 20, 2023UNAIDS
Monitoring & EvaluationWhat is it and why should we do it?
• M&E is a framework for organizing, presenting and using information in order to help decision makers to better plan, develop, implement, and evaluate the program response to a given epidemic need.
• A cyclical learning process Through each cycle (Semi-annual, Annual, Biennial, or
Multi-year) we seek to understand more so we can plan better, implement more effectively & efficiently, achieve greater outcomes and impact.
Programs are rarely ALL GOOD or ALL BAD M&E helps us to understand what is working and what
is not so that we can keep what works and make the mid-course corrections needed to fix or improve.
April 20, 2023UNAIDS
M&E Framework – Linking Data to Program Planning and Implementation
Program M&E (Metrics) Time Frames
Goals Impact Indicators 3-5 years
Objectives Outcome Indicators 1-2 Years
Activities Output IndicatorsQuarterly, Semi-
Annually, Annually
April 20, 2023UNAIDS
Assessment and Planning
Resources Activities Annual Program Outputs
Intermediate Program Objectives
5-year Program Goals
(Input) (Interventions) (Outputs) (Outcomes) (Impacts)
National HIV Strategy HIV IncidenceSituational Analysis Staff Trainings Staff Trained Provider Behavior HIV PrevalenceResponse Analysis ► Funds ► Services ► Clients Served ► Risk Behavior ► Social NormsStakeholder Needs Materials Education Condoms Distributed Service Use Behavior AIDS MorbidityResource Analysis Facilities Outreach Syringes Distributed Clinical Outcomes AIDS MortalityCollaboration Plans Supplies Advocacy Tests Conducted Quality of life Economic Impact
M&E as part of National Strategic Planning
M&E Framework
Using Data for Planning and Decision Making
April 20, 2023UNAIDS
M&E - Putting the Framework into PracticeLinking Data to Program Planning
Program M&E (Metrics) Time Frames
5-year Goal: Reduce the Annual Transmission Rate of HIV among MSM
HIV Incidence rate among MSM 3-5 years
Objective 1.1: Increase knowledge of HIV
Percentage of MSM who correctly identify ways of preventing the sexual transmission of HIV and reject major misconceptions
1-2 Years
Objective 1.2: Increase percent of MSM who are aware of their HIV status
Percentage of MSM who receive and HIV test and are aware of their status 1-2 Years
Objective 1.3: Reduce risk of HIV infection through sexual transmission
Percentage of men reporting the use of a condom the last time they had sex with a male partner
1-2 Years
Technical Area: Prevention of HIV among MSM
April 20, 2023UNAIDS
M&E - Putting the Framework into PracticeLinking Data to Program Planning and Implementation
Technical Area: Prevention of HIV among MSM
5-Year Goal 1
Reduce the Annual Transmission Rate of HIV among MSM
Program Objectives (for Goal 1):
Objective 1.1: Increase knowledge of HIV
Objective 1.2: Increase percent of MSM who are aware of their HIV status
Objective 1.3: Reduce risk of HIV infection through sexual transmission
April 20, 2023UNAIDS
M&E - Putting the Framework into PracticeLinking Data to Program Planning and Implementation
Technical Area: Prevention of HIV among MSM
5-Year Goal - 1
Reduce annual transmission of HIV
Intermediate Program Objectives (for Goal 1):
Objective 1.1: Increase knowledge of HIV among MSM
Outcome Indicator: Percentage of MSM who correctly identify ways of preventing the sexual transmission of HIV and reject major misconceptions
Objective 1.2: Increase percent of MSM who are aware of their HIV status
Outcome Indicator: Percentage of MSM who receive and HIV test and are aware of their status
Objective 1.3: Reduce risk of HIV infection through sexual transmission
Outcome Indicator: Percentage of men reporting the use of a condom the last time they had sex with a male partner
Impact Indicator: HIV Incidence rate among MSM
April 20, 2023UNAIDS
M&E - Putting the Framework into Practice Linking Data to Program Planning and Implementation
5-year Goal:
Reduce the annual transmission rate of HIV among MSM
Objectives Activities Activity Output IndicatorsDevelop and test IEC campaign targeting MSM and transgender people
Benchmark: Completed by date [XX/XXXX]
Train outreach workers Number of outreach workers trained
Number people reached
Number information materials distributed
Distribution of condoms and water-based lubricants Number condoms distributed
Train medical staff to manage sexually transmitted infections as they affect MSM and Transgender people
Number of medical workers trained
Detection and management of sexually transmitted infections through provision of clinical services
Number of service delivery points with staff trained to manage STI as they affect MSM and transgender people
Train staff on issues related to MSM and transgender in the provision of VCT
Number staff trained
Ensure MSM friendly environment for provision of confidential, voluntary HIV counseling and testing services
Number service delivery points with staff trained to provide VCT services to MSM and transgender
Provide VCT outreach services to MSM Number of MSM receiving HIV test
Outcome Indicator (Objectives 1.2 and 1.3): Percentage of MSM reached with Prevention Program
Technical Area: Prevention of HIV among MSM
Outcome Indicator (Objective 1.3): Percentage of MSM who receive and HIV test and are aware of their status
Distribute information and education materials about HIV and other sexually transmitted infections
Objective 1.1: Increase knowledge of HIV among MSM
Outcome Indicator (Objective 1.1): Percentage of MSM who correctly identify ways of preventing the sexual transmission of HIV and reject major misconceptions
Outcome 1.2: Reduce risk of HIV infection through sexual transmission
Outcome Indicator (Objective 1.2): Percentage of men reporting the use of a condom the last time they had sex with a male partner
Impact Indicator: HIV Incidence rate among MSM
Objective 1.3: Increase percent of MSM who are aware of their HIV status
April 20, 2023UNAIDS
M&E - Putting the Framework into Practice Linking Data to Program Planning and Implementation
Indicators
Baseline 2010 2011 2012 2013
Impact Indicator: HIV Incidence rate among MSM x x
Outcome Indicator (Objective 1.1): Percentage of MSM who correctly identify ways of preventing the sexual transmission of HIV and reject major misconceptions
x x x
Output: Benchmark: Completed by date [XX/XXXX] x x x x x
Output: Number of outreach workers trained x x x x x
Output: Number people reached x x x x x
Output: Number information materials distributed x x x x x
Outcome Indicator (Objective 1.2): Percentage of men reporting the use of a condom the last time they had sex with a male partner
x x x
Number condoms distributed x x x x x
Number of medical workers trained x x x x x
Number of service delivery points with staff trained to manage STI as they affect MSM and transgender people x x x x x
Outcome Indicator (Objective 1.3): Percentage of MSM who receive and HIV test and are aware of their status
x x x
Number staff trained x x x x x
Number service delivery points with staff trained to provide VCT services to MSM and transgender x x x x x
Number of MSM receiving HIV test x x x x x
Outcome Indicator (Objective 1.2 and 1.3): Percentage of MSM reached with Prevention Program
x x x
Program Objective 3
Program Objective 2 & 3
Program Objective 1.1
Program Objective 2
Technical Area: Prevention of HIV among MSM
Targets/Results
April 20, 2023UNAIDS
M&E - Putting the Framework into Practice Linking Data to Program Planning and Implementation
Define• Numerator, denominator, disaggregation (age, gender)
Describe the variables that will be used to create your indicator as well as any equations or other definitional information required to calculate the indicator
• Measurement tool Surveillance, survey, program records?
• Data collection frequency Monthly, Quarterly, Annually, Biennially?
• Responsibility Who is responsible for what data and at what level?
• Purpose and use
Set targets Collect data • Use operational guideline – now in pilot countries
April 20, 2023UNAIDS
M&E - Putting the Framework into Practice Linking Data to Advocacy
Example from Mozambique• KYE• KYR• NASA/MEGAS• I-RARE• Data Triangulation• Modes of Transmission
April 20, 2023UNAIDS
Partners IDU 0.3%
Clients 7%
One sexual partner 47.3%
Medical injections 1.7%
Partners of MPs 18%
Multiple partners (MPs) 6%
Female partners of MSM 0.1%
MSM 5.1%
Partners of Clients 10%
Sex workers 2%
Injecting Drug Use (IDU) 3%
Blood transfusions 0.1%
Incidence model results - 2008
Sex-work related 19%
Related to multiple partner behaviours 24%
Note: The incidence model requires detailed data. Many of the data required were not available, and many proxy data or estimations were necessary. Such the model results should be interpreted with caution.
April 20, 2023UNAIDS
Figura 63. Gastos em prevenção, por população beneficiária em Moçambique (US$), 2004-2008
05,000,000
10,000,00015,000,00020,000,00025,000,00030,000,00035,000,00040,000,00045,000,000
PVHI
V
GAR
Out
ras
popu
laçõe
sch
ave
emris
coPo
pulaç
ões
espe
cifica
s "a
cess
iveis"
Popu
lação
em g
eral
Inte
rven
ções
não
orien
tada
s
Gas
tos
(US$
)
Fonte: Análise MEGAS suplementar, J. Durão Nov. 2010
