25
decision making on health decision making on health systems in LMICs: what systems in LMICs: what evidence do policymakers evidence do policymakers need? need? Harriet Nabudere, MD, MPH Knowledge Translation for Health Policy and Systems College of Health Sciences, Makerere University Kampala, Uganda

Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Embed Size (px)

Citation preview

Page 1: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Using evidence to inform decision Using evidence to inform decision making on health systems in making on health systems in LMICs: what evidence do LMICs: what evidence do policymakers need?policymakers need?

Harriet Nabudere, MD, MPHKnowledge Translation for Health Policy and SystemsCollege of Health Sciences, Makerere UniversityKampala, Uganda

Page 2: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Supporting Use of Research Evidence Supporting Use of Research Evidence (SURE) for Policy in African Health (SURE) for Policy in African Health SystemsSystemsSURE is a collaborative project that builds

upon two existing initiatives – The Regional East African Community Health (REACH) Policy Initiative and the Evidence-to-Policy Network (EVIPNet) Africa.

Both networks aim to promote the use of evidence in health policy decisions.

REACH comprises the countries; Uganda, Tanzania, Kenya, Rwanda and Burundi.

EVIPNet Africa comprises the countries of Burkina Faso, Cameroon, Centrafrique, Ethiopia, Mozambique, and Zambia.

Page 3: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Overall Strategy:Overall Strategy:SURE comprises 8 work packages.There are 6 work packages with

scientific/technological objectives: WP1: Production of research syntheses

(evidence briefs for policy) to address priority policy questions.

WP2: Development and evaluation of strategies for improving access to research evidence to inform policy decisions, i.e.; user-friendly formats for evidence briefs and clearing house.

WP3: Developing and evaluating mechanisms for a rapid response service to meet policymaker needs for research evidence.

Page 4: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Overall Strategy (contd)Overall Strategy (contd)

WP4: Developing and evaluating methods for conducting deliberative/policy dialogues that are informed by research syntheses/evidence briefs. Methods for involving civil society, the general public, the media in policy development.

WP5: Capacity-building for researchers, policymakers and civil society in developing and implementing evidence-informed health policies.

WP6: Comprehensive evaluation of the African partners initiatives to improve the use of research to inform health policy decisions.

Page 5: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Setting Priorities for Guidance:Setting Priorities for Guidance:Consultations:Consultations:

Criteria: Important problem, viable options, opportunity for change, available evidence, etc

Stakeholder Survey: Parliamentarians, policymakers, health managers, researchers, civil society

Advisory Group: 3 policymakers, 1 researcher, 1 CS practitioner

Framed and ranked issues that were considered high priority for the Ugandan health system.

Page 6: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

SURE Year 2: SURE Year 2: Evidence Brief for PolicyEvidence Brief for Policy

TitleAuthorshipProblem DescriptionPolicy OptionsImplementation ConsiderationsCompletion of the evidence briefDialogues and Evaluation

Page 7: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy: Title: Title:

‘Improving Access to Skilled Attendance at Delivery’

Page 8: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Authorship:Authorship:

Contributing Authors: 2 members, REACH Uganda team1 Senior Policymaker, MOHSkilled Birth Attendance Working

Group: 2 Senior Policymakers (MOH),1 Obstetrician Consultant/Researcher/

Academician

Page 9: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:The Problem (1):The Problem (1):

• Identification of evidence i.e national statistics & local data from MoH, UBOS, WHO, UN data etc.

• Advanced draft describing the problem

• Internal reviews by the working group & external reviews with revision of the problem section.

Page 10: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:The Problem (2):The Problem (2):

The burden: high maternal mortality ratio 435 per 100,000 live births (DHS,2006) from MMR 670 (UN,1990)

Coverage of Skilled attendance stood at 42% (DHS, 2006) and under 50% (AHSPR, 2009/2010)

Maternal and perinatal causes constitute 13.2% of the total disease burden (WHO,2004)

Page 11: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Policy Options:Policy Options:

Identification and appraisal of evidence (preferably systematic reviews of effects) for impacts (benefits and harms) of alternative organisational arrangements to address the problem

• Identification and appraisal of other evidence: local single studies.

Page 12: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Appraisal of the evidence:Appraisal of the evidence:SURE checklist for systematic review SURE checklist for systematic review methodsmethods

1. Check on methods used to search, select and appraise studies in systematic reviews

PICOS criteria, data sources, timeframe,

explicit selection criteria,.. 2. Check on methods used to analyse

findings in systematic reviews Reliable reporting for study characteristics &

results, analysis methods, appropriate

combination of findings..

Page 13: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Appraisal of the evidence:Appraisal of the evidence:GRADE framework for rating quality of GRADE framework for rating quality of evidenceevidence

1. Identification of important outcomes from a systematic review

2. Assessment of quality of evidence per outcome using GRADE framework

3. Tabulated summary of findings per outcome

4. Key messages in plain language

Page 14: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Policy Options (contd):Policy Options (contd):

Agreement and development of draft on 3 policy options (organisational arrangements):

Providing Intrapartum Care at first level Health Centre

Working with the Private-for-Profit sector

Maternity Waiting Homes

Page 15: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Implementation Strategies (1):Implementation Strategies (1):

Identification and appraisal of evidence (preferably SRs of effects) on barriers to implement the policy options & strategies to address these.

Identification and appraisal of other evidence and local information e.g local single studies, national reports,…

Page 16: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Implementation Strategies (2):Implementation Strategies (2):

Agreement on the implementation barriers & strategies:

Implementation Barriers: poor care seeking behavior from mothers, social & economic constraints for mothers, inadequate HRH, inadequate health facilities and financing,

Strategies: VHTs, community mobilisation, community referral and transport schemes, strengthening health infrastructure and public-private collaboration

Page 17: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:Implementation Strategies (3):Implementation Strategies (3):

Advanced draft describing the policy options, implementation barriers & strategies

Internal review and revision of the policy options, implementation barriers & strategies

Page 18: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy:Evidence Brief for Policy:other considerations - other considerations -

Systematic reviews and single studies used were assessed not only for methodological quality but also, where possible, for:

◦applicability to the local context◦equity across socio-economic groups◦scaling up considerations (costs and

cost-effectiveness)◦gaps in the research evidence hence

need for monitoring and evaluation

Page 19: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Full Evidence Brief for Full Evidence Brief for PolicyPolicyDraft title and cover pageKey messages (1 page)Executive summary (8 pages)Full Report (45 pages)BibliographyDescription of methodsAcknowledgementsConflicts of interestExternal review of the draft policy briefRevision of the full policy brief

Page 20: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Evidence Brief for Policy: Evidence Brief for Policy: EvaluationEvaluation

The evidence brief was the main input for discussion at two national policy dialogues for stakeholders including legislators, policymakers, researchers, civil society and the media

A survey was conducted with the stakeholders about the usefulness of the design format of the brief

Page 21: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation
Page 22: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Overall assessment of the Overall assessment of the evidence brief for policyevidence brief for policy

‘The purpose of the policy brief was to present the available research evidence on a high-priority issue in order to inform a policy dialogue where research evidence would be just one input to the discussion. How well did the policy brief achieve its purpose?’ (N=22)

Rating on a scale of 1 (failed) to 7 (achieved) Mean: 6.6 Median: 7 Range: 2

Page 23: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

The need for guidance among The need for guidance among decision-makersdecision-makers

‘I want to use research evidence of the type that was discussed at the policy dialogue to help work through what I will say in a briefing, advocate for, or decide. (N=19)’

Scale of 1 (strongly disagree) to 7 (strongly agree)

Mean: 6.3 Median: 6 Range: 2

Page 24: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

The demand for health The demand for health systems guidancesystems guidance

------Forwarded Message -----From: xxxxxxxxxTo: [email protected]: Sunday, October 9, 2011 10:34 AMSubject: POLICY ISSUES

Greetings my sister. Wish you happy independence. There many policies we have to work on this year includiing legislative matters.

You may have to give us more time. The following are pending- Palliative Care Policy- Interns Policy- Human Tissue Bill- Policy on Emergency Services.- The Tertiary Health Institutions Bill. We have to discuss one of these days.

Page 25: Using evidence to inform decision making on health systems in LMICs: what evidence do policymakers need? Harriet Nabudere, MD, MPH Knowledge Translation

Dr Harriet Nabudere

SURE Project Coordinator

College of Health Sciences, Makerere University

Kampala, Uganda

Email: [email protected]