47
Evaluation Report Vooma Weekend (1-3 Oct) 8 October 2021 Dr David Harrison, Demand Acceleration Lead Dr Lesley Bamford, Vaccination Programme Coordinator Mr Gaurang Tanna, Service Delivery Workstream Coordinator For enabling and undertaking this analysis: Milani Wolmarans and the EVDS teams Julia Michalow and the Genesis-Analytics team

Evaluation Report Vooma Weekend (1-3 Oct)

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Evaluation Report

Vooma Weekend (1-3 Oct)

8 October 2021

Dr David Harrison, Demand Acceleration Lead

Dr Lesley Bamford, Vaccination Programme Coordinator

Mr Gaurang Tanna, Service Delivery Workstream Coordinator

For enabling and undertaking this analysis:

• Milani Wolmarans and the EVDS teams

• Julia Michalow and the Genesis-Analytics team

22

Guide to this report

Rationale• Summary of the rationale for the Vooma Vaccination Weekend

Key takeaways and next steps

Overview of Vooma Vaccination Weekend strategy

Analysis of 3 day vaccination uptake• Fri-Sun 1-3 Oct

Note of appreciation

Analysis of two day weekend-only vaccination uptake• Sat-Sun 2-3 Oct• To assess potential vaccination uptake when more sites open on

Saturdays and Sundays

Rationale

Target: Achieve 70% coverage of people aged 18 and older by the end of 2021

Effort required

Vaccination coverage (% of

adult population having received at least one dose)

0

70%

Vaccination uptake effort curve

34%WE ARE HERE08.10.2021 People

willing and able or open to persuasion

People willing if personal costs or constraints reduced

People unwilling or resistant

5

OBJECTIVE 1: Prevent as much severe Covid-19 disease and death as we can as quickly as possible

0 10 20 30 40 50 60 70 80

Northern Cape

Mpumalanga

North West

Gauteng

SA AVERAGE

Free State

KwaZulu-Natal

Eastern Cape

Western Cape

Limpopo

Percent

First dose coverage in people 60+ (as at 5 Oct 2021)

0 10 20 30 40 50 60 70

Mpumalanga

North West

Gauteng

KwaZulu-Natal

Northern Cape

SA AVERAGE

Western Cape

Free State

Limpopo

Eastern Cape

Percent

First dose coverage in people 50-59 yrs(as at 5 Oct 2021)

6

OBJECTIVE 2: Maximize population coverage (First dose & full vaccination coverage)

0 5 10 15 20 25 30 35 40 45

Mpumalanga

Gauteng

KwaZulu-Natal

Northern Cape

North West

SA AVERAGE

Free State

Eastern Cape

Limpopo

Western Cape

Percent

Vaccination coverage by province (as at 8 Oct 2021)

1st dose Fully vaccinated

77

National demand for vaccination has faltered

88

0

20

40

60

80

100

120

Per

cen

t

First dose coverage by self-reported health insurance status of people 60+ yrs (5 Oct 2021)

Insured Uninsured

0

10

20

30

40

50

60

70

80

90

100

Perc

ent

First dose coverage by self-reported health insurance status of people 50-59 yrs (5 Oct 2021)

Insured Uninsured

The rate of vaccination is lower among people without medical aid (‘uninsured’)

9

Geographical Prioritisation

Prioritisation based on 2 key metrics:

Indicator Definition Time period Target for prioritisation

Number unvaccinated Number of individuals who have not received a single dose of the COVID-19 vaccine

Up to 12 September Determined by province, district and sub-disttrict

First dose vaccination coverage

Numerator: Number of individuals who have received at least one dose of the COVID-19 vaccine (J&J or 1st Dose Pfizer)

Denominator: Number of individuals in the population

Up to 12 September First dose vaccination coverage < 19% is below the national average

Go where the LARGEST unvaccinated persons are…..

….. but DO NOT leave those behind with LOWEST coverages (for equity reasons)

10

Based on these metrics, our highest priority districts are ….

Province District

ECNelson Mandela Bay Metro

O R Tambo

FS T Mofutsanyana(district with lowest coverage in province)

GP

Ekurhuleni MM

Johannesburg MM

Sedibeng DM

Tshwane MM

KZN

Amajuba DM

eThekwini MM

iLembe DM

Umzinyathi DM

Uthukela DM

Zululand DM

Province District

LP Vhembe

MPUEhlanzeni DM

G Sibande DM

Nkangala DM

NCJ T Gaetsewe DM

Pixley ka Seme DM

NWBojanala Platinum DM

Ruth Segomotsi Mompati DM

WC Cape Town

1111

Demand Acceleration: Key strategies

Public Leadership

•Vaccination Campaign Weekend

•Collective statement of commitment

•Celebrity & leader vaccinations

Clear and unambiguous

communication

•Policy clarity

•Tighten communications pipeline

•Behavioural nudges

•Signage at sites

Media & marketing campaign platforms

•Radio

•TV

•Print

•Social media

•Retail space & corporate platforms

Social Mobilisation

•Outbound use of National Contact Centre

•Networks (civil society, business, labour, govt)

•District-wide mobilisation

•Social media analytics & rebuttal

Incentives

•Private sector offered incentives

• Investigate national incentive scheme

12

Overview of Vooma Vaccination Weekend strategy

01-03 Oct 2021

Aim:To mobilise nation-wide leadership to help accelerate demand for vaccination

13

# 15 million more by Christmas“We can save 20,000 lives if we vaccinate 70% of adults by the end of the year”

Vaccination Vooma Weekend (1 - 3 October 2021)

National call to action:President called on every Premier and Mayor to convene a COVID-19 compliant event on 1-3 October to demonstrate collective leadership

and support for the vaccination programme.

Clear and unequivocal leadership• Bring together leadership from

across the political spectrum, civil society, traditional leaders, labour and business.

Vaccination sites openProvinces and private sector to open vaccination sites:Target 500,000 vaccinations

BUILD UP• Announce and call to action• Focused communications & media

engagement• Enlist leadership across all sectors of

society to get behind the events and declare support

NATIONAL ACTIVATION• Provinces to ensure enough

vaccination sites across SA open and sufficiently staffed

EVENTS IN EVERY DISTRICT• Invite select number of leaders (COVID compliant)• Mobilise sports and other icons• Mobilise local media mobilise• Recognise health workers and health managers• Recognise young people and other volunteers who

have contribute significantly

Events in every district• Led by President, Premiers and Mayors• Joined by sports personalities, musicians

and other celebrities of arts & culture

1 2 3

14

President’s Call to Action

Similar letters sent to leaders of civil society, traditional leaders, unions and business

1

2

3

4

5

6

7

8 9

10

11

12

13

14

15

16 17

18

19

20

2122

2324

25

26

27

28

29

30

31

3233

34

35

36

37

3839

40

41

42

43

44

45

46

47

48

49

50

51

52

1. West Coast

2. Cape Winelands

3. Overberg

4. Eden

5. Central Karoo

6. Namakwa

7. Pixley ka Seme

8. Siyanda

9. Frances Baard

10. Cacadu

11. Amathole

12. Chris Hani

13. Joe Gqabi

14. OR Tambo

15. Xhariep

16. Lejweleputswa

17. Thabo Mofutsanyana

18. Fezile Dabi

19. Ugu

20. uMgungundlovu

21. uThukela

22. uMzinyathi

23. Amajuba

24. Zululand

25. uMkhanyakude

26. uThungulu

27. iLembe

28. Gert Sibande

29. Nkangala

30. Ehlanzeni

31. Mopani

32. Vhembe

33. Capricorn

34. Waterberg

35. Bojanala Platinum

36. Ngaka Modiri Molema

37. Dr Ruth Segomotsi Mompati

38. Dr Kenneth Kaunda

39. Sedibeng

40. Sisonke

41. Alfred Nzo

42. ohn Taolo Gaetsewe

43. Sekhukhune

44. West Rand

45. Buffalo City

46. City of Cape Town

47. Ekurhuleni

48. eThekwini

49. City of Johannesburg

50. Mangaung

51. Nelson Mandela Bay

52. City of Tshwane

District Municipalities Metropolitan Municipalities

Vooma Vaccination events 1st & 2nd October 2021

Reported: 88 events in 43 districts

16

Recognition to best performing provinces

Best performing provinces

1.Eastern Cape

2.Limpopo

3.Western Cape

Ranking Criteria:• Risk reduction – First dose coverage

50+ and women: men ratio• Coverage - First dose coverage 18+ • Equity - Ratio uninsured: insured

(Rankings as at 15 September 2021)

Province (cumulative to 15 Sep)Eastern Cape

Free State Gauteng

KwaZulu-Natal Limpopo

Mpumalanga

North West

Northern Cape

Western Cape

First dose vaccination coverage, 20+ 33.00% 30.00% 25.00% 25.00% 32.00% 20.00% 23.00% 27.00% 36.00%

First dose vaccination coverage, 20+ insured 49.55% 50.71% 45.69% 54% 60% 32.16% 46.78% 41.89% 68%

First dose vaccination coverage, 20+ uninsured 32.5% 28.8% 21.4% 23.1% 31.1% 20.9% 21.1% 26.5% 30.0%

Ratio of insured:uninsured, first dose vaccination coverage, 20+ 1.53 1.76 2.14 2.33 1.92 1.54 2.21 1.58 2.27

First dose vaccination coverage, 50+ 60% 55.5% 47.7% 54.4% 64.2% 43.4% 43.3% 45.4% 58.6%

First dose vaccination coverage, 50+ males 63% 55.2% 45.8% 54.6% 68.7% 43.2% 43.4% 47.3% 58.5%

First dose vaccination coverage, 50+ females 58.9% 55.7% 49.5% 54.3% 61.8% 43.5% 43.3% 43.9% 58.6%

Ratio of women:men, first dose vaccination coverage, 50+ 0.93 1.01 1.08 1.00 0.90 1.01 1.00 0.93 1.00

Indicator (cumulative to 15 September) EC FS GP KZN LP MP NW NC WC

First dose vaccination coverage, 18+ 2 1 3

First dose vaccination coverage, 18+ insured 1 2 3

First dose vaccination coverage, 18+ uninsured 3 3 2

Ratio of insured:uninsured, first dose vaccination coverage, 18+ 3 2 1

First dose vaccination coverage, 50+ 2 3 1

First dose vaccination coverage, 50+ males 2 1 3

First dose vaccination coverage, 50+ females 2 3 1

Ratio of women:men first dose vaccination coverage, 50+ 3 1 2

Scores

Objective 2 : Maximise coverage 5 0 0 0 1 2 0 1 3

Objective 1: Minimise mortality and morbidity 5 0 0 0 4 0 0 2 1

TOTAL 10 0 0 0 5 2 0 3 4

17

Provincial recognition

2. Limpopo 3. Western Cape1. Eastern Cape

18

Recognition of high-performing districts

ROLE INDICATORS

MANAGEMENT,

LEADERSHIP AND

INNOVATION

Effective planning and programme execution

Effective management of supply and demand

Innovation and responsiveness to supply and demand challenges

Ability to harness the full capacity of the district in support of vaccinations

FOCUS ON HIGH RISK/

VULNERABLE GROUPS

Effective strategies to prioritise people aged 50+

Effective outreach strategies to reach under-serviced communities

DEMAND

ACCELERATION

Highly effective communication plans leading to increased uptake Highest proportion

of community engagements / responses Strategies to make it easier for people to get

vaccinated

Involvement of non-government partners

SERVICE DELIVERY Highest proportion of vaccinations administered, expressed as a proportion of the total

population:

Sub-categories:

18 - 34 years; 35 - 49 years; 50 years + Age Group

STOCK MANAGEMENT Most effective vaccination storage and local distribution

Pre-emptive strategies to prevent stock-outs

PUBLIC-PRIVATE

COLLABORATION

Effective use of private sector facilities for vaccination of people without medical

insurance

Province nominated Districts

Eastern Cape Amathole

Free State -

Gauteng Tshwane

KwaZulu-Natal Mgungundlovu

Limpopo Mopani

Mpumalanga -

Northern Cape -

North West Dr KennethKaunda

Western Cape Overberg

19

Recognition of high-performing sub-district teams

DISTRICT NOMINATION

In this category, we recognised the efforts of our 213 sub-districts that have supported the vaccination programme. Each district was requested to

nominate ONE ward-based outreach, community activators or vaccination site team (depending on the category) for each district

ROLE CATEGORIES MATRIX/INDICATORS (these are guidelines and District Teams were requested to use

their own best judgement)

Building

demand in

communities

Most effective Ward-Based Outreach / CHW

Team

Highest number of households reached

Outstanding Community Based Activators (non-

government)

This category recognises religious groups, NGO’s, CBO’s, traditional leadership, trade

unions or and other groupings driving the uptake of vaccinations in each sub-district

through communications and social mobilisation.

Efficiency and

quality at

vaccination

sites

Most Effective Vaccination Site (public)

Sub-district with the most accurate and updated data on EVDS Updated information on the stock visibility system Efficient data capturing teams Qualitative assessment of team effectiveness and user-friendliness Innovations in expanding access Ensuring participation of people with disabilitiesMost Effective Vaccination Site (private)

Innovative

partnerships

Most Innovative Partnerships to promote

vaccination uptake

This category recognises any innovative partnerships to expand access (outreach or

transport solutions) or to incentivise participation in the vaccination programme

Coverage of Vooma

Vaccination Weekend

Article Sentiment

N = 107 (by Monday 4 Oct)

Positive33%

Neutral61%

Negative6%

20

Analysis of three–day vaccination uptake Fri – Sun (1-3 Oct 2021)

Vaccination trends in the past month (8 Sept – 7 Oct 2021)

355,000 vaccinations achieved over the weekend, and upward trend has been sustained.

1st dose vaccinations up 26%:Weekday average in the week following of 106,393 compared to average of 84,121 for weekdays in the previous 2 weeks (excluding the Heritage Day holiday).

But this average is still far too low: 1st

dose vaccinations need to average 250,00 a day to achieve the target of 70% adult coverage by end of the year.

0

50,000

100,000

150,000

200,000

250,000

8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 1 2 3 4 5 6 7 8

Total and (1st Pfizer + J&J) 08 Sep - 08 Oct 2021

Total J&J or 1st dose

Pre-Voomamedia

23

Sites open over weekend (Fri- Sun)

Weekend 1-3 Oct 2021 1 Oct 2021 2 Oct 2021 3 Oct 2021

Eastern Cape 369 367 240 183Private 42 40 42 2Public 327 327 198 181

Free State 119 93 73 22Private 25 25 25Public 94 68 48 22

Gauteng 844 843 349 135Private 199 198 199 1Public 645 645 150 134

KwaZulu-Natal 329 254 225 104Private 78 77 78 1Public 251 177 147 103

Limpopo 78 61 78 2Private 51 51 51 2Public 27 10 27

Mpumalanga 88 84 81Private 36 36 36Public 52 48 45

North West 90 88 88Private 17 17 17Public 73 71 71

Northern Cape 79 50 51 7Private 7 7 7Public 72 43 44 7

Western Cape 328 289 207 53Private 125 125 125Public 203 164 82 53

Grand Total 2324 2129 1392 506

Planned sites

There were 16% more sites open on Voomaweekend relative to the average over previous weekends in September (excl. Heritage Day weekend).

Actual sites

Comparing the number of vaccinations per weekend

Number of Vaccinations by WeekendCompared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a14% increase in total number of

vaccinations.

Vooma achieved a 28% increasein total vaccinations compared to what was expected during 1-3 October.

Number of weekend first dose vaccinations

Compared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a 16% increase in first dose vaccinations.

Vooma achieved a 25% increasein first dose vaccinations compared to what was expected over 1-3 October.

Comparing total vaccinations per weekend, by insurance status

Total Vaccinations by Weekend (Fri + Sat + Sun)

Uninsured population● Compared to previous weekends in September (excl Heritage Day weekend),

Vooma achieved 21% increase in total vaccinations.● Compared to the expected total vaccinations during 1-3 October, Vooma achieved

23% increase in total vaccinations.

Insured population● Compared to previous weekends in September (excl Heritage Day weekend),

Vooma achieved 10% decrease in total vaccinations.● Compared to the expected total vaccinations during 1-3 October, Vooma achieved

45% increase in total vaccinations.

45%

23%

Comparing first dose vaccinations per weekend, by insurance status

First Dose Vaccinations by Weekend (Fri + Sat + Sun)

Uninsured population● Compared to previous weekends in September (excl Heritage Day weekend),

Vooma achieved 25% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma

achieved 22% increase in first dose vaccinations.

Insured population● Compared to previous weekends in September (excl Heritage Day weekend),

Vooma achieved 40% decrease in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma

achieved 15% increase in first dose vaccinations.

22%

15%

Comparing throughput in open sites

Average Number of First Dose Vaccinations per Site by Weekend

There is a decreasing trend in the average number of first dose vaccinations per site on weekends.

During September, throughput per site was consistent on Vooma compared to previous weekends (excl Heritage Day weekend).

Vaccination trends by age group

First Dose Vaccinations by Age Group

The age profile of vaccinations during Vooma was similar to that of previous weekends, with somewhat higher uptake amongst individuals <30 years.

Vaccination trends by sex

First Dose Vaccinations by Sex

The sex profile of vaccinations during Vooma weekend is consistent with that of previous weekends.

Vaccination trends by insurance status

First Dose Vaccinations by Insurance Status An increasing proportion of first dose vaccinations is amongst the uninsured population. This trend remained consistent during Vooma weekend.

Effect of Vooma in priority vs non priority districts

First Dose Vaccinations by District Priority

Prioritised districts (x22) only achieved a 6% increase in first dose vaccination uptake during Vooma weekend (weekends in Sept excl. Heritage Day weekend)

Share of Total First Dose Vaccinations by District Priority

Sub-Analysis of Sat – Sun vaccination uptake (2-3 Oct 2021)(to explore the effects of extending opening hours over the weekend)

Comparing total vaccinations per weekend (Sat-Sun)

Expected vs. Actual Total Vaccinations per Weekend (Sat + Sun)Compared to previous weekends in September (exclHeritage Day weekend), Voomaachieved 116% increase in total

vaccinations.

Vooma achieved a 141% increase in total vaccinations compared to what was expected over 1-3 October.

Comparing total vaccinations per weekend, by insurance status (Sat – Sun)

Total Vaccinations by Weekend (Sat + Sun)

Uninsured population● Compared to previous weekends in September (excl Heritage Day

weekend), Vooma achieved 140% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October,

Vooma achieved 135% increase in first dose vaccinations.

Insured population● Compared to previous weekends in September (excl Heritage Day weekend),

Vooma achieved 43% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October, Vooma

achieved 175% increase in first dose vaccinations.

Comparing first dose vaccinations per weekend (Sat – Sun)

Compared to previous weekends in September (excl Heritage Day weekend), Vooma achieved a 132% increase in first dose vaccinations.

Vooma achieved a 138% increase in first dose vaccinations compared to what was expected over 1-3 October.

Expected vs. Actual First Dose Vaccinations per Weekend (Sat + Sun)

Comparing first dose vaccinations per weekend, by insurance status (Sat – Sun)

First Dose Vaccinations by Weekend (Sat + Sun)

Uninsured population● Compared to previous weekends in September (excl

Heritage Day weekend), Vooma achieved 158% increase in first dose vaccinations.

● Compared to the expected first dose vaccinations during 1-3 October, Vooma achieved 140% increase in first dose vaccinations.

Insured population● Compared to previous weekends in September (excl Heritage Day

weekend), Vooma achieved 1.4% increase in first dose vaccinations.● Compared to the expected first dose vaccinations during 1-3 October,

Vooma achieved 180% increase in first dose vaccinations.

Comparing throughput in open facilities, by insurance status (Sat – Sun)

Average Number of First Dose Vaccinations per Open Facilityby Weekend (Medical Aid Supplied)

Average Number of First Dose Vaccinations per Open Facilityby Weekend (No Medical Aid Supplied)

Vaccination trends by insurance status (Sat – Sun)

First Dose Vaccinations by Insurance Status

An increasing proportion of first dose vaccinations is amongst the uninsured population. This trend remained consistent during Vooma weekend.

Vaccination trends by sex (Sat – Sun)

First Dose Vaccinations by Sex

The sex profile of vaccinations during Vooma weekend is consistent with that of previous weekends.

Vaccination trends by sex for uninsured population (Sat – Sun)

First Dose Vaccinations by Sex (No Medical Insurance Supplied)

Vaccination trends by age group (Sat – Sun)

First Dose Vaccinations by Age Group

The age profile of vaccinations during Voomawas similar to that of previous weekends, with somewhat higher uptake amongst individuals <30 years.

Key takeaways and next steps

4444

Key takeaways

The Vooma Vaccination Weekend helped build momentum for the broader demand acceleration strategy.

We were able to make districts the focus of much attention- unprecedented level of political and social mobilisation in every district in SA.

We achieved 71% of the target of 500,000 vaccinations for the weekend – although this was lower than we had hoped for, these are the ambitious targets we have to set if we are to come close to achieving 70% coverage of all adults by the end of the year. We recommend retaining the target of 500,000 for the next Vooma weekends.

Human resource constraints are a big challenge to sustaining weekend sites - all provinces need to review daily vaccination patterns to ensure hours of opening are used most efficiently and to potentially increase weekend hours.

Demand is elastic (η= ~0.25) – we can achieve more by intensifying communication, social mobilisation and ensuring access.

These strategies will improve uptake, but will need to be augmented by additional strategies (such as cost-offset and incentive strategies) to achieve the coverage goals

4545

Where to next for demand acceleration

More definitive analysis:• Ensure we have diagnosed the problem correctly• Start linking uptake to specific interventions

Location-specific concerted strategies:e.g. Bojanala Platinum DM

Sub-national leadership engagement:Business, religious leaders, unions, traditional leadership

Intensified public communication:• Radio & TV• Print & social media• Ordinary people as champions ‘Vooma Vax Champs’

Thorough appraisal of incentives• For consideration

Next dates (TBC):• 1 Nov (Voting day) – sites open• 12-14 Nov – full Vooma• 3-5 Dec – full Vooma

Thank you

4747

Thank you to all those who gave ‘Vooma’ to the weekend

To His Excellency, President Cyril Ramaphosa and the Presidency team To the GCIS teams at national, provincial and district leavel To all leaders and sports and arts & culture personalities who participated in the Vooma Vaccination

Weekend To all health workers, health service managers and volunteers To media and communications companies which provided substantial support To foundations, funders and implementing partners which provided support To all other people who gave ‘Vooma’ to the weekend.

May we exceed our target of 500,000 in the next Vooma Vaccination Weekend!12-14 November 2021