Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
Ronette Engela PCAS, The Presidency
DPSAPerformance management
12 June 2008
ContentGWM&E system
Performance measures Additional information
In 2005 Cabinet approved an implementation plan
to developa monitoring and evaluation system
for use across government
1MonitoringEvaluationEarly warningVerificationData collectionAnalysis Reporting
3 Components
1) Principles 2) Compendium
of indicators3) Implementation
plan
Linked to planningframework
Cabinet memorandum
2005
2Based on standard, shared indicators
3Composite systemBuilt over timePilotRoll-out
Not a single automated IT system
Framing phase
Quality improvement and analysisphase
IT systems
Schematic vision of roll out
Fellowship Battle Victory Quest
2005-2007 2008-?2010 2011 onwards =indicative
Composite system that draws its data from contributory systems Emerging system built up over time with consistent and sustained participation by all stakeholders
Conceptual anchor matrix of indicators
National vision doesnNational vision doesn’’t justt justhappenhappen’’ at provincesat provinces
Well Well conceptualisedconceptualised, consistent , consistent with international practicewith international practice
‘Green Book’
SYSTEMS Large existing systems in place that have taken years to build upPerformance monitoring system by NT of 500 indicators of concurrent functionsExtensive systems in Housing, Education, Health, DWAF, SAPS, Soc DevSome provinces – FS, GT, WC & EC
What do we have?What do we have?Status quo
Good CAPACITY and experienceConceptual coherencebetween core national departments, even joint projects
Need to focus on quality improvement
Policy platform established 2007GWM&E frameworkPPI frameworkSA Statistical Quality Assurance frameworkDraft DPLG LG framework
Common definitions document
Products and Processes Products and Processes Status quoCross cutting M&E
products PoA Development IndicatorsPublic Mang WatchIGR publication of non financial informationENE include performance indicatorsProvincial Budget Statements –performance indicators
Revitilised M&E Task Team Coordinating Forum
Learning Network2 events, 300 att, Web link
GWM&E System: Policy platformGWM&E System: Policy platform
Social, Economic & Demographic Statistics
Registers and Admin data
Evaluations
Programme Performance Information
GWM&E framework
PPI framework
SASQAF
Common definitions
GWM&E System: data terrainsGWM&E System: data terrains
Social, Economic & Demographic Statistics
Registers and Admin data
Evaluations
Programme Performance Information
NationalIndicators
PoAPoA
Established the culture of reportingDoes not allow proper outcome/impact assessment
Sometimes need process - court casesWill be assessed, redesigned end 2007Building custom based web system
PoAPoAAnnual State of the Nation –priorities are announcedWeb based system 300 usersBi-monthly report to Cabinet
Positive
NegativeNegative
72 72 Development IndicatorsDevelopment Indicators
Economic growth and transformation
Education
Employment Social cohesion
Poverty and inequality Safety and security
Household and community assets
International
Health Good governance
www.ThePresidency.gov.zawww.ThePresidency.gov.za
NationalIndicators
GWM&E Framework: Programme Performance Information
PPIDept sector sector sector
Derived information system DPLGDWAF
Transversal systems PERSAL BAS
Stats
E
E
C&SStats
E
Programme Performance Information
sector
Derived information system
Transversal systemsLine manager
Dept exec
Programme manager
Exec Authority
dept
PPI service delivery information500
indicators
Annual MTSF informs MTEF - budgetAnnual Performance Plans tabled in parl / legislaturesProv APP prescribed format with indicators that measures delivery of servicesQuarterly reports to provincial Treasuries who passes it on to NTTo be publishedMonitor Annual Report against APP 8 years to build8 years to build
Education
Number of learner days covered by the nutrion
programme
Number of schools w ith an adequate
number of functional toilets
ATPrelimenary
Q1 ATPrelimanery
Q1 ATPrelimaner
y Q1 ATPrelimanery
Q1Eastern Cape – 53 – 4 657 – 895 – 20 204Free State 184 27 30 – 42 – 8 285 9 804Gauteng 199 48 1 963 1 963 1 963 1 963 30 000 45 754Kw aZulu-Natal 233 992 800 42 012 000 4 893 4 801 3 766 3 647 – – Limpopo – – – – – – – – Mpumalanga 156 39 1 763 – 438 – 51 376 51 376Northern Cape 174 27 620 450 600 500 22 648 22 648North West 196 50 1 403 – – – 34 000 42 505Western Cape 34 680 000 9 150 075 1 450 1 450 164 162 46 900 46 900* Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Education
Programme 2: Public Ordinary School Education
Number of learners benefitting from scholar
transport
Number of public Ordinary schools w ith
water supplyProvinces
Health
PHC total headcount Utilisation rate-PHC
ATPrelimenar
y Q1 ATPrelimanery
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1 ATPrelimane
ry Q1Eastern Cape – 1,103,422 - R 68 2.7 1.9 - 3.4 70.0% - Free State – 1,018,446 R 99 - 2.3 0.3 3.8 0.9 78.0% 79.1% Gauteng 30,000,000 2,454,049 R 52 R 151 2.5 1.5 4.5 1.3 100.0% 68.0% Kw aZulu-Natal 19,986,457 4,231,976 R 206 R 86 2.0 2.0 4.0 4.0 100.0% 85.0% Limpopo – 2,924,118 R 238 R 63 3.0 2.2 3.3 4.9 80.0% 79.0% Mpumalanga – – - - - - - - - - Northern Cape 2,500,500 401,758 R 182 R 52 3.5 5.0 5.0 10.0 70.0% 45.0% North West – 1,142,181 R 78 R 125 3.5 1.2 5.0 2.6 100.0% - Western Cape – – - - - - - - - -
Programme 2: District Health Services
Utilisaton rate for under 5 year olds - PHC Supervision visit rate
Clinics and community health centres
Provinces
Expenditure per PHC headcount (province)
Social Development
Number of children who stay in Children Homes -
Government
Number of children who stay in Children Homes -
NGO
Number of children who stay in Places of Safety - Government
Prov ATPrelimenary
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1Eastern Cape - - 2 111 527 500 250 - - Free State 800 934 See Govern - 100 260 - - Gauteng - - - - - - - - Kw aZulu-Natal 60 64 2 250 1 962 750 276 1 500 241 Limpopo 500 270 257 350 120 200 - - Mpumalanga 80 20 648 445 - - 720 111 Northern Cape - - 672 1 258 20 23 750 555 North West 160 30 1 704 405 - - 300 78 Western Cape - - 2 198 2 198 - - - - * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Social Development
Programme 2: Social Welfare Services
Number of Children who stay in Secure Care
Centres - Government
2.6 Child Care and Protection Services
Agriculture
Number of emerging farmers supported w ith
advice
Number of commercial farmers supported w ith
advice
Number of contacts sharing research related
information
Prov ATPrelimenary
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1Eastern Cape 14,000 1,265 90 24 75 25 Free State 1,162 719 451 277 540 168 Gauteng 600 89 - - - - Kw aZulu-Natal 16,162 9,118 1,043 238 296 180 Limpopo - - - - - - Mpumalanga 120 35 110 10 133 36 Northern Cape 6,000 - 100 - - - North West 12,073 4,644 1,530 926 157 12 Western Cape 1,000 579 500 171 - - * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - Agriculture
Programme 3: Farmer Support and Development3.2 Extension Services
Transport
Number of kilometres resealed tarred roads
Number of kilometres regravel roads
Numver of kilometres routine maintenance on al
roads
Prov ATPrelimenary
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1 ATPrelimanery
Q1Eastern Cape - - 974 297 51,900 20,600 100 200 Free State 20 - 90 - 85,000 14,465 2,227 137 Gauteng 2 2 5,200 2,303 - - - - Kw aZulu-Natal - 12 1,000 90 - - - - Limpopo - - - - - - - - Mpumalanga 200 58 114 - 1,000 150 14,557 1,130 Northern Cape - - - - - - - - North West 52 - 370 - 71,000 14,270 - - Western Cape 340 100 410 69 32,182 32,182 5,000 2,210 * Zero's indicate no information *(SDD) versus (AT) First Quarter 2007/08 - PW Roads & Transport
Programme 3: Road Infrastructure
EPWP Employment - Number of jobs created
3.5 Maintenance
PROVINCIAL DEPARTMENT
PROVINCIAL TREASURY
NAT CONCURRENT SECTOR DEPT
NATIONAL TREASURY
PREMIERS OFFICE
DPSAHuman resource info
Output & outcome infoOutput & outcome info
Gov tPoA indicators
PRESIDENCY
PoA
Performance information
Performance information
PROVINCIAL DEPARTMENT
PROVINCIAL TREASURY
NAT CONCURRENT SECTOR DEPT
NATIONAL TREASURY
Financial information
Financial information
PREMIERS OFFICE
Outpu
t & ou
tcome
info
DPSAHuman resource info
Output & outcome infoOutput & outcome info
CABINET
•Systems initiated in response to specific needs•Hard working, but not smart working systems•Smart analysis to align information
Status quo
Focus for 2008
Premier’s office guideline on M&EGeneric framework for M&E – to be work shopped in each sectorData forums per sectorDemographic data & HH data seminarAdmin datasets (300)
Massive GIS projectNeed to develop institutional M&E system –Thusongcentres
Ke ya lebogaKe a leboha
Ke a lebogaNgiyabonga
NdiyabulelaNgiyathokoza
NgiyabongaInkomu
Ndi khou livhuhaDankie
Thank you
EvaluationEvaluationNeed for detailed policy
evaluations on a number of different levels:Departmental led reviews and evaluation of policies and programmesSectoral reviews (Pres & NT)Broad, cross cutting reviews led by centre of government (15 Y R)
Monitoring and Monitoring and evaluation have evaluation have different different purposespurposes
“M” before “E”part of public sector reform initiative
Programme Performance Programme Performance InformationInformation
National Treasury
Constitution S.215 S.216Budget & Exp Management
PFMA & MFMA
Ensure information on inputs, outputs and outcomes …
MandateTreasury
…underpins planning, budgeting, implementation management and accountability reporting…
…to promote transparency andexpenditure control.
Programme Performance Information
E
C&SDept
Derived information system
Area of Responsibility
Transversal systemsLine manager
Dept exec
Programme manager
Exec Authority
Dept
Develop a Develop a ProgrammeProgramme Performance Performance Information Information manual for each sectormanual for each sector
•The process for updating the Manual•Structures and systems to manage performance information•Processes to identify performance information••Listing and definitions of all the performance information Listing and definitions of all the performance information collected by the institutioncollected by the institution
••Technical standards for the institutions performance informationTechnical standards for the institutions performance information•Collecting and collating performance information•Checking and verifying information•Confidentiality•Use of performance information•Publication of performance information
PPI policy frameworkCurrent focusTreasury
Part of budget documentation requirementPart of budget documentation requirement
Ensure Programme Performance Information is appropriately used for planning, budgeting and managementplanning, budgeting and management purposes •set performance standards and targets priorto the start of each year•review performance and take management action•evaluate performance at the end of a service delivery period
PPI manual per sector - extensive consultation to determine needs of
different usersNext stepsTreasury
IMPACTS
OUTCOMES
OUTPUTS
INPUTS
ACTIVITIES
CENSUS AND SURVEY INFORMATION
PROGRAMME PERFORMANCE INFORMATION
PERFORMANCE EVALUATIONS
10 YEAR PERFORMANCE REVIEWS
END TERM REVIEWS
PERIODIC PROGRAMME EVALUATIONS
SERVICE DELIVERYEVALUATIONS
PERFORMANCE MANAGEMENT
THE CENSUS
HOUSEHOLD SURVEYS
BENEFICIARY / USER SURVEYS
MANAGEMENTSURVEYS
Methodology
National Statistical SystemNational Statistical System
StatsSA
Evaluations
PPI
Dept Dept
Derived information system
Transversal systems
Dept
Area of Responsibility
Census and Survey Information
Registers and Admin data
The Statistics Act (No. 6 of 1999) The Statistics Act (No. 6 of 1999) 2002 January Cabinet 2002 January Cabinet LegkotlaLegkotla
State of the Nation Addresses State of the Nation Addresses 2004 and 20052004 and 2005
•Section 14 subsection 6 clauses (a), (b) and (c) where the Statistician-General may advise an organ of state on the application of quality criteria and standards
•Section 14 subsection 7 clauses (a) and (b) grants the Statistician-General power to designate statistics produced by other organs of state as official statistics
•Section 14 subsection 8 clauses (a) and (b) authorisesthe Statistician-General to comment on the qualityof national statistics produced by another organ of state; and to publish such other department’s statistics
MandateStatsSA
Demand for information[user groups or
indicator categories]
Stats SA Other producersdepartments
• Insufficient supply of quality information• Uncertain quality?Poor comparabilityIsolated producersNo shared standards• Insufficient statistical skills
Official statistics
Unknown quality
Problem
Demand for information[user groups or
Indicator categories]
Stats SAOther producers
[departments, CSOs, etc]
Regulatory environment• Statistics Law• Governance structure• Quality standards• Advocacy programme• Code of conduct
• Adequate information• Reliable information
[quality, sustainable]• Sufficient skills
Coordination
Feedback
Proposed solution
Feed
back
Proposed new approachProposed new approach
Use official statistics to ensure quality
• SASQAF [quality framework]•Framework of international best practice•UN Principles of Official Statistics
Maintain the decentralised system of statistical production
Transform all national statistics into official statistics
SASQAFDraft available
Transform existing departmental Transform existing departmental data (registers & surveys) data (registers & surveys) into sustainable sources into sustainable sources
of official statisticsof official statistics
•More use of administrative data than of surveys - sustainability and cost
• Agreements and collaboration between Stats SA and individual dept
• Joint Working Party between Stats SAand each of the departments to improve quality
ProgrammeNSS
ConcernsConcerns
Inadequate appreciation of the practice of managing for results
• Measurement of performance and “objective” info for planning and decision-making not a priority
• Current practice of existing M&E units without measurement
Circumlocutionary behaviour of public officers (multiple formalities)
• Waiting for approval (all the way to the minister!): inadequate delegation of authority
• Lack of institutional memory in government departments [change the head: start afresh]
•Operational silos – protecting one’s turf•Cover-ups: fear of exposure
Derived system:Derived system:DPLG local government DPLG local government
DPLG
GWM&E Framework: DPLG Derived Information
PPIE
C&SDept Dept Dept Dept
Derived information system
Transversal systems
Constitution Chapter 3 & 7 Constitution Chapter 3 & 7 Municipal Systems ActMunicipal Systems Act
Municipal StructureMunicipal Structure’’s Acts ActMandate
DPLG
5 Local Govt 5 Local Govt KPAsKPAs•Municipal Transformation and Organisational Development
•Basic Service Delivery•Local Economic Development•Financial Viability and Management•Public Participation and Community Involvement
Collaboration with key Collaboration with key national departmentsnational departments
ResponsibilityDPLG
•The Presidency•National Treasury•Dept of Public Service and Administration•Dept of Water and Forestry•Dept of Mineral and Energy•Dept of Housing•Statistics South Africa•South African Institute for ManagementDevelopment (MR&E capacity building)
Varying degrees: Varying degrees: ofof understanding understanding and and
ofof M&E capacity and readinessM&E capacity and readiness
•Lack of integrated approach to local governmentM&E across 3 spheres
•Lack of appropriate M&E reporting structures tomonitor local government service delivery•Capacity and capability to monitor local govtservice delivery
DPLG assessed readiness of provincial depts of local govt and Office of Premiers to do
Local govt M&EProblem
Types of local government Indicators
43%
36%
21%
9%
2%
20%
0%
45%
27%
8%
0%5%
10%15%20%25%30%35%40%45%50%
Input Activities Output Outcome Impact
Indicator category
Perc
enta
ge
Initially 500
Collated allCollated allindicators indicators
on local on local govtgovtPhase 1Phase 1
Now ±150
Shared understanding of Local government indicator Shared understanding of Local government indicator development across all three spheres Phase 2development across all three spheres Phase 2
GWM&E System
National
Provincial
District
Local
GPOA
PGDS
IDP
IDPIndicators
Achievements to dateAchievements to date Done
Readiness assessment of provincial dept of local governmentDraft Local Government MR&E framework, aligned to GWM&EMR&E business process mapping of Local government indicatorsNational Local Government MR&E forum establishedCollaboration with SAMDI and NT TAU for capacity building
Next stepsNext stepsPlans
Finalise Local Government M&E policy frameworkDevelop a compendium of indicators for Local GovernmentDesign and implement Local govt MR&E system that extracts information with multiple sector departments that deal with Local Government –based on impact model Capacity building for provinces and municipalities
ConcernsConcernsNeed to incorporate Public Opinions/ Imbizo processesIncorporate indicators into performance contracts
Conceptual clarity - IGRKey role players involvedConvergence around indicators
Data quality will improve with public attention and utilisationAG auditing
on performance mangsystem, not content
Myth: Myth: ““at the press of a at the press of a buttonbutton””Systems to alert about Systems to alert about problem, need political problem, need political will to deal with itwill to deal with it
Conclusion
Steady does it
KeKe yaya lebogalebogaKeKe a a lebohaleboha
KeKe a a lebogalebogaNgiyabongaNgiyabonga
NdiyabulelaNdiyabulelaNgiyathokozaNgiyathokoza
NgiyabongaNgiyabongaInkomuInkomu
NdiNdi khoukhou livhuhalivhuhaDankieDankie
Thank youThank you