71
Performance management without the blame Gestion du rendement sans blâme Max Moullin, Director, Public Sector Scorecard Research Centre Sheffield UK

Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Performance management without the blame Gestion du rendement sans blâme

Max Moullin, Director, Public Sector Scorecard Research Centre Sheffield UK

Page 2: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

‘proactively managing the relationship between resources consumed,

activity and outcomes’

Performance management is …

understanding outcomes

understanding cause & effect

culture of innovation

and learning

link between strategy, processes &

performance measures

John Thornton

Page 3: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Insurance Claims Example

•  Insurance company has an average waiting time of 12 minutes in its claims department - up to 25 minutes at busy times. Many complaints.

•  The manager is considering four options: A. employ 2 extra staff

B. reduce average call time by 25% C. divert most enquiries to the internet or

D. share services with another company.

What would you recommend?

Page 4: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

"Don't just do something, stand there"

The White Rabbit (Disney's Alice in

Wonderland movie, 1951)

… and do some systems thinking

Page 5: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Systems Thinking: Insurance Claims

Reasonforphonecall % HowtoaddressChasingupduetonon-response

18 Processclaimson7me

Don'tunderstandclaimform

22 Produceclearerform.Helponwebsite.

Disagreewithdecision 18 GiveclearreasonsMistakeinprocessingclaim

12 BeEertrainingtopreventerrors

Informingcompanyaboutdetailsofclaim

25 Addsvalue.Butcheckthatallstagesneeded.

Other 5 Inves7gatefurther

Two stages: analyse data. Take action!

Page 6: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Inaddi'onyouaretoldthat28%ofcallshavetobere-directedastheycomethroughtothewrongperson,while5%ofcallsarere-directedtwice.

14:13

Page 7: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Why Measure Performance ... "Implement measurement systems for

improvement that reveal the true performance of the system and the impact

of any changes made in real time" NHS Modernisation Agency

"Objective, measurable indicators of success allow governments to be accountable"

Rudy Giulani

“Measuring performance is one of the strongest drivers for change”

Alan Underwood, Royal Berkshire Ambulance Service

Page 8: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Eight pointers for improving public sector performance

management …

Page 9: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

1. Use a balanced set of measures

Pointers for improving public sector performance management …

Page 10: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

The UK NHS Performance Assessment Framework

•  Health improvement •  Fair access •  Effective delivery of appropriate

healthcare •  Efficiency •  Patient / carer experience •  Health outcomes of NHS care

Page 11: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

NHS PAF* Key Targets Health improvement ???

Fair access 18 month inpatient waits 15 month inpatient waits 26 week outpatient waits Cancelled operations Two week cancer waits

Effective delivery of appropriate healthcare

Hospital cleanliness Improving working lives Clinical governance reports

Efficiency Financial m’ment

Patient / carer experience

12 hour trolley waits

Health outcomes of NHS care

???

* Performance assessment framework

Page 12: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Eight pointers for improving public sector performance management

1.  Use a balanced set of measures

2. Make sure you measure what matters to patients, carers and other stakeholders

Page 13: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

User-Focussed Services ... •  Do your services 'meet the requirements and

expectations of service users and other stakeholders while keeping costs to a minimum’

(my definition of quality - Moullin, 2002) •  Are they based on best practice evidence and

meeting appropriate standards •  Do service users feel in control of their care •  Are services integrated across agencies and

professions •  Do you do 'the small things that matter' well •  Are services sensitive, equal, and fair •  Do you listen & act ?

Page 14: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

1.  Use a balanced set of measures 2.  Make sure you measure what

matters to service users and other stakeholders

3.  Involve staff in determining the measures

Pointers for improving public sector performance management …

Page 15: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Pointer 4. Manage performance across organisational boundaries

•  For example, research on teenage

pregnancy showed that 71% of young women between 16 and 18 who were NEET* for > 6 months were parents by 21

•  Therefore if you run a team aimed at addressing teenage pregnancy, working together with local colleges and employers is absolutely vital.

* Not in education,

employment or training

Page 16: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Glaucoma diagnosis – typical pathway

Optician GP Optometrist prescribed eye drops

No treatment

needed

30%

100%

Optician prescribed eye drops

Revised pathway

70%

Managing performance across organisational boundaries

Q. What is the problem with this revised pathway?

Page 17: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 17

Pointer 5: Focus on outcomes, not activity

"Effective commissioning must focus on outcomes. Only then will we achieve the high quality, value for money public services

that people deserve"

Sir Stuart Etherington, Chief Executive, UK National Council for Voluntary Organisations

Page 18: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Examples of Outcomes *

! Young people are successful learners

! Better educated and skilled workforce

! More and better employment opportunities

! Improved life chances

! Strong, resilient and supportive communities

! People safe from crime, disorder and danger

! Reduced inequalities * Scottish Government’s National Performance Framework

Page 19: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

•  Meeting government targets - 81% service requests completed on time

•  However 30% of requests were transferred to another organisation FOUR TIMES OR MORE

•  Each time the request was transferred the time frame was reset Result: poor service but meets targets, incentive to pass on service requests

• ©Max Moullin 19

Focusing on activity – Road improvements in New Zealand *

* Source: John Cooney, Central Otago District Council in Middleton (2010) Delivering public services that work.

Page 20: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Moullin, 2006

©Max Moullin 20

Pointer 6: Integrate risk management

'identifying and addressing key risks are essential for any high-performing

organisation and therefore any evaluation of performance without

considering risk is incomplete'

Page 21: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Pointer 7: Take account of the cost of measurement

"Public sector organisations spend up to 20% of time on form-filling, auditing, measuring and reporting performance but only a fraction of this is ever used to gain relevant and new insights or lead to performance improvements."

Professor John Baillie

Chair of Audit Scotland

Page 22: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

8.  Develop a performance management culture focussed on innovation, learning, and change - and not a top-down blame culture …

©Max Moullin 22

Pointers for improving public sector performance management …

Page 23: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

"All performance targets are flawed, some are useful"

Max Moullin, "What's the Score",

Public Finance, 22 May 2009

with due acknowledgment to the quality management guru Deming who said:

"all models are flawed, some are useful"

Page 24: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

UNINTENDED

EFFECTS

Emphasis on 5 A-C GCSEs. Schools focus on those on C-D margin

% of offences brought to justice target led to more efforts on easy to solve

crimes No of children on child

protection register

COMPLACENCY

TUNNEL VISION

DATA MIS-REPRESENTATION

MEASURE FIXATION

GAMING

MYOPIA Concentrating on short-term

Page 25: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

COMPLACENCY

TUNNEL VISION

DATA MIS-REPRESENTATION

MEASURE FIXATION

GAMING

MYOPIA Concentrating on short-term

Emphasis on 5 A-C GCSEs. Schools focus on those on

C-D margin

% of offences brought to justice target led to more efforts on easy

to solve crimes

Follow-up appts for ophthalmology delayed to meet targets for new ones

3.5 hour wait for A&E is OK

UNINTENDED

EFFECTS

NAO Review of 650 NHS waiting time

records showed that 50% were incorrect

© Max Moullin,

No of children on child protection register

Page 26: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Performance management culture

“Once we accept that all targets are flawed, it is clear that the priority is to develop a performance management

culture focussed on innovation, learning, and change - and not a top-

down blame culture”

However targets can be useful too… Moullin, M. (2009) What’s the Score, Public Finance

Page 27: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Hospital waiting times in England–thousands of people waiting a number of months

©Max Moullin 27 Source: Dept of Health

0

50

100

150

200

250

300

350

400

1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008

Thou

sand

s

>6 months

> 9 months

Page 28: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

No of English schools where less than 25% of pupils gain

5 A* - C GCSEs

0

200

400

600

800

1997 2006

83

768

No of English schools where more than 70% of pupils gain

5 A* - C GCSEs

Source: Cabinet Office

Page 29: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 29

The Public Sector Scorecard

OUTCOMES

PROCESSES

CAPABILITY

The Public Sector Scorecard is an integrated performance

management framework for the public and third sectors

The Public Sector Scorecard ‘has moved performance management

from a top-down, blinkered, blame-game approach to a

system founded on inclusiveness, cooperation and understanding’

Neil Robinson, IMPACT, Autumn 2015, The Operational Research Society

Page 30: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

The PSS – Key Features

•  Can be used across organisational boundaries

•  Focusses on outcomes, inc. value for money •  Incorporates risk management •  Service user involvement throughout •  Incorporates service improvement, systems

thinking & process mapping •  Looks at issues of organisational culture,

partnership working and behavioural issues •  Culture of innovation and learning, not a top-

down blame culture

Page 31: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 31

The Public Sector Scorecard

What are the outcomes we really want to achieve for our service users and stakeholders?

How effective are our processes in achieving these outcomes? How can we improve them?

How can we best support our people and processes to achieve the outcomes required?

OUTCOMES

PROCESSES

CAPABILITY

Page 32: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 32

SERVICE USER/

STAKEHOLDER

FINANCIAL

SERVICE DELIVERY

INNOVATION & LEARNING

STRATEGIC key performance

outcomes

The Public Sector Scorecard

LEADERSHIP

PEOPLE, PARTNERSHIPS & RESOURCES

PROCESSES

CAPABILITY

OUTCOMES

Page 33: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Clarifying outcomes

Identifying process & capability outputs

Strategy mapping

Integrating risk management

Re-designing processes

Addressing capability

Developing performance

measures

Learning from performance

measures

How the Public Sector Scorecard works

Page 34: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 34

Strategy maps •  Kaplan and Norton (2001) say a strategy

map ‘describes how shareholder value is created from intangible assets’

•  However with the PSS, it can be defined more simply as showing the relationships between capability, process and outcome elements

•  They are the vital link between strategy and performance measurement

Page 35: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

USER EXPECTATIONS 1. Reduce waiting

lists 2. Reduce user

dissatisfaction

FINANCIAL 1. Boost

finances of the sector.

SERVICE DELIVERY 1.  Improve health info systems 2.  Improve communication between

different parts of health service 3.  Improve environmental conditions

and promote healthy diet. 4. Reduce risk factors 5. Reduce mortality and sickness 6. Reduce contagious & non-

contagious diseases.

STRATEGIC 1.  Improve population health 2. Reduce health inequalities 3.  Increase public satisfaction

with the health service 4. Ensure the quality of health

interventions.

Public Health - Chile

LEADERSHIP 1. Lead functions & health promotion 2. Leadership & management of staff

teams & organisational devt

RESOURCE MANAGEMENT 1.  Increase and

improve the resources of HR in health sector.

2.  Improve and implement the health sector infrastructure.

3. Preparation for emergencies or disasters.

OUTCOMES

PROCESSES

CAPABILITY

INNOVATION & LEARNING

1. Strengthen research in health

2.  Improve the quality of medicine and health technology.

Page 36: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Example – mini strategy map for Fire and Rescue Service

Tackling the fire-fighting

culture

Prevention activities with

offices, homes etc

Zero preventable fire deaths

OUTCOMES

PROCESSES

CAPABILITY

Page 37: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Clarifying outcomes

Identifying process & capability outputs

Strategy mapping

Integrating risk management

Re-designing processes

Addressing capability

Developing performance

measures

Learning from performance

measures

How the Public Sector Scorecard works

Page 38: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Risk Management with the PSS 1. Develop your strategy map ignoring risk

2.  Identify major risks under each perspective 3. View reducing a key risk as a desired outcome 4. Analyse each risk to identify root-causes and the

likelihood and potential impact of each risk 5. Look at the processes for eliminating, reducing or

mitigating these risks - how can these be improved 6.  Identify and address behavioural (capability)

aspects including the risk management culture 7.  Include the major risks and the actions required in

the strategy map 8. Develop objectives and performance measures for

the risks and the actions required.

Page 39: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Clarifying outcomes

Identifying process & capability outputs

Strategy mapping

Integrating risk management

Re-designing processes

Addressing capability

Developing performance

measures

Learning from performance

measures

How the Public Sector Scorecard works

Page 40: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Clarifying outcomes

Identifying process & capability outputs

Strategy mapping

Integrating risk management

Re-designing processes

Addressing capability

Developing performance

measures

Learning from performance

measures

How the Public Sector Scorecard works

Page 41: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Ethnic Minority (EM) Employment Task Force Improving ethnic minority employment

Building employability

Connecting people to work

Equal opportunities

Increasing self-employment (DTI)

Increasing EM employment in

public sector (HO)

Pilot project on procurement in public sector

Reducing racial discrimination at work (DTI)

Research on why some groups earn less than others

with similar qualifications

Reducing attainment gaps

at different stages (DfES)

Work with low attaining groups

Reducing racial prejudice (HO)

Increasing EM aspirations

Increasing employment rates in areas with high EM popn. (ODPM)

Ethnic minority outreach

programme

Improving outreach

outcomes (DWP)

OUTCOMES

PROCESSES

CAPABILITY Joint working

between departments Leadership from the task force

Page 42: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Improving ethnic minority employment

2003 - 18% 2010 - 12%

Main outcome measure:

Gap between ethnic minority and overall employment rates:

Ethnic Minority Employment Task Force

Page 43: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

◊ Three year £10 million programme aimed at reducing obesity in children and families

◊ Aim: To empower all children and families in Sheffield to maintain a healthy weight

◊ Approach: Systems approach tackling obesity in several ways at once

◊ Used a combination of the Public Sector Scorecard and the Theory of Planned behaviour

CASE STUDY:

Page 44: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

8 strands of work Breastfeeding Friendly City

Community Health

Champions

Parents as Positive Role Models

Schools

Healthy Open Spaces Cross Sector Innovation

Living Neighbourhoods

Social Marketing

Page 45: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Strategy Mapping

" Strategy mapping is a very powerful tool, both for the Balanced Scorecard and the Public Sector Scorecard

" It provides the link between strategy and performance improvement

" However it is often applied lazily, with little attention to cause and effect

" Strategy maps often ignore the organisational and capability issues that need to be addressed for the strategy to succeed

Page 46: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Possible Strategy Map for Reducing Obesity

©Max Moullin 46

Objectives & Measures

Improve Performance

Three questions: does it show the strategy will it improve outcomes

can we measure the effects

Activities on diet in schools

Encourage children to have a better diet

Reduce child obesity

Page 47: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

People plan to adopt healthy lifestyle

People adopt healthy lifestyle

Personal desire to adopt healthy

lifestyle

Attitudes of those around

them

Perceived ability to change their

behaviour

Interventions to overcome barriers

Interventions to persuade people of benefits of change

Interventions to help address

these attitudes

Interventions to help people's perceptions

that they can do it

Reduce obesity

Integrating the Public Sector Scorecard and the Theory of Planned Behaviour

Overcoming barriers to

change

Page 48: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Leadership from programme board

Reducing obesity in children & families

Satisfied stakeholders

Greater desire to adopt healthy

lifestyle

Breastfeeding-friendly city

Innovative new partnerships

across all sectors

Joint working SCC, NHS, private

& third sectors

Better diet & nutrition

Favourable attitudes of

others Community

health champions

Effective social marketing

Community engagement

Increased physical activity

Confidence in ability to change

Schools at the heart of healthy

communities

Parents as positive role

models

Shared vision

Value for money & sustainability

Overcoming barriers to

change Healthy, safe,

accessible, open spaces

Living neighbourhoods

Effective project management

strategy map

OU

TC

OM

ES

P

RO

CE

SS

ES

CA

PA

BIL

ITY

Page 49: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Coverage

Year6NCMPObesitycoverageandprevalencedata2006-2011

Coverage

Coverage Coverage Coverage

Coverage

Changes from previous year: Stat neighbours, England and Y&H all rose, Sheffield fell.

Page 50: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Feedback

'The strategy map is really useful as it simplifies a complex issue with a complex response into an orderly understandable approach'

Executive Director for Children, Young People, and Families, Sheffield City Council

. • ©Max Moullin 50

Page 51: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

'The SLC4L Strategy Map visually told the story of SLC4L, what we were trying

to achieve and how.

It helped all those involved understand the outcome and process measures the programme was trying to achieve, and

therefore being evaluated against.'

SLC4L programme director

.

• ©Max Moullin 51

Page 52: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Sheffield Right First Time Project

•  Multi-million pound project aiming to reduce unnecessary visits to hospital by providing more support for people in the community

•  Facilitated three workshops (3.5 hours each) with 20 senior people at director level and below from local hospitals, adult social care, public health and the voluntary sector

•  Separate user ‘reference’ group established •  Developed a strategy map and associated

dashboard

Page 53: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

EffecEveuseofresources

Reducedunnecessaryacutebed

days

Incontroloftheirhealth

ReducedisolaEon&anxiety Reducedcostof

unscheduledcare.

SustainabilityEffecEvepersonal

&self-care

Improvedmentalhealth

Reducedhospitaladmissions,lengthofstay&outpaEent

aNendances

Right First Time - Strategy Map O

UT

CO

ME

S

* LTCs - Long-term conditions

Health&Wellbeingof

peoplewithLTCs

Page 54: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Health&Wellbeingof

peoplewithLTCs

EffecEveuseofresources

Reducedunnecessary

acutebeddays

Incontroloftheirhealth

ReducedisolaEon&anxiety Reducedcostof

unscheduledcare.SustainabilityEffecEvepersonal

&self-careImproved

mentalhealth

ReducedA&Eadmissionsfor

non-A&EpaEents

IntegratedLTC&mentalhealthcare.

Reducedadmissionstocarehomes

Consistentgoodqualitycareincare

homesAccessiblesharedrecords

Reduceddelays

Carers’needsmet

Removalofnon-VAacEviEes

Re-designflow

systems

ReduceunwarrantedtreatmentvariaEon

LessduplicaEon

ofassessments Integrated

H&SCteamsMoreindependence

Reducedhospitaladmissions,lengthofstay&outpaEentaNendances

OU

TC

OM

ES

P

RO

CE

SS

ES

Page 55: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Health&Wellbeingof

peoplewithLTCs

EffecEveuseofresources

Reducedunnecessary

acutebeddays

Incontroloftheirhealth

ReducedisolaEon&anxiety Reducedcostof

unscheduledcare.SustainabilityEffecEvepersonal

&self-careImproved

mentalhealth

ReducedA&Eadmissionsfor

non-A&EpaEents

IntegratedLTC&mentalhealthcare

Reducedadmissionstocarehomes

Consistentgoodqualitycareincare

homesAccessiblesharedrecords

Reduceddelays

Carers’needsmet

Removalofnon-VAacEviEes

Re-designflow

systems

ReduceunwarrantedtreatmentvariaEon

Focusonresource-intensivepaEents

BeNersharingofinformaEon

EmphasisonprevenEon&earlydiagnosis

MorejoinedupworkinginH&SC.

ChangepublicpercepEonrehospitalcare

Simplerfinancial

flows&risksharing

LessduplicaEonofassessments Integrated

H&SCteamsMoreindependence

Reducedhospitaladmissions,lengthofstay&outpaEentaNendancesO

UT

CO

ME

S

PR

OC

ES

SE

S

CA

PA

BIL

ITY

Page 56: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Facilitating the RFT project

•  First workshop established the main outcomes required and the main outputs needed to achieve these outcomes

•  Between workshops, I drew up a draft strategy map and circulated it before the meeting

•  At the start of the second workshop I asked people ‘did they recognise this project’ and ‘was there anything missed out’. Feedback very positive, with a couple of changes we incorporated.

•  We then focussed on how we could measure the various outcomes and outputs, followed by a joint presentation to the Health and Social Care Trust chief executive

•  Used a combination of interactive facilitation methods with post-its, flip charts etc.

Page 57: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Right First Time Dashboard Updated: 23/01/2014

Section 3: Headline acute care system metrics

Key charts 1 and 2 demonstrate a sustained and continuing decline in ACS bed-nights (preventable largely chronic causes of acute admission), mainly due to reducing LOS. However, this gain is being offset by increasing non-ACS bed-nights that has the net effect of maintaining a fairly static overall rate of bed usage, albeit lower than previous years. Both ACS and overall admission volume (spells), although currently higher than previous years, has been declining month on month towards the previous three-year average. The rate of ACS readmission remains static and in line with last year. HASC and North localities account for most of the increase in admissions.

700080009000

1000011000120001300014000150001600017000

Apr 10M

ay 10Jun 10Jul 10Aug 10Sep 10O

ct 10N

ov 10D

ec 10Jan 11Feb 11M

ar 11Apr 11M

ay 11Jun 11Jul 11Aug 11Sep 11O

ct 11N

ov 11D

ec 11Jan 12Feb 12M

ar 12Apr 12M

ay 12Jun 12Jul 12Aug 12Sep 12O

ct 12N

ov 12D

ec 12Jan 13Feb 13M

ar 13Apr 13M

ay 13Jun 13Jul 13Aug 13Sep 13O

ct 13N

ov 13D

ec 13Jan 14Feb 14M

ar 14

Commencement of RFT ACSC Bed nights Trend(10/11-11/12) Trend(12/13-13/14)

0%

2%

4%

6%

8%

10%

12%

14%

Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar

13/14 Readmissions12/13 Readmissions

750

770

790

810

830

850

870

890

9698

100102104106108110112114116

Apr-13

May-13

Jun-13

Jul-13

Aug-13

Sep-13

Oct-13

Nov-13

Adm

issi

ons

Peop

le

Frequent Fliers: People with ACS SpellsFrequent Fliers: Spells in ACS

Chart 3: ACS Readmission Rates Chart 2: ACS and Total Emergency admissions (Spells and Bed Nights) - % growth year to date vs average of 3 previous years

Chart 4: 7 day working - STHFT live discharges (proportions by day of the week)

Chart 5: ACS Frequent Fliers

Chart 1: Ambulatory Care Sensitive (ACS) bed nights

-15%

-10%

-5%

0%

5%

10%

15%

Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb MarYTD ACS Spells YTD ACS Bed NightsYTD Total Spells YTD Total Bed Nights

0%

5%

10%

15%

20%

25%

Monday

Tuesday

Wednesday

Thursday

Friday

Saturday

Sunday

Last 4 weeks (approx. 1 month)Previous 13 weeks (approx. 3 months)

Produced by: BI Team, WSYB CSU Page 2 of 6

Page 58: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Comment on the RFT Strategy Map and Dashboard

‘It was very helpful to be able to see what's happening across the health & social care system and where the balance of risks lie.’

Chief Executive, Sheffield City Council

Page 59: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

How the PSS reduces the impact of perverse incentives

•  Measures user satisfaction •  Focus on outcomes, not activity •  Works across organisational boundaries •  Involves staff, users and other

stakeholders in developing measures •  Much more selective approach to targets,

not top down •  No blame culture – appraisal model

©Max Moullin 59

Page 60: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

ACTIVITY: USE OF TARGETS AND PERFORMANCE MEASURES

On each table, I would like you to come up with: 1.  One (or more) examples where having

a target has led to improved service 2.  One (or more) examples where targets

have caused problems 3.  What can we learn from these

examples?

Page 61: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

It is important to know how well policies are working in practice so you can improve services, be accountable to the public, and help achieve change However ... •  Any targets need to be developed in conjunction

with the people responsible for achieving them (at all levels) service users, and other stakeholders. Targets should motivate not alienate.

•  We need to recognise that ‘all targets are flawed, but some are useful’ and ensure that there is dialogue rather than blame if performance happens to be below the target

Making Deliverology deliver ...

Page 62: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

•  Remember what Deming says: ‘goals without methods’ are always counter-productive

•  If measures are not directly related to outcomes or evidence-based drivers of those outcomes, then they should be scrapped

•  Make sure you celebrate success and help those who are not doing so well improve

•  Public and third sector organisations need to take ownership of their own integrated service improvement and performance measurement frameworks.

Making Deliverology deliver (cont.)

Page 63: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

©Max Moullin 63

Satisfied users & public

Value for money

DELIVEROLOGY

Staff and user involvement

Better public services

Making Deliverology Deliver

No blame culture

Celebrate success

PROCESSES

CAPABILITY

OUTCOMES

Avoid ‘goals without methods’

Ensure targets motivate, not

alienate

Page 64: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Recommendations

•  Make sure you focus on the outcomes that matter to users and other key stakeholders

•  What about your processes? Can they be more effective in delivering these outcomes

•  How can your organisation improve its capability to support its people and processes in meeting the outcomes required

•  Develop your performance measures around desired outcomes, processes and capability

•  Develop a culture of innovation, learning and continuous improvement and not a blame culture

•  Use the Public Sector Scorecard to help you

Page 65: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

MAIN REFERENCES 1.  Jones, P. (2011) Strategy Mapping for learning Organisations,

Gower, Farnham, UK2.  Kaplan, R.S. and Norton, D.P. (2001). The Strategy-focused

Organisation, Harvard Business School Press, Boston, MA. 3.  Middleton, P. ed. (2010) Delivering Public Services that Work.

Triarchy Press, Axminster.4.  Moullin, M. (2002) Delivering Excellence in Health and Social Care.

Open University Press. ISBN 0-335-20888-65.  Moullin, M and Copeland, R (2013) Implementing and evaluating

behaviour change programmes with the Public Sector Scorecard. National Health Executive, Jul-Aug 2013, pp.16-18

6.  Moullin, M. (2009) What's the Score? Feature article, Public Finance.

7.  Moullin, M. (2016) Improving quality and performance with the Public Sector Scorecard. In Radnor, Z. et al. (2016) Public Service Operations Management research handbook, pp.251-270, Routledge

8.  Robinson, N. (2015) Developing strategy in the Public Sector, Impact, Issue 2, Autumn 2015, The Operational Research Society

9.  Seddon, J. (2008) Systems Thinking in the Public Sector, Triarchy Press, Axminster.

Page 66: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Contact details

Max Moullin, BSc(Soc.Sc.), MSc, CQP, FORS, FCQI, FRSA Director, Public Sector Scorecard

Research Centre, Sheffield, UK Visiting Fellow, Sheffield Business School e-mail: [email protected]

web site: www.publicsectorscorecard.co.uk

Page 67: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

John Seddon on ‘deliverology’

•  ‘A Mickey Mouse command and control system (that is being generous to Barber and unfair to the mouse)

•  It drives activity down into systems with no knowledge of the impact on the way the system will perform’

Seddon, J. (2008) Systems Thinking in the Public Sector, Triarchy Press, Axminster, Chapter 8.

Page 68: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Public Safety Canada Balanced Scorecard

Prompt, effective & fair service

Use financial resources fairly, efficiently and

effectively

Reduce Criminal

Victimization

Enhanced personal security

Use force & authority

legitimately, fairly and effectively

Call offender to account in appropriate

ways

Reduce fear of crime

Page 69: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Focussing on activity rather than outcomes

Handling applications for benefits or planning applications

Typical Performance Measure: Time from receipt to either giving decision or informing claimant that form is incomplete.

Is this a good measure? … of staff performance … of the claimant's experience

… of management performance

©Max Moullin 69

MAYBE* NO NO

* but potential perverse effects

Page 70: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

Why focus on outcomes in health care ...

Stowell & Ackerman, Harvard Business Review, Sep 2015

1.  Outcomes define the goal of the organization and set direction

2.  Outcomes inform the composition of integrated care teams

3.  Outcomes motivate clinicians to compare their performance and learn from each other

4.  Outcomes highlight value-enhancing cost reduction

Page 71: Performance management without the blame Gestion du ...ppx.ca/wp-content/uploads/2016/05/Plenary-Max-Moullin.pdf · MYOPIA Concentrating on short-term Emphasis on 5 A-C GCSEs. Schools

2nd Public Sector Finance & Efficiency Summit © Max Moullin, Slide 71