Death by Market Power: Reform, Competition and Patient Outcomes in the British National Health...

Death by Market Power:Reform, Competition and Patient Outcomes

in the British National Health ServiceMartin Gaynor

Carnegie Mellon University, University of Bristol, RAND, & NBERRodrigo Moreno-SerraImperial College London

Carol PropperImperial College London & University of Bristol

Human Capital Research Collaborative Fall ConferenceFederal Reserve Bank of Minneapolis

October 14,15, 2010

1

INTRODUCTION

Motivation

1. Health care reform is happening in most developed countries: U.S., U.K., Germany, Netherlands, Belgium, Israel, Australia,...

2. Market-oriented approaches to health care are an important reform model outside U.S. a. Lack of strong research evidence w.r.t. quality.b. Price not relevant in most systems outside the

U.S., or for U.S. Medicare program (20% of U.S. spending).

3

Motivation, cont’d.

3. In U.S. consolidation in markets has led to questions about functioning of markets in health care.a. How well are markets working?b. Could further consolidation promoted by health

reform be harmful?4. Need to add to knowledge about conditions under

which markets might work.a. Quality, cost, prices (U.S.).

5. Little information about impacts on children.

Our Contribution1. Most empirical evidence on the impact of competition

on quality uses variation in market structure across existing hospital markets. a. We’d like to randomly assign hospitals to varying degrees

of competition.b. Clearly not the case.

2. We exploit a policy “experiment” (NHS) to assess the impact of competition.a. Examine a range of hospital outcomes (measures of

quality, quantity/access, spending).3. Find that lower market concentration is associated

with higher quality without a commensurate increase in expenditure.

The NHS Reforms

1. 1997- buyers and sellers operated under co-operation and negotiated annual budgets on price and volume.a. Patients had little choice of hospital.b. Quality not contracted on (except waiting times).

2. Policy change initiated in 2003, put in place in 20063. GoaI – to promote competition among hospitals

NHS Reforms, cont’d.

4. Key elementsa. ‘Choose and Book’ – patients must be offered choice of 5

hospitals.b. Payment by Results (PbR) - movement from negotiated

to fixed prices (HRGs - similar to U.S. DRGs). i. PbR accounts for almost 70% of activity.

c. Reward /Penalties for Performance.i. Foundation Trust Status – Retain net income.ii. Poor performance – management replacment, closure, merger.

Expected Effects of the Reform

1. Expected effectsa. ‘Choose and Book’ – increase elasticity of demand facing

hospitals.b. PbR – change conduct .

i. Hospitals paid for activity.ii. Focus on quality since prices fixed.

2. Do hospitals have incentives to respond?a. Not for profit, annual budget constraint.b. Poor financial & clinical performance heavily penalised.c. PbR system is very highly geared.

i. Levels of prices key.

What We Do

1. Exploit policy change in NHS 2006 to undertake difference in difference analyses .

2. Use time periods before/after reform and variation in market concentration.a. Before/After: 2003/2007b. Concentration: More/Less Concentrated

3. Post-policy a hospital in a less concentrated market faces greater exposure to the policy.

21 i

ni sHHI

Data

1. HES (Hospital Episode Statistics) data from the NHS (http://www.hesonline.nhs.uk/Ease/servlet/ContentServer?siteID=1937)a. Data on all admissions to NHS hospitals in England.

i. Standard hospital discharge data set: diagnoses, procedures, patient characteristics, location,etc.

ii. ~13 million records per yeariii. We use data on ~160 short term general hospitals per

yearb. We use hospital level data for 2 years – 2003/04,

2007/08c. Used to construct measures of concentration and

some outcome measures

Data, cont’d.

2. Measures of quality and performancea. Some calculated from HES data (e.g. in-hospital

deaths within 28 days of admission for various treatments, deaths in all locations after AMI admission, LOS)

b. Some derived from official data on hospital performance (e.g. waiting times data, CQC data)

3. Data from administrative sourcesa. NHS staffing datab. Small area characteristics (wages, mortality)

Measures of Concentration

1. HHIs for hospitals based on patient flows

1. Built up from small area (~ 7000 persons) patient flows to hospitals

a. Calculate HHIs at MSOA level for 2003 and 2007b. Use all non-emergency admissionsc. Allow market to be whole country

2. Aggregate to hospitals based on share of patient flows to hospital from each MSOA

21 i

ni sHHI

WHAT THE RAW DATA SHOW

Raw Data

1. Did mortality rates go up (more) in more concentrated markets after the reform?

2. Did concentration change (before/after reform)?

3. Did demand change post-reform?

The Paper While Standing on One Foot28 Day AMI Mortality Rate and HHI

Still on One Foot 28 Day All Causes Mortality and HHI

Decrease in Concentration

Levels and Changes in Concentration by Location

Did Demand Change Post Reform?

1. Examine changes in patterns of patient care seeking 2003-07 by:a. Quality of Hospitals (top vs. bottom quartiles of

AMI mortality rate in 2003)b. Exposure to competition (bottom vs top quartile

of HHI in 2003)

Better Hospitals are Attracting More Patients

AMI mortality rate (2003) Bottom quartile Top quartile

2003 2007

% change (2003-

07) 2003 2007

% change (2003-

07)

Number of elective admissions

33,985 38,274 12.6% 41,398 45,132 9.0%

Average distance travelled by patients

11.4 11.7 2.4% 10.0 10.1 1.1%

Share of patients bypassing nearest hospital

0.37 0.39 5.4% 0.45 0.43 -4.4%

Number of hospitals

33 33 32 32

Hospitals More Exposed to Policy are Attracting More Patients

Market concentration: HHI (2003)Low (bottom quartile) High (top quartile)

2003 2007

% change (2003-

07) 2003 2007

% change (2003-

07)Number of elective admissions

21,757 26,924 23.8% 55,253 61,049 10.5%

Average distance travelled by patients

8.1 8.3 2.3% 15.5 15.5 0.5%

Share of patients bypassing nearest hospital

0.45 0.46 2.2% 0.47 0.47 0.0%

Number of hospitals 41 41 40 40

REGRESSION ANALYSIS

Econometric Strategy

1. Exploit policy change in NHS 2006 to undertake difference in difference analyses .

2. Use time periods before/after reform and variation in market concentration.

3. Identification from cross sectional and time series variation.4. Policy effect = Market Concentration* Policy On (2007).

a. Parameter δ in regression.

qit = + I(t=2007) +I(t=2007)*HHIit + HHIit + Xiti +it

Econometric Issues

1. There may remain concerns over endogeneity of concentration + patient heterogeneity.

2. Control for patient heterogeneity with observables.a. Patient age, sex, severity (Charlson index) .b. Local area health, income.c. Include hospital fixed effects.

3. Replace actual HHI with a measure of market structure based on factors unrelated to quality or unobserved patient heterogeneity.a. Predicted from estimated model of hospital choice.

Regression Results

1. Mortality, Waiting Times2. Quantity, Expenditure

25

DiD Estimates of Market Structure on Outcomes and Waiting Times

(1) (2) (3) (4) (5) (6) (7)

28 day AMI

mortality rate (in-

hospital, ages 55+)

30 day AMI

mortality rate

(on or after discharge,ages 35-

74)

28 day all causes

mortality rate (in-

hospital)

28 day mortality

rate (in-

hospital, excluding

AMI)

MRSA bacterae

mia rate

Patients waiting

3 months or more

Attendances

spending less than

4 hours in A&E

DiD coefficient 0.246*** 0.313** 0.069** 0.066** -0.110 0.078 -0.005

(0.084) (0.116) (0.027) (0.028) (0.118) (0.167) (0.011)

Hospitals 133 133 162 162 161 162 150

Observations 250 250 323 323 318 323 299

Estimated Effect of the Policy1. Hospitals in less concentrated markets had significantly lower

mortality rates post-reform than those in more concentrated markets.a. The policy “worked.”

2. 10% fall in HHI associated with a 2.46% reduction in in-hospital AMI mortality rate.

3. 1/3rd of a percentage point at mean AMI mortality rate (13.2%).4. Similar to #s from previous work.

a. Kessler and McClellan (2000) i. Change from top to bottom quartile of HHI leads to 3.37 percentage point

decrease in AMI death rate. Our equivalent #: 3.61.b. Cooper et al. (2010)

i. 1 s.d. change leads to 0.3 percentage point reduction in AMI death rate. Our #: 0.33.

27

Policy Impacts on LOS, Admissions, and Expenditure

28

(1) (2) (3) (4) (5) (6)

Length-of-stay and admissionsExpenditure and

productivity

Mean length-of-

stay(days)

Total admissions(number)

Elective admissions

(share of total)

Non-elective

admissions (share of

total)

Operating expenditure

(£1,000)

Operating expenditure

(£1,000) per admission

DiD coefficient 0.254*** -0.012 -0.005 -0.001 0.007 0.014

(0.059) (0.031) (0.017) (0.024) (0.072) (0.074)

Hospitals 162 162 162 162 162 162

Observations 323 324 324 324 319 319

Did the Policy Matter?1. Benefits from the observed change in market

structure post reform.a. 3,354 life years saved = £227 million (=$350mil).

2. Cost of being in a concentrated market compared to being in a less concentrated one.a. An HHI of 2,000 less (=one s.d.) implies a saving of £3.7

billion (=$5.7 bil).3. NHS budget is £100 billion (=$154 bil).

a. Impact is 0.2% of NHS budget.b. Immediate impact is small, but we only value deaths

averted and longer term impact of reducing concentration considerably larger.

Conclusions1. Robust evidence that under a regulated price regime,

within two years a pro-competitive policy resulted in:a. an improvement in clinical outcomes, as measured in death

rates,b. reduction in length of stay,c. no increase in expenditures.

2. Conclude: policy appears to have saved lives and did not (measurably) increase costs.a. “Competition saves lives; monopoly kills.”

3. Competition can be an important mechanism for enhancing the quality of care.

4. This may have a significant impact on children’s health.a. Vulnerable population.b. Future research.

Additional slides

Competition and Quality in Health Care1. Theory

a. Regulated prices – competition increases quality (if price > marginal cost; e.g., regulated airline models).

i. Quality elasticity of firm’s demand increasing in the # of firms.ii. Competition increases management effectiveness, thereby increasing

quality.b. Market determined prices – anything can happen.

2. Evidence is mixeda. Regulated prices

i. Medicare – competition improves quality (e.g., Kessler & McClellan, 2000)

b. Market determined pricesi. U.S. private markets – not so clear (Volpp et al., 2003)ii. U.K. 90s reforms – competition reduced quality (Propper et al, 2008)

3. Little evidence from policies designed to introduce competition

Tests of Difference in Difference Assumptions

1. If we find a relationship between mortality and market structure is it due to the policy or to pre-existing differences between hospitals with different market structures?

2. We examine:a. bivariate associations between the observed baseline conditions and the

subsequent four year change in the HHI;i. Admissions, AMI admissions, doctors, clinical staff, area mortality rate, case mix,

Index of Multiple Deprivation, Charlson Index.b. bivariate associations between the initial levels of mortality and the

subsequent changes in market structure.i. In-hospital AMI mortality, 30 day AMI mortality, In-hospital all-cause mortality.

3. If the change in HHI is associated with pre-existing differences this may indicate that hospitals that differ in HHI growth may also differ in unobserved factors.

4. None of the associations significantly different from zero.

33

Predicted HHI

1. Predicted HHIs from predicted patient flows from estimated MNL model of hospital choice.a. a la Kessler and McClellan (2000).b. Choice in MNL model depends on:

i. hospital characteristics (size, teaching status), ii. differential distance from patient’s MSOA centroid to

hospital,iii. patient characteristics (age, sex, level of co-morbidity).

c. Choice set – all hospitals within 100km extended to ensure that there is always a first and second choice within hospital type (size, teaching) with minimum of 50 admissions.

Robustness Checks1. Results may be driven by pre-existing differences

between hospitals that are correlated with market structure.a. Placebo test using 2001 as before policy and 2003 as

after policy – insignificant.2. Estimation using only pre-policy variation in market

structure.a. HHI*2007 – significant.

3. Add further controls for patient heterogeneity; income shock from PbR; local area economic conditions (male wage, ambulance speeds).a. DiD estimates still significant, magnitudes almost

unchanged.

35

Hospitals Used by GPs and Distances Travelled by Patients

Tests of DiD Assumptions

(1) (2) (3) (4) (5) (6) (7) (8) (9) (10) (11)

CovariateTotal

admissions

AMI admissions (ages 55+)

Doctors (share of clinical staff)

Qualified clinical staff

(share of clinical staff)

Area standardized

mortality rate

Case mix

Index of Multiple Deprivation (average for

patients’ areas of residence)

Charlson index

(average for admissions at the hospital)

28 day AMImortality rate (in-hospital, ages 55+)

30 day AMI mortality rate(on or after discharge, ages 35-74)

28 day all-cause mortality

rate (in-hospital)

Coefficient -0.624 -0.051 5.329 -10.233 -1.695 -0.001 81.732 -1.080 -1.808 47.847

(0.642) (0.086) (8.792) (7.947) (1.936) (0.003) (72.197) (4.751) (6.623) (42.840)

P-value for Wald test 0.129

Observations 162 151 161 161 162 162 162 162 130 130 162

Robustness tests(1) (2) (3)

28 day AMI mortality rate

(in-hospital, ages 55+)

28 day all-causemortality rate (in-hospital)

Mean length-of-stay

(days) Robustness test

1. Baseline 0.246*** 0.069** 0.254***

(0.084) (0.027) (0.059)

Observations 250 323 323

2. Placebo DiD test for 2001-2003 -0.047 0.005 -0.036

(0.077) (0.027) (0.047)

Observations 250 309 309

3. Using time invariant pre-reform HHI level (2003) 0.216*** 0.066** 0.245***

as market structure measure (0.079) (0.028) (0.059)

Observations 250 323 323

4. Controlling for the Charlson index 0.246*** 0.067** 0.239***

(0.084) (0.027) (0.060)

Observations 250 323 323

5. Controlling for the Index of Multiple Deprivation 0.278*** 0.067** 0.263***

(0.085) (0.029) (0.061)

Observations 250 323 323

6. Controlling for surpluses/deficits 0.242** 0.076** 0.229***

(0.093) (0.030) (0.066)

Observations 236 302 302

7. All hospitals (weighted by number of admissions) 0.138** 0.069*** 0.261***

(0.069) (0.024) (0.061)

Observations 299 323 323

8. Using levels of the dependent variable and HHI 0.170** 0.069*** 0.197***

(implied elasticity)

Observations 250 323 323

9. Controlling for income (male wage in area) 0.247*** 0.061** 0.258***

(0.086) (0.029) (0.062)

Observations 248 319 319

10. Controlling for the share of urgent ambulance calls 0.238**

responded within eight minutes (0.100)

Observations 233

Magnitude of Effects

39

28 day mortality rate (all causes)

Panel A - Observed magnitudes

Average number of admissions (2003/04) 63,094Average number of deaths (2003/04) 1,135.1Average mortality rate (2003/04) (%) 1.799%Average number of admissions (2007/08) 72,558Average number of deaths (2007/08) 1,053.5Average mortality rate (2007/08) (%) 1.452%Average change in deaths (2003-07) (positive = deaths averted) 81.5Average decrease in predicted HHI (2003/04-2007/08) -118

Panel B - Continuous HHI: magnitudes implied by estimated coefficient (summary stats refer to HHI 03)

Baseline coefficient (elasticity) (%) 0.069

Scenario 1: Average decrease in HHI (Policy impact)Implied counterfactual percentage increase in the mortality rate 2007/08 per hospital (for elasticity calculated at mean HHI) 0.2%Total lives saved for the whole sample of hospitals (N = 162) 327Total number of years of life saved for the whole sample of hospitals 3,354Total savings in £million (value of year of life = £60,000/p.a.) £201

Scenario 2: One standard deviation increase in HHI 03 (= increase of 1928 units, from 4,353 to 6,281 in the whole sample)Implied counterfactual percentage increase in the mortality rate 2007/08 per hospital (for elasticity calculated at mean HHI) 3.1%Total lives saved for the whole sample of hospitals (N = 162) 5,336Total number of years of life saved for the whole sample of hospitals 54,771Total savings in £million (value of year of life = £60,000/p.a.) £3,286

No change in patient type except for IMD for good hospitals

40

Change 2007-2005

(1) (2) (3) (4) (5) (6)

Elective admissions

Number of MSOAs

(electives)

Mean distance travelled

(electives)

Mean IMD

ranking Charlson

index Number of diagnoses

Mean waiting time 56.434* 0.694** 0.004* 13.836*** 0.00002 0.001 (elective admissions) (33.680) (0.295) (0.002) (3.061) (0.00013) (0.001)

Overall quality of services 1165.859 21.762** 0.078 207.347** -0.00030 0.024 (score) (897.260) (9.294) (0.076) (95.395) (0.00519) (0.031)

In-hospital mortality rate -942.177 14.816* -0.175* 14.927 -0.01229* -0.005 (all causes) (1255.291) (8.718) (0.103) (91.709) (0.00638) (0.050)

In-hospital mortality rate -91.980 -1.035 0.001 26.533 0.00086 0.002 (AMI) (227.052) (1.029) (0.011) (21.365) (0.00131) (0.005)

Teaching hospital status 1234.181 20.211 -0.098 335.378** -0.00041 -0.034

(2088.132) (17.763) (0.133) (143.230) (0.01348) (0.042)

Note: Index of Multiple Deprivation (over all patients), where patients in the most deprived locality in the year are attributed the ranking of 1 and higher values are attributed to patients living in less deprived areas.

Competitive hospitals in 2005 not attracting observably sicker/different patients but are attracting more patients

41

Change 2007-2005

(1) (2) (3) (4) (5) (6)

Elective admissions

Number of MSOAs

(electives)

Mean distance travelled

(electives)

Mean IMD

ranking Charlson

index Number of diagnoses

Level of HHI -483.360 -2.620 0.032 41.200 0.002 -0.003

(505.402) (2.788) (0.025) (43.781) (0.002) (0.015)

Indicator for bottom 3156.728** 18.499* -0.084 -139.657 0.001 0.004 quartile of HHI (1513.533) (10.949) (0.096) (162.770) (0.008) (0.056)

Number of hospitals 162 162 162 162 162 162 Note: Index of Multiple Deprivation (over all patients), where patients in the most deprived locality in the year are attributed the ranking of 1 and higher values are attributed to patients living in less deprived areas.

42

Predicted HHIs based on predicted patient flows based on MNL model of hospital choice

2

1 1

1 1 1 1 1

ˆ ˆˆ ˆ ˆ,ˆ ˆ

ˆ ˆ ˆ ˆ ˆ ˆ ˆ, 1 ,k k k

K Jkj jk

j k kk jj k

n n nn J

j ij k ij k kj jk iji i j i i

n nHHI HHI HHI

n n

n n n n n