14
Spy Pond Partners April 2009 NCHRP 20-24(37C) – Comparative Performance Measurement Safety Performance Based on the Fatality Analysis Reporting System (FARS)

NCHRP 20-24(37C) – Comparative Performance Measurement

Embed Size (px)

DESCRIPTION

NCHRP 20-24(37C) – Comparative Performance Measurement. Safety Performance Based on the Fatality Analysis Reporting System (FARS). April 2009. Value of Comparative Performance Measurement for Safety. - PowerPoint PPT Presentation

Citation preview

Page 1: NCHRP 20-24(37C) – Comparative Performance Measurement

Spy Pond Partners

April 2009

NCHRP 20-24(37C) – Comparative Performance Measurement

Safety Performance Based on the Fatality Analysis Reporting System (FARS)

Page 2: NCHRP 20-24(37C) – Comparative Performance Measurement

2Spy Pond Partners

Value of Comparative Performance Measurement for Safety

• Comparative performance measurement is a powerful technique for motivating and facilitating changes that result in improved performance

• Motivates organizations to pursue improvements by showing them what their peers have been able to achieve

• Highlights effective practices associated with states that “moved the needle” for traffic fatality rate during the 2000-2007 timeframe

• Results adds to a growing compendium of best practices (construction delivery, pavement smoothness, safety…)

• Comparative performance provides a compelling basis for executives for further improvement and associated practices.

• Linking results to practice at a macro level in the case of safety has proved valuable not so much for discovering new practices, but for reinforcing and lending further support to already recognized best practices.

Page 3: NCHRP 20-24(37C) – Comparative Performance Measurement

3Spy Pond Partners

Value of Comparative Performance Measurement for Safety (cont.)

• Looking at what multiple high performing states have done allows distillation of important practices

• Compared to the two other areas (on-time, on-budget and pavement smoothness), safety is more "mature" with respect to performance measurement and use of performance data to target improvements.

• A single "take away" from the interviews with top performing states, it is the critical importance of being able to FOCUS activities based on credible and timely data.

• Safety practitioners have institutionalized use of performance data for discovery of what works well and what doesn't.

• Continued work towards improving comparability of safety data across states is important – it will be valuable as federal performance measures are explored for reauthorization.

Page 4: NCHRP 20-24(37C) – Comparative Performance Measurement

4Spy Pond Partners

Final Set of Performance Measures

• Primary Performance Measure• % change in 3 year average between 2000-2002 and 2005-2007 in total

fatalities per 100 million VMT

• Secondary Performance Measure (tie breaker or screening)• 3 year average 2005-2007 Fatality rate

• Supplemental Performance Measures • % change in 3 year average between 2003-2005 and 2005-2007 in total

fatalities per 100 million VMT (most recent portion of the 2000-2007 time period)

• % change in 3 year average between 2000-2002 and 2005-2007 in urban fatality rate (fatalities on roads with urban functional classification divided by 100 million VMT on roads with urban functional classification)

• % change in 3 year average between 2000-2002 and 2005-2007 in rural fatality rate (fatalities on roads with rural functional classification divided by 100 million VMT on roads with rural functional classification)

• Change in 3 year average of total number of fatalities

Page 5: NCHRP 20-24(37C) – Comparative Performance Measurement

5Spy Pond Partners

Performance Results

National Average

0.70

0.90

1.10

1.30

1.50

1.70

1.90

2.10

2.30

2.50

0.70 0.90 1.10 1.30 1.50 1.70 1.90 2.10 2.30 2.50

2000-2002 Average Fatality Rate (Fatalities/100M VMT)

20

05

-20

07

Av

era

ge

Fa

tatl

ity

Ra

te

(Fa

talit

ies

/10

0M

VM

T)

Page 6: NCHRP 20-24(37C) – Comparative Performance Measurement

6Spy Pond Partners

Methods for Identification of Top Performing States

Four methods used – recommendations reflect “union” across methods

1. Straight ranking based on percentage change in fatalities

2. Screen out states with lower than national average fatality rate, then rank based on percentage change in fatalities

3. Geographic peer groupings - select top state within each of 5 geographic zones (see next slide) – based on percentage change in fatalities, with absolute fatality rate as tie-breaker

4. Urban/Rural peer groupings – 5 groups based on percentage of 2000-2002 fatalities on urban classified roadways – select top state within each group – based on percentage change in fatalities, with absolute fatality rate as tie-breaker

Page 7: NCHRP 20-24(37C) – Comparative Performance Measurement

7Spy Pond Partners

Peer Groupings - Geographic Regions

• Used by FHWA for Travel Monitoring – 5 regions (http://www.fhwa.dot.gov/ohim/tvtw/08maytvt/region.cfm)

Page 8: NCHRP 20-24(37C) – Comparative Performance Measurement

8Spy Pond Partners

Peer Groupings - % of Fatalities on Urban Roadways

• Group 1• Less than 15 percent of fatalities on Urban Classified Roads (9 states)• ME, MS, MT, ND, SC, SD, VT, WV, WY

• Group 2• 16-30 percent of fatalities on Urban Classified Roads (15 states)• AL, AS, ID, IN, IA, KS, KY, MN, NE, NH, NM, OK, OR, UT, WI

• Group 3• 31-45 percent of fatalities on Urban Classified Roads (14 states)• AK, CO, DE, GA, LA, MI, MO, NC, OH, PA, TN, TX, VA, WA

• Group 4• 46-60 percent of fatalities on Urban Classified Roads (8 states)• AR, CA, FL, HI, IL, MD, NV, NY

• Group 5• Over 60 percent of fatalities on Urban Classified Roads (4 states)• CT, MA, NJ, RI

Page 9: NCHRP 20-24(37C) – Comparative Performance Measurement

9Spy Pond Partners

Summary Results and Recommendations for Best Practice Identification

* tied or close second

Number of Fatalities Fatality Rate

Number of Fatalities Fatality Rate

CO 1,2,3,4 722 1.69 565 1.17 -31%

MN 1,2,3,4 617 1.15 519 0.91 -21%

MI 1,2,3*,4* 1329 1.34 1101 1.06 -21%

UT 1,2,4* 331 1.41 289 1.11 -21%

CT 2,3,4 328 1.06 289 0.91 -14%

MA 3*,4* 456 0.86 429 0.78 -9%

Pct Change in Fatality

Rate

2000-2002 2005-2007

State

Selected by Which

Methods

Page 10: NCHRP 20-24(37C) – Comparative Performance Measurement

10Spy Pond Partners

Selected States

Top Performing States - Interviewed

Tier 1 Top Performers

• Alaska

• Colorado

• Connecticut

• Maine

• Maryland

• Massachusetts

• Michigan

• Minnesota

• New York

• Utah

Page 11: NCHRP 20-24(37C) – Comparative Performance Measurement

11Spy Pond Partners

Findings

Improvements in safety performance were the result of:

Coordinated, Focused Efforts on the 4E's (Engineering – Enforcement – Education - Emergency Response)

with

no big surprises, no silver bullets

Solid Leadership

Dedicated Resources

Committed Players

Page 12: NCHRP 20-24(37C) – Comparative Performance Measurement

12Spy Pond Partners

Findings

High degree of consistency across states interviewed in what people felt was important

Page 13: NCHRP 20-24(37C) – Comparative Performance Measurement

13Spy Pond Partners

Findings

Key factors leading to good performance were:

• Leadership and Interagency Partnerships

• Performance Targets and Continuous Monitoring of Progress

• Support Legislation to Reduce Highway Fatalities

• Use timely and accurate data to target programs and countermeasures for greatest payoff

• Maximize coordination across state and local law enforcement agencies

• Pursue creative and proactive public communications and messaging

Page 14: NCHRP 20-24(37C) – Comparative Performance Measurement

14Spy Pond Partners

Safety Data for Comparative Performance Measurement

• Shift to use of fatalities to fatalities+injuries to provide a more robust basis for comparison• Fatalities are relatively rare events – random variations impact performance

results • Continue work on consistency across states on definition and reporting of

serious injuries.

• Support improvements to timeliness of both crash and VMT data • States that have achieved quick turnaround have reported significant

benefits in terms of willingness to use the data to target resources where they will have the greatest payoff

• Improve locational accuracy of crash data (particularly for local roadways)

• Quantification of both enforcement activities and engineering improvements to allow for cross state comparison would be of value

• % of freeway miles with shoulder rumble strips by year (for engineering)• % of annual nighttime/weekend VMT represented by enforcement activities.