37
UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing Aviation and ATM Safety Challenges La Granja 11th-14th July, 2016 Joram Verstraeten, NLR The Risk Observatory Future Sky Safety P4 - “Total System Risk Assessment”

The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Aviation and ATM Safety Challenges

La Granja 11th-14th July, 2016

Joram Verstraeten, NLR

The Risk Observatory Future Sky Safety P4 - “Total System Risk Assessment”

Page 2: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

The FSS programme

12 July, 2016 SAFETY | FUTURE SKY 2

Page 3: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

FSS Projects

12 July, 2016 SAFETY | FUTURE SKY 3

Research on safety risk priority areas P3 Specific solutions for runway excursion accidents P4 Total system risk assessment - “The Risk Observatory” P5 Resolving the organizational accident P6 Human Performance Envelope P7 Mitigating the risk of fire, smoke & fumes

Coordination of research and innovation at European RI P1 Coordination of Institutionally Funded Safety Research P2 Dissemination, exploitation and communication

Page 4: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

FSS Website

https://www.futuresky-safety.eu/

12 July, 2016 SAFETY | FUTURE SKY 4

Page 5: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 5

Page 6: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Safety Management (by Bill Voss)

1. What is most likely to be the cause of your next accident

or serious incident? 2. How do you know that? 3. What are you doing about it? 4. Is it working?

12 July, 2016 SAFETY | FUTURE SKY 6

Page 7: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Understand safety performance

12 July, 2016 SAFETY | FUTURE SKY 7

Thomas Hoffman, COO Austro Control

Source: http://www.optics-project.eu/?page_id=877/#3rd-WS-pres

Page 8: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

What is a risk observatory?

12 July, 2016 SAFETY | FUTURE SKY 8

.

. .

.

Prototype risk observatory

Exposure data

Radar data

FDM data Occurrence data Exposure data

....

Structuring of safety data

Feed into integrated risk assessment framework

Acquire safety information

Page 9: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 9

Page 10: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 10

Page 11: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Why do we want a risk observatory?

12 July, 2016 SAFETY | FUTURE SKY 11

FlightPath 2050 goal: The European ATS has less than one accident per ten million commercial aircraft flights

accidents fatal accidents

source: EASA Annual Safety Review 2014

Page 12: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Approach to reach objectives

1. Consultation and desktop research 2. Drafted requirements 3. Translated requirements into an

early prototype

12 July, 2016 SAFETY | FUTURE SKY 12

Page 13: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Stakeholder consultation

Aircraft operators ANSPs Aircraft manufacturers Airports Authorities

12 July, 2016 SAFETY | FUTURE SKY 13

Page 14: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Previous research

12 July, 2016 SAFETY | FUTURE SKY 14

• ASCOS • ASIAS • ISAAC • ISAM • MISSA • PROSPERO • SVETLANA • Threat Radar

Page 15: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Consortium expertise

12 July, 2016 SAFETY | FUTURE SKY 15

Page 16: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

What did the stakeholders say?

• “The risk observatory should be proactive: a ‘bell should ring’ if there is a threat”

• “We would like to monitor our performance against the performance of comparable organisations”

• “The risk observatory can serve as a source of hazards and lessons learned when performing risk assessments”

• “We would like to estimate the impact of a risk mitigation measure”

12 July, 2016 SAFETY | FUTURE SKY 16

Page 17: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 17

“The risk observatory should be proactive: a ‘bell should ring’ if there is a threat”

Page 18: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 18

“We would like to monitor our performance against the performance of comparable organisations”

Page 19: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 19

“The risk observatory can serve as a source of hazards and lessons learned”

Page 20: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 20

“We would like to estimate the impact of a risk mitigation measure”

Page 21: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

What is a risk observatory?

12 July, 2016 SAFETY | FUTURE SKY 21

.

. .

.

Prototype risk observatory

Exposure data

Radar data

FDM data Occurrence data Exposure data

....

Structuring of safety data

Feed into integrated risk assessment framework

Acquire safety information

Acquire safety information

Prototype risk observatory

Acquire safety information

Identifying risks and generating safety intelligence from extensive safety data exploitation

Page 22: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 22

Page 23: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 23

Page 24: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12 July, 2016 SAFETY | FUTURE SKY 24

Page 25: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

But, the Risk Observatory is more...

12 July, 2016 SAFETY | FUTURE SKY 25

It is software for end-users

It is supporting software and hardware

It is an organisation

Page 26: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Challenges

• What added value can models deliver to the safety data?

• What are the possibilities and impossibilities of working with large and confidential datasets?

• How are we going to built the risk observatory?

• How can the risk observatory be organized?

12 July, 2016 SAFETY | FUTURE SKY 26

Page 27: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Added value of risk models (1/4)

12 July, 2016 SAFETY | FUTURE SKY 27

This ESD shows 3 scenarios of which 1 is an accident scenario: • A unstable approach is followed by a missed approach. The following approach is normal and there is a

normal landing. • There is an unstable approach, but the flight crew continues the approach. The aircraft does not

touchdown long or fast and lands normally. • There is an unstable approach, but the flight crew continues the approach. The aircraft does

touchdown long or fast causing a runway excursion.

Page 28: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Added value of risk models (2/4)

12 July, 2016 SAFETY | FUTURE SKY 28

This ESD shows the quantifications (equal to the examples given in the previous slide): • There is 1 runway excursion (caused by a continued UA) per 5 million flights • 1 UA out of 26,700 UA results in a runway excursion

Unstable approach

5.3E-03

Flight crew does not execute

missed approach2.2E-02

Aircraft touchdown long or fast

1.7 E-03

Runway excursion

Normal landing

Normal landing

2.0E-7

5.2E-03

1.2E-04

yes yes yes

no no

Page 29: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Added value of risk models (3/4)

Combining models

12 July, 2016 SAFETY | FUTURE SKY 29

New risk modelling informed by real-time operational data of everyday performance

Page 30: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Added value of risk models (4/4)

12 July, 2016 SAFETY | FUTURE SKY 30

Shared modelling expertise

Page 31: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

How can the risk observatory be organized? • Should there be one Risk Observatory in Europe , or could

there be more? • Will the Risk Observatory be developed, implemented and

operated in the EU by: • A new, central, independent and not-for-profit body; • An existing, independent and not-for-profit body; • An existing governmental or industrial body;

• What governance structure for the Risk Observatory is needed in Europe?

• How to develop a long-term funding strategy to ensure continuity of the Risk Observatory services?

• Assure that data shared with the ROO are protected against misuse for purposes other than safety?

12 July, 2016 SAFETY | FUTURE SKY 31

Page 32: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Are we unique? No...

12 July, 2016 SAFETY | FUTURE SKY 32

FAA ASIAS

Page 33: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Are we unique? No...

12 July, 2016 SAFETY | FUTURE SKY 33

Data4Safety programme

Page 34: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

...But there are unique aspects

12 July, 2016 SAFETY | FUTURE SKY 34

• A collective wisdom on aviation safety: service providers,

authorities and research institutions • Translating the input safety data into a picture of risk • It is research, we are not held back by “cold feet”

because of legal, political or other constraints

Page 35: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

Contact P4

NLR - Netherlands Aerospace Centre Joram Verstraeten

[email protected]

12 July, 2016 SAFETY | FUTURE SKY 35

Page 36: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

12/07/2016 36

Page 37: The Risk Observatory - UPMblogs.upm.es/.../239/2016/07/future-Sky-total-siystem-risk-assessme… · UPM SUMMER SCHOOL LISA - Laboratory of ideas for Safety in Aviation. Addressing

http://www.futuresky-safety.eu

Icons used from the Noun Project (Ainsley Wagoner, Creative stall, Rflor, Marc David Rapoza)