35
Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978) 318-8394

Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Embed Size (px)

Citation preview

Page 1: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Uncertainty, Probability, & Models

Robert C. PatevNAD Regional Technical Specialist

(978) 318-8394

Page 2: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

1. What is risk

2. Nature of uncertainty

3. Probability theory

4. Probability models

PRESENTATION OVERVIEW

Page 3: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

3

WHAT IS RISK?

Page 4: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

4

WHAT IS RISK?

Risk (n.) 1.The possibility of suffering harm or loss; danger.2.A factor, thing, element, or course involving uncertain danger;

a hazard. 3.The danger or probability of loss to an insurer. b. The amount

that an insurance company stands to lose. 4.The variability of returns from an investment. b. The chance of

nonpayment of a debt. 5.One considered with respect to the possibility of loss.

tr.v. risked, risk·ing, risks 1. To expose to a chance of loss or damage; hazard. See

Synonyms at endanger. 2. To incur the risk of: His action risked a sharp reprisal.

Page 5: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

5

WHAT IS RISK?

Risk (n.) 1.The possibility of suffering harm or loss; danger.2.A factor, thing, element, or course involving uncertain danger;

a hazard. 3.The danger or probability of loss to an insurer. b. The

amount that an insurance company stands to lose. 4.The variability of returns from an investment. b. The chance

of nonpayment of a debt. 5.One considered with respect to the possibility of loss.

tr.v. risked, risk·ing, risks 1. To expose to a chance of loss or damage; hazard. See

Synonyms at endanger. 2. To incur the risk of: His action risked a sharp reprisal.

Page 6: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

6

WHAT IS RISK?

Risk (n.) 1.The possibility of suffering harm or loss; danger.2.A factor, thing, element, or course involving uncertain danger;

a hazard. 3.The danger or probability of loss to an insurer. b. The amount

that an insurance company stands to lose. 4.The variability of returns from an investment. b. The chance of

nonpayment of a debt. 5.One considered with respect to the possibility of loss.

tr.v. risked, risk·ing, risks 1. To expose to a chance of loss or damage; hazard. See

Synonyms at endanger. 2. To incur the risk of: His action risked a sharp reprisal.

Page 7: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

NORTH ATLANTIC DIVISION

7

Uncertainty

Probability

Impact

Consequence

Risk

Page 8: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

8

WHAT IS RISK?

RiskInsurance industry: risk = consequence

High Risk

Low Risk

Co

ns

eq

ue

nc

e

Page 9: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

WHAT IS RISK?

RiskPublic health: risk = incidence (frequency or probability)

High Risk

Low Risk

Probability

Page 10: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

10

WHAT IS RISK?

RiskManagement & engineering:

risk = probability * consequence

High Risk

Low Risk

ProbabilityC

on

se

qu

en

ce

Page 11: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

NORTH ATLANTIC DIVISION

Federal agency definitions of risk

Quantitative Flood Risk

C

P

PxC

PxC

P

Page 12: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

12

WHAT IS RISK?

High Risk

Low Risk

Probability

Co

ns

eq

ue

nc

e

High Risk

Low Risk

ProbabilityC

on

se

qu

en

ce

Page 13: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

13

WHAT IS RISK?

Page 14: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

NORTH ATLANTIC DIVISION

Federal agency response

Quantitative Flood Risk

What does “ yellow-and-a-half ”Mean?

Page 15: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

WHAT IS RISK?

15

Page 16: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

16

NATURE OF UNCERTAINTY: WHAT DOES IT MEAN TO BE “UNCERTAIN?”

Page 17: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

17

NATURE OF UNCERTAINTY:

=≠

Page 18: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

18

NATURE OF UNCERTAINTY

Page 19: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

19

NATURE OF UNCERTAINTY

Aleatory vs. epistemic uncertaintyAleatory uncertainty is that of random or

stochastic occurrences; natural variation in space or time; irresolvable.

Epistemic uncertainty is that due to limited knowledge or information.

Page 20: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

20

NATURE OF UNCERTAINTY

Aleatory Epistemic

Page 21: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

NATURE OF UNCERTAINTY

Page 22: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

22

WHAT IS PROBABILITY?

“The theory of probability is at the bottom nothing but common sense reduced to calculus.”

— Laplace 1812

Page 23: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

23

WHAT IS PROBABILITY?

Mathematical probability (1654)Axioms of probability (Kolmogorov 1933)

Frequency measures Aleatory uncertainty

Degree-of-belief measures Epistemic uncertainty

0 P(A) 1

P(S) 1,P() 0

P(E1 E2 ...) E i for E i disjointi

Page 24: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Probability as relative frequency

• Crop experiments• Pharmaceutical testing• Games of chance

Probability as degree of belief (or truth)

• Nuclear plant failure• Major California earthquake• Chance of car crash

WHAT IS PROBABILITY?

24

Page 25: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

25

PARTIAL BELIEF

Axioms of probabilityAny ‘meaning’ that adheres to the axioms is, de facto, ‘probability’

Relative frequencyClassical frequency (DeMoivre)Limiting frequency (Venn)Infinite trials (Fisher, Gibbs)

Degree of beliefNecessary (rational) degree of belief (H.Jeffreys)Subjective degree of belief (Ramsey, Savage,

deFinetti)“Radical probabilism” (R.Jeffrey)

Page 26: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

26

WHAT IS PROBABILITY?

“It’s an excellent proof, but it lacks warmth and feeling”

Page 27: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Frank P. Ramsey 1903 – 1930

PARTIAL BELIEF

27

Page 28: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Subjectivist view: Probabilities are simply degree-of-beliefs by rational

individuals, without basis in objective reality. Two people may have different probabilities for the same

uncertain event, and both be correct. In practice,

it's hard to get people to tell us what their degrees of belief are, and they probably don’t know anyway

To get round this, Ramsey postulated that people need to 'put their money where their probabilities are'. Fundamental meaning of subjective (Ramsey) probability: the willingness to take action based on the belief (to bet).

PARTIAL BELIEF

28

Page 29: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

PARTIAL BELIEF

Ramsey’s theory

Ramsey shows that these assumptions lead to a measure that satisfies the axioms of probability

Thus, partial belief measured in this way is a ‘probability’ and thus adheres to the mathematical properties of probabilities.

Page 30: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

QUANTIFYING SUBJECTIVE PROBABILITY

IntrospectionAsk the decision maker directly, what’s his or her belief

about the probability that the event will occurs. Might include surveys Need to incorporate possibly several estimates

Betting approachHow many dollars would it take to make the decision

maker indifferent about which side to bet on?Can solve for the probability

Page 31: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Verbal DescriptionProbability Equivalent

Low High

virtually impossible 0.01 0.00 0.05

very unlikely 0.10 0.02 0.15

unlikely 0.15 0.04 0.45

fairly unlikely, rather unlikely 0.25 0.02 0.75

fair chance, toss-up 0.50 0.25 0.85

usually, good chance, probable, likely

0.75 0.25 0.95

quite likely 0.80 .030 0.99

very likely, very probably 0.90 0.75 0.99

virtually certain 0.99 0.90 1.00

QUANTIFYING SUBJECTIVE PROBABILITY

Source: Lichtenstein, S., and J.R. Newman (1967). "Empirical scaling of common verbal phrases associated with numerical probabilities," Psychon. Sci., 9(10): 563-564.

Page 32: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Engineering Risk and Reliability

Subjective probability assessment

Page 33: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

Difficulties …People don’t have well-formed subjective

probabilitiesMany people do not like to bet, hard to get their

opinion in this way Risk-averse people had to make the bets small

enough to rule out risk-aversionSome people have difficulty grasping the

hypothetical game that is asked of them.Some may fail to take the measuring seriously.

QUANTIFYING SUBJECTIVE PROBABILITY

Page 34: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

50%

98%

QUANTIFYING SUBJECTIVE PROBABILITY

How good are we at quantifying uncertainty?How may ships passed through the Panama

Canal last year?Best estimate

25-75% bounds

1-99% bounds

Page 35: Delivering Integrated, Sustainable, Water Resources Solutions Uncertainty, Probability, & Models Robert C. Patev NAD Regional Technical Specialist (978)

Delivering Integrated, Sustainable, Water Resources Solutions

PRESENTATION OVERVIEW

What is “risk”What is “uncertainty”What is “probability”How well do people assign probabilities?