30
Decision Making in Complex Environments Lecture 2 – Ratings and Introduction to Analytic Network Process

Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

  • Upload
    others

  • View
    17

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Decision Making in Complex

EnvironmentsLecture 2 – Ratings and Introduction to Analytic Network

Process

Page 2: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Lectures Summary

Lecture 1•AHP=Hierarchies

Lecture 2•Ratings=Large number of alternatives

•Convert AHP to ANP model

Lecture 3•ANP=Networks

Lecture 4•Benefits Opportunities Costs Risks

Lecture 5•Structuring Complex Models with BOCR

Lecture 6•Resource Allocation

•Group Decisions

Week 7•Final Projects

Page 3: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Main points

u Ratings vs Pairwise Comparisons

u Analytic Network Process – ANP

u Use SuperDecisions software to learn how to

u Create a ratings model

u Convert an AHP model to ANP model

Page 4: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Outcomes of this lecture

Understand what a ratings model is

Be able to design a ratings model

Understand what an ANP model is

Be able to desing an ANP model

Learn how to use SuperDecisions to

handle Ratings and ANP models

Page 5: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Ratings

Page 6: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

What are ratings?

u In AHP/ANP we have two ways of creating priorities:

u By comparing the alternative in pairs (pairwise comparisons)

u By RATING the alternatives one at a time with respect to an ideal or standard

u This kind of measuring is analogous to measuring something with a physical device, like measuring length with a yardstick

u When do we use ratings?

u When alternatives are though to be independent of one another

u The presence or absence of an alternative must have no effect on how one rates any of the others

u When we can have an IDEAL alternative in mind to compare with

u When the number of alternatives make the pairwise comparisons too time consuming

u e.g. if we want to evaluate 50 employees, then 1,225 (50(49)/2) pairwise comparisons, would be required for each criterion if we used a pairwise comparison model and not a ratings model.

Page 7: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Ratings - Methodology

Step 1•Create and AHP or ANP model WITHOUT any alternatives•No alternatives cluster will appear in the model

Step 2•Do all the pairwise comparisons needed to evaluate the criteria

Step 3•Select all the bottom level criteria and use them as criteria in the ratings model

Step 4•For each criterion define a custom scale

Step 5•Rate each alternative against the criteria using the respective scale

Step 6•Calculate each alternative’s score by multiplying the scale value to the criterion weight and sum through the line

Step 7•Idealize all results to find what is the rank of each alternatives

Page 8: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Ratings and Rank reversal

u When using rating we don’t have rank reversals

u That means that adding alternatives to the model will not create changes on the relative ranks of the existing alternatives

u In pairwise comparisons this is not the case

Rank reversal

Page 9: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Ratings scales

u One must be able to say how high or low an alternative rateon each criterion

u To do that you must have something in mind called an IDEALso that you get the feeling about how close or far the alternative is from the ideal and allocate it to one of various intensity slots of ranking — we call them SCALES

u Scales

u A scale is a group of intensities used to evaluate an alternative against a specific criterion

u We calculate each scale item’s intensity by pairwise comparing the scale items or by directly entering values

u We have one scale for each decision criterion

u The same scale can be used for more than one criteria in the same model

u The same scale can be re-used in different models

Page 10: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Ratings – Example: Best City to Live in

Page 11: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Step 2 – Pairwise compare criteria

u We pairwise compare the criteria to find their weights

Cultural Family Housing Jobs Transportation

Cultural 1

Family 1

Housing 1

Jobs 1

Transportation 1

Page 12: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Step 3 – Create Scale for each criterionu For each criterion we create a scale, to do so we

u Find the scale items that are appropriate for that kind of criterion

u Pairwise compare them to calculate the priorities or

u Directly enter the values

Page 13: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Step 4 – Rate Alternatives

u Each alternative is rated having in mind how this alternative compares to the ideal alternative

u We calculate the final results by multiplying the value of the cell to the weight of the criterion and sum across the row

Page 14: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Analytic Network Process

Page 15: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

AHPLinear Hierarchy

Page 16: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Analytic Network Process (ANP)

u The ANP is a mathematical theory that makes it possible for one to deal systematically with dependence and feedback, and includes the AHP as a special case.

u The reason for its success is the way it elicits judgments and uses measurement to derive ratio scales.

u Real life problems involve dependence and feedback. Such phenomena can not be dealt with in the framework of a hierarchy but we can by using a network with priorities.

u With feedback the alternatives can depend on the criteria as in a hierarchy but may also depend on each other.

u The criteria themselves can depend on the alternatives and on each other as well.

u Feedback improves the priorities derived from judgments and makes prediction more accurate.

Page 17: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Loop in a component indicates inner dependence of the elements in that component with respect to a common property.

Arc from componentC4 to C2 indicates theouter dependence of the elements in C2 on theelements in C4 with respectto a common property.

C4

C1

C2

C3

Feedback

Analytic Network ProcessFeedback Network with components having

Inner and Outer Dependence among Their Elements

Page 18: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

AHP vs ANPu AHP: What is more preferred or

more important? Both are more or less subjective and personal.

u ANP: What has greater influence? This requires factual observation and knowledge to yield valid answers and thus is more objective.

u Decisions with the ANP should be more stable because one can consider their effect on and survival in the face of other influences.

Page 19: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

The questions we answer in ANP

u Given a criterion, which of two elements has greater influence (is more dominant) with respect to that criterion?

u Given an alternative, which of two criteria or properties is more dominant in that alternative?

u Given a criterion and given an element X in any cluster, which of two elements in the same cluster or in a different cluster has greater influence on X with respect to that criterion?

u The entire decision must use the idea of something “influencing” another. Otherwise it must use the idea of “influenced by” throughout the analysis as follows:

u Given a criterion and given an element X in any cluster, which of two elements in the same or in a different cluster is influenced more by X with respect to that criterion.

Page 20: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Main Operations of the ANP

u Relative measurement: Reciprocal relation

u Judgments: Homogeneity

u Hierarchy or Network: Structure of problem; the control hierarchy

u Priorities, Dominance and Consistency: Eigenvector

u Weighting the components

u Composition, Additive to also handle dependence through the supermatrix

u Supermatrix: Interdependence; raising the supermatrix to powers

Page 21: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Weighting The Components

u In the ANP one often needs to prioritize the influence of the components themselves on each other component to which the elements belong.

u This influence is assessed through paired comparisons with respect to a control criterion.

u The priority of each component is used to weight the priorities of all the elements in that component.

u The reason for doing this is to enable us to perform feedback multiplication of priorities by other priorities in a cycle, an infinite number of times.

u The process would not converge unless the resulting matrix of priorities is column stochastic (each of its columns adds to one).

u To see that one must compare clusters in real life, we note that if a person is introduced as the president it makes much difference, for example, whether he or she is the President of the United States or the president of a local labor group.

Page 22: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Inner vs. Outer Dependence

u In a network, the elements in a component u may influence other elements in the same component (inner

dependence)

u may influence elements in other components (outer dependence)

u with respect to each of several properties

u We want to determine the overall influence of all the elements. To do so we: u organize the properties or criteria

u define connections among criteria and alternatives

u perform comparisons

u synthesize to obtain the priorities of these properties

u derive the influence of elements in the feedback system

u weight the resulting influences

u obtain the overall influence of each element.

Page 23: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

W =

C1 C2 CN

e11e12 e1n1e21e22 e2n2

eN1eN2 eNnN

W11 W12 W1N

W21 W22 W2N

WN1 WN2 WNN

C1

C2

CN

e11e12

e1n1e21e22

e2n2eN1eN2

eNuN

c1.

C3

c4c2.Feedback

Networks and the Supermatrix

Page 24: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

where

Wi1 Wi1 Wi1

Wij =

(j1) (j2) (jnj)

(j1) (j2) (jnj)Wi2 Wi2 Wi2

WiniWini

Wini(j1) (j2) (jnj)

Page 25: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Three Supermatrices in ANP

1) The original supermatrix of column eigenvectors obtained from pairwise comparison matrices of elements

2) Weighted supermatrix in which each block of column eigenvectors belonging to a component is weighted by the priority of influence of that component. This renders the weighted supermatrix column stochastic.

3) The limit supermatrix obtained by raising the weighted supermatrix to large powers.

Page 26: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

0 0 0 0 0

W21 0 0 0 0W =

Wn-1, n-2 0 00 0 0 Wn, n-1 I

0 W32 0 0 0

0 0

C1

C2

CN

e11

e1n1

e21

e2n2

eN1

eNnN

C1 C2 CN-2 CN-1 CN

e11 e1n1e21 e2n2

eN1 eNnNe(N-2)1 e(N-2) nN-2

e(N-1)1 e(N-1) nN-1

Supermatrix of a Hierarchy

Page 27: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Wk=

Wn,n-1 Wn-1,n-2 W32 W21 Wn,n-1 Wn-1,n-2 W32

for k>n-1

Wn,n-1 Wn-1,n-2 Wn,n-1 I

00

0

00

0

00

0

00

0

00

0

… ...

Page 28: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

Summarizing ANP

u In ANP we have criteria grouped in clusters and alternatives grouped in a cluster usually named “Alternatives”

u We can have inner and outer dependencies among the criteria, the alternatives and the criteria and the alternatives

u We can have feedback (self loop) in any cluster

u We can pairwise compare the clusters like we do the criteria and the alternatives

u The final results are given by the limit supermatrix

u We do sensitivity in the same way that we do the AHP sensitivity

Page 29: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

ANP Example - US Economy Turnaround 2001-2002

Page 30: Decision Making in Complex Environments...Decision Making in Complex Environments Lecture 2 –Ratings and Introduction to Analytic Network Process. Lectures Summary Lecture 1 •AHP=Hierar

ANP Example – Hamburger Model