Upload
sharon-allison
View
228
Download
8
Embed Size (px)
Citation preview
INTROTO RATING
SCALES
2014 v1.02014 v1.0
Define Decision: Build Rating Scales
2
Identify Alternatives
Identify Criteria
Identify Participants
Build Ratings Scales
Define
Build rating scales to evaluate alternatives
Rating scales enable us to assess how well a project, vendor, candidate, etc. fulfills the criteria Defines what constitutes “good” or “bad” Converts judgments into a numeric value
In a home remodeling project prioritization, what does a rating for increase the feeling of more space look like?
Each lower level criterion requires a rating scale
3
Set Rating Scale Weights
Every rating has an assigned weight that converts the rating into a value. The best or highest rating gets a weight of “1” The worst or lowest rating gets a weight of “0”
Ask yourself, for this criterion, what is good enough? How much more do I value the next rating up?
4
5
Three ways to handle quantitative criteria
In the Home Improvement model, how would you evaluate a project’s reduction in utility costs (monthly)?
Option 1: Enter an absolute number Numeric rating scale
Option 2: Select from a range of numbers Verbal rating scale
Option 3: Select from multiple descriptive titles Verbal rating scale
6
Option 1: Enter an absolute number
Developing a numeric rating scale Numeric rating scales capture numbers Only 2 values are required on your scale, but additional
points may be entered Points in between defined values are calculated on a
straight line – a value of $100 gets a rating of 0.7 in this example
Option 1: Enter an absolute number (cont.)
Entering ratings using a numeric rating scale Data can be imported or directly entered by participants Values outside the listed range are allowed.
7
8
Option 2: Select from a range of numbers
Developing a verbal scale for a range of numbers Useful if a specific number value isn’t available or when there is
some uncertainty around the actual value
Option 3: Select from multiple descriptive titles
Developing a verbal scale using descriptive titles
9
Build Rating Scales
10
There are options available for building Rating Scales
Option 1: Select from the Blueprints Pane Modify the scale(s) to better fit the criterion
Option 2: Copy from existing scales Edit the scales(s) to better fit the criterion
Option 1: Select from Blueprints Pane
11
The Decision Blueprints pane provides Sample Scales that may be used. Mouse over the Sample Scales while holding down the Ctrl key to see a quick view and see if they can be applied to rate the criterion
The Decision Blueprints pane provides Sample Scales that may be used. Mouse over the Sample Scales while holding down the Ctrl key to see a quick view and see if they can be applied to rate the criterion
Click and drag the chosen scale to the main workspace or click APPLY. After the sample scale is applied to the Decision, it can be modified to better match the criterion
Click and drag the chosen scale to the main workspace or click APPLY. After the sample scale is applied to the Decision, it can be modified to better match the criterion
21
Option 2: Copy from previously built scales
12
Select a scale from the drop-down list to copy a previously built scale, click APPLY, then edit accordinglySelect a scale from the drop-down list to copy a previously built scale, click APPLY, then edit accordingly1
Define Ratings
13
Click Show Rating Definitions to generate a pop-up window in which to define the scaleClick Show Rating Definitions to generate a pop-up window in which to define the scale
Highlight the criterion for which you want to define a scaleHighlight the criterion for which you want to define a scale1 2
Define the chosen criteria in the scale and click Hide Rating Definitions to close the windowsDefine the chosen criteria in the scale and click Hide Rating Definitions to close the windows3
Best Practices for Building Rating Scales
There is no “one size fits all” approach to ratings
As with initial criteria development, it works best for a small group to develop a strawman proposal that the larger group can validate
A four or five-point scale is preferred to a three-point scale as it allows for a greater level differentiation on large alternative sets
Rating values should be considered as ratio numbers, not interval numbers
Use Scale Definitions to define what constitutes a specific rating
14
Learn more atDLU.decisionlens.com