24
Steps in Scale Development (DeVellis, 2003)

Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Embed Size (px)

Citation preview

Page 1: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

Page 2: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Specificity as an aid to clarity.

Page 3: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Page 4: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

Page 5: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

Page 6: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

Page 7: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

Page 8: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

Page 9: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

Page 10: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

7. Evaluate items.

Page 11: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

7. Evaluate items.

8. Produce final scale.

Page 12: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

7. Evaluate items.

8. Produce final scale.

Page 13: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

Page 14: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

6. Administer items to pilot sample.

Page 15: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

6. Administer items to pilot sample.

For focus group

Page 16: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

6. Administer items to pilot sample.

For focus group Pretest sample should resemble study

sample. Sample size 3 to 9 Discuss questions with respondents to find

confusion or ambiguity. Refine answer options. Time how long it takes.

Page 17: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

6. Administer items to pilot sample.

For pilot study

Page 18: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

6. Administer items to pilot sample.

For pilot study Pretest sample should resemble study

sample. n>20 Study descriptive statistics of items. Refine answer options. Time how long it takes. Test reliability. Revise scale based on reliability information Examine variance among respondents.

Page 19: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example

2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

7. Evaluate items.

8. Produce final scale.

Page 20: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Steps in Scale Development (DeVellis, 2003)

1. Determine clearly what it is you want to measure.

Theory as an aid to clarity.

Measuring “elusive phenomena that cannot be directly observed”.

Specificity as an aid to clarity.

Do you wish to measure a broad, general construct or a context-specific construct?

Locus of control example2. Generate an item pool.

3. Determine the format for measurement.

4. Have item pool reviewed.

5. Consider inclusion of validation items.

6. Administer items to pilot sample.

7. Evaluate items.

8. Produce final scale.

Page 21: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Locus of control example

Page 22: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Locus of control example

Internal-External Scale (Rotter, 1966)

Generalized, Broad, One dimension

Locus of Control

Page 23: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Locus of control example

Internal-External Scale (Rotter, 1966)

Generalized, Broad, One dimension

Locus of Control

Multidimensional Scale (Levinson, 1973)

Generalized,Three dimensions One’s

SelfPowerful Others

Luck or Chance

Page 24: Steps in Scale Development (DeVellis, 2003). 1.Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to

Locus of control example

Internal-External Scale (Rotter, 1966)

Generalized, Broad, One dimension

Locus of Control

Multidimensional Scale (Levinson, 1973)

Generalized,Three dimensions One’s

SelfPowerful Others

Luck or Chance

Multidimensional Scale (Wallston, Wallston & DeVellis, 1978)

Health,Three dimensions

One’s Self

Powerful Others

Luck or Chance

Health Health Health