Multiple Choice Golden Rules

Preview:

Citation preview

This presentation was developed for the exclusive use of students enrolled in:

Educational Testing & Grading, Professor Gregory E. Stone.

© 2004 Gregory E. Stone. All rights reserved. This presentation may not be reproduced in any form, in part or as a whole, without the express written permission of the author.

1. Simple, Direct, Concise1. Simple, Direct, Concise

Avoid presenting irrelevant information.

Of the following gentlemen, who was elected president by a majority of the citizens of the United States after the Civil War?

A. Abraham LincolnB. Andrew JacksonC. Andrew JohnsonD. Ulysses S. Grant

Of the following gentlemen, who was elected president by a majority of the citizens of the United States after the Civil War?

A. Abraham LincolnB. Andrew JacksonC. Andrew JohnsonD. Ulysses S. Grant

Of the following, who was elected president of the United States after the Civil War?

A. Abraham LincolnB. Andrew JacksonC. Andrew JohnsonD. Ulysses S. Grant

2. Parallel response options2. Parallel response options

Make certain options are grammatically correct and of

parallel content.

Christopher Columbus travelled to America in a

A. airplane.B. boat.C. car.D. forest.

Christopher Columbus travelled to America in a

A. airplane.B. boat.C. car.D. forest.

Christopher Columbus travelled to America in a/an

A. airplane.B. boat.C. car.D. train.

3. Plausible and real 3. Plausible and real

Don’t make up nonsense terms. Ensure that incorrect answers are reasonable but clearly incorrect.

The free-floating structures within the cell that synthesize protein are called

A. chromosomes.B. free ribosomes.C. lysomenes.D. mediocrities.

The free-floating structures within the cell that synthesize protein are called

A. chromosomes.B. free ribosomes.C. lysomenes.D. mediocrities.

The free-floating structures within the cell that synthesize protein are called

A. chromosomes.B. free ribosomes.C. lysomenes.D. mitochondria.

4. Alphabetize options 4. Alphabetize options

Alphabetizing options ensures a true randomization of responses (i.e. A is not always the correct

answer).

Which of these instruments is used to measure humidity?

A. hygrometerB. barometerC. anemometerD. thermometer

Which of these instruments is used to measure humidity?

A. hygrometerB. barometerC. anemometerD. thermometer

Which of these instruments is used to measure humidity?

A. anemometerB. barometerC. hygrometerD. thermometer

5. Option length similar 5. Option length similar

Ensure that your correct answer and incorrect answers are of the

same length.

Which of the following best illustrates the law of diminishing returns?

A. Short supplyB. Over populationC. Decreased utilityD. A factory doubled its labor force and increased production by 50 percent.

Which of the following best illustrates the law of diminishing returns?

A. Short supplyB. Over populationC. Decreased utilityD. A factory doubled its labor force and increased production by 50 percent.

Which of the following best illustrates the law of diminishing returns?

A. A factory doubled its labor force and increased production by 50 percent.B. A machine decreased in utility as its parts became worn.C. The demand for a farm product increased faster than the supply of the product.D. The population of a country increased faster than the means of subsistence.

6. Avoid repeating words 6. Avoid repeating words

If all the options begin with “the”, simply move “the” up into the

stem.

Pascal’s Law may be used to explain the operation of

A. a leverB. an electric fan.C. an empty bucket.D. a syringe.

Pascal’s Law may be used to explain the operation of

A. a lever.B. an electric fan.C. an empty bucket.D. a syringe.

Pascal’s Law may be used to explain the operation of a/an

A. electric fan.B. hydraulic break. C. empty bucket.D. syringe.

7. Don’t be ambiguous 7. Don’t be ambiguous

Avoid using terms like “usually” “often” or “rarely” - these require

speculation. Be specific!

8. Avoid the Use of Negatives 8. Avoid the Use of Negatives

Reverse thought questions may be easy to write but are generally

just confusing - and perform poorly.

Which of the following states is not north of the Mason-Dixon line?

A. MaineB. New YorkC. PennsylvaniaD. Virginia

Which of the following states is not north of the Mason-Dixon line?

A. MaineB. New YorkC. PennsylvaniaD. Virginia

Which of the following states is south of the Mason-Dixon line?

A. MaineB. New YorkC. PennsylvaniaD. Virginia

9. Avoid abbreviations 9. Avoid abbreviations

Use abbreviations only where they are standard, should be

remembered and are printed in textbooks/standards.

10. Avoid regional biases 10. Avoid regional biases

Not all students come from YOUR community or background.

Ensure all items are fair for a diverse culture.

11. Order numbers and letters 11. Order numbers and letters

When letters or numbers are the options, ensure that they are

alphabetized and/or in numerical order.

With which of the following vitamins is milk most often fortified?

A. Vitamin DB. Vitamin CC. Vitamin BD. Vitamin A

With which of the following vitamins is milk most often fortified?

A. Vitamin DB. Vitamin CC. Vitamin BD. Vitamin A

With which of the following vitamins is milk most often fortified?

A. Vitamin AB. Vitamin BC. Vitamin CD. Vitamin D

12. Options should be independent and mutually

exclusive.

12. Options should be independent and mutually

exclusive.

Do NOT overlap item options

The founding fathers included

A. Jefferson, Lincoln and WashingtonB. Lincoln, Jefferson and AdamsC. Adams, Jefferson and WashingtonD. Washington, Lincoln and Nixon

The founding fathers included

A. Jefferson, Lincoln and WashingtonB. Lincoln, Jefferson and AdamsC. Adams, Jefferson and WashingtonD. Washington, Lincoln and Nixon

Who among the following is consideredto be one of America’s “founding fathers?”

A. JacksonB. JeffersonC. LincolnD. Nixon

Disco was a dominant musical form between which years?

A. 1960-1970B. 1970-1980C. 1980-1990D. 1990-2000

Disco was a dominant musical form between which years?

A. 1960-1970B. 1970-1980C. 1980-1990D. 1990-2000

Disco was a dominant musical form between which years?

A. 1960-1969B. 1970-1979C. 1980-1989D. 1990-1999

13. Don’t clue the answer 13. Don’t clue the answer

Avoid using associations, phrases or similarity in option wording that

my “clang” with the stem.

Which of the following organizations should you contact to find out about a tornado warning in your locality?

A. Local radio stationB. State farm bureauC. United States Post OfficeD. United States Weather Bureau

Which of the following organizations should you contact to find out about a tornado warning in your locality?

A. Local radio stationB. State farm bureauC. United States Post OfficeD. United States Weather Bureau

Which of the following organizations should you contact to find out about a tornado warning in your locality?

A. Nearest radio stationB. State farm bureauC. United States Post OfficeD. United States Weather Bureau

14. Don’t teach 14. Don’t teach

Exams are not meant as learning exercises. Leave teaching to the schools. Let the learning occur

before and after the exam.

Most of South America was settled by colonists from Spain. How would you account for the large numbers of Spanish colonists settling there? They

A. wanted lower taxes.B. were seeking religious freedom.C. were adventurous.D. were in search of wealth.

Most of South America was settled by colonists from Spain. How would you account for the large numbers of Spanish colonists settling there? They

A. wanted lower taxes.B. were seeking religious freedom.C. were adventurous.D. were in search of wealth.

Spanish colonists settled most of South America in search of

A. adventure.B. lower taxes.C. religious freedom.D. wealth.

15. Watch those negatives 15. Watch those negatives

Negative questions are sneaky -- ensure that there is no reverse

polarity

Which of the following is not a safe driving practice on icy roads?

A. Accelerating slowly.B. Holding the wheel firmly.C. Not slamming on brakes.D. Not slowing down gradually.

Which of the following is not a safe driving practice on icy roads?

A. Accelerating slowly.B. Holding the wheel firmly.C. Not slamming on brakes.D. Not slowing down gradually.

Which of the following is considered a safe driving practice on icy roads?

A. Accelerating quickly.B. Braking gently and slowly.C. Holding the wheel with one hand.D. Making sharp turns.

16. Refer to a learning objective 16. Refer to a learning objective

Ensure that all items closely match your objectives - you can’t

test what you don’t talk about

17. Avoid biased language 17. Avoid biased language

Try not to be offensive to any particular racial, ethnic, gender etc

group.

18. Present a Problem 18. Present a Problem

A complete problem should be presented in the stem. Don’t

make candidates read the entire item before they figure out your

question.

The artificial satellite with the highest orbital speed

A. is the most recently launched satellite.B. is the satellite in the higher orbit.C. is the satellite in the lower orbit.D. is the satellite with an orbit closest to the equator.

The artificial satellite with the highest orbital speed

A. is the most recently launched satellite.B. is the satellite in the higher orbit.C. is the satellite in the lower orbit.D. is the satellite with an orbit closest to the equator.

Does the artificial satellite in higher or lower orbit have the higher orbital speed?

A. Higher orbit.B. Lower orbit.C. Orbit speeds are identical.

19. Straightforward vocabulary 19. Straightforward vocabulary

Don’t use $100 words when a $25 word will do just fine.

20. All and Nothing 20. All and Nothing

Avoid the use of All or None of the Above in your responses.

Which of the following characteristics is not a difference between a trumpet and a trombone?

A. Both are made primarily of metal.B. Both can play notes an octave below middle C.C. Both can change pitch primarily with valves.D. All of the above.E. None of the above.

Which of the following characteristics is not a difference between a trumpet and a trombone?

A. Both are made primarily of metal.B. Both can play notes an octave below middle C.C. Both can change pitch primarily with valves.D. All of the above.E. None of the above.

Which of the following is true of both trumpets and trombones? They

A. are made primarily of metal.B. can play notes an octave below middle C.C. can change pitch primarily with valves.

Questions & CommentsQuestions & Comments

Recommended