View
325
Download
23
Category
Tags:
Preview:
Citation preview
Qualitative Methodsvs.
Quantitative Methods
Qualitative Methods?
Quantitative Methods?
(Some) Qualitative Methods
• (Participant) Observation
• Structural Analysis
• Case Studies
• Interviewing
• Questionnaires/Surveys
Surveys and Questionnaires
Why would you use Questionnaires and how would
you create and administer them?
Surveys and Questionnaires
• Why?
– One of the most common ways to gather data– Can be tailored to your needs– Can be an effective research source
Surveys and Questionnaires
• How?– Need to know
• Difference between question types• Techniques for question wording• Techniques for overall design of questionnaire• Finding a sample population• Effective ways to distribute and enhance the return
rate of questionnaires
Surveys and Questionnaires
Question Type• The more structured a question, the
easier it is to analyze• Many types of questions, but seven main
ones1. Verbal (or “Open”)2. List3. Category4. Ranking5. Scale6. Quantity7. Grid
Surveys and Questionnaires
Question Wording– What to watch: Ambiguity, Imprecision, &
Assumption• Perceived Commonality
– In-situ example: How much time, on average, do you spend studying? a) a great deal; b) a little bit; c) not at all
• Memory• Knowledge• Double Questions: e.g., “Do you attend math and
chemistry classes?”• Leading Questions: e.g., “Do you agree that
mature students earn better grades?”
Question Wording– What to watch: Ambiguity, Imprecision, &
Assumption• Presuming Questions are usually formed by a
researcher’s strong opinions or feelings – and not everyone feels that way; e.g., “Does the University provide Adequate Counseling?”
• Hypothetical Questions: “If you had no family responsibilities and plenty of money, what would you do with your life?”
• Offensive/Sensitive Issues (e.g., specific age, sexual orientation, grades, etc.)
Surveys and Questionnaires
Surveys and Questionnaires
Question Design– No matter how perfectly worded, a
questionnaire will lose much of its impact if it looks untidy
– Some guidelines:• Typed; nice, easy-to-read font• Clear instructions• Spacing (white space) between questions• Check boxes?• Order of questions is very important• Allow space for computer scoring (if applicable);
make certain of its impression
Surveys and Questionnaires
Finding a Sample
– Dependent on your time and project– Location– Should be representative of population in
your project
Distribution and Return of Questionnaires
– Face to face is best• Can explain questionnaire and take-back
immediately once complete
– If must leave-out/mail, include:• Explain the purpose of the study• Outline anonymity, if applicable• What approvals have been given (and by whom)• Indicate what will be done with the information
Surveys and Questionnaires
Surveys and Questionnaires
Reliability
• How reliable is your test, measurement, or survey?
• The extent to which a test (or survey or measurement) produces similar results under constant conditions on all occasions
• How to “test” for reliability– Test-retest– Alternate forms– Split-half
Validity
• Are the parts of your test, measurement, or survey a valid?
• Makes sure that an item measures what it’s supposed to measure– Unreliable = invalid; BUT reliable does not
necessarily = validity– Examine your items critically:
Surveys and Questionnaires
Example of a Survey: Good or Bad?-------------------------------------------
Evaluation of GCU674, Geographic Techniques for Teachers
Instructor: _____________________________Date: _____________________________
Please rate the following: "Great!" "Pretty Good"
"Just OK"
"Not Very
Helpful"
"Total Waste of
Time"
The information presented helped me understand basic techniques used in geography
The presenter clearly explained the information
The handouts were helpful
Do you still need to talk with your instructor to help clarify information about geographic techniques?
Would you use any of the information in your future research endeavors? Yes No
Comments:
IRB…or, is the Survey Harmful?
Institutional Review (IRB)
• An Institutional Review Board is a diverse group of scientific and non-scientific individuals who conduct the initial and ongoing review of behavioral and clinical research studies involving human subjects.
• It is the responsibility of the IRB to review all material related to a study to be sure standards of ethics are maintained. This is especially important in items that will be viewed by the study patient, such as the Informed Consent document, advertisements, diaries, and informational brochures.
• Often follow the “scientific method”– Create hypotheses, theories, models – Construct instruments and/or methods for
measurement and/or testing of hypotheses– Attempt to investigate, manipulate, and/or
control variables – Compile data – Replicate/Model and analyze data – Assess outcomes
• Stats, models, graphs, charts, tables, etc.
(Some) Quantitative Methods
Quantitative Data?
What is an Index?
• A way to Quantify the Unquantifiable
• Examples:– From everyday Life?
• Ranking movies, ranking hotels, ranking restaurants, best schools, best cities
– From schooling?• SAT, your GPA, grading scales in classes
– From geography?• Palmer Drought Severity index, Moh’s hardness
scale, sand mobility index, soil development index
Qualitative vs. Quantitative
• Can they overlap?
• “Mixed method” approach– Can use one or the other, or both– Must use each correctly– What if no previous research exists?
Reading
• Tufte, Edward. 1983. The Visual Display of Quantitative Information.
Recommended