Survey Que Research

PowerPoint presentation to accompany Research Design Explained 6th edition; 2007 Mark Mitchell & Janina JolleyChapter 8Survey Research

PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina Jolley

PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyOverviewQuestions to ask before doing survey researchThe advantages and disadvantages of different survey instrumentsPlanning your surveyAdministering your surveyAnalyzing your data


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyQuestions to Ask Before Doing Survey ResearchDo you have a clear hypothesis?Do your questions focus on that hypothesis?Will participants answers provide accurate answers to your questions?*To whom will your results apply?*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyAnswers May Be Inaccurate Because:People dont know the causes of their own behaviorPeoples memories are inaccuratePeople are not good at predicting their future behaviorPeople are not telling you what they know because ofSocial desirability biasDemand characteristicsResponse sets


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyGeneralizing Your ResultsDo you know what your population is?How can you get a representative sample of that population?Will nonresponse bias prevent you from generalizing your results to that population?


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyAdvantages and Disadvantages of Survey Research:ConclusionsEasy way to get a lot of informationHowever, that information:Will not have internal validityMay not have construct validity because of self-report problems May not have external validity because of poor sampling or because of nonresponse biasMay not answer research question because survey questions werent focused on hypotheses


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyThe Advantages and Disadvantages of Different Survey Instruments

Written Instruments *Interviews*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyWritten InstrumentsSelf-administered questionnairesCheap, easy to distribute to large sample--but nonresponse bias is big problemAnonymous which may promote honest responsesInvestigator-administered questionnairesHigher response ratesMay hurt sense of anonymity and thus decrease honesty of responsesNote: A highly refined version of the investigator-administered questionnaire is the psychological test*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyPsychological testsMay be part or all of a questionnaireEven if you dont use questions from tests, you can try to use strategies that test-makers use*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyThings Questionnaire Writers Can Learn from Test MakersPretest questions and measureStandardize how measure is administeredBe objectiveBe aware of response setsSeek evidence for measures reliability and validity


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyInterviewsMay be worth added expense ifIt increases response rateNeed ability to clarify questions, follow up on responsesMay not be worth added expense if construct validity is harmed byInterviewer biasParticipant trying to impress interviewerTelephone interviews may be ideal solution*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyAdvantages of Telephone InterviewsCheaper than face-to-face interviewsCan have high relatively high response rateInterviewer bias controlled byLack of body cuesMonitoring/taping interviewers calls


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyPlanning a SurveyDeciding on a research questionChoosing the format of your questions*Choosing the format of your interview--if you use an interview*Editing your questions*Sequencing your questions*Refining your survey instrument*Choosing a sampling strategy*


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyChoosing the Format of Your QuestionsFixed alternativeYes/NoReliableNot powerfulLikertOpen-endedMay not be properly answeredMay be difficult to score


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyChoosing the Format of Your InterviewUnstructuredInterviewer bias is a serious problemData may not be hard to analyzeSemi-structuredFollow-up questions allowedProbably best for pilot studiesStructuredStandardized, reducing interviewer bias


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyEditing Questions: Nine Mistakes to Avoid1. Avoid leading questions2. Avoid questions that invite the social desirability bias3. Avoid double-barreled questions4. Avoid long questions5. Avoid negations6. Avoid irrelevant questions7. Avoid poorly worded response options8. Avoid big words9. Avoid ambiguous words & phrases


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleySequencing QuestionsTo boost response rate, put innocuous questions first, personal questions lastTo avoid wasting time, qualify earlyTo increase accuracy, keep similar questions togetherTo boost response rate, put demographic questions last


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyPutting the Final Touches on Your Survey InstrumentProfessional appearanceProof readingPilot testingPractice coding responses--may lead to refining questionnaire so that it is easier to code responses


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyChoosing a Sampling StrategyRandom samplingProportionate stratified random samplingConvenience samplingQuota samplingConclusionsOnly random sampling will be representativeNonresponse bias may ruin your sample


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyAdministering the SurveyInformed consentClear instructionsDebriefingConfidentiality


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyAnalyzing Survey DataSummarizing dataInferential statistics


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleySummarizing DataInterval or ratio dataMeanCorrelation coefficientsTables of meansNominal dataFrequencies, percentagesPhi coefficientTables of frequencies


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyUsing Inferential StatisticsInterval or ratio dataLooking at relationships between pairs of variablesIf have two groups, could use t-test between meansIf not, should use test to see whether the correlation between two variables was significantBe aware that if you do numerous statistical tests, you may be setting yourself up for a Type 1 errorTo look at more than two variables at once, you can doANOVAMultivariate analysis of variance, multiple regression, factor analysis, and other sophisticated tests


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyUsing Inferential StatisticsNominal dataChi-Square testBe aware that if you do numerous statistical tests, you may be setting yourself up for Type 1 errors


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyConcluding RemarksSurvey research is the most used research methodSurvey research is the most misused research methodYou know how to use rather than abuse survey research


PowerPoint presentation to accompany Research Design Explained ,6th edition; 2007 Mark Mitchell & Janina JolleyThe End


**************************

Documents

Survey Que Research