Upload
phamnhi
View
223
Download
5
Embed Size (px)
Citation preview
1
CHAPTER 3: METHODOLOGYLESSON #2: PILOT STUDY
Copyright © 2014 Dr. Rich Schuttler
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
Copyright © 2014 Dr. Rich Schuttler
2
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
• When is a Pilot Study Needed?
Copyright © 2014 Dr. Rich Schuttler
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
• When is a Pilot Study Needed?
• Who is in a Pilot Study?
Copyright © 2014 Dr. Rich Schuttler
3
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
• When is a Pilot Study Needed?
• Who is in a Pilot Study?
• How to Conduct a Pilot Study?
Copyright © 2014 Dr. Rich Schuttler
How to Conduct a Pilot Study?
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
• When is a Pilot Study Needed?
• Who is in a Pilot Study?
• How to Conduct a Pilot Study?
Copyright © 2014 Dr. Rich Schuttler
How to Conduct a Pilot Study?
• Examples from Prior Mentees
4
AGENDA
Wh t i Pil t St d ?• What is a Pilot Study?
• When is a Pilot Study Needed?
• Who is in a Pilot Study?
• How to Conduct a Pilot Study?
Copyright © 2014 Dr. Rich Schuttler
How to Conduct a Pilot Study?
• Examples from Prior Mentees
• Reflective Summary
What is a Pilot Study?
A method to ensureA method to ensure survey questions are developed to
obtain needed data.
Copyright © 2014 Dr. Rich Schuttler
5
What is a Pilot Study?
A method to verifyA method to verify how long it will take
for survey participant to
complete.Copyright © 2014 Dr. Rich Schuttler
What is a Pilot Study?
A method get expertA method get expert feedback on the
accuracy of tool to gain needed data.
Copyright © 2014 Dr. Rich Schuttler
6
What is a Pilot Study?
A method to improveA method to improve reliability of survey
instrument.
Copyright © 2014 Dr. Rich Schuttler
What is a Pilot Study?
Can meanCan mean
different things
t diff t l !to different people!
Copyright © 2014 Dr. Rich Schuttler
7
What is a Pilot Study?
According to Mackey and Gass (2005), the function of a pilot
study is to assess, make revisions, and make definitive
determinations about the study.
Copyright © 2014 Dr. Rich Schuttler
What is a Pilot Study?The pilot study allows the
researcher the opportunity toresearcher the opportunity to determine if the research structure was appropriate, determine interviewing techniques, and g q ,reflect based on the pilot test experience (Seidman, 2006).
Copyright © 2014 Dr. Rich Schuttler
8
When is a Pilot Study Needed?This can be subjective – so I
will share my approach forwill share my approach….for dissertation research….
Copyright © 2014 Dr. Rich Schuttler
When is a Pilot Study Needed?This can be subjective – so I
will share my approach forwill share my approach….for dissertation research….
ALWAYS!ALWAYS!
Copyright © 2014 Dr. Rich Schuttler
9
When is a Pilot Study Needed?
For newly
created instruments
Copyright © 2014 Dr. Rich Schuttler
When is a Pilot Study Needed?
Validated InstrumentsValidated Instruments
With
Different PopulationsDifferent Populations
Copyright © 2014 Dr. Rich Schuttler
10
When is a Pilot Study Needed?
Other situations …
Copyright © 2014 Dr. Rich Schuttler
WHO IS IN A PILOT STUDY?
SurveySurvey
Population
QualifiedQualified
Copyright © 2014 Dr. Rich Schuttler
11
How to Conduct a Pilot Study?
Depends on Research Method & Design
Copyright © 2014 Dr. Rich Schuttler
How to Conduct a Pilot Study?
Depends on Research Method & Design
Qualitative•Qualitative
Copyright © 2014 Dr. Rich Schuttler
12
How to Conduct a Pilot Study?
Depends on Research Method & Design
Qualitative•Qualitative
•Quantitative
Copyright © 2014 Dr. Rich Schuttler
How to Conduct a Pilot Study?
Depends on Research Method & Design
Qualitative•Qualitative
•Quantitative
•Mixed Method•Mixed Method
Copyright © 2014 Dr. Rich Schuttler
13
What is a Pilot Study?In Proposal:
• Describes how the survey instrument will be tested for accuracy
Copyright © 2014 Dr. Rich Schuttler
What is Chapter 3?In Dissertation:
• Describes how the survey instrument was tested for accuracy
Copyright © 2014 Dr. Rich Schuttler
14
Examples Provided• All examples are from my prior mentees
Copyright © 2014 Dr. Rich Schuttler
Examples Provided• All examples are from my prior mentees
• Most were approved on the first pass through reviews
Copyright © 2014 Dr. Rich Schuttler
15
Examples Provided• All examples are from my prior mentees
• Most were approved on the first pass through reviews
• Each provided me written consent to use ptheir work in this manner to help others complete their programs. They own the copyright to their work. My copyright for this program.
Copyright © 2014 Dr. Rich Schuttler
Dr. Dustin Pawlak - 2011
A PHENOMENOLOGICAL STUDY:A PHENOMENOLOGICAL STUDY: THE INFLUENCE OF PROFESSIONAL ATHLETES’ UNETHICAL BEHAVIOR ON AMATEUR ATHLETES
Copyright © 2014 Dr. Rich Schuttler
16
Dr. Dustin Pawlak Example
The pilot study involved administering th i t i t l t fthe interview protocol to a few volunteers similar to the demographics of the research pool that the researcher will find at the selected college institution The pilotselected college institution. The pilot test made certain the questions achieved the information sought-after in this study.
Copyright © 2014 Dr. Rich Schuttler
Dr. Dustin Pawlak Example
The pilot tests assist in determining if th ti l i lthe questions were logical, understandable, and clear to the participants (Seidman, 2006). Pilot testing the interview protocol offered a chance to discover discrepanciesa chance to discover discrepancies and make adjustments prior to administering the actual study.
Copyright © 2014 Dr. Rich Schuttler
17
Dr. Dustin Pawlak Example
Neuman (2003) noted the fimportance of pilot testing as a
manner for the researcher to develop their system for receiving and recording data and g gto discover aspects of the study in need of improvement.
Copyright © 2014 Dr. Rich Schuttler
Dr. Joseph Hage - 2013
INFLUENCE OF RELIGION AND RELIGIOSITY ON LEADERSHIP PRACTICESIN THE WORKPLACE: AIN THE WORKPLACE: A QUANTITATIVE CORRELATION STUDY
18
Dr. Joseph Hage Example The survey instruments were validated and
the derivative translations were reviewedthe derivative translations were reviewed and certified by professional linguists. Pilot testing is recommended to reveal errors in the design or problems with the instruments (Cooper & Schindler, 2011). In international research, pilot testing is important to reduce cultural, language, and response bias (Harzing, Reiche, & Pudelko, 2011).
Copyright © 2014 Dr. Rich Schuttler
Dr. Joseph Hage Example To this end, an appropriate sample size is
needed. By applying the central limit theorem, a sample size of n=30 or greater will result in the means of the sample to be distributed around the population mean approximately in a normal distribution (Cooper & Schindler 2011;distribution (Cooper & Schindler, 2011; Weiers, 2005). In this study, a research pilot test was performed using the LPI and URPI survey instruments.
Copyright © 2014 Dr. Rich Schuttler
19
Dr. Joseph Hage Example
As shown in Table 9, the pilot test sample consisted of 20 Muslims and 13 Christians. Convenience sampling is an accepted technique to validateaccepted technique to validate survey instruments (Neuman, 2011).
Copyright © 2014 Dr. Rich Schuttler
Dr. Joseph Hage Example The pilot testing process comprised
t t ( ) lid ti thtwo stages: (a) validating the translated instruments, and (b) creating the RPI, which is a derivative survey of the URPI. The results from the pilot study are reported in thethe pilot study are reported in the next chapter.
Copyright © 2014 Dr. Rich Schuttler
20
Dr. Joseph Hage Example Table 9
Pilot Study Data Sampling (N=33)
Participants Ratio
Muslims 20 60.6%
Christians 13 39.4%Christians 13 39.4%
Total 33 100.0%
Copyright © 2014 Dr. Rich Schuttler
Reflective Summary
• What is a Pilot Study?
• When is a Pilot Study Needed?
• Who is in a Pilot Study?
• How to Conduct a Pilot Study?
• Examples from Prior Mentees
Copyright © 2014 Dr. Rich Schuttler