AU MM Slides Jwc

8/10/2019 AU MM Slides Jwc

http://slidepdf.com/reader/full/au-mm-slides-jwc 1/59

How to Design a MixedMethods Study

by John W. Creswell, Ph.D. and Vicki . Plano Clark,M.S.

!ni"ersity o# $ebraska%incoln

&ndrews !ni"ersity, July, '(()



'



*

How would you co+bine two

tyes o# data-ualitati"e

/ext Data

/his is a sa+le o# atext 0le o# words that+ight be collected ontranscrits through

inter"iews, 0eldnotes#ro+ obser"ations, or#ro+ otically%scanned docu+ents.

uantitati"e$u+eric Data

'*)'1)*22''*'2*'

'**''1)*

*2'')*')*'2*')**

*'**)))2

''''222)*'2)*'2*

''222111

'**2)*')*'2*')**

*'2*1)*'



)

3b4ecti"es o# the

worksho5 et6s design a +ixed +ethods study et6s study how eole learn +ixed

+ethods research in this roo+-7or you can work on your own ro4ectand #ollow along at each ste8

et6s start with a title. Write a title. What data will we collect-



1

What are tyes o# 9uantitati"e and

9ualitati"e data- uantitati"e data

Close%ended

scales &ttitudinal:beha"i

oral scales ;eha"ioral

checklists Census,

attendancerecords

ualitati"e data 3en%ended

resonses Se+i%structured

inter"iews Se+i%structured

obser"ations <ecords:docu+ent

s Videotaes



=

et6s identi#y our 9uantitati"e and

9ualitati"e data collection



>

$ow let6s consider so+e reasons#or why we are collecting 7and

+ixing8 both #or+s o# data /ogether 9uantitati"e and 9ualitati"e data ro"ide both

recise +easure+ent and generali?ability o#9uantitati"e research and the in%deth, co+lex ictureo# 9ualitati"e research

/o "alidate 9uantitati"e results with 9ualitati"e data We do not ha"e an ade9uate instru+ent. /hus, we need

to exlore "iews and de"elo an instru+ent 3ur 9uantitati"e data ro"ide a general exlanation and

we need to #ollow%u with articiants and ha"e the+exlain the 9uantitati"e results

@n our exeri+ent, outco+es to be +easured are notenoughA they need to be co+le+ented byunderstanding the rocess o# articiants



B

et6s identi#y our reason #or +ixing



So /here are good reasons #or

gathering both #or+s o# data ;utthere are certain

re9uire+ents #or this to work best



2(

<e9uire+ent E25 $ow let6sconsider whether we ha"e the

skills, ti+e, and resources- We need +ini+u+ skills in both

9ualitati"e and 9uantitati"e data

collection. What do we need- We need ti+e and resources #or

extensi"e data collection and

analysis. How +uch ti+e andresources do we need-



22

Write down the skills, ti+e, and

resources we will need





2*

et6s identi#y the audiences



2)

;ut audiences +ay notrecogni?e it yet because it is

so new @ncreased use and accetance o#

9ualitati"e research #ro+ 2(6s to

resent /he co+lexity o# our research roble+stoday re9uires understanding trends,diFerences, as well as indi"idual stories,

setting @ndi"iduals ad"ocating #or and writingabout +ixed +ethods research as adistinct, new rocedure 7e.g., books8



21

/hey +ay think that it is

analy?ing data searatelyQuantitative Data Qualitative Data

Mixing: converging the data or connecting

the data



2=

;ut how do we +ix-Converge data:

ual uan<esults

Connect data:

ual uan <esults



2>

Why our audience +ay

recogni?e it /he e"idence

;ooks Methodological articles Many ublished research studies

using it

Gederal agencies Pri"ate #oundations



2B



2

3ther writings, initiati"eson +ixed +ethodsresearch5 <esearch studies reorted in 4ournals Methodological articles exloring issues

and rocedures Website #or bringing +ixed +ethodswriters together

Con#erence sessions Handbook of Mixed Methods in Social

and Behavioral Research

Pri"ate #oundation interestA #ederalagency interest





'2

uotes5 ICo+bining 9ualitati"e and 9uantitati"e

+ethods has gained broad aeal inublic health research. /he key 9uestionhas beco+e not whether it is accetableor legiti+ate to co+bine +ethods, butrather how they will be co+bined to be+utually suorti"e and how 0ndings

achie"ed through diFerent +ethods willbe integrated. 7$@H, 3Kce o# ;eha"ioraland Social Science <esearch, 28.



''

$ational &cade+y o#

Sciences /hree +a4or research 9uestions in9uality educational research5

L What is haening- 79ualitati"e design

L @s there a syste+atic eFect- 7a 9uantitati"e exeri+ent8

L Why or how it is haening-7a 9ualitati"e #ollowu8



'*

;ut e"en i# they recogni?e it, they+ay not areciate or understand

how to design a +ixed +ethodsstudy IWe are interested in a rando+i?ed

control trial with a non%exeri+ental

aroach e+bedded within it. 7ari"ate #oundation oKcer8

IWe accet +ulti%+ethod studies, butin"estigators +ostly do not sort out the

co+lexity o# these ro4ects so that wecan understand the+. 7a #ederalro4ects oKcer8.



')

We need to de0ne +ixed+ethods research #or our

audiences Mixed methods research is a design #or

collecting, analyzing, and mixing bothquantitative and qualitative data in asingle study or series of studies tounderstand a research roble+.

/he urose o# this #or+ o# research isthat both 9ualitati"e and 9uantitati"e

+ethods, in co+bination, ro"ide a betterunderstanding o# a research roble+ orissue than either +ethod alone.



'1

$ow we could +ix within singlestudies or +ultile studies

Single Study:

<esults

ualuan

Multiple Studies (called multimethod researc

Study 2 Study ' Study * Study )

uan ual ual uan



'=

So how do we design a+ixed +ethods study-

/he +odel

Type of mixed methods design

Procedures for:•designing the title•writing the introduction to a study

•writing the purpose statement and research questions/hypotheses•data collection•data analysis•writing the mixed methods report•evaluating the mixed methods research

World"iews, theoretical #ra+eworks, roble+ and research9uestion, skills, resources



'>

What is a world"iew-

Philosohy about your re#erences #or howyou learn about so+ething through research

ou re#er the 9uantitati"e world"iew5you are the exert, you decide what needsto be learned, you build in ob4ecti"ity

ou re#er the 9ualitati"e world"iew5articiant is the exert, articiant hels

you build knowledge, you bring ersonalbias in

ou re#er both the 9uantitati"e and9ualitati"e world"iew



'B

/he next stes in lanningour study

et6s write the o"erall research9uestion #or our study



'

/hen let6s choose a tye o#+ixed +ethods study to

conduct What designs are ossible-



*(

/yes o# +ixed +ethodsdesigns

I. Triangulation Mixed Methods Design

II. Nested Mixed Methods Design

QUAN

Data and Results

QUAN

Pre-test

Data and Results

+ QUAL

Data and Results

QUAN

Post-test

Data and Results

Interpretation

Qual Process



*2

/yes o# +ixed +ethodsdesigns

III. Explanatory Mixed Methods Design

IV. Exploratory Mixed Methods Design

QUAN

Data and Results

QUAL

Data and Results

qualData and

Results

quan

Data and Results

Follow-up

uilding



*'

/riangulation Design5Characteristics

Collecting both 9uantitati"e and 9ualitati"e data Collecting these data at the sa+e ti+e in the

research rocedure &naly?ing the 9uantitati"e and 9ualitati"e data

searately Co+aring or co+bining the results o# the

9uantitati"e and 9ualitati"e analysis

Nxa+le5 collect sur"ey data 79uantitati"e8 andcollect indi"idual inter"iews 79ualitati"e8 andthen co+are the results



**

/riangulation Design5When is it used-

When you want to co+bine thead"antages o# 9uantitati"e 7trends, largenu+bers, generali?ation8 with 9ualitati"e7detail, s+all nu+bers, in%deth8

When you want to "alidate your9uantitati"e 0ndings with 9ualitati"e data

When you want to exand your9uantitati"e 0ndings with so+e oen%ended 9ualitati"e data 7e.g., sur"ey withclosed% and oen%ended data8





*1

$ested Design5Characteristics

Collecting both 9uantitati"e and 9ualitati"e data Collecting both tyes o# data at the sa+e ti+e Ha"ing 3$N #or+ o# data lay a s+aller role in the

study than the other #or+ o# data &lso,

!sing one #or+ o# data to answer one 9uestionA the other#or+ another 9uestion

Collecting one #or+ o# data at one le"el o# analysis and

another at another le"el o# analysis Nxa+le5 ou conduct an exeri+ent and during

the exeri+ent you gather 9ualitati"e inter"iewdata. /he outco+es o# the exeri+ent assessed9uantitati"ely address diFerent 9uestions than therocess o# the exeri+ent exlored 9ualitati"ely.



*=

$ested Design5 When is itused-

When you do not ha"e ti+e orresources to co++it to extensi"e

9uantitati"e and 9ualitati"e datacollection When you want to study the rocess

o# an exeri+ent as well as the

outco+es When you want to exa+ine diFerent

le"els in an organi?ation



*>

uan

Data collectionPre%test

uanData collectionPost%test

Process O collectionand analysis o# 9ualitati"e

data

$ested <esearch Design

Nxeri+ent

@nter"ention



*B

Nxlanatory Se9uentialDesign5 Characteristics

Viewing the study as a two%hase ro4ect Collecting 9uantitati"e data 0rst #ollowed

by collecting 9ualitati"e data second /yically, a greater e+hasis is laced on

the 9uantitati"e data in the study Nxa+le5 ou 0rst conduct a sur"ey and

then #ollow u with a #ew indi"iduals whoanswered ositi"ely to the 9uestionsthrough inter"iews



*

Nxlanatory Se9uentialDesign5 When do you useit- When you want to exlain the

9uantitati"e results in +ore deth

with 9ualitati"e data 7e.g., statisticaldiFerences a+ong grous, indi"idualswho scored at extre+e le"els8

When you want to identi#yaroriate articiants to study in+ore deth 9ualitati"ely



Here is an exa+le o# an exlanatory design5

Quantitative ata!

"um#er of cigarettes

C$S%% Qualitative ata!

Semi%structuredintervie&s' audio

recorded andtranscri#ed

Data collected 2( ti+eso"er the course o# acalendar year #or )(articiants

Quantitative nalysis

raphic plot of C$S%% scores over timefor each participant

raphic plot ofcigarettes*day valuesover time for eachparticipant

Case Selection Qualitative nalysis

escription of eachcase

+denti,cation of lifeevents occurringduring criticalmonths &heresmo-ing increased or

decreased .hematic analysis of

life events for eachcase

Cross%case thematicanalysis

+nterpretation

/hy did changes insmo-ing occur0

uantitati"eData Collection

79uan8

ualitati"eData Collection

@nterretation Obased on 9uan

and !& results

ualitati"eData &nalysis

7!&8

Case Selectionuantitati"eData &nalysis

79uan8

Selected 1 casesmaximally varying+denti,ed criticalmonths in &hichsmo-ing varied

Creswell et al. 7in rogress8

Q



)2

Nxloratory Se9uentialDesign5 Characteristics

Viewing the study as a two%hase ro4ect ualitati"e data collection recedes

9uantitati"e data collection /yically, greater e+hasis is laced on

the 9ualitati"e data in the study Nxa+le5 ou collect 9ualitati"e diary

entries, analy?e the data #or the+es, and

then de"elo an instru+ent based on thethe+es to +easure attitudes on a9uantitati"e sur"ey ad+inistered to alarge sa+le.



)'

Nxloratory Se9uentialDesign5 When do you useit- /o de"elo an instru+ent when

one is not a"ailable 70rst exlore,

then de"elo instru+ent8 /o de"elo a classi0cation or

tyology #or testing

/o identi#y the +ost i+ortant"ariables to study 9uantitati"elywhen these "ariable are not known



!hase I Qualitative "esear#h - $ear %

Qualitative Data &olle#tion 'nstru#tured Interviews -

() parti#ipants

* oservations at the site

%, do#uents

Qualitative Data nalysis Text nalysis/ 'sing Q0" N,

Qualitative FindingsDevelopent o1 #odes and thees

1or ea#h site

!hase II Quantitative "esear#h - $ear 2

Quantitative Instruent Developent

Quantitative Test o1 the Instruent

&reate approxiately a *)-ite

instruent plus deographi#s

dinister survey to ()) individuals

Deterine 1a#tor stru#ture o1 ites and

#ondu#t reliaility analysis 1or s#ales

Quantitative "esults

Deterine how groups di11erusing N3V test

Sequential Exploratory Mixed Methods Design



))

How will we analy?e the 9uantitati"eand 9ualitati"e data 7within the

design tyes8-

ualitati"e

analysis /ext:i+age data Coding /he+es Descrition @nterrelated

the+es

/yes o# analysis5 uantitati"e

analysis $u+eric data Descriti"e trend

analysis

Hyothesis testing,eFect si?e, inter"alesti+ates



)1

/riangulation data analysis

!&$data collection

!&$data analysis

!&data collection

!& data analysis

<esults

L Searate !&$and !& dataanalysis

L /wo otionsL Data trans#or+ation 7change!& to !&$ or !&$ to !&8L Co+arison 7kee searate andco+are:contrast8

/able Nxa+le o# Data /rans#or+ation o# /ext !nits into $u+eric Data



CountAdjCount!!Ro" PctColu#n Pct

Patients N$%

Ph&sicians N$'

Medical Assistants N$'

(he#es

)a#iliarit&*ith the)or#

+,.'+/.0

+1'%.%1',2

+/'1.,21.,

'/+..+222

Reactions tothe )or#

%,++.

%%%+2%

+22%.2

'0,+1'

++.,

%/.+/

+0'.+1.

+222

Use 3orManagingDe4ression

1,,.,0%/0

+11''%..+2,21

,/2+2'+22

%0201.+222

Changes tothe )or#

++..1.

,1..++

+/'/2

,%2,'2

+01'0

,2..+1

'/0+.,,

+222

5ituationalUse o3 the)or#

1,.0/,+

0%+..''+'/

.0+'.,1++

+.+,/.+222

%%.++%.

+222

.1+''2

+222

,+/2,

+222

/able. Nxa+le o# Data /rans#or+ation o# /ext !nits into $u+eric Data



)>

uan

Data collectionPre%test

uanData collectionPost%test

ualitati"e Process

$ested data analysis

Post%test scoresor gain scores

/he+es:Codes:@nterrelated /he+es

Pre%testscores

Data&nalysis

Co+are:Describe <esults

uantitati"e Nxeri+ent

@nter"ention



)B

Nxlanatory se9uential dataanalysis

!&$data analysis

L Statistical resultsL 3utlier casesL Nxtre+e cases

ualdata collection

7urose#ul sa+ling8

L Select cases based on s.d. "ariablesL Select cases to reresent outliersL Select cases to reresent extre+e casesL Select cases to +ake grou co+arisons

ual

analysis

L codesL the+esL cases



)

Nxloratory se9uential dataanalysis

!& dataanalysis

uotes

Codes

/he+es

uan data analysisinstru+ent de"elo+ent

@te+s on a sur"ey

Variables on a sur"ey

Scales on a sur"ey



1(

et6s identi#y how we will analy?ethe data



12

Drawing our Design

et6s draw a icture o# our design @denti#y the tye o# design &dd in data collection &dd in data analysis

Show the Row o# acti"ities &dd in Iroducts #or our

audiences



1'

Hel#ul tis #or creating this "isual5

2. i"e a title to the "isual +odel.'. Choose either hori?ontal or "ertical layout #or the +odel.*. Draw boxes #or 9uantitati"e and 9ualitati"e stages o# data

collection, data analysis and interretation o# the study

results.). !se caitali?ed 7!&$8 or s+all letters 79uan8 to designate

riority o# 9uantitati"e and 9ualitati"e data collection andanalysis.

1. !se single%headed arrows to show the Row o# rocedures inthe design.

=.

Seci#y rocedures #or each 9uantitati"e and 9ualitati"e datacollection and analysis stage.>. Seci#y exected roducts or outco+es o# each 9uantitati"e

and 9ualitati"e data collection and analysis rocedure.B. Make your +odel si+le.. Si?e your +odel to one age.

$ l t6 k



1*

$ow let6s rework oururose state+ent usingso+e scrits



1)

I/he urose o# this concurrent +ixed +ethods studyis to better understand a research roble+ bycon"erging both 9uantitati"e 7nu+eric8 and

9ualitati"e 7text or i+age8 data. @n this aroach, 79uantitati"e instru+ents8 will be used to+easure the relationshi between the 7indeendent "ariables8 and 7deendent

"ariables8. &t the sa+e ti+e in the study, the 7central heno+enon8 will be exloredusing 79ualitati"e inter"iews,docu+ents, obser"ations, "isual +aterials8 with

7articiants8 at 7the research

site8.

Sa+le Scrit #or a ConcurrentDesign

7/riangulation or $ested8



11

I/he urose o# this two%hase, exloratory +ixed+ethods study will be to exlore articiant "iewswith the intent o# using this in#or+ation to de"elo

and test an instru+ent with a sa+le #ro+ aoulation. /he 0rst hase will be a 9ualitati"eexloration o# a 7central heno+enon8 bycollecting 7data8 #ro+ 7articiants8 at 7research site8. /he+es #ro+this 9ualitati"e data will then be de"eloed into aninstru+ent 7or sur"ey8 so that the 7theoryand research 9uestions:hyotheses8 can be testedthat 7relate, co+are8

7indeendent "ariable8 with 7deendent

Sa+le Scrit #or a Se9uential Nxloratory

Design



1=

I/he urose o# this two%hase, exlanatory +ixed+ethods study will be to obtain statistical,9uantitati"e results #ro+ a sa+le and then #ollow%u

with a #ew indi"iduals to robe or exlore those resultsin +ore deth. @n the 0rst hase, 9uantitati"eresearch 9uestions or hyotheses will address therelationshi or co+arison o# 7indeendent8and 7deendent8 "ariables with 7articiants8 at 7the research site8. @n thesecond hase, 9ualitati"e inter"iews or obser"ationswill be used to roble+ signi0cant 79uantitati"eresults8 by exloring asects o# the 7central

heno+enon8 with

Sa+le Scrit #or a Se9uential Nxlanatory



1>

Criteria #or e"aluating our lan5

!se aroriateter+inology #or title anddesign

Pro"ide a rationale #or

+ixing and include itearly in the study7Iwhen you use8

Create a +ixed +ethodsurose state+ent

@denti#y tyes o# 9ualand 9uan data to becollected and 9ual and9uan data analysisstes

@nclude a"isual:roceduraldiagra+ o# +ethods

with ti+eline !se rigorous

rocedures #or the9uantitati"e data

collection andanalysis

t6 h d i #



1B

et6s share our drawings o#our +ixed +ethods

rocedures



How to Design a MixedMethods Study

by John W. Creswell, Ph.D. and Vicki . Plano Clark,M.S.

!ni"ersity o# $ebraska%incoln

&ndrews !ni"ersity, July, '(()

Documents

AU MM Slides Jwc