15
Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech University of Colorado Denver Anthony J. Onwuegbuzie Sam Houston State University The purposes of this paper are to outline seven types of qualitative data analysis techniques, to present step-by-step guidance for conducting these analyses via a computer-assisted qualitative data analysis software program (i.e., NVivo9), and to present screenshots of the data analysis process. Specifically, the following seven analyses are presented: constant comparison analysis, classical content analysis, key- word-in-context, word count, domain analysis, taxonomic analysis, and componential analysis. It is our hope that providing a clear step-by-step process for conducting these analyses with NVivo9 will assist school psychology researchers in increasing the rigor of their qualitative data analysis procedures. Keywords: qualitative data analysis, NVivo, qualitative research, computer-assisted qualitative data analysis software School psychology researchers have many available tools in order to complete successfully their research. For example, it is commonly known that school psychology researchers can utilize published surveys, web-based data col- lection tools (e.g., Zoomerang), and quantitative computer programs (e.g., SPSS) to assist with their analyses. These tools are extremely bene- ficial for school psychology researchers because they assist them with many of the steps required in a quantitative research study. Unfortunately, available tools for qualitative research studies are less commonly known, which may contrib- ute to there being relatively few purely qualita- tive studies published in the area of school psychology (Powell, Mihalas, Onwuegbuzie, Suldo, & Daley, 2008). Indeed, Powell et al. (2008) documented that of the 438 empirical articles published in the four leading school psychology journals (i.e., School Psychology Quarterly, School Psychology Review, Psychol- ogy in the Schools, Journal of School Psychol- ogy) between 2001 and 2005, only 6 repre- sented qualitative research articles. Yet, utiliz- ing these tools, such as QDA Miner, Ethnograph, and NVivo (QSR International Pty Ltd, 2008), can increase the rigor of a qualita- tive study (Onwuegbuzie & Leech, 2007), es- pecially those with large data sets. For many school psychology researchers, the most complicated step in the research process is that of analysis (Gliner, Morgan, & Leech, 2009; Leech & Onwuegbuzie, 2007). Knowing which analysis to use with different types of research questions and various types of data can be very confusing, especially for a novice re- searcher. This is even a more prominent issue with qualitative data because many school psy- chology researchers have not had much training in qualitative methods, and they are often not knowledgeable about different qualitative data analysis techniques (Leech & Goodwin, 2008). Consistent with our assertion, Powell et al. (2008) reported that of the 57 National Associ- ation of School Psychology-approved graduate- level school psychology programs, only 1 (1.75%) appeared to require that students enroll in one or more qualitative courses, and 11 (19.3%) appeared to offer one or more qualita- tive courses as an elective. For school psychologists who conduct quali- tative research, there is available guidance and tools to assist in analysis. When looking for Nancy L. Leech, School of Education and Human De- velopment, University of Colorado Denver; Anthony J. On- wuegbuzie, Department of Educational Leadership and Counseling, Sam Houston State University. Correspondence concerning this article should be ad- dressed to Nancy L. Leech, University of Colorado Denver, School of Education and Human Development, Campus Box 106, PO Box 173364, Denver, CO 80217. E-mail: [email protected] School Psychology Quarterly © 2011 American Psychological Association 2011, Vol. 26, No. 1, 70 – 84 1045-3830/11/$12.00 DOI: 10.1037/a0022711 70

Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

Beyond Constant Comparison Qualitative Data Analysis:Using NVivo

Nancy L. LeechUniversity of Colorado Denver

Anthony J. OnwuegbuzieSam Houston State University

The purposes of this paper are to outline seven types of qualitative data analysistechniques, to present step-by-step guidance for conducting these analyses via acomputer-assisted qualitative data analysis software program (i.e., NVivo9), and topresent screenshots of the data analysis process. Specifically, the following sevenanalyses are presented: constant comparison analysis, classical content analysis, key-word-in-context, word count, domain analysis, taxonomic analysis, and componentialanalysis. It is our hope that providing a clear step-by-step process for conducting theseanalyses with NVivo9 will assist school psychology researchers in increasing the rigorof their qualitative data analysis procedures.

Keywords: qualitative data analysis, NVivo, qualitative research, computer-assisted qualitativedata analysis software

School psychology researchers have manyavailable tools in order to complete successfullytheir research. For example, it is commonlyknown that school psychology researchers canutilize published surveys, web-based data col-lection tools (e.g., Zoomerang), and quantitativecomputer programs (e.g., SPSS) to assist withtheir analyses. These tools are extremely bene-ficial for school psychology researchers becausethey assist them with many of the steps requiredin a quantitative research study. Unfortunately,available tools for qualitative research studiesare less commonly known, which may contrib-ute to there being relatively few purely qualita-tive studies published in the area of schoolpsychology (Powell, Mihalas, Onwuegbuzie,Suldo, & Daley, 2008). Indeed, Powell et al.(2008) documented that of the 438 empiricalarticles published in the four leading schoolpsychology journals (i.e., School PsychologyQuarterly, School Psychology Review, Psychol-ogy in the Schools, Journal of School Psychol-

ogy) between 2001 and 2005, only 6 repre-sented qualitative research articles. Yet, utiliz-ing these tools, such as QDA Miner,Ethnograph, and NVivo (QSR International PtyLtd, 2008), can increase the rigor of a qualita-tive study (Onwuegbuzie & Leech, 2007), es-pecially those with large data sets.

For many school psychology researchers, themost complicated step in the research process isthat of analysis (Gliner, Morgan, & Leech,2009; Leech & Onwuegbuzie, 2007). Knowingwhich analysis to use with different types ofresearch questions and various types of data canbe very confusing, especially for a novice re-searcher. This is even a more prominent issuewith qualitative data because many school psy-chology researchers have not had much trainingin qualitative methods, and they are often notknowledgeable about different qualitative dataanalysis techniques (Leech & Goodwin, 2008).Consistent with our assertion, Powell et al.(2008) reported that of the 57 National Associ-ation of School Psychology-approved graduate-level school psychology programs, only 1(1.75%) appeared to require that students enrollin one or more qualitative courses, and 11(19.3%) appeared to offer one or more qualita-tive courses as an elective.

For school psychologists who conduct quali-tative research, there is available guidance andtools to assist in analysis. When looking for

Nancy L. Leech, School of Education and Human De-velopment, University of Colorado Denver; Anthony J. On-wuegbuzie, Department of Educational Leadership andCounseling, Sam Houston State University.

Correspondence concerning this article should be ad-dressed to Nancy L. Leech, University of Colorado Denver,School of Education and Human Development, CampusBox 106, PO Box 173364, Denver, CO 80217. E-mail:[email protected]

School Psychology Quarterly © 2011 American Psychological Association2011, Vol. 26, No. 1, 70–84 1045-3830/11/$12.00 DOI: 10.1037/a0022711

70

Page 2: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

guidance, there are numerous texts wherein theauthors discuss qualitative research in general(e.g., Eisner, 1998; Glesne & Peshkin, 1992);yet, many of these texts include only one chap-ter on data analysis (e.g., Berg, 2004; Bogdan &Biklen, 2003; Creswell, 2007; Schram, 2003;Shank, 2002). There are several textbooks thatfocus solely on qualitative data analysis (Coffey& Atkinson, 1996; Dey, 1993; Grbich, 2007;Miles & Huberman, 2004; Phillips & Jor-gensen, 2002; Silverman, 2001). Yet, all ofthese texts, with a few exceptions (e.g., Grbich,2007; Miles & Huberman, 1994) focus on asingular analysis (e.g., discourse analysis; Phil-lips & Jorgensen, 2002). Therefore, these textsdo not present a comprehensive review ofmultiple types of available qualitative dataanalysis techniques, and none of these textspresent how to conduct these analyses usingcomputer software.

Leech and Onwuegbuzie (2007) go furtherthan do most authors of these textbooks bydescribing seven types of analyses, namely,constant comparison analysis, classical contentanalysis, keyword-in-context, word count, do-main analysis, taxonomic analysis, and compo-nential analysis; and they outline how to con-duct each manually. These authors have alsocreated a compendium of 18 qualitative analy-ses to assist the school psychology researcher inchoosing the appropriate analysis for theirworks (Leech & Onwuegbuzie, 2008).

Fortunately, such guides (e.g., Leech & On-wuegbuzie, 2007, 2008) can assist the schoolpsychology researcher with conducting qualita-tive analyses manually. Yet, with large datasets, conducting qualitative data analysis man-ually typically is not practical or desirable. Overthe past decade or so, the availability of com-puter software to conduct qualitative data anal-ysis has increased (Ulin, Robinson, & Tolley,2005). Today, there are programs such as QDAMiner, Ethnograph, NVivo (QSR InternationalPty Ltd, 2008), and Atlas/ti to assist researcherswith their analyses. These programs, in manyrespects, are very similar to one another andfacilitate many of the same analyses to be con-ducted; yet, each tends to have its own uniquefeatures (Fielding & Lee, 1998; Tesch, 1990;Weitzman & Miles, 1995). Using a computer-assisted qualitative data analysis software(CAQDAS) program can take qualitative dataanalysis much further than is possible compared

to conducting the analysis manually (Bazeley,2006, 2007; Fielding & Lee, 1998; Kelle, 1996;Tesch, 1990; Weitzman & Miles, 1995). Forexample, these programs assist the researcher inrecording, storing, indexing, sorting, and codingqualitative data (Morse & Richards, 2002). Oneespecially helpful feature of CAQDAS is theirability efficiently to compare categories andcodes in a relatively short amount of time(Bazeley, 2006).

Many researchers who use qualitative dataanalyses software typically use the software toconduct some form of constant comparisonanalysis (Glaser & Strauss, 1967; Strauss &Corbin, 1998). Doing so limits the researcher tofinding codes throughout the dataset; othertypes of relationships in the data are not iden-tified and might be overlooked. Computer soft-ware tools are capable of assisting the qualita-tive researcher with multiple types of analyses,so that the underlying theories and relationshipsin the data can emerge.

It is important to keep in mind that whenconducting qualitative research, the researcheris the main tool for analysis (Denzin & Lincoln,2005). Thus, CAQDAS programs, along withall types of analysis software (e.g., SPSS, SAS),do not analyze the data for the researcher.Rather, the researcher utilizes the computer pro-gram to assist in the analysis.

Table 1Types of Qualitative Research Designs

● Ethnography● Auto-ethnography● Life history● Oral history● Ethnomethodology● Case study● Participant observation● Field research or field study● Naturalistic study● Phenomenological study● Ecological descriptive study● Descriptive study● Symbolic interactionist study● Microethnography● Interpretive research● Action research● Narrative research● Historiography● Literary criticism● Grounded theory

71QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 3: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

Unfortunately, there is little guidance forschool psychology researchers connecting theavailable types of analysis with CAQDAS pro-grams. The excellent textbooks written by Ba-zeley and Richards (2000) and Bazeley (2007)present information on how to use NVivo, butdo not discuss the multiple types of availabledata analysis techniques and how to conducteach type with CAQDAS programs. More re-cently, a few authors have examined the use ofqualitative data analysis software (Dennis &Bower, 2008; Peters & Wester, 2006) in relationto analysis, but none of them provide step-by-step guidance in conducting specific traditionalqualitative data analysis techniques. Indeed, todate, no qualitative software provides explicitguidelines as to how to conduct an array oftraditional qualitative data analyses. As such,analysts have difficulty in tailoring their com-puter-assisted qualitative data analysis tech-niques to specific analyses of interest (e.g., con-stant comparison analysis) (cf. Onwuegbuzie,Leech, et al., 2009). For example, an analysis of

manuals of leading qualitative software pro-grams (e.g., NVivo, Atlas-ti) revealed no ex-plicit information as to how to use the softwareto facilitate a constant comparison analysis.This is surprising, considering this analysis isone of the most utilized analyses undertaken byqualitative researchers (Leech, 2004) becausenot only does this analytical technique allowqualitative researchers to analyze the four majorsources of data in qualitative research—namely,talk, observations, drawings/photographs/videos, and documents (Leech & Onwuegbuzie,2008)—but it also allows virtually any partic-ular size or unit of text to be analyzed (e.g., oneparagraph, one transcript, one document, mul-tiple documents).

With this in mind, the purpose of this paper isto outline seven types of qualitative data anal-ysis, specifically constant comparison analysis,classical content analysis, keyword-in-context,word count, domain analysis, taxonomic analy-sis, and componential analysis; to present step-by-step guidance for conducting these analyses

Table 2Using NVivo To Conduct Constant Comparison Analysis

If a node exists that you would like to reuse:Highlight selected text.Right click to open a list of choices.Select Code Selection.Select At Existing Nodes. The Select Project Items window will appear.Check the box next to the node you would like to reuse.Click on OK. Your selected text is now coded.

If there is not an existing node to reuse:Highlight selected text.Right click to open a list of choices.Select Code Selection.Select At New Node. The New Node window will appear.Type the name of the new node in the box next to Name. You can also include a description of the node under

Description.Click on OK. Your selected text is now coded.

Once your text is coded, you can create Tree Nodes. These are groupings of your Free Nodes.First, click on Nodes (located in the bottom left hand corner). Your Free Nodes will be displayed.Look through your free nodes and identify nodes that are similar. If you are unsure, you can double click on the

node to bring up the data that have been coded with the node.Highlight and drag your free nodes that are similar over to Tree Node (located in the upper left hand corner).Once you have moved all the similar free nodes, click on Tree Nodes. The Tree Nodes will now be displayed.Right click and select New Tree Node. Type in the name of your new Tree Node. Then, click on the nodes that are

included in this Tree Node and drag them into the new category.Once your Tree Nodes are organized:

Each Tree Node can then be written as a theme (perform this step outside of the NVivo program).To see the frequency of used codes in one source:

Click on View � Coding Stripes.Select with type of strips you would like to view (None, Selected Items, Nodes Most Coding, Nodes Least Coding,

Nodes Recently Coding). The coding stripes will appear to the right of the data window.

72 LEECH AND ONWUEGBUZIE

Page 4: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

with a CAQDAS program; and to presentscreenshots of the data analysis process. Theseseven techniques for analysis were chosenbased on their being the earliest formalizedqualitative data analysis techniques (e.g., con-stant comparison analysis; Glaser & Strauss,1967; domain analysis, taxonomic analysis,componential analysis; Spradley, 1979; key-word-in-context; Luhn, 1960; classical contentanalysis; Berelson, 1952) and also some of themost commonly used analysis (e.g., constantcomparison analysis). In fact, of the 60 qualita-tive data analysis procedures identified by On-wuegbuzie, Leech, and Collins (2010), theseseven analytical techniques are among the old-est. The qualitative data analysis programNVivo (QSR International Pty Ltd, 2008) waschosen as the CAQDAS program because it iscommonly used by educational researchers; yet,these analyses can be conducted with otherCAQDAS programs. It is our hope that provid-ing a clear step-by-step process for conductingthese analyses with NVivo, along with real datathat have been analyzed, will assist school psy-chology researchers to increase the rigor of theirqualitative data analysis procedures.

Descriptions and Computer Guides of aVariety of the Available Analysis Tools

To help the school psychology researcher inundertaking analysis of large sets of qualitativedata, CAQDAS programs, such as NVivo, canbe utilized. Seven types of analysis will bepresented, namely, constant comparison analy-sis, keywords-in-context, word count, classicalcontent analysis, domain analysis, taxonomicanalysis, and componential analysis. For eachtype of analysis, we will present a guide forusing NVivo software and figures of what willbe seen when using the computer program. It isimportant to choose the analytical techniques,considering which analysis will be helpful un-derstanding the data at a deeper level. Regard-less of the type of qualitative data (e.g., inter-view data, survey data, observational data,personal journals, diaries, permanent records,transcription of meetings) or the type of re-search design (see Table 1), NVivo can be usedto conduct the analysis.

Leech and Onwuegbuzie (2007) present aframework for choosing among the seven anal-yses. Once an analysis has been chosen and it

Figure 1. Constant comparison analysis: Coding stripes.

73QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 5: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

has been determined that using qualitative dataanalysis software would be helpful, the guide-lines presented will assist the school psychol-ogy researcher in conducting the analysis. Inorder to conduct these analyses using NVivo, itwould be best to have rudimentary knowledgeof the program. A few words that are unique toNVivo, and which are helpful to understand,

include nodes, tree nodes, and free nodes.Nodes are similar to codes in constant compar-ison analysis (described in detail below). Thus,nodes are what a researcher uses to place mean-ing on different parts of the text. Tree nodes aregroupings of nodes. As more nodes are created,the researcher can organize the nodes into treenodes. Finally, free nodes are nodes that have

Figure 2. Constant comparison analysis: Tree nodes and associated free nodes.

Table 3Using NVivo To Conduct Keyword-In-Context (File Under Queries)

● Click on the Queries tab on the left bottom of the screen. Or on the main menu, click on the Explore tab and thenselect New Query.

● The working window (above the data window) will be blank if this is the first time you have run a query. If it is notthe first time, the past queries will be listed.

● Click on the Explore tab and then select Queries.● Click on New Query. Select the type of Query you wish to run (Text Search, Coding, Compound, Word Frequency,

Matrix Coding, Coding Comparison, Group).● To conduct a KWIC analysis, click on Text Search. The Text Search Query window will open.● In the Search for box type in the word for which you wish to search.● Click on Run. A new window will open with the results. A list of sources will be given that include the searched

word. You can click on the specific source to see where each word is (it will be highlighted in the text) and thewords that come before and after the keyword.

● If you wish to save your Query, click on Explore � Last Run Query.● The Text Search Query Properties window will appear. Check the box next to Add To Project● Type the name of the query in the box next to Name. You can include a description of the query in the box next to

Description.● Click on OK. The new query will be listed in the Queries window.

74 LEECH AND ONWUEGBUZIE

Page 6: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

not been added to a tree. In the following sec-tions, the seven analysis techniques are pre-sented, along with guidelines for utilizingNVivo software for each type of analysis. Fi-nally, real data from Hess, Molina, andKozleski (2006) have been analyzed and screen-shots of what would appear with NVivo8 areincluded.

Constant Comparison Analysis

One of the most commonly used qualitativedata analysis techniques is constant comparisonanalysis developed by Glaser and Strauss(1967). Table 2 presents guidelines for usingNVivo to conduct an analysis using constantcomparison.

Figure 1 shows one of the excerpts from thedata. In the right bottom pane, the codes can beseen as stripes. These stripes correspond withthe text that has been coded. For this set of data,there are eight codes. We have highlighted thetext “I am his advocate. I have to speakup . . . say, okay, wait a minute, slow down,what does that mean, what did you say?” that

was coded as “advocate.” The stripes help theresearcher to see what text has been coded withthe different codes. Figure 2 presents TreeNodes. This is a list of the codes after theyhave been grouped together. For example, withthese data, one theme that could be found fromthe codes under “IEP meeting” might be “IEPmeetings can be an emotional experience that isdifficult to understand with many different peo-ple involved.”

Keywords-in-Context

When a school psychology researcher is in-terested in how participants use language, key-words-in-context (KWIC; Fielding & Lee,1998) is a data analysis method that can assist inincreasing their understanding. When the schoolpsychology researcher has data that includeshort, one-phrase responses or when there arespecific words of interest that the researcherswould like to understand better how they areutilized by participants, KWIC can be a bene-ficial analysis. It is important to utilize multiplewords around a keyword because using too few

Figure 3. Keyword-In-Context: Query searching for the keyword “school.”

75QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 7: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

words can create a loss of content around thekeyword.

Table 3 presents guidelines for using NVivoto conduct an analysis using KWIC. Figure 3presents the word count for the keyword“school.” We identified three participants’ re-sponses that included the keyword. Figure 4shows the responses, which indicate the follow-ing phrases were used with the keyword“school”—(a) “school really scares the heck outof him,” (b) “he goes to a rough kind of school,”and (c) “you know when you are in a school thathas a lot of special needs kids.”

Word Count

School psychology researchers who are in-terested in understanding differences amongparticipants may want to conduct a wordcount. Instead of using terms in the finalreport of a study such as many, most, or some,qualitative school psychology researchers canobtain the actual counts to report in additionto—as opposed to instead of—the descrip-

tions of the phenomenon (Sandelowski,2001). Although use of word count is notalways justified, as surmised by Miles andHuberman (1994), there are at least three rea-sons for counting in qualitative data analysis:(a) to identify patterns more easily, (b) toverify a hypothesis, and (c) to maintain ana-lytic integrity.

Table 4 presents guidelines for using NVivoto conduct an analysis using word count. Figure5 presents the results of a word count analysis.We requested a count of all the words in thedata and we identified that the word “he” wasused the most (46 times/5.98% of the words)and “different” was utilized seven times/0.91%of the words.

Classical Content Analysis

Classical content analysis is similar to con-stant comparison analysis, except with classi-cal content analysis themes or codes arecounted, whether they are created a priori or aposteriori. With datasets that have codes

Figure 4. Keyword-In-Context: Seeing the context around each keyword.

76 LEECH AND ONWUEGBUZIE

Page 8: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

emerging multiple times, classical contentanalysis can assist the school psychology re-searcher in understanding what concepts werepredominantly discussed. When conducting aclassical content analysis, codes can be iden-tified either deductively, inductively, orabductively.

Table 5 presents guidelines for using NVivo toconduct classical content analysis. Figure 6 pres-ents the tree nodes and free nodes associated witheach. It can be seen that the code “advocate” wasused a total of four times in two sources.

Domain Analysis

Domain analysis is based on the concept thatlanguage incorporates symbols (Spradley, 1979).A symbol is defined as “an act, sound, or objecthaving cultural significance and the capacity toexcite or objectify a response” (Merriam-Webster,2009). Symbols include three basic elements: (a)the symbol itself, which Spradley (1979) labeledthe cover term; (b) to what the symbol refers,which Spradley (1979) named the included term;and (c) the relationship between the symbol andthe referent, which Spradley (1979) gave the des-ignation of the semantic relationship.

When conducting a domain analysis, a schoolpsychology researcher would search for cultural

knowledge through what Spradley (1979) callsdomains. These domains are extracted via identi-fying a set of cover terms, included terms, and thesemantic relationships. Spradley (1979) presentednine semantic relationships. Through a six-stepprocess domains are identified and labeled.

Table 6 presents guidelines for using NVivo toconduct a domain analysis. Figure 7 presents re-sults of a domain analysis utilizing the domain“IEP.” In conducting the domain analysis, theresearcher began by choosing a domain: in thisexample, the domain is “IEP.” Next, the re-searcher searched the data using the semantic re-lationship of attributive which is described as “Xis defined with respect to one or more attributes ofY” (Spradley, 1979, p. 110). Thus, the researcherread through the data and found attributes of anIEP, such as “different people” and “took years.”Shown in the right hand box are the attributesfrom the data that include this domain.

Taxonomic Analysis

After conducting a domain analysis, if aschool psychology researcher wants or needsfurther analysis, a taxonomic analysis can beconducted. Taxonomic analysis assists the re-searcher in understanding how specific wordshave been utilized by the participants. This

Table 4Using NVivo To Conduct Word Count

To locate specific words in the data:Click on the Queries tab on the left bottom of the screen. Or on the main menu, click on the Explore tab and then

select New Query.The working window (above the data window) will be blank if this is the first time you have run a query. If it is not

the first time, the past queries will be listed.Right click or click on the Explore tab and select New Query.Click the Text Search option. The Text Search Query dialog box will be displayed.Under the Text Search Criteria tab, in the Search for box, type the words you wish to count.If you want to save the query, click the Add to Project checkbox at the top of the dialog. Enter a name and

description in the General tab.Click on Run.

To count the number of times a specific word is found in the data:Click on the Queries tab on the left bottom of the screen. Or on the main menu, click on the Explore tab and then

select New Query.The working window (above the data window) will be blank if this is the first time you have run a query. If it is not

the first time, the past queries will be listed.Right click or click on the Explore tab and select New Query.Click the Word Frequency option. The Word Frequency Query dialog box will be displayed.You can select the text to search (all the data or a subset of the data).If you want to save the query, click the Add to Project checkbox at the top of the dialog. Enter a name and

description in the General tab.Click on Run. The number of times each word is found in the data will be displayed.

77QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 9: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

analysis is based on the concept that words canhave different meanings and distinct conno-tations for each person. Spradley (1979) de-fined a taxonomy as a classification systemthat sorts the domains through a flowchartthat presents the relationships among theterms in the domain.

Table 7 presents guidelines for using NVivoto conduct a taxonomic analysis. Figure 8 pres-ents the taxonomy for one participant’s re-sponse regarding the IEP meeting. To generateFigure 8, the researcher first conducted a do-main analysis to identify the domain “IEP meet-ing” and the terms that were in relationship tothe domain (i.e., difficult to sit, sat there crying,etc.). Next, the researcher utilized NVivo todraw the relationship via a flowchart. As shownin the figure, the parent portrayed the following

concepts for the IEP meeting: (a) it was difficultto sit, (b) emotional (i.e., crying), (c) feelingalone, and (d) being rushed.

Componential Analysis

If a school psychology researcher is inter-ested in understanding the relationship amongwords used by a participant(s), and after a do-main analysis has been completed, a componen-tial analysis can be conducted. The advantageto conducting a componential analysis is thatthe results can assist the school psychologyresearcher in finding and presenting the sim-ilarities and differences among participants’understandings.

Table 8 presents guidelines for usingNVivo to conduct a componential analysis.

Figure 5. Word count analysis.

Table 5Using NVivo To Conduct Classical Content Analysis

● Click on Nodes in the left hand bottom corner. Select either Free Nodes or Tree Nodes under Nodes. We selectedTree Nodes because most of our codes were included here.

● In the working window the codes will appear, along with the number of times each was used.

78 LEECH AND ONWUEGBUZIE

Page 10: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

Figure 9 presents the componential analysiswhere the researcher was interested in under-standing how the different participants’ re-sponses varied in their use of the followingfive concepts: (a) attending classes withoutsupport, (b) autism, (c) coping socially, (d)being mainstreamed, and (e) parents’ use ofemail. As seen in the analysis, autism wasfound in four of the data sources, whereasbeing mainstreamed and parents’ use of emailwas extracted from one data source. The re-searcher may choose to go back to the partic-ipants to understand better these last twoconcepts.

Where to Go From Here

School psychology researchers have manytools available to assist them with their re-search, regardless of the type of research con-ducted (i.e., quantitative, qualitative, mixed). Itis unfortunate that more school psychology re-searchers do not publish qualitative studies—and perhaps one reason for this is the difficultyin analyzing large qualitative data sets. Thus,the purpose of this paper was briefly (i.e., withinthe space constraints of School PsychologyQuarterly) to outline seven types of qualitativedata analysis techniques, specifically constant

Figure 6. Classical content analysis.

Table 6Using NVivo To Conduct Domain Analysis

This analysis is conducted similarly to keywords-in-context.● Find the keyword (domain) and then look for cover term, included term, and semantic relationship.● Alternatively, once you have identified your cover terms, you can make each cover term a free node and then include

the cover terms as the text within the nodes and use the memo function to record the semantic relationship.● Alternatively still, using Spradley’s (1979) nine semantic relationships (i.e., strict inclusion, spatial, cause-effect,

rationale, location for action, function, means-end, sequence, and attribution), you can set up a node for each type ofsemantic relationship and then code accordingly.

79QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 11: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

comparison analysis, classical content analysis,keyword-in-context, word count, domain anal-ysis, taxonomic analysis, and componentialanalysis; and to present step-by-step guidance

and screenshots for conducting these analysesusing a CAQDAS program.

There are four important caveats that itbehooves us to mention at this point. First, we

Figure 7. Domain analysis.

Table 7Using NVivo To Conduct Taxonomic Analysis (File Under Models)

● Click on the Models tab on the left bottom of the screen or select the Model tab at the top of the screen.● The working window (above the data window) will be blank if this is the first time you have created a model. If it is

not the first time, the past models will be listed.● Place the cursor in the Models pane and right click to open a list of choices.● Select New Model. The New Model window will appear.● Type in the name of the new model next to Name. You can include a description of the query in the box next to

Description.● Click on OK. The Model window will appear in the bottom half of the screen. If you wish to have a bigger window

in which to work, you can click in the Model window then click on Window � Docked. This will create a newseparate window.

To create the model:● Click in the working area to open the Model tab. Select Add Project Items . . .● The Select Project Items window will open.● From the left hand box, select the words Free Nodes or Tree Nodes, whichever you wish to add to the model. This

will change the choices in the right box.● From the right hand box, add a check to the nodes you wish to use. If you have set up tree nodes, one tree node will

produce a taxonomy.● Click on OK. The Add Associated Data window will open.● Select Children. This will create a model with the Tree Node name as the top and the underlying codes as the

bottom.

80 LEECH AND ONWUEGBUZIE

Page 12: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

are not suggesting that all qualitative datashould be analyzed via some form of CAQ-DAS program. However, we do believe that,especially for large qualitative datasets—

which typifies a significant proportion ofqualitative studies—CAQDAS programs pro-vide a useful tool for recording, storing, in-dexing, and sorting qualitative data (Morse &

Figure 8. Taxonomic analysis.

Table 8Using NVivo To Conduct Componential Analysis

● Click on the Queries tab on the left bottom of the screen.● The working window (above the data window) will be blank if this is the first time you have run a query. If it is not

the first time, the past queries will be listed.● Right click to open a list of choices.● Click on New Query. Select the Matrix Coding (alternately you can select Explore � New Query � Matrix Coding).

The Matrix Coding Query window will open.● Under Define More Rows, you can select what you would like in your rows.● Once you select the type of information, click on Select and you can choose the specific pieces you would like to

include.● Click on Add to List.● Click on the Columns tab.● Under Define More Columns, you can select what you would like in your rows.● Once you select the type of information, click on Select and you can choose the specific pieces you would like to

include.● Click on Add to List.● Click on Run. A new window will open with the results.● If you wish to save your Query, click on Explore � Last Run Query.● The Matrix Coding Query Properties window will appear. Check the box next to Add To Project● Type the name of the query in the box next to Name. You can include a description of the query in the box next to

Description.● Click on OK. The new query will be listed in the Queries window.

81QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 13: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

Richards, 2002). Indeed, as noted by Bazeley(2007).

The use of a computer is not intended to supplanttime-honored ways of learning from data, but toincrease the effectiveness and efficiency of suchlearning. The computer’s capacity for recording,sorting, matching, and linking can be harnessed bythe researcher to assist in answering their researchquestions from the data, without losing access to thesource data or contexts from which the data havecome (p. 2)

Our second caveat is that we are not sug-gesting that all qualitative researchers whodecide to use CAQDAS programs should useNVivo. In fact, we encourage school psychol-ogy researchers to explore other CAQDASprograms, which include the following: AT-LAS.ti 6 (http://www.atlasti.com/), HyperRE-SEARCH2.8.3 (http://www.researchware.com/products/hyperresearch.html), MAXQDA 2007 (http://www.maxqda.com/), QDA Miner 3.2 (http://www.provalisresearch.com/QDAMiner/QDAMinerDesc.html), Qualrus (http://www.ideaworks.com/qualrus/index.html?gclid � CLn83KzDtp0CFZ-JM5QodzReMiw), and Transana 2.30 (http://www.transana.org/). However, we selected NVivobecause it is one of the most widely used CAQDASprograms, with as many as 400,000 users in more

than 150 countries (QSR International Pty Ltd,2009).

Third, the NVivo commands that we pro-vide in the tables do not represent the onlyway to conduct each of the selected sevenqualitative analysis programs. In fact, we en-courage school psychology qualitative re-searchers not only to explore other ways touse NVivo to conduct each of these analyses,but also to document and share the results oftheir explorations. Fourth, as declared byLeech and Onwuegbuzie (2007), CAQDASprograms can help researchers to analyzetheir data, but they cannot analyze the data forresearchers. Further, in using CAQDAS pro-grams, flexibility, creativity, insight, and in-tuition should never be replaced by a system-atic and mechanical analysis of qualitativedata (Dey, 1993). The researcher is the maintool for analysis, regardless of whether acomputer program is used to assist in theanalysis (Denzin & Lincoln, 2005).

Despite these caveats, we believe that pro-viding a clear, step-by-step process for con-ducting qualitative data analyses with NVivohopefully will assist school psychology re-searchers in conducting rigorous studies thatcan be published.

Figure 9. Componential analysis.

82 LEECH AND ONWUEGBUZIE

Page 14: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

References

Bazeley, P. (2006). The contribution of computersoftware to integrating qualitative and quantitativedata and analyses. Research in the Schools, 13(1),64–74.

Bazeley, P. (2007). Qualitative data analysis withNVivo qualitative project book. Thousand Oaks,CA: Sage.

Bazeley, P., & Richards, L. (2000). The NVivo qual-itative project book. Thousand Oaks, CA: Sage.

Berelson, B. (1952). Content analysis in communi-cative research. New York, NY: Free Press.

Berg, B. L. (2004). Qualitative research methods forthe social sciences (5th ed.). Boston, MA: Pearson.

Bogdan, R. C., & Biklen, S. K. (2003). Qualitativeresearch for education: An introduction to theoriesand methods (4th ed.). Boston, MA: Pearson.

Coffey, A., & Atkinson, P. (1996). Making sense ofqualitative data: Complementary research strate-gies. Thousand Oaks, CA: Sage.

Creswell, J. W. (2007). Qualitative inquiry and re-search design: Choosing among the five traditions(2nd ed.). Thousand Oaks, CA: Sage.

Dennis, B. W., & Bower, T. (2008). Using contentanalysis software to analyze survey comments.Libraries and the Academy, 8, 423–437.

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction:The discipline and practice of qualitative research.In N. K. Denzin & Y. S. Lincoln (Eds.), The Sagehandbook of qualitative research (3rd ed., pp.1–32). Thousand Oaks, CA: Sage.

Dey, I. (1993). Qualitative data analysis: A user-friendly guide for social scientists. London, Eng-land: Routledge.

Eisner, E. W. (1998). The enlightened eye: Qualita-tive inquiry and the enhancement of educationalpractice. Upper Saddle River, NJ: Merrill PrenticeHall.

Fielding, N. G., & Lee, R. M. (1998). Computeranalysis and qualitative research. Thousand Oaks,CA: Sage.

Glaser, B. G., & Strauss, A. L. (1967). The discoveryof grounded theory: Strategies for qualitative re-search. Chicago, IL: Aldine.

Glesne, C., & Peshkin, A. (1992). Becoming quali-tative researchers: An introduction. White Plains,NY: Longman.

Gliner, J. A., Morgan, G. A., & Leech, N. L. (2009).Research methods in applied settings: An inte-grated approach to design and analysis (2nd ed.).New York, NY: Taylor & Francis.

Grbich, C. (2007). Qualitative data analysis: An in-troduction. Thousand Oaks, CA: Sage.

Hess, R., Molina, A., & Kozleski, E. B. (2006). Untilsomebody hears me: Parental voice and advocacyin special education decision-making. British

Journal of Special Education, 33, 148–157. doi:10.1111/j. 1467–8578.2006.00430.x

Kelle, U. (Ed.). (1996). Computer-aided qualitativedata analysis. Thousand Oaks, CA: Sage.

Leech, N. L. (2004). Types of qualitative and quan-titative analyses used by faculty researchers. Un-published manuscript, University of ColoradoDenver.

Leech, N. L., & Goodwin, L. D. (2008). Building amethodological foundation: Doctoral- level meth-ods courses in colleges of education. Research inthe Schools, 15(1), 1–8.

Leech, N. L., & Onwuegbuzie, A. J. (2007). An arrayof qualitative analysis tools: A call for data anal-ysis triangulation. School Psychology Quar-terly, 22, 557–584. doi:10.1037/1045–3830.22.4.557.

Leech, N. L., & Onwuegbuzie, A. J. (2008). Quali-tative data analysis: A compendium of techniquesfor school psychology research and beyond.School Psychology Quarterly, 23, 587–604. doi:10.1037/1045–3830.23.4.587

Luhn, H. P. (1960). Keyword-in-context index fortechnical literature. American Documentation, 11,288–295.

Merriam-Webster. (2009). Merriam-Webster OnlineDictionary. Retrieved from http://www.merriam-webster.com/dictionary/symbol

Miles, M. B., & Huberman, A. M. (1994). Qualita-tive data analysis: An expanded sourcebook (2nded.). Thousand Oaks, CA: Sage.

Morse, J. M., & Richards, L. (2002). Read me first fora user’s guide to qualitative methods. ThousandOaks, CA: Sage.

Onwuegbuzie, A. J., & Leech, N. L. (2007). Validityand qualitative research: An oxymoron? Quality &Quantity: International Journal of Methodol-ogy, 41, 233–249. doi:10.1007/s11135-006 –9000-3.

Onwuegbuzie, A. J., Leech, N. L., & Collins,K. M. T. (2010). Toward a new era for conductingmixed analyses: The role of quantitative dominantand qualitative dominant crossover mixed analy-ses. In W. P. Vogt & M. Williams (Eds.), Thehandbook of methodological innovation. ThousandOaks, CA: Sage. Manuscript submitted forpublication.

Onwuegbuzie, A. J., Leech, N. L., Slate, J. R., Stark,M., Sharma, B., Frels, R., Harris, K., & Combs,J. P. (2009, February). A model for teaching andlearning qualitative research. Paper presented atthe annual meeting of the Southwest EducationalResearch Association, San Antonio, TX.

Peters, V., & Wester, F. (2006). How qualitative dataanalysis software may support the qualitative anal-ysis process. Quality & Quantity, 41, 635–659.doi:10.1007/s11135-006–9016-8

83QUALITATIVE ANALYSIS COMPUTER TOOLS

Page 15: Beyond Constant Comparison Qualitative Data Analysis ...aronatas/beyondconstantcomparison_spq... · Beyond Constant Comparison Qualitative Data Analysis: Using NVivo Nancy L. Leech

Phillips, L. J., & Jorgensen, M. W. (2002): Discourseanalysis as theory and method. Thousand Oaks,CA: Sage.

Powell, H., Mihalas, S., Onwuegbuzie, A. J., Suldo,S., & Daley, C. E. (2008). Mixed methods researchin school psychology: A mixed methods investi-gation of trends in the literature. Psychology in theSchools, 45, 291–309. doi:10.1002/pits. 20296

QSR International Pty Ltd. (2008). NVIVO: Ver-sion 8. Reference guide. Doncaster Victoria, Aus-tralia: Author.

QSR International Pty Ltd. (2009). Our history. Re-trieved from http://www.qsrinternational.com/about-qsr_history.aspx

Sandelowski, M. (2001). Real qualitative researchersdon’t count: The use of numbers in qualitativeresearch. Research in Nursing & Health, 24, 230–240.

Schram, T. H. (2003). Conceptualizing qualitative in-quiry: Mindwork for fieldwork in education and thesocial sciences. Upper Saddle River, NJ: Pearson.

Shank, G. D. (2002). Qualitative research: A per-sonal skills approach. Upper Saddle River, NJ:Merrill Prentice Hall.

Silverman, D. (2001). Interpreting qualitative data.London, England: Sage.

Spradley, J. P. (1979). The ethnographic interview.Fort Worth, TX: Holt, Rinehart & Winston.

Strauss, A., & Corbin, J. (1998). Basics of quali-tative research: Techniques and procedures fordeveloping grounded theory. Thousand Oaks,CA: Sage.

Tesch, R. (1990). Qualitative research: Analysistypes and software tools. London, England:Falmer.

Ulin, P. R., Robinson, E. T., & Tolley, E. E. (2005).Qualitative methods in public health: A field guidefor applied research. San Francisco, CA: Jossey-Bass.

Weitzman, E., & Miles, M. B. (1995). Computerprograms for qualitative data analysis. ThousandOaks, CA: Sage.

Online First Publication

APA-published journal articles are now available Online First in the PsycARTICLESdatabase. Electronic versions of journal articles will be accessible prior to the printpublication, expediting access to the latest peer-reviewed research.

All PsycARTICLES institutional customers, individual APA PsycNET� database pack-age subscribers, and individual journal subscribers may now search these records as anadded benefit. Online First Publication (OFP) records can be released within as little as 30days of acceptance and transfer into production, and are marked to indicate the postingstatus, allowing researchers to quickly and easily discover the latest literature. OFParticles will be the version of record; the articles have gone through the full productioncycle except for assignment to an issue and pagination. After a journal issue’s printpublication, OFP records will be replaced with the final published article to reflect thefinal status and bibliographic information.

84 LEECH AND ONWUEGBUZIE