Research Analysis

The Qualitative Analysis Trap (or, Coding Until Blue in the Face)

There is a trap that is easy to fall into when conducting a thematic-style analysis of qualitative data. The trap revolves around coding and, specifically, the idea that after a general familiarization with the in-depth interview or focus group discussion content the researcher pores over the data scrupulously looking for anything deemed worthy of a code. If you think this process is daunting for the seasoned analyst who has categorized and themed many qualitative data sets, consider the newly initiated graduate student who is learning the process for the first time.

Recent dialog on social media suggests that graduate students, in particular, are susceptible to falling into the qualitative analysis trap, i.e., the belief that a well done analysis hinges on developing lots of codes and coding, coding, coding until…well, until the analyst is blue in the face. This is evident by overheard comments such as “I thought I finished coding but every day I am finding new content to code” and “My head is buzzing with all the possible directions for themes.”

Coding of course misses the point. The point of qualitative analysis is not to deconstruct the interview or discussion data into bits and pieces, i.e., codes, but rather to define the research question from participants’ perspectives Read Full Text

The Important Role of “Buckets” in Qualitative Data Analysis

An earlier article in Research Design Review“Finding Connections & Making Sense of Qualitative Data” – discusses the idea that a quality approach to a qualitative research design incorporates a carefully considered plan for analyzing, and making sense of, the data in order to produce outcomes that are ultimately useful to the users of the research. Specifically, this article touches on the six recommended steps in the analysis process.* These steps might be thought of as a variation of the classic Braun & Clarke (2006) thematic analysis scheme in that the researcher begins by selecting a unit of analysis (and thus becoming familiar with the data) which is then followed by a coding process.

Unique to the six-step process outlined in the earlier RDR article is the step that comes after coding. Rather than immediately digging into the codes searching for themes, it is recommended that the researcher look through the codes to identify categories. These categories basically represent buckets of codes that are deemed to share a certain underlying construct or meaning. In the end, the researcher is left with any number of buckets filled with a few or many codes from which the researcher can identify patterns or themes in the data overall. Importantly, any of the codes within a category or bucket can (and probably will) be used to define more than one theme.

As an example, consider an in-depth interview study with financial managers of a large non-profit organization concerning their key considerations when selecting financial service providers. After the completion of 35 interviews, the researcher absorbs the content, selects the unit of analysis (the entire interview), and develops 75-100 descriptive codes. In the next phase of the process the researcher combs through the codes looking for participants’ thoughts/comments that convey similar broad meaning related to the research question(s). In doing so, Read Full Text

The Virtue of Recordings in Qualitative Analysis

A February 2017 article posted in Research Design Review discusses qualitative data transcripts and, Qualitative Research Recordingspecifically, the potential pitfalls when depending only on transcripts in the qualitative analysis process. As stated in the article,

Although serving a utilitarian purpose, transcripts effectively convert the all-too-human research experience that defines qualitative inquiry to the relatively emotionless drab confines of black-on-white text. Gone is the profound mood swing that descended over the participant when the interviewer asked about his elderly mother. Yes, there is text in the transcript that conveys some aspect of this mood but only to the extent that the participant is able to articulate it. Gone is the tone of voice that fluctuated depending on what aspect of the participant’s hospital visit was being discussed. Yes, the transcriptionist noted a change in voice but it is the significance and predictability of these voice changes that the interviewer grew to know over time that is missing from the transcript. Gone is an understanding of the lopsided interaction in the focus group discussion among teenagers. Yes, the analyst can ascertain from the transcript that a few in the group talked more than others but what is missing is the near-indescribable sounds dominant participants made to stifle other participants and the choked atmosphere that pervaded the discussion along with the entire group environment.

Missing from this article is an explicit discussion of the central role audio and/or video recordings – that accompany verbal qualitative research modes, e.g., face-to-face and telephone group discussions and in-depth interviews (IDIs) – play in the analysis of qualitative data. Researchers who routinely utilize recordings during analysis are more likely to derive valid interpretations of the data while also staying connected to Read Full Text