qualitative analysis

Qualitative Sample Design: Making the Most of Diversity & Inclusion

Diversity and inclusion in qualitative research is an important topic of discussion in Research Design Review. It is Making use of diversity and inclusiona topic closely related to the broader subject of sample design which has been discussed, directly or indirectly, in many RDR articles. One such article — “Sample Size in Qualitative Research & the Risk of Relying on Saturation” — talks about the many factors to be considered when determining sample size, including the diversity of participants.

“A TQF Approach to Choosing a Sample Design” discusses the Credibility component of the Total Quality Framework and specifically the area of Scope. This article emphasizes a systematic approach to sampling when recruiting from a large population to ensure an inclusive sample of participants who “share defining characteristics.”

In “Exploring Human Realities: A Quality & Fair Approach,” the focus is on the manner in which quality approaches to qualitative research design — including the scope of the sample design — enable researchers to “embrace diversity in our participants” by “giving participants a fair voice in the research.”

An all-important yet often overlooked consideration when building inclusive sample designs is quality data analysis. That is, the ability to account for and interpret the diversity embedded in the data. When the population of interest is large and diverse (e.g., parents and children participating in a state-wide youth program spanning five communities), the researcher needs to think carefully about the collected data and, specifically, about what can and cannot be interpreted from the final data set.

There are two broad scenarios when this consideration comes into play. In one instance, qualitative researchers may pride themselves with the inclusiveness and diversity of their research participants yet ignore the impact this diversity may have on the resulting data. If 30 in-depth interviews (IDIs) Read Full Text

Qualitative Data Analysis: What Is A Theme?

Theme development from two categoriesThere are many articles in Research Design Review concerning qualitative data analysis. And, like most articles on this subject matter, there is invariably a direct or indirect reference to themes, i.e., an analysis process that works toward deriving themes from the data. With so much of the focus on developing themes in qualitative data analysis, it is appropriate to consider the all-important question, What is a theme?

To answer that question, it may be easier to begin with what is not a theme. A theme is not a product of word frequency counts. For example, if the word “communication” comes up frequently by participants in a focus group study pertaining to what patients need from their physicians, “communication” is not a useful theme that the researcher draws from the data. If an in-depth interview (IDI) study is conducted with older adults concerning their experiences during the pandemic and the word “technology” or words “technological devices” are often used in response to the interviewer’s questions, these words do not constitute a theme.

Similarly, the dominance of participants’ comments within a particular topic area does not necessarily represent a theme to be derived from the data. The focus group participants may have talked a lot about some aspect of communication as it relates to the patient-physician relationship; however, “communication” may not be the appropriate theme. And, even though the IDI participants may have brought up the topic of technology in response to many of the interviewer’s questions, “technology” is not necessarily a theme to be derived from the analysis.

Using these examples, “communication” and “technology” are better classified as categories or “buckets” rather than themes. As discussed in “The Important Role of ‘Buckets’ in Qualitative Data Analysis”

These categories basically represent buckets of codes that are deemed to share a certain underlying construct or meaning. In the end, the researcher is left with any number of buckets filled with a few or many codes from which the researcher can identify patterns or themes in the data overall.

It is within and across the categories that researchers derive themes. To do that, the researcher approaches each bucket with the question, ‘In what context was this construct discussed?’ In other words, on what basis or meaning did participants talk about the broad constructs the researcher perceived in the data. It is only by digging into each bucket and then analyzing across buckets that the researcher will create rich themes leading to useful outcomes for the research sponsor. For example, when the researcher explores the “communication” bucket they may find that some participants were only focused on the mode of communication (e.g., email compared to phone communication) while others mostly talked about the frequency and speed of communication, and still other participants spoke entirely about the content of communication. The researcher may be tempted to assert that communication is the theme as defined by these various areas of emphasis but that is a weak approach compared to the rich insight that can be gained by extending the analysis across categories.

By looking across categorical buckets researchers derive a contextually driven understanding of the data. An example of this is provided in the article “Actively Conducting an Analysis to Construct an Interpretation.” This article demonstrates (by way of an IDI study with financial managers) the researcher’s creation of the theme “strong partnership” from two categories — partner and communication — derived from three codes in the partner category and two codes in communication (see the image above). As stated in that article

The theme “strong partnership” did not simply emerge from the data, it was not lying in the data waiting to be discovered. Rather, the researcher utilized their analytical skills, in conjunction with their constructed understanding of each participant’s contribution to the data, to create contextually sound, meaningful themes such as “strong partnership.” Then, with the depth of definition associated with each theme, the researcher looked within and across themes to build an interpretation of the research data targeted at the research objectives, and provided the users of the research with a meaningful path forward.

 

A Key to Qualitative Data Analysis: Time

Key to QDAAn earlier article in Research Design Review discusses Fast and Slow Thinking in Research Design. The emphasis here is on the idea that “there is no easy solution to the discovery of how people think” and researchers’ methods need to incorporate an approach that allows for “an appreciation of the many facets of the human mind – the irrational and rational, emotional and cognitive.”

Although not explicitly discussed in this earlier article, “discovery of how people think” in a slow, considered manner is the ultimate goal of qualitative data collection and the qualitative data analysis process. By definition, the unique attributes of qualitative research require a thoughtful, measured course of action. Two of these attributes — the importance of context and the importance of meaning — play a significant role in mandating the researcher’s unwavering attention.

An unspoken yet key ingredient in qualitative research methodology, and particularly qualitative data analysis, is time. That is, taking the necessary time to absorb each participant’s contribution to the research objectives and then deeply examine the similarities and differences across participants. And yet, many researchers often feel compelled to speed up their analysis.

When deciding to conduct a qualitative research study, the timeline should be given careful consideration. Qualitative researchers owe it to the integrity of their research results (and ultimately to the users of the research) to fully accept and embrace the amount of time required for analysis. And likewise, to resist demands (from others or self-inflicted) that serve to unduly accelerate the analysis process.

Researchers are encouraged to build in the time required to conduct a complete analysis and to document the estimated time requirement when developing the research design. Let it be known from the outset that additional weeks or months may be needed in the timeline to allow for a thorough and meaningful analysis at the completion of data collection.

Qualitative data analysis — understanding the contextual meanings of how people think (individually and collectively) — takes time. Embrace it. Enjoy it. It is why we conduct qualitative research in the first place.