Qualitative Analysis

Qualitative Research: A Call for Collective Action

Among thCollective action in qualitative researche many keynote speakers, presentations, and posters at the American Psychological Association 2020 Virtual Convention (which is available online until August 1, 2021), the program includes a symposium on “Questioning Qualitative Methods – Rethinking Accepted Practices.” This session includes three presentations: “Do We Have Consensus About Consensus? Reconceptualizing Consensus as Epistemic Privilege” (by Heidi Levitt), “Is Member-Checking the Gold Standard of Quality Within Qualitative Research?” (by Sue Motulsky), and “Is Replication Important for Qualitative Researchers?” (by Rivka Tuval-Mashiach).

Ruthellen Josselson serves as discussant for this session. In her remarks, Dr. Josselson uses the symposium theme of “rethinking accepted practices” to discuss the second-tier status or “marginalization” of qualitative research, particularly in the field of psychology, and suggests a way to think differently about working in qualitative research. Josselson begins by acknowledging the core realities of qualitative research. Drawing on the panelists’ presentations – and not unlike an earlier article in Research Design Review on the “10 Distinctive Qualities of Qualitative Research” – she highlights unique aspects of qualitative research such as the multiple, contextual nature of “truth,” the absence of isolated variables to measure, and the impossibility of exact replication. These realities, however, do not or should not condemn qualitative research to the periphery of the research methods arena.

To drive qualitative research away from the periphery and its marginalized status, Josselson offers an approach centered on “collectivism” or the idea of a concerted effort among qualitative researchers to investigate phenomena together with the objective of making meaningful contributions toward addressing the research issue. In this spirit, qualitative researchers set out Read Full Text

Sample Size in Qualitative Research & the Risk of Relying on Saturation

Qualitative and quantitative research designs require the researcher to think carefully about how and how many to sample within the population segment(s) of interest related to the research objectives. In doing so, the researcher considers demographic and cultural diversity, as well as other distinguishing characteristics (e.g., usage of a particular service or product) and pragmatic issues Risk of Relying on Saturation(e.g., access and resources). In qualitative research, the number of events (i.e., the number of in-depth interviews, focus group discussions, or observations) and participants is often considered at the early design stage of the research and then again during the field stage (i.e., when the interviews, discussions, or observations are being conducted). This two-stage approach, however, can be problematic. One reason is that giving an accurate sample size prior to data collection can be difficult, particularly when the researcher expects the number to change as the result of in-the-field decisions.

Another potential problem arises when researchers rely solely on the concept of saturation to assess sample size when in the field. In grounded theory, theoretical saturation

“refers to the point at which gathering more data about a theoretical category reveals no new properties nor yields any further theoretical insights about the emerging grounded theory.” (Charmaz, 2014, p. 345)

In the broader sense, Morse (1995) defines saturation as “‘data adequacy’ [or] collecting data until no new information is obtained” (p. 147).

Reliance on the concept of saturation presents two overarching concerns: 1) As discussed in two earlier articles in Research Design ReviewBeyond Saturation: Using Data Quality Indicators to Determine the Number of Focus Groups to Conduct and Designing a Quality In-depth Interview Study: How Many Interviews Are Enough? – the emphasis on saturation has the potential to obscure other important considerations in qualitative research design such as data quality; and 2) Saturation as an assessment tool potentially leads the researcher to focus on the obvious “new information” obtained by each interview, group discussion, or observation rather than gaining a deeper sense of participants’ contextual meaning and more profound understanding of the research question. As Morse (1995) states,

“Richness of data is derived from detailed description, not the number of times something is stated…It is often the infrequent gem that puts other data into perspective, that becomes the central key to understanding the data and for developing the model. It is the implicit that is interesting.” (p. 148)

With this as a backdrop, a couple of recent articles on saturation come to mind. In “A Simple Method to Assess and Report Thematic Saturation in Qualitative Research” (Guest, Namey, & Chen, 2020), the authors present a novel approach to assessing sample size in the in-depth interview method that can be applied during or after data collection. This approach is born from Read Full Text

Qualitative Data Analysis: 16 Articles on Process & Method

“Qualitative Data Analysis: 16 Articles oQualitative Data Analysisn Process & Method” is a new compilation of selected articles appearing in Research Design Review from 2010 to December 2019 concerning various facets of qualitative data analysis. Although there are other RDR articles posted in this time period related to analysis — such as articles on transparency, e.g., “The Use of Quotes & Bringing Transparency to Qualitative Analysis” and those pertaining to quantitative-qualitative research topics, e.g., “Qualitative Analysis: The Biggest Obstacle to Enriching Survey Outcomes”  — the 16 articles in this compilation are narrowly focused on issues relevant to applying a quality approach to the analytical process — e.g., identifying the unit of analysis, coding, and use of “buckets” — and the qualitative content analysis method.

“Qualitative Data Analysis: 16 Articles on Process & Method” is available for download here.

Two other compilations are also available for download: “The Focus Group Method: 18 Articles on Design & Moderating is available for download here. And “The In-depth Interview Method: 12 Articles on Design & Implementation” is available for download here.