validity

A Rigorous Qualitative Study to Explore Type 1 Diabetes in Older Adults: Using the Total Quality Framework

Diabetic MedicineIn “Supporting the ‘lived expertise’ of older adults with type 1 diabetes: An applied focus group analysis to characterize barriers, facilitators, and strategies for self-management in a growing and understudied population” (Cristello Sarteau et al., 2024), the authors discuss their study among older adults (OAs, defined as adults 65 years of age or older) with type 1 diabetes concerning care management. This research consisted of nine in-person focus group discussions with a total of 33 OAs and caregivers.

Central to the design and implementation of this research was the Total Quality Framework (TQF) (Roller & Lavrakas, 2015). The authors selected the TQF due to their focus on rigor and a quality approach to investigate the lived experiences of OAs with type 1 diabetes.

To support rigorous research and reporting, we selected the Total Quality Framework (TQF), a comprehensive set of evidence-based criteria for limiting bias and promoting validity in all phases of the applied qualitative research process. (p. 2)

In this article, the authors provide a unique and useful table describing the rationale behind their methodological decisions pertaining to each component of the TQF, i.e., Credibility, Analyzability, Transparency, and Usefulness. For example, with respect to Credibility, the table offers a lengthy discussion of sample design, including the impact of limited resources on the recruitment process and why the size of each group discussion was kept to 4-5 participants. Other areas of discussion in the table include the coding format and identification of themes (Analyzability), complete disclosure of elements related to design, data collection, and analysis (Transparency), and “how the study should be interpreted, acted upon, or applied in other research context in the real world” (Usefulness). Importantly, readers are directed to areas within the article where they can read about the explanations of methodological decisions that go beyond the limited space of the table, e.g., definition of the target population.

This research “revealed, above all, the complex and dynamic nature of managing type 1 diabetes over the lifespan” and provided “valuable foundational information for future research efforts” (p. 13). In addition to the perceived strengths of the research, the authors’ quality approach also allowed for an informed discussion of the limitations (e.g., diversity in the sample). By way of the TQF Transparency component, the authors provide readers with the details they need to build on this research and move forward in defining care-management solutions for the OA population with type 1 diabetes. As the authors state, the TQF enabled them to “promote confidence in using results from our study to inform future decision-making” (p. 17).

Cristello Sarteau, A., Muthukkumar, R., Smith, C., Busby‐Whitehead, J., Lich, K.H., Pratley, R.E., Thambuluru, S., Weinstein, J., Weinstock, R.S., Young, L.A. and Kahkoska, A.R., 2024. Supporting the ‘lived expertise’of older adults with type 1 diabetes: An applied focus group analysis to characterize barriers, facilitators, and strategies for self‐management in a growing and understudied population. Diabetic Medicine, 41(1), e15156.

Roller, M. R., & Lavrakas, P. J. (2015). Applied qualitative research design: A total quality framework approach. Guilford Publications.

A TQF Approach to Construct Validity

TQF approach to construct validity

Construct validity plays an important role in the design, implementation, analysis, and ultimate usefulness of qualitative research methods. The construct of validity itself in qualitative research is discussed in this article and cites qualitative researchers across disciplines who explore “unique dimensions” and other considerations  relating to validity in qualitative research.

The Total Quality Framework (TQF) relies heavily on construct validity in its quality approach to each phase of the qualitative research process. At each phase, the researcher must ask “Am I gaining real knowledge about the core concepts that are the focus of this research?” For example,

  • An important step when developing a research design is to identify the key constructs associated with the research objectives to investigate, and the particular attributes of each construct that the researcher wants to explore. So, for example, a researcher conducting a study on dietary behavior may have interest in “health consciousness,” including shopping behavior related to organic and fresh foods.
  • In the in-depth interview and focus group discussion methods, careful attention needs to be paid to guide development and the inclusion of questions relevant to the constructs of interest. When developing the guide, the researcher needs to ask “Is this [topic, question, technique] relevant to the construct we are investigating?”, and “Does this [topic, question, technique] provide us with knowledge about the aspect of the construct that we intended to explore in the interviews/discussions?”
  • In ethnography, the observation guide and observation grid are important tools. “The grid is similar to the guide in that it helps to remind the observer of the events and issues of most import; however, the observation grid is a spreadsheet or log of sorts that enables the observer to actually record and reflect on observable events in relationship to the research constructs of interest” (Roller & Lavrakas, 2015, p. 206).
  • The quality of qualitative data analysis hinges on the researcher’s ability to effectively identify, analyze, and develop valid interpretations of the data around the important constructs associated with the research objectives. To assist the researcher, a TQF approach to analysis recommends a codebook format and coding form (which is basically a reflexive journal for the coder[s] to record thoughts and justifications for their coding decisions) that highlights constructs of interest. For example,

TQF codebook and coding form

  • Construct validity also plays an important role in the transparency of the final research document. In the study report, the researcher can (and should) elaborate on the design, data gathering, and analysis decisions that were made pertaining to the key constructs, as well as the main themes that were derived from the data — i.e., the knowledge that was gained from the research — concerning these constructs.

Roller, M. R., & Lavrakas, P. J. (2015). Applied qualitative research design: A total quality framework approach. New York: Guilford Press.

 

Photo by Bon Vivant

Shared Constructs in Research Design

Shared constructs

In 2021, a three-part series appeared in Research Design Review concerning three shared constructs in quantitative and qualitative research design — sampling, bias, and validity. Although quantitative and qualitative research, and the respective research designs, are distinct from each other in many ways, there are commonalities across research methodologies that cannot be ignored in quality research design. These commonalities include fundamental constructs that further a principled approach to research design, such as the notion of sampling, bias, and validity.

The three articles posted in 2021 devoted to these shared constructs — Part 1-Sampling, Part 2-Bias, and Part 3-Validity — have been compiled into this single document “Shared Constructs in Research Design,” available for download.