Total Quality Framework

Applying the TQF Credibility Component: An IDI Case Study

The Total Quality Framework (TQF) is an approach to qualitative research design that integrates quality principles without stifling the fundamental and unique attributes of qualitative research. In so doing, the TQF helps qualitative researchers develop critical thinking skills by showing them how to give explicit attention to quality issues related to conceptualization, implementation, analysis, and reporting.

The following case study offers an example of how many of the concerns of the Credibility (or data collection) component of the TQF were applied to an in-depth interview (IDI) study conducted by Roller Research. This case study can be read in its entirety in Roller & Lavrakas (2015, pp. 100-103).

Credibility Component of the Total Quality FrameworkScope

This study was conducted for a large provider of information services associated with nonprofit organizations based in the U.S. The purpose was to investigate the information needs among current and former users of these information services in order to facilitate the development of “cutting edge” service concepts.

Eighty-six (86) IDIs were conducted among individuals within various grant-making and philanthropic organizations (e.g., private foundations, public charities, and education institutions) who are responsible for the decision to purchase and utilize these information services.

There were two important considerations in choosing to complete 86 interviews: (a) the required level of analysis – it was important to be able to analyze the data by the various types of organizations, and (b) practical considerations – the available budget (how much money there was to spend on the research) and time restrictions (the research findings were to be presented at an upcoming board meeting). In terms of mode, 28 IDIs were conducted with the largest, most complex users of these information services, while the remaining 58 interviews were conducted on the telephone.

Participants were stratified by type, size, and geographic location and then selected on an nth-name basis across the entire lists of users and former users provided by the research sponsor.

A high degree of cooperation was achieved during the recruitment process by way of: Read Full Text

Mobile & Online Qualitative Research: The Good, the Bad, & the Ugly

Data quality matters. Regardless of the research method or approach, our ability to say anything meaningful about our research outcomes hinges on the integrity of the data. The greater care the researcher takes to ensure the basic ingredients of “good” research design, the more confident the researcher and importantly the user of the research will be in the recommendations drawn from the research and its ultimate usefulness.

This focus on data quality applies to all research. And although it is most often a topic of discussion among survey researchers, data quality considerations are increasingly (I hope!) a discussion among qualitative researchers as well. Indeed, the underlying validity of our qualitative data is an important consideration regardless of the researcher’s paradigm orientation or the qualitative method, including the more recent methodological options – that is, mobile and online qualitative research.

Mobile and online technology – in particular, tech solutions that combine observation with a multimethod/mode approach – offer qualitative researchers new ways to investigate a variety of situations that give them a closer understanding of participants’ lived experiences as never before possible. Three such situations are: Read Full Text

Credibility & the Online Asynchronous Focus Group Method

The Total Quality Framework (TQF) offers researchers a way to think about basic research principles at each stage of the qualitative research process – data collection, analysis, reporting – with the goal of doing something of value with the outcomes (i.e., the usefulness of the research). The first of the four components of the TQF is Credibility which pertains to the data collection phase of a qualitative study. A detailed discussion of Credibility can be found in this 2017 Research Design Review article.

This article – and in similar fashion to the companion articles associated with the other three components of the TQF – explains the chief elements that define Credibility, stating that “credible qualitative research is the result of effectively managing data collection, paying particular attention to the two specific areas of Scope and Data Gathering.” Although a great deal of the discussions thus far have been centered on traditional qualitative methods, the increasingly important role of technological solutions in qualitative research makes it imperative that the discussion of Credibility (and the other TQF components) expand to the digital world.

The online asynchronous focus group (“bulletin board”) method has been around for a long time. It is clearly an approach that offers qualitative researchers many advantages over the face-to-face mode while also presenting challenges to the integrity of research design. The following presents a snapshot of the online bulletin board focus group method through the lens of the two main ingredients of the TQF Credibility component – Scope and Data Gathering. This snapshot is not an attempt to name all the strengths and limitations associated with the Credibility of the online asynchronous focus group method but rather highlight a few key considerations.Credibility of Asynch Focus Group Method