Author: Margaret R. Roller

Is It Good Research?

To see this and other slide decks on best practices in research methods and design, go to https://www.slideshare.net/MargaretRoller.

 

The TQF Qualitative Research Proposal: Research Questions & Hypotheses

TQF Proposal: Questions & Hypotheses

The following is a modified excerpt from Applied Qualitative Research Design: A Total Quality Framework Approach (Roller & Lavrakas, 2015, p. 338).

The background and literature review section of the Total Quality Framework (TQF) proposal provides the context for the research question(s) and/or hypotheses that the proposed research is designed to address. In this section, the proposal author must not only put forth the questions/hypotheses under study, but provide support as to why these are the ones that merit investigation. In doing this, the author should rely on the TQF to bolster the logical arguments that are advanced in support of these research questions/hypotheses.

The extent to which the research questions revolve around quality-design issues will depend, in part, on the results of the literature review and the nature of the research topic. For example, a proposal to study physician–patient consultations might state the primary research question as “What are the main factors that appear to contribute to the frequency and type of conversations concerning cancer patients’ sexual functioning among a representative sample of a clinic’s oncology physicians?” The researcher may or may not harbor a hypothesis along with the research question. However, depending on the literature review, the researcher might enter into the research hypothesizing, for example, that the frequency and substance of physician–patient conversations concerning sexual function are associated with how closely the physician’s demographic characteristics (e.g., age, gender, and race) match those of the patient. Or, a proposal on this topic may focus on methodological, rather than substantive, hypotheses such as noting TQF flaws in past research and hypothesizing that the author’s proposed methods for the new study will avoid the problems of earlier research (which the researcher may believe led to biased findings and ill-advised recommendations) and thereby result in outcomes that are more credible and therefore more useful.

Careful, thoughtful attention needs to be paid to this section of the proposal. It is the research questions and/or hypotheses that the researcher describes here that will play a large role in guiding the next section of the TQF proposal, the design of the research study.

Actively Conducting an Analysis to Construct an Interpretation

It is not uncommon for researchers who are reporting the results of their quantitative studies to go beyond describing their numerical data and attempt to interpret the meaning associated with this data. For example, in a survey concerning services at a healthcare facility, the portion of respondents who selected the midpoint on a five-point scale to rate the improvement of these services from the year before might be interpreted as having a neutral opinion, i.e., these respondents believe the caliber of services has remained the same, neither better nor worse than a year earlier. And yet there are other interpretations of the midpoint response that may be equally viable. These respondents may not know whether the services have improved or not (e.g., they were not qualified to answer the question). Or, these respondents may believe that the services have gotten worse but are reluctant to give a negative opinion.

Survey researchers fall into this gray area of interpretation because they often lack the tools to build a knowledgeable understanding of vague data types, such as scale midpoints. Unless the study is a hybrid research design (i.e., a quantitative study that incorporates qualitative components), the researcher is left to guess respondents’ meaning.

In contrast, the unique attributes of qualitative research methods offer researchers the tools they need to construct informed interpretations of their data. By way of context, latent (coupled with manifest) meanings, the participant-researcher relationship, and other fundamentals associated with qualitative research, the trained researcher collects thick data from which to build an interpretation that addresses the research objectives in a profound and valuable manner for the users of the research.

Qualitative data analysis is a process by which the researcher is actively involved in the creation of themes from the data and the interpretation within and across themes to construct results that move the topic of investigation forward in some meaningful way. This active involvement is central to what it means to conduct qualitative research. Faithful to the principles that define qualitative research, researchers do not rest on manifest content, such as words alone, or on automated tools that exploit the obvious, such as word clouds.

This is another way of saying — as stated in this article on sample size and saturation — that “themes do not simply pop up…but rather are the result of actively conducting an analysis to construct an interpretation.” As Staller (2015) states, “In lieu of the language of ‘discovering’ things with its positivistic roots, the researcher is actually interpreting the evidence” (p. 147).

Braun and Clarke (2006, 2016, 2019, 2021) have written extensively about the idea that “themes do not passively emerge” (2019, p. 594, italics in original) from thematic analysis and that meaning

is not inherent or self-evident in data, that meaning resides at the intersection of the data and the researcher’s contextual and theoretically embedded interpretative practices – in short, that meaning requires interpretation. (2021, p. 210)

An article posted in 2018 in Research Design Review“The Important Role of ‘Buckets’ in Qualitative Data Analysis” — illustrates this point. The article discusses the analytical step of creating categories (or “buckets”) of codes representing shared constructs prior to building themes. As an example, the discussion focuses on three categories that were developed from an in-depth interview study with financial managers — Technology, Partner, Communication. The researcher constructed themes by looking within and across categories, considering the meaning and context associated with each code. One such theme was “strong partnership,” as illustrated below.

Themes from buckets

The theme “strong partnership” did not simply emerge from the data, it was not lying in the data waiting to be discovered. Rather, the researcher utilized their analytical skills, in conjunction with their constructed understanding of each participant’s contribution to the data, to create contextually sound, meaningful themes such as “strong partnership.” Then, with the depth of definition associated with each theme, the researcher looked within and across themes to build an interpretation of the research data targeted at the research objectives, and provided the users of the research with a meaningful path forward.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Braun, V., & Clarke, V. (2016). (Mis)conceptualising themes, thematic analysis, and other problems with Fugard and Potts’ (2015) sample-size tool for thematic analysis. International Journal of Social Research Methodology, 19(6), 739–743. https://doi.org/10.1080/13645579.2016.1195588

Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, Vol. 11, pp. 589–597. https://doi.org/10.1080/2159676X.2019.1628806

Braun, V., & Clarke, V. (2021). To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qualitative Research in Sport, Exercise and Health, 13(2), 201–216. https://doi.org/10.1080/2159676X.2019.1704846

Staller, K. M. (2015). Qualitative analysis: The art of building bridging relationships. Qualitative Social Work, 14(2), 145–153. https://doi.org/10.1177/1473325015571210