online research

The Asynchronous Focus Group Method: Participant Participation & Transparency

There is a great deal that is written about transparency in research. It is generally acknowledged that researchers owe it to their research sponsors as well as to the broader research community to divulge the details of their designs and the implementation of their studies. Articles pertaining to transparency Participant participation in asynchronous focus group discussionshave been posted throughout Research Design Review.

The need for transparency in qualitative research is as relevant for designs utilizing off-line modes, such as in-person interviews and focus group discussions, as it is for online research, such as asynchronous focus groups. A transparency detail that is critical for the users of online asynchronous – not-in-real-time – focus group discussions research is the level of participant participation. This may, in fact, be the most important information concerning an asynchronous study that a researcher can provide.

Participation level in asynchronous discussions is particularly important because participation in the online asynchronous mode can be erratic and weak. Nicholas et al. (2010) found that “online focus group participants offered substantially less information than did those in the [in-person] groups” (p. 114) and others have underscored a serious limitation of this mode; that is, “it is very difficult to get subjects with little interest in [the topic] to participate and the moderator has more limited options for energising and motivating the participants” (Murgado-Armenteros et al., 2012, p. 79) and, indeed, researchers have found that “participation in the online focus group dropped steadily” during the discussion period (Deggs et al., 2010, p. 1032).

The integrity and ultimate usefulness of focus group data hinge solidly on the level of participation and engagement among group participants. This is true regardless of mode but it is a particularly critical consideration when conducting asynchronous discussions. Because of this and because transparency is vital to the health of the qualitative research community, focus group researchers employing the online asynchronous method are encouraged to continually monitor, record, and report on the rate and level of participation, e.g., how many and who (in terms of relevant characteristics) of the recruited sample entered into the discussion, how many and who responded to all questions, how thoughtful and in-depth (or not) were responses, how many and who engaged with the moderator, and how many and who engaged with other participants.

This transparent account of participant participation offers the users of asynchronous focus group research an essential ingredient as they assess the value of the study conducted.

Deggs, D., Grover, K., & Kacirek, K. (2010). Using message boards to conduct online focus groups. Retrieved from http://www.nova.edu/ssss/QR/QR15-4/deggs.pdf

Murgado-Armenteros, E. M., Torres-Ruiz, F. J., & Vega-Zamora, M. (2012). Differences between online and face-to-face focus groups, viewed through two approaches. Journal of Theoretical and Applied Electronic Commerce Research, 7(2), 73–86.

Nicholas, D. B., Lach, L., King, G., Scott, M., Boydell, K., Sawatzky, B., … Young, N. L. (2010). Contrasting Internet and face-to-face focus groups for children with chronic health conditions : Outcomes and participant experiences. International Journal of Qualitative Methods, 9(1), 105–122.

Image captured from: https://uwm.edu/studentinvolvement/student-organizations-2/our-communityinvolvement/

The Focus Group Method

In 2018, five articles were published pertaining to the focus group method. Two of these articles discuss the key differentiating attribute of focus groups, i.e., participant interaction and engagement, and the important role this attribute plays in the integrity of the research.

The interactive component of the focus group method also raises questions concerning mode, which is the subject of two other articles in this compilation. Specifically, these articles address the strengths and limitations of the in-person and online asynchronous focus group modes.

The fifth article in this paper discusses the concept of saturation in the context of determining the “right” number of focus groups to conduct for a particular study. Saturation has been discussed before in RDR, with the emphasis being on the idea that saturation alone is an inadequate measure by which to derive the number of events and, in fact, as a sole measure, saturation jeopardizes data quality, see “Designing a Quality In-depth Interview Study: How Many Interviews Are Enough?”

The focus group method has been discussed in RDR over the years, such as this article on mode differences, and this article (actually, slide show) on applying the Total Quality Framework to focus groups, and a discussion on the use of projective techniques, as well as an article on the many considerations in the design and implementation of the focus group method.

Mobile & Online Qualitative Research: The Good, the Bad, & the Ugly

Data quality matters. Regardless of the research method or approach, our ability to say anything meaningful about our research outcomes hinges on the integrity of the data. The greater care the researcher takes to ensure the basic ingredients of “good” research design, the more confident the researcher and importantly the user of the research will be in the recommendations drawn from the research and its ultimate usefulness.

This focus on data quality applies to all research. And although it is most often a topic of discussion among survey researchers, data quality considerations are increasingly (I hope!) a discussion among qualitative researchers as well. Indeed, the underlying validity of our qualitative data is an important consideration regardless of the researcher’s paradigm orientation or the qualitative method, including the more recent methodological options – that is, mobile and online qualitative research.

Mobile and online technology – in particular, tech solutions that combine observation with a multimethod/mode approach – offer qualitative researchers new ways to investigate a variety of situations that give them a closer understanding of participants’ lived experiences as never before possible. Three such situations are: Read Full Text