Importance of Nonresponse in Qualitative Research
May 31, 2013
Nonresponse and non-response error is more than a quantitative issue. While qualitative researchers may shudder at the thought, the typically-ignored impact of nonresponse is just as important in the qualitative realm. Why is nonresponse in qualitative research important? Because we are conducting qualitative research. Not qualitative let’s get a few warm bodies around the table for our face-to-face focus group, but actually research methods that, like all research, demand certain protocols that address potential biasing effects. One of these is nonresponse. The warm bodies in our group discussion may make the moderator and client observers feel great – Thank goodness, someone showed up! – but the uncomfortable reality is that the people who chose not to participate – or were never contacted by a recruiter and asked to participate in the first place – greatly affect our research outcomes. Indeed, the trajectory of a group discussion has as much to do with the people sitting around a table as it does with those who aren’t there.
Who are the folks that the recruiter glossed over and never contacted on our sample list? How are the people who elect to attend our group discussion the same or different than those who didn’t? And, without knowing the answers to these questions, how can qualitative researchers put their research findings into any perspective? How do they know what they think they know?
This is why, among other things, researchers need to pay more attention to gaining cooperation in their qualitative studies. Fortunately for the qualitative researcher, there are many ways to improve cooperation and thereby decrease the threat from nonresponse. For example, the design of a focus group study needs to carefully consider the personal circumstances of potential participants, i.e., where they are, what they do in their day, how they communicate, etc. This should lead to design considerations such as:
- Location, e.g., Does the researcher need to give participants a choice of location, such as an uptown or downtown facility?
- Time, e.g., Is 6:00 p.m. really the best time for participants to meet?
- Incentive, e.g., What type of material and/or non-material incentive “makes sense” for this participant segment?
- Mode of contact, e.g., Are participants most likely to respond to phone, email, or the U.S. mail as way of contact and how should the researcher combine these modes to gain greater cooperation?
And, at a minimum, the recruiting screener should:
- Communicate the purpose of the study to arouse interest in participating without introducing details that may influence participants’ feedback in the discussion;
- Communicate a personal benefit or non-material motivation (e.g., telling suburban women that their participation in a discussion concerning the local shopping mall is their opportunity to contribute to the creation of an improved shopping environment);
- Mention the material incentives, such as the nature of the incentive (e.g., cash, a gift card, prized tickets to a sporting event, donation to a favorite charity, etc.) and the value;
- Identify the study’s sponsor; and
- Provide logistical details so that showing up for the focus group – face-to-face, on the telephone, or online – is easy and uncomplicated.