Guide development

Guide Development & the Integrity of Qualitative Research Data

The funnel four-stage approach to in-depth interview (IDI) and focus group guide development is an effective and efficient method for gaining key insights among qualitative research participants within an allotted time frame. A 2015 article in Research Design Review Integrityoffers a schematic of this approach and outlines the intended purpose associated with each of the four basic stages (see “Interview Guide Development: A 4-Stage ‘Funnel’ Approach”).

But what exactly does “effective and efficient” mean as it relates to guide development, and why should we care? The answers lie in the fact that a thoughtful funnel approach to guide development enables the researcher to derive quality data from their qualitative research while achieving research objectives and maximizing the ultimate usefulness of the outcomes. By having a clear understanding of what it means to develop an interview or discussion guide that is both effective and efficient, the researcher has added greatly to the integrity of the qualitative research data and design.

There are at least six ways that the funnel four-stage approach to guide development is important to the effectiveness and efficiency of IDI and focus group research. The funnel approach:

  • Mitigates bias. Progressively moving to the primary topic of interest allows the interviewer/moderator to gather an understanding of perceptions and behavior unblemished by the researcher’s own agenda.

 

  • Helps identify variations. The general-to-narrow approach inherently provides the researcher with the necessary fundamental information that is needed to compare and contrast earlier comments with participants’ later remarks. In this way, the interviewer/moderator is able to identify variations in what is being said and conduct the necessary follow-up.

 

  • Fosters rapport through a friendly flow of conversation. By beginning the interview or discussion with questions that are general in nature, the interviewer/moderator is facilitating the researcher-participant relationship in a conversational and non-threatening way.

 

  • Reduces repetition. The flow of conversation that is grounded in a general-to-narrow method logically circumvents the potential problem of inappropriately repeating the same or similar topic areas or asking redundant questions.

 

  • Encourages engagement and cooperation. Just as the funnel approach facilitates rapport building through conversation, it also creates an atmosphere in which participants feel emboldened to engage with the researcher and, in focus groups, with the other participants. This heightened level of cooperation fuels otherwise hidden insights which in turn help to mitigate bias and bolster data quality.

 

  • Aids in analysis. By mitigating bias, helping to identify variations in the data, fostering rapport, reducing repetition, and encouraging engagement and cooperation, the funnel approach to guide development ultimately advances data analysis. The analyst is able to discern categories and themes, as well as outliers, in the data in a straightforward way based on well-thought-out transitions in the conversations.

 

Image capture from: http://www.modernvillagallery.com/artists-2/sarah-goodnough/

Interview Guide Development: A 4-Stage Funnel Approach

In-depth interviewers and focus group moderators typically work from an outline of relevant topics and questions that guides them Funnel approach to guide developmentthrough the interview or discussion. The guide is intended to be just that, a guide, and not a strict, prescriptive document. With the guide, the ultimate goal is to enable the interviewer or moderator to efficiently incorporate all of the issues that are important to achieving the research objectives. Maintaining clarity throughout the interview or discussion on the related issues is actually a more essential purpose of the guide than the actual questions or follow-up probes it may contain.

The most typical and effective approach in constructing an interview or discussion guide is to begin broadly and progressively narrow the topic area to the subject matter of greatest importance to the research objectives, i.e., a “funnel” approach. The funnel consists of four basic stages.

Stage 1: Introductions
The interviewer or moderator introduces themself, briefly explains the purpose of the research, the use of audio/video recording, participant’s anonymity, etc., and allows the participant(s) to comment or ask questions.

The participant(s) introduce themselves by way of answering a few simple questions related to the research objective. For example, in a focus group study with new homeowners concerning their recent mortgage process, the researcher might begin by asking participants how they picked the home they did and one or two things they love about living there.

Stage 2: General information related to the topic
This stage provides background and context to the topic broadly defined, giving the researcher a necessary perspective from which to pursue certain questioning as well as conduct an informed analysis at the conclusion of the research. In the study with new homeowners, this stage might include a discussion about their attitudes toward the mortgage loan process.

Stage 3: Awareness, attitudes &/or behavior related to particular issues
At this stage, the interview or discussion begins to home in on the ultimate objective of the research. Now, for instance, the new homeowners might be asked about their recall and attitudes toward the various mortgage documents (the real focus of the study) they reviewed and signed during the mortgage process.

Stage 4: Attitudes specific to the targeted objective & constructive suggestions for improvement
Aided by the relevant background and context provided in stages 1-3, the final stage of the funnel approach is when the researcher dives into the true “meat” of the interview or discussion. Using the study with new homeowners, this stage might ask about participants’ reactions to prototypes of re-formatted mortgage documents, asking them to compare these prototypes with those used in their mortgages, and asking for suggestions on how to improve the prototypes in order to better communicate with new borrowers.

A four-stage funnel approach is useful – efficient and effective – in creating one-on-one or group interview guides that lead researchers on a path toward reaching their objectives.

[NOTE: Instruction on qualitative guide and question development is available. Please contact Margaret Roller.]