There are lots of articles discussing question design, focusing on such things as how to mitigate various forms of bias, clearly communicate the intended meaning of the question, and facilitate response. Survey question wording is discussed in this “tip sheet” from Harvard University as well as in “Questionnaire Design” from Pew Research Center, and a recent article in Research Design Review discussed the not-so-simple “why” question in qualitative research (see “Re-considering the Question of ‘Why’ in Qualitative Research”).
Getting the question “right” is a concern of all researchers, but qualitative researchers have to be particularly mindful of the responses they get in return. It is not good enough to use an interview guide to ask a question, get an answer, and move on to the next question. And, it is often not good enough to ask a question, get an answer, interject one or two probing questions, and move on to the next question. Indeed, one of the toughest skills a qualitative interviewer has to learn is how to evaluate a participant’s answer to any given question. This goes way beyond evaluating whether the participant responded in line with the intention of the question or the potential sources of bias. Rather, this broader, much-needed evaluation of a response requires a reflexive, introspective consideration on the part of the interviewer.
Reflexivity is central to a qualitative approach in research methods. It is a topic that is discussed often in RDR – see “Interviewer Bias & Reflexivity in Qualitative Research,” “Reflections from the Field: Questions to Stimulate Reflexivity Among Qualitative Researchers,” and “Facilitating Reflexivity in Observational Research: The Observation Guide & Grid” – because of its role Read Full Text
It is easy to fall into the trap of relying on the “why” question when conducting qualitative research. After all, the use of qualitative research is often supported with the claim that qualitative methods enable the researcher to reach beyond quantitative numerical data to grasp the meaning and motivations – that is, the why – associated with particular attitudes and behavior. And it is in this spirit that researchers frequently find themselves with interview and discussion guides full of “why” questions – Why do you say you are happy? Why do you prefer one political candidate over another? Why do you diet? Why do you believe in God? Why do you use a tablet rather than a laptop computer?
Yet “why” is rarely the question worth asking. In fact, asking “why” questions can actually have a negative effect on data collection (i.e., Credibility) and contribute bias to qualitative data. This happens for many reasons, here are just four:
The “why” question potentially
• Evokes rationality. By asking the “why” question, researchers are in essence asking participants to justify their attitudes and behavior. In contemplating a justification, it is not unusual for participants to seek Read Full Text
There are four components to the Total Quality Framework in qualitative research design. The first component, Credibility, has to do with data collection; specifically, the completeness and accuracy of the data collected. There are two critical facets to Credibility – Scope (coverage and representation) and Data Gathering (bias, nonresponse, and how well [or not] particular constructs are measured).
The second component is Analyzability. This component is concerned with the completeness and accuracy of the analyses and interpretations. The Analyzability component is concerned with Processing (e.g., the use of transcriptions, coding) and Verification (e.g., by way of triangulation, deviant cases, and/or a reflexive journal).
By looking at just these two components of the TQF, what judgments can we make as to the strengths and limitations of the various modes Read Full Text