Question Design

Focusing on a Research Design Reality: Questions Lead to Answers

Questions Lead to AnswersAt the core of research design development — in quantitative and qualitative methods — is the reality that individuals who have agreed to participate in our research studies generally answer the questions we ask. This fundamental reality places a heavy burden on the researcher developing a quality research design. Survey research that relies on closed-end questionnaire items is vulnerable to unreliable data due to question design that confuses respondents or fosters interpretations outside the true intention of the question asked. All of which leaves the researcher with weak data and consequently flawed analysis and erroneous final results. The need for more involved research designs that effectively investigate complex subject matter is discussed throughout Research Design Review, including in “Life Is Meaningful, Or Is It?: The Road To Meaning In Survey Data” and “Feelings & Sensations: Where Survey Designs Fail Badly.”

Ask a willing research respondent/participant a question and you are likely to get an answer. It may not be the question the researcher intended, it may confuse the responding individual, but the Read Full Text

Re-considering the Question of “Why”

It is easy to fall into the trap of relying on the “why” question when conducting qualitative research. After all, the use of qualitative research is often supported with the claim that qualitative methods enable the researcher to reach beyond quantitative numerical data to grasp the meaning and motivations – that is, the why – associated with particular attitudes and behavior. And it is in this spirit that researchers frequently find themselves with interview and discussion guides full of “why” questions – Why do you say you are happy? Why do you prefer one political candidate over another? Why do you diet? Why do you believe in God? Why do you use a tablet rather than a laptop computer?

Yet “why” is rarely the question worth asking. In fact, asking “why” questions can actually have a negative effect on data collection (i.e., Credibility) and may contribute to a distortion in qualitative data. This happens for many reasons, here are just four:

The “why” question potentially

• Evokes rationality. By asking the “why” question, researchers are in essence asking participants to justify their attitudes and behavior. In contemplating a justification, it is not unusual for participants to seek Read Full Text

Life Is Meaningful, Or Is It?: The Road To Meaning In Survey Data

Samantha Heintzelman and Laura King, at the University of Missouri, published an article in American Psychologist in 2014 titled, “Life is Pretty Meaningful.” In this article the authors meaningful walkdiscuss their work that explores the answer to the “lofty” question “How meaningful is life, in general?” To do this, Heintzelman and King examined two broad categories of data sources: 1) large-scale surveys – six representative surveys conducted in the U.S. and a worldwide poll; and 2) articles published in the literature that explicitly report on research studies utilizing one of two established measures of meaning in life – the Purpose in Life Test (PIL) and Meaning in Life Questionnaire (MLQ). The large-scale surveys asked yes-and-no questions such as “Did you feel that your life has meaning [in the past 12 months]?” as well as agree-disagree rating scale items such as “My life has a real purpose.” Their analysis of these surveys concluded that “for most people, life is meaningful [and] comparatively few Read Full Text