triangulation

Verification: Looking Beyond the Data in Qualitative Data Analysis

It is a common misperception among researchers that the analysis of research data is a process that is confined to the data itself. This is probably truer among qualitative researchers than survey researchers given that the latter Image result for looking beyondfrequently publish their work in the literature comparing and contrasting their data with relevant earlier studies. Qualitative research, on the other hand, is typically held up to less scrutiny; and, except for the usual comparisons of populations segments, it is rare to find an analytical discussion that goes beyond the patterns and themes derived from the qualitative data itself. This may be for any number of reasons. It may be associated with the idea that qualitative research by definition is chock full of uncontrollable variables that vary from study to study making data comparisons across studies unreliable, or it may be researchers’ unfamiliarity Read Full Text

Managing Ghosts & the Case for Triangulation in Qualitative Research

The most recent issue of the American Psychological Association’s Monitor on Psychology includes an interview with developmental psychologist, Jerome Kagan.  In this interview he talks about psychology’s research “ghosts,” referring to the dubious generalizations psychologist’s make from their often-limited research.  Kagan’s primary point is that “it’s absolutely necessary to gather more than one source of data, no matter what you’re studying,” and that these multiple sources of data should come from verbal and behavioral as well as physiological measures.  Only by combining these various perspectives on an issue or situation – that is, utilizing data taken in different contexts and by way of alternative methods and modes – can the researcher come to a legitimate conclusion.

This is not unlike triangulation, esp., in the social and health sciences, which is used to gauge the trustworthiness of research outcomes.  Triangulation is the technique of examining a specific research topic by comparing data obtained from: two or more methods, two or more segments of the sample population, and/or two or more investigators.  In this way, the researcher is looking for patterns of convergence and divergence in the data.  Triangulation is a particularly important design feature in qualitative research – where measures of validity and reliability can be elusive – because it furthers the researcher’s ability to gain a comprehensive view of the research question and come closer to a plausible interpretation of final results.

Where is this multifaceted process in the commercial world of qualitative marketing research?  Academics talk about the importance of including some form of triangulation in research design yet there is not a lot of evidence that this occurs in marketing research.  While there are an increasing number of ways to gather qualitative feedback – particularly via social media and mobile – that provide researchers with convenient sources of data, there needs to be more discussion on case studies that have utilized multiple data sources and methods to find reliable themes in the outcomes.  Importantly, it is further hoped that marketing researchers use this contrast-and-compare approach to scrutinize the research issue from both traditional (e.g., face-to-face group discussions, in-depth interviews, in-home ethnography) and new (e.g., online based, smartphone) information-gathering strategies.

The triangulation concept is just one way that marketing researchers can begin to bring rigor to their research designs and manage the “ghosts” of groundless assumptions and misguided interpretations.