reporting

Reporting Qualitative Research: A Model of Transparency

A number of articles in Research Design Review have discussed, in one form or another, the Total Quality Framework (TQF)* approach to qualitative research design.  An RDR post last month pertained to applying the TQF to the in-depth interviewing method; while other articles have focused on transparencyways to integrate quality measures – in harmony with the TQF – into ethnography, mobile research, and the research proposal.  Separate from applications per se, an article in February 2015 discussed the compatibility of a quality approach with social constructionism.

One of the four components of the TQF is Transparency** which is specific to the reporting phase of the research process.  In particular, Transparency has to do with the researcher’s full disclosure of the research design, fieldwork, and analytical procedures in the final document.  This sounds simple enough yet it is common to read qualitative research reports, papers, and articles that too quickly jump to research findings and discussion, with relatively scant attention given to the peculiarities of the design, data gathering, or analysis.  This is unfortunate and misguided because these details are necessary for the user of the research to understand the context by which interpretations were derived and to judge the applicability of the outcomes to other situations (i.e., transferability).

There are, of course, exceptions; and, indeed, many researchers are skillful in divulging these all-important details.  One example is Deborah C. Bailey’s article, “Women and Wasta: The Use of Focus Groups for Understanding Social Capital and Middle Eastern Women.”  In it, Bailey provides Read Full Text

Reporting Ethnography: Storytelling & the Roles Participants Play

In Chapter 10 of Sam Ladner’s book Practical Ethnography: A Guide to Doing Ethnography in the Private Sector, the author discusses a best practice approach to reporting ethnographic research for a corporate audience.  She states Shakespean actorthat “private-sector ethnographic reports are successful if they are dramatic and consistent with the organization’s truth regime” (p.165).  To this end, Ladner recommends text reports with “clickable hyperlinks” throughout and supplemental material, such as a PowerPoint presentation, that acts as the “marketing campaign” or “movie trailer” for the text document.

As another “delightful element” to the ethnography report, Ladner suggests the use of personas or archetypes, each representing a depiction of participants that share a particular characteristic.  This is “a useful way to summarize the voluminous amount of qualitative data” (p. 167); however, Ladner cautions that personas “are often done badly” and points to Steve Portigal’s article on the subject matter, “Persona Non Grata.”  In it, Portigal advocates for maintaining the “realness” of research participants rather than manufacturing a “falsehood” (by way of personas) that distances the users of the research from the people they want to know most about.  Portigal encourages researchers to engage with the “messiness of actual human beings,” emphasizing that “people are too wonderfully complicated to be reduced to plastic toys [that is, personas].”

Reporting observational research for corporate users can be a challenge.  On the one hand, the researcher is obligated to dig into the messiness of analysis and convey an honest accounting of what the researcher saw and heard.  On the other hand, the final reporting is meaningless if no one pays attention to it, thereby preventing the research from having the desired effect of bringing new energy and a new way of thinking to the organization.  Ladner and Portigal agree that powerful storytelling grounded in reality is the best approach, but how do we create a compelling drama while maintaining the integrity of our data?  A combination of formats, as Ladner suggests, is one tactic.  And the use of personas may be another.  An open and ongoing discussion among researchers about personas – if and how the roles we assign the actors in our final story are (or can be) created while staying true to the study participants – seems like a worthwhile effort.

 

Image captured from: https://www.thestage.co.uk/features/2015/386081/

 

Reporting What We Know From What We Ask

For most of us, it is important to write a final research report that goes beyond the questions we asked and the responses we received. Unlike a topline debriefing that may require a simple rundown of the questions and responses, our qualitative and quantitative studies typically Pop-tartsculminate in write-ups that provide thoughtful discussions of our analyses and interpretations of the data.

The consumers of our research reports take it on blind faith that the data along with the corresponding questions and issues are reported accurately, and that the researchers’ interpretations of the findings are consistent with both the data and the questions asked or issues raised.   And yet blind faith is not always enough. Those are the times when a closer look at what the research actually asked and what is actually reported is needed.

One example is a July 2014 report from Gallup on its research concerning Americans’ consumption habits. The report, in part, shows that nearly all (more than 90%) Read Full Text