Skip to main content
The BMJ logoLink to The BMJ
. 2001 Sep 1;323(7311):514.

Checklists for improving rigour in qualitative research

Never mind the tail (checklist), check out the dog (research)

Robert Power 1
PMCID: PMC1121093  PMID: 11560141

Editor—Barbour's article is tantalising and mystifying in equal measure.1 She is right to counsel qualitative researchers from shielding behind a protective wall of checklists and quasi-paradigmatic research techniques—although the same should be levelled at epidemiologists, statisticians, and health economists, with all researchers being charged with the responsibility of ensuring that the research tools and analysis fit the question to be addressed. Yet, and this is where the tantalising becomes mystifying, she twice (once in the second paragraph and again in the last) tells us that our research strategies need to be informed by the epistemology of qualitative research, without giving us an inkling as to what she believes this to be. Although she rightly espouses the importance of context for qualitative researchers, she denies us the context in which to assess her own critique.

As a champion of applied social science, particularly action research and qualitative research in public health, I think that the biggest threat to this growing area of work is not so much overadherence to prescriptive checklists and sampling strategies but rather the over-reliance on self reports and verbal representations of the world. For many, qualitative research has become synonymous with the semistructured interview, the self report, and the ubiquitous focus group. The roots of qualitative research are in anthropology and ethnography, where direct observation of events is central. Much of the contribution of qualitative research in the understanding of social aspects of health issues, notably HIV/AIDS, has been through direct observation of the nuances of social behaviour. Questioning the validity of checklists and the prevailing methodological orthodoxy in qualitative research is useful, but of greater relevance is the need to promote (and teach) a more observational paradigm for qualitative health research.

References

  • 1.Barbour RS. Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? BMJ. 2001;322:1115–1117. doi: 10.1136/bmj.322.7294.1115. . (5 May.) [DOI] [PMC free article] [PubMed] [Google Scholar]
BMJ. 2001 Sep 1;323(7311):514.

Including personal reflections might help

Brian Williams 1

Editor—Barbour has been brave enough to place her head above the parapet.1-1 Over the past few years, researchers who use qualitative methods have received greater esteem, obtained funding from sources previously out of bounds, and published in journals that may have dismissed their efforts a decade ago. As a result it has been in the interests of many researchers to keep some of these views to themselves. I believe that Barbour has done a service to the integrity of the methodology of qualitative research, but she stops short of offering many solutions. I sympathise. Solutions to any of the problems highlighted are themselves likely to be added to the checklists. For example, Barbour seems to advocate the “constant-comparative” method of analysis, but should this simply be added to current lists?

The constant search for rigour simply results in longer and longer checklists. One only has to compare the assessment and design guidelines for clinical trials 20 years ago with those of today to see the point. Will qualitative research go the same way? Perhaps it does not matter, and longer checklists simply reflect advances in knowledge of the scientific method. My concern, however, is that, although checklists are a quick and easy way of facilitating the appraisal of a paper, they simply set up rules that researchers play to and get around, in rather the same way that they find ways of getting round tax legislation.

Historically, qualitative researchers have addressed this issue, not simply through technical fixes but the more important process of documenting reflection. They constantly reflect on the research question, their role, attitudes, feelings, the impact of the researcher on the people being studied, and so on. Although the personal reflections of the researcher may seem rather out of place in many academic journals, it would at least provide a way of covering some of the known and unknown blind spots of checklists. This applies to quantitative as well as qualitative research. In reading the report of a clinical trial, do we really know everything that happened? For example, patients were not told what drug they were receiving but were they really “blind”? Rigour may lie in the unreported details, peculiarities, and idiosyncrasies of studies as much as in the overarching issues contained in a checklist. The challenge is finding a way of making it possible and acceptable to report these openly.

References

  • 1-1.Barbour RS. Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? BMJ. 2001;322:1115–1117. doi: 10.1136/bmj.322.7294.1115. . (5 May.) [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Publishing Group

RESOURCES