Abstract
This paper addresses the logistical challenges of implementing public health interventions in the setting of cluster randomized trials (CRTs), drawing on the experience of carrying out a CRT within a community-based health insurance (CBHI) scheme in rural India. Our CRT is seeking to improve the equity impact — i.e., reduce the differential in claims submission for hospitalization between poor and less poor — of this CBHI in rural areas. Five main challenges are identified and discussed: 1) assigning control clusters, 2) blinding, 3) implementing interventions simultaneously, 4) minimizing leakage, and 5) piggy-backing on a changing scheme. These challenges are not likely to be unique to low-income settings, although the fifth challenge is particularly likely when working with relatively small and resource-constrained programs. While compromises to methodological best-practice may reduce internal validity, they make the intervention more ‘real’, and potentially more applicable, to other programs and settings. Further, careful documentation of compromises allows them to be considered in the final analysis.
MeSH terms: Health insurance, India, nongovernmental organizations, randomized controlled trials
Résumé
Cet article traite des difficultés logistiques rencontrées dans la mise en oeuvre d’interventions de santé publique dans le cadre d’essais contrôlés randomisés par grappes. Il tire les enseignements d’une expérience menée au sein d’un système d’assurance-santé communautaire dans une région rurale de l’Inde. Il s’agit d’une intervention randomisée par grappes qui a pour but d’améliorer l’équité du système, à savoir réduire l’écart entre les demandes de remboursement des frais d’hospitalisation soumises par les populations pauvres et moins pauvres. Cinq grandes difficultés sont présentées et discutées dans l’article: 1) la mise en place des groupes de contrôle, 2) la création des conditions d’un test en aveugle, 3) la simultanéité des interventions, 4) le risque de contamination entre les groupes et 5) l’implantation sur un dispositif connaissant des modifications. Ces problèmes ne sont pas propres au contexte des pays en développement, bien que le dernier soit plus courant dans le cas de petits programmes aux ressources limitées. Les concessions faites par rapport aux canons méthodologiques sont susceptibles de réduire la validité interne de l’étude, mais elles rendent l’intervention plus réaliste et potentiellement plus applicable à d’autres contextes. En outre, une documentation précise de ces compromis nous permet de les prendre en compte à la fin de l’analyse.
Footnotes
Acknowledgement of sources of support: This research was carried out as part of a collaboration between the Health Economics and Financing Programme (LSHTM) and Vimo SEWA. Financial support was provided by the Wellcome Trust (UK).
References
- 1.Palmer N, Mueller DH, Gilson L, Mills A, Haines A. Health financing to promote access in low income settings—how much do we know. Lancet. 2004;364:1365–70. doi: 10.1016/S0140-6736(04)17195-X. [DOI] [PubMed] [Google Scholar]
- 2.Donner A, Klar N. Pitfalls of and controversies in cluster randomization trials. Public Health Matters. 2004;94(3):416–22. doi: 10.2105/ajph.94.3.416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Donner A. Some aspects of the design and analysis of cluster randomization trials. Applied Statistics. 1998;47(Part1):95–113. [Google Scholar]
- 4.Victora CG, Habicht JP, Bryce J. Evidence-based public health: Moving beyond randomized trials. Am J Public Health. 2004;94(3):400–5. doi: 10.2105/AJPH.94.3.400. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Campbell MK, Elbourne DR, Altman DG, et al. CONSORT statement: Extension to cluster randomised trials. BMJ. 2004;328:702–8. doi: 10.1136/bmj.328.7441.702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Edwards SJL. Ethical issues in the design and conduct of cluster randomised controlled trials. BMJ. 1999;318:1407–9. doi: 10.1136/bmj.318.7195.1407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Duflo E. ABCDE. 2003. Scaling up and evaluation; p. 39. [Google Scholar]
- 8.Torgerson DJ. Contamination in trials: Is cluster randomisation the answer. BMJ. 2001;322:355–57. doi: 10.1136/bmj.322.7282.355. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Varnell SP, Murray DM, Janega JB, Blitstein JL. Design and analysis of group-randomized trials: A review of recent practices. Am J Public Health. 2004;94(3):393–99. doi: 10.2105/AJPH.94.3.393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Murray DM, Varnell SP, Blitstein JL. Design and analysis of group-randomized trials: A review of recent methodological developments. Am J Public Health. 2004;94(3):423–32. doi: 10.2105/AJPH.94.3.423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ranson MK, Sinha T, Chatterjee M, Acharya A, Bhavsar A, Morris SS. Soc Sci Med. 2005. Making health insurance work for the poor: Learning from the Self-Employed Women’s Association’s communitybased health insurance scheme. [DOI] [PubMed] [Google Scholar]
- 12.Sinha T, Ranson MK, Chatterjee M, Acharya A, Mills A. Health Policy and Planning. 2006. Barriers faced by the poor in benefiting from community-based insurance services: Lessons learnt from SEWA Insurance, Gujarat. [DOI] [PubMed] [Google Scholar]
- 13.Hawe P, Shiell A, Riley T. Complex interventions: How “out of control” can a randomised controlled trial be. BMJ. 2004;328:1561–63. doi: 10.1136/bmj.328.7455.1561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Duflo E, Kremer M. World Bank Operations Evaluation Department (OED) Conference on Evaluation and Development Effectiveness. 2003. Use of randomization in the evaluation of development effectiveness; p. 37. [Google Scholar]
- 15.BMC Medical Research Methodology. 2003. [DOI] [PMC free article] [PubMed]