Skip to main content
NCBI home page
American Journal of Public Health logoLink to American Journal of Public Health
. 1995 Oct;85(10):1378–1383. doi: 10.2105/ajph.85.10.1378

Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993.

J M Simpson 1, N Klar 1, A Donnor 1
PMCID: PMC1615612  PMID: 7573621

Abstract

OBJECTIVES. This methodological review aims to determine the extent to which design and analysis aspects of cluster randomization have been appropriately dealt with in reports of primary prevention trials. METHODS. All reports of primary prevention trials using cluster randomization that were published from 1990 to 1993 in the American Journal of Public Health and Preventive Medicine were identified. Each article was examined to determine whether cluster randomization was taken into account in the design and statistical analysis. RESULTS. Of the 21 articles, only 4 (19%) included sample size calculations or discussions of power that allowed for clustering, while 12 (57%) took clustering into account in the statistical analysis. CONCLUSIONS. Design and analysis issues associated with cluster randomization are not recognized widely enough. Reports of cluster randomized trials should include sample size calculations and statistical analyses that take clustering into account, estimates of design effects to help others planning trials, and a table showing the baseline distribution of important characteristics by intervention group, including the number of clusters and average cluster size for each group.

Full text

PDF
1378

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Abdeljaber M. H., Monto A. S., Tilden R. L., Schork M. A., Tarwotjo I. The impact of vitamin A supplementation on morbidity: a randomized community intervention trial. Am J Public Health. 1991 Dec;81(12):1654–1656. doi: 10.2105/ajph.81.12.1654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Bartlett A. V., Englender S. J., Jarvis B. A., Ludwig L., Carlson J. F., Topping J. P. Controlled trial of Giardia lamblia: control strategies in day care centers. Am J Public Health. 1991 Aug;81(8):1001–1006. doi: 10.2105/ajph.81.8.1001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bauman K. E., LaPrelle J., Brown J. D., Koch G. G., Padgett C. A. The influence of three mass media campaigns on variables related to adolescent cigarette smoking: results of a field experiment. Am J Public Health. 1991 May;81(5):597–604. doi: 10.2105/ajph.81.5.597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bell R. M., Ellickson P. L., Harrison E. R. Do drug prevention effects persist into high school? How project ALERT did with ninth graders. Prev Med. 1993 Jul;22(4):463–483. doi: 10.1006/pmed.1993.1038. [DOI] [PubMed] [Google Scholar]
  5. Cushman R., James W., Waclawik H. Physicians promoting bicycle helmets for children: a randomized trial. Am J Public Health. 1991 Aug;81(8):1044–1046. doi: 10.2105/ajph.81.8.1044. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Donner A., Birkett N., Buck C. Randomization by cluster. Sample size requirements and analysis. Am J Epidemiol. 1981 Dec;114(6):906–914. doi: 10.1093/oxfordjournals.aje.a113261. [DOI] [PubMed] [Google Scholar]
  7. Donner A., Brown K. S., Brasher P. A methodological review of non-therapeutic intervention trials employing cluster randomization, 1979-1989. Int J Epidemiol. 1990 Dec;19(4):795–800. doi: 10.1093/ije/19.4.795. [DOI] [PubMed] [Google Scholar]
  8. Donner A., Klar N. Methods for comparing event rates in intervention studies when the unit of allocation is a cluster. Am J Epidemiol. 1994 Aug 1;140(3):279–301. doi: 10.1093/oxfordjournals.aje.a117247. [DOI] [PubMed] [Google Scholar]
  9. Donner A. Sample size requirements for stratified cluster randomization designs. Stat Med. 1992 Apr;11(6):743–750. doi: 10.1002/sim.4780110605. [DOI] [PubMed] [Google Scholar]
  10. Elder J. P., Wildey M., de Moor C., Sallis J. F., Jr, Eckhardt L., Edwards C., Erickson A., Golbeck A., Hovell M., Johnston D. The long-term prevention of tobacco use among junior high school students: classroom and telephone interventions. Am J Public Health. 1993 Sep;83(9):1239–1244. doi: 10.2105/ajph.83.9.1239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Ellickson P. L., Bell R. M., McGuigan K. Preventing adolescent drug use: long-term results of a junior high program. Am J Public Health. 1993 Jun;83(6):856–861. doi: 10.2105/ajph.83.6.856. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Ennett S. T., Tobler N. S., Ringwalt C. L., Flewelling R. L. How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations. Am J Public Health. 1994 Sep;84(9):1394–1401. doi: 10.2105/ajph.84.9.1394. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Feldman H. A., McKinlay S. M. Cohort versus cross-sectional design in large field trials: precision, sample size, and a unifying model. Stat Med. 1994 Jan 15;13(1):61–78. doi: 10.1002/sim.4780130108. [DOI] [PubMed] [Google Scholar]
  14. Freedman L. S., Green S. B., Byar D. P. Assessing the gain in efficiency due to matching in a community intervention study. Stat Med. 1990 Aug;9(8):943–952. doi: 10.1002/sim.4780090810. [DOI] [PubMed] [Google Scholar]
  15. Gomel M., Oldenburg B., Simpson J. M., Owen N. Work-site cardiovascular risk reduction: a randomized trial of health risk assessment, education, counseling, and incentives. Am J Public Health. 1993 Sep;83(9):1231–1238. doi: 10.2105/ajph.83.9.1231. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Graham J. W., Johnson C. A., Hansen W. B., Flay B. R., Gee M. Drug use prevention programs, gender, and ethnicity: evaluation of three seventh-grade Project SMART cohorts. Prev Med. 1990 May;19(3):305–313. doi: 10.1016/0091-7435(90)90030-n. [DOI] [PubMed] [Google Scholar]
  17. Hansen W. B., Graham J. W. Preventing alcohol, marijuana, and cigarette use among adolescents: peer pressure resistance training versus establishing conservative norms. Prev Med. 1991 May;20(3):414–430. doi: 10.1016/0091-7435(91)90039-7. [DOI] [PubMed] [Google Scholar]
  18. Hebert J. R., Kristeller J., Ockene J. K., Landon J., Luippold R., Goldberg R. J., Kalan K. Patient characteristics and the effect of three physician-delivered smoking interventions. Prev Med. 1992 Sep;21(5):557–573. doi: 10.1016/0091-7435(92)90064-o. [DOI] [PubMed] [Google Scholar]
  19. Hsieh F. Y. Sample size formulae for intervention studies with the cluster as unit of randomization. Stat Med. 1988 Nov;7(11):1195–1201. doi: 10.1002/sim.4780071113. [DOI] [PubMed] [Google Scholar]
  20. Hulley S. B. Symposium on CHD prevention trials: design issues in testing life style intervention. Am J Epidemiol. 1978 Aug;108(2):85–86. doi: 10.1093/oxfordjournals.aje.a112605. [DOI] [PubMed] [Google Scholar]
  21. Jeffery R. W., Forster J. L., French S. A., Kelder S. H., Lando H. A., McGovern P. G., Jacobs D. R., Jr, Baxter J. E. The Healthy Worker Project: a work-site intervention for weight control and smoking cessation. Am J Public Health. 1993 Mar;83(3):395–401. doi: 10.2105/ajph.83.3.395. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Kelly J. A., St Lawrence J. S., Diaz Y. E., Stevenson L. Y., Hauth A. C., Brasfield T. L., Kalichman S. C., Smith J. E., Andrew M. E. HIV risk behavior reduction following intervention with key opinion leaders of population: an experimental analysis. Am J Public Health. 1991 Feb;81(2):168–171. doi: 10.2105/ajph.81.2.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Knutsen S. F., Knutsen R. The Tromsø Survey: the Family Intervention study--the effect of intervention on some coronary risk factors and dietary habits, a 6-year follow-up. Prev Med. 1991 Mar;20(2):197–212. doi: 10.1016/0091-7435(91)90020-5. [DOI] [PubMed] [Google Scholar]
  24. Koepsell T. D., Martin D. C., Diehr P. H., Psaty B. M., Wagner E. H., Perrin E. B., Cheadle A. Data analysis and sample size issues in evaluations of community-based health promotion and disease prevention programs: a mixed-model analysis of variance approach. J Clin Epidemiol. 1991;44(7):701–713. doi: 10.1016/0895-4356(91)90030-d. [DOI] [PubMed] [Google Scholar]
  25. Koepsell T. D., Wagner E. H., Cheadle A. C., Patrick D. L., Martin D. C., Diehr P. H., Perrin E. B., Kristal A. R., Allan-Andrilla C. H., Dey L. J. Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annu Rev Public Health. 1992;13:31–57. doi: 10.1146/annurev.pu.13.050192.000335. [DOI] [PubMed] [Google Scholar]
  26. Lando H. A., McGovern P. G., Barrios F. X., Etringer B. D. Comparative evaluation of American Cancer Society and American Lung Association smoking cessation clinics. Am J Public Health. 1990 May;80(5):554–559. doi: 10.2105/ajph.80.5.554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Lewis B. S., Lynch W. D. The effect of physician advice on exercise behavior. Prev Med. 1993 Jan;22(1):110–121. doi: 10.1006/pmed.1993.1008. [DOI] [PubMed] [Google Scholar]
  28. Martin D. C., Diehr P., Perrin E. B., Koepsell T. D. The effect of matching on the power of randomized community intervention studies. Stat Med. 1993 Feb;12(3-4):329–338. doi: 10.1002/sim.4780120315. [DOI] [PubMed] [Google Scholar]
  29. McCusker J., Stoddard A. M., Zapka J. G., Morrison C. S., Zorn M., Lewis B. F. AIDS education for drug abusers: evaluation of short-term effectiveness. Am J Public Health. 1992 Apr;82(4):533–540. doi: 10.2105/ajph.82.4.533. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Murray D. M., Perry C. L., Griffin G., Harty K. C., Jacobs D. R., Jr, Schmid L., Daly K., Pallonen U. Results from a statewide approach to adolescent tobacco use prevention. Prev Med. 1992 Jul;21(4):449–472. doi: 10.1016/0091-7435(92)90053-k. [DOI] [PubMed] [Google Scholar]
  31. Payment P., Richardson L., Siemiatycki J., Dewar R., Edwardes M., Franco E. A randomized trial to evaluate the risk of gastrointestinal disease due to consumption of drinking water meeting current microbiological standards. Am J Public Health. 1991 Jun;81(6):703–708. doi: 10.2105/ajph.81.6.703. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Perry C. L., Kelder S. H., Murray D. M., Klepp K. I. Communitywide smoking prevention: long-term outcomes of the Minnesota Heart Health Program and the Class of 1989 Study. Am J Public Health. 1992 Sep;82(9):1210–1216. doi: 10.2105/ajph.82.9.1210. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Resnicow K., Cross D., Lacosse J., Nichols P. Evaluation of a school-site cardiovascular risk factor screening intervention. Prev Med. 1993 Nov;22(6):838–856. doi: 10.1006/pmed.1993.1076. [DOI] [PubMed] [Google Scholar]
  34. Shipley M. J., Smith P. G., Dramaix M. Calculation of power for matched pair studies when randomization is by group. Int J Epidemiol. 1989 Jun;18(2):457–461. doi: 10.1093/ije/18.2.457. [DOI] [PubMed] [Google Scholar]
  35. Sorensen G., Morris D. M., Hunt M. K., Hebert J. R., Harris D. R., Stoddard A., Ockene J. K. Work-site nutrition intervention and employees' dietary habits: the Treatwell program. Am J Public Health. 1992 Jun;82(6):877–880. doi: 10.2105/ajph.82.6.877. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Sussman S., Dent C. W., Stacy A. W., Sun P., Craig S., Simon T. R., Burton D., Flay B. R. Project towards no tobacco use: 1-year behavior outcomes. Am J Public Health. 1993 Sep;83(9):1245–1250. doi: 10.2105/ajph.83.9.1245. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Walker R., Heller R., Redman S., O'Connell D., Boulton J. Reduction of ischemic heart disease risk markers in the teenage children of heart attack patients. Prev Med. 1992 Sep;21(5):616–629. doi: 10.1016/0091-7435(92)90069-t. [DOI] [PubMed] [Google Scholar]
  38. Williams D. A. The analysis of binary responses from toxicological experiments involving reproduction and teratogenicity. Biometrics. 1975 Dec;31(4):949–952. [PubMed] [Google Scholar]
  39. Worden J. K., Solomon L. J., Flynn B. S., Costanza M. C., Foster R. S., Jr, Dorwaldt A. L., Weaver S. O. A community-wide program in breast self-examination training and maintenance. Prev Med. 1990 May;19(3):254–269. doi: 10.1016/0091-7435(90)90026-g. [DOI] [PubMed] [Google Scholar]
  40. Zeger S. L., Liang K. Y., Albert P. S. Models for longitudinal data: a generalized estimating equation approach. Biometrics. 1988 Dec;44(4):1049–1060. [PubMed] [Google Scholar]

Articles from American Journal of Public Health are provided here courtesy of American Public Health Association

RESOURCES