Skip to main content
PMC home page
Injury Prevention logoLink to Injury Prevention
. 1998 Jun;4(2):141–147. doi: 10.1136/ip.4.2.141

Evaluation of interventions to prevent injuries: an overview

A Dannenberg 1, C Fowler 1
PMCID: PMC1730368  PMID: 9666371

Abstract

Overview of issues involved in evaluating the effectiveness of injury interventions is presented. An intervention should be evaluated to show it prevents injuries in the target population, to identify unintended consequences, to correct problems that limit effectiveness, to justify current and future resources from funding agencies, and to guide its replication elsewhere. Problems in conducting evaluations include obtaining sufficient resources, coping with rare events, establishing reliability and validity of measurement instruments, separating effects of multiple simultaneous events, and adjusting for the time lag between an intervention and its effects.

When feasible, changes in injury rates (documented by medical records) should be used. These are more convincing for demonstrating intervention effectiveness than changes in observed or reported behaviors or in knowledge and attitudes (documented by surveys). Quasiexperimental evaluation designs are often useful, such as measuring injury rates before and after an intervention in a time series design, or intervening in one of two comparable communities in a non-equivalent control group design. Evaluations using true experimental designs, in which individuals or groups are randomized to receive or not receive an intervention, are highly desirable but are often difficult due to logistical or ethical considerations. An evaluation component should be integral to the introduction of any new injury intervention.

Full Text

The Full Text of this article is available as a PDF (118.3 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Baker M. D., Moore S. E., Wise P. H. The impact of 'Bottle Bill' legislation on the incidence of lacerations in childhood. Am J Public Health. 1986 Oct;76(10):1243–1244. doi: 10.2105/ajph.76.10.1243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Bergman A. B., Rivara F. P., Richards D. D., Rogers L. W. The Seattle children's bicycle helmet campaign. Am J Dis Child. 1990 Jun;144(6):727–731. doi: 10.1001/archpedi.1990.02150300127033. [DOI] [PubMed] [Google Scholar]
  3. Coté T. R., Sacks J. J., Lambert-Huber D. A., Dannenberg A. L., Kresnow M. J., Lipsitz C. M., Schmidt E. R. Bicycle helmet use among Maryland children: effect of legislation and education. Pediatrics. 1992 Jun;89(6 Pt 2):1216–1220. [PubMed] [Google Scholar]
  4. Cushman R., Down J., MacMillan N., Waclawik H. Helmet promotion in the emergency room following a bicycle injury: a randomized trial. Pediatrics. 1991 Jul;88(1):43–47. [PubMed] [Google Scholar]
  5. Dannenberg A. L., Gielen A. C., Beilenson P. L., Wilson M. H., Joffe A. Bicycle helmet laws and educational campaigns: an evaluation of strategies to increase children's helmet use. Am J Public Health. 1993 May;83(5):667–674. doi: 10.2105/ajph.83.5.667. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Davidson L. L., Durkin M. S., Kuhn L., O'Connor P., Barlow B., Heagarty M. C. The impact of the Safe Kids/Healthy Neighborhoods Injury Prevention Program in Harlem, 1988 through 1991. Am J Public Health. 1994 Apr;84(4):580–586. doi: 10.2105/ajph.84.4.580. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Ferguson S. A., Leaf W. A., Williams A. F., Preusser D. F. Differences in young driver crash involvement in states with varying licensure practices. Accid Anal Prev. 1996 Mar;28(2):171–180. doi: 10.1016/0001-4575(95)00051-8. [DOI] [PubMed] [Google Scholar]
  8. Ferguson S. A., Preusser D. F., Lund A. K., Zador P. L., Ulmer R. G. Daylight saving time and motor vehicle crashes: the reduction in pedestrian and vehicle occupant fatalities. Am J Public Health. 1995 Jan;85(1):92–95. doi: 10.2105/ajph.85.1.92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Fergusson D. M., Horwood L. J., Beautrais A. L., Shannon F. T. A controlled field trial of a poisoning prevention method. Pediatrics. 1982 May;69(5):515–520. [PubMed] [Google Scholar]
  10. Gallaher M. M., Fleming D. W., Berger L. R., Sewell C. M. Pedestrian and hypothermia deaths among Native Americans in New Mexico. Between bar and home. JAMA. 1992 Mar 11;267(10):1345–1348. [PubMed] [Google Scholar]
  11. Gielen A. C., Dannenberg A. L., Ashburn N., Kou J. Teaching safety: evaluation of a children's village in Maryland. Inj Prev. 1996 Mar;2(1):26–31. doi: 10.1136/ip.2.1.26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Gielen A. C., Joffe A., Dannenberg A. L., Wilson M. E., Beilenson P. L., DeBoer M. Psychosocial factors associated with the use of bicycle helmets among children in counties with and without helmet use laws. J Pediatr. 1994 Feb;124(2):204–210. doi: 10.1016/s0022-3476(94)70304-3. [DOI] [PubMed] [Google Scholar]
  13. Hingson R., McGovern T., Howland J., Heeren T., Winter M., Zakocs R. Reducing alcohol-impaired driving in Massachusetts: the Saving Lives Program. Am J Public Health. 1996 Jun;86(6):791–797. doi: 10.2105/ajph.86.6.791. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Hollands C. M., Winston F. K., Stafford P. W., Shochat S. J. Severe head injury caused by airbag deployment. J Trauma. 1996 Nov;41(5):920–922. doi: 10.1097/00005373-199611000-00033. [DOI] [PubMed] [Google Scholar]
  15. Janda D. H., Wojtys E. M., Hankin F. M., Benedict M. E. Softball sliding injuries. A prospective study comparing standard and modified bases. JAMA. 1988 Mar 25;259(12):1848–1850. doi: 10.1001/jama.259.12.1848. [DOI] [PubMed] [Google Scholar]
  16. Kelsey T. W., Jenkins P. L. Farm tractors and mandatory roll-over protection retrofits: potential costs of the policy in New York. Am J Public Health. 1991 Jul;81(7):921–923. doi: 10.2105/ajph.81.7.921. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Kraus J. F. Effectiveness of measures to prevent unintentional deaths of infants and children from suffocation and strangulation. Public Health Rep. 1985 Mar-Apr;100(2):231–240. [PMC free article] [PubMed] [Google Scholar]
  18. Langley J. D., Wagenaar A. C., Begg D. J. An evaluation of the New Zealand graduated driver licensing system. Accid Anal Prev. 1996 Mar;28(2):139–146. doi: 10.1016/0001-4575(95)00040-2. [DOI] [PubMed] [Google Scholar]
  19. Loftin C., McDowall D., Wiersema B., Cottey T. J. Effects of restrictive licensing of handguns on homicide and suicide in the District of Columbia. N Engl J Med. 1991 Dec 5;325(23):1615–1620. doi: 10.1056/NEJM199112053252305. [DOI] [PubMed] [Google Scholar]
  20. Mallonee S., Istre G. R., Rosenberg M., Reddish-Douglas M., Jordan F., Silverstein P., Tunell W. Surveillance and prevention of residential-fire injuries. N Engl J Med. 1996 Jul 4;335(1):27–31. doi: 10.1056/NEJM199607043350106. [DOI] [PubMed] [Google Scholar]
  21. McLoughlin E., Clarke N., Stahl K., Crawford J. D. One pediatric burn unit's experience with sleepwear-related injuries. Pediatrics. 1977 Oct;60(4):405–409. [PubMed] [Google Scholar]
  22. McLoughlin E., Langley J. D., Laing R. M. Prevention of children's burns: legislation and fabric flammability. N Z Med J. 1986 Oct 22;99(812):804–807. [PubMed] [Google Scholar]
  23. McLoughlin E., Marchone M., Hanger L., German P. S., Baker S. P. Smoke detector legislation: its effect on owner-occupied homes. Am J Public Health. 1985 Aug;75(8):858–862. doi: 10.2105/ajph.75.8.858. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Miller T. R., Levy D. T. Cost outcome analysis in injury prevention and control: a primer on methods. Inj Prev. 1997 Dec;3(4):288–293. doi: 10.1136/ip.3.4.288. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Pearn J. H., Wong R. Y., Brown J., 3rd, Ching Y. C., Bart R., Jr, Hammar S. Drowning and near-drowning involving children: a five-year total population study from the City and County of Honolulu. Am J Public Health. 1979 May;69(5):450–454. doi: 10.2105/ajph.69.5.450. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Rivara F. P., Calonge N., Thompson R. S. Population-based study of unintentional injury incidence and impact during childhood. Am J Public Health. 1989 Aug;79(8):990–994. doi: 10.2105/ajph.79.8.990. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Robertson L. S. Crash involvement of teenaged drivers when driver education is eliminated from high school. Am J Public Health. 1980 Jun;70(6):599–603. doi: 10.2105/ajph.70.6.599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Robertson L. S., Kelley A. B., O'Neill B., Wixom C. W., Eiswirth R. S., Haddon W., Jr A controlled study of the effect of television messages on safety belt use. Am J Public Health. 1974 Nov;64(11):1071–1080. doi: 10.2105/ajph.64.11.1071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Robertson L. S., Zador P. L. Driver education and fatal crash involvement of teenaged drivers. Am J Public Health. 1978 Oct;68(10):959–965. doi: 10.2105/ajph.68.10.959. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Robitaille Y., Legault J., Abbey H., Pless I. B. Evaluation of an infant car seat program in a low-income community. Am J Dis Child. 1990 Jan;144(1):74–78. doi: 10.1001/archpedi.1990.02150250084038. [DOI] [PubMed] [Google Scholar]
  31. Rodgers G. B. The safety effects of child-resistant packaging for oral prescription drugs. Two decades of experience. JAMA. 1996 Jun 5;275(21):1661–1665. [PubMed] [Google Scholar]
  32. Sacks J. J., Brantley M. D., Holmgreen P., Rochat R. W. Evaluation of an intervention to reduce playground hazards in Atlanta child-care centers. Am J Public Health. 1992 Mar;82(3):429–431. doi: 10.2105/ajph.82.3.429. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Shi L. A cost-benefit analysis of a California county's back injury prevention program. Public Health Rep. 1993 Mar-Apr;108(2):204–211. [PMC free article] [PubMed] [Google Scholar]
  34. Sloan J. H., Kellermann A. L., Reay D. T., Ferris J. A., Koepsell T., Rivara F. P., Rice C., Gray L., LoGerfo J. Handgun regulations, crime, assaults, and homicide. A tale of two cities. N Engl J Med. 1988 Nov 10;319(19):1256–1262. doi: 10.1056/NEJM198811103191905. [DOI] [PubMed] [Google Scholar]
  35. Spiegel C. N., Lindaman F. C. Children can't fly: a program to prevent childhood morbidity and mortality from window falls. Am J Public Health. 1977 Dec;67(12):1143–1147. doi: 10.2105/ajph.67.12.1143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Thompson D. C., Rivara F. P., Thompson R. S. Effectiveness of bicycle safety helmets in preventing head injuries. A case-control study. JAMA. 1996 Dec 25;276(24):1968–1973. [PubMed] [Google Scholar]
  37. Thompson R. S., Rivara F. P., Thompson D. C. A case-control study of the effectiveness of bicycle safety helmets. N Engl J Med. 1989 May 25;320(21):1361–1367. doi: 10.1056/NEJM198905253202101. [DOI] [PubMed] [Google Scholar]
  38. Tinetti M. E., Baker D. I., McAvay G., Claus E. B., Garrett P., Gottschalk M., Koch M. L., Trainor K., Horwitz R. I. A multifactorial intervention to reduce the risk of falling among elderly people living in the community. N Engl J Med. 1994 Sep 29;331(13):821–827. doi: 10.1056/NEJM199409293311301. [DOI] [PubMed] [Google Scholar]
  39. Vulcan A. P., Cameron M. H., Watson W. L. Mandatory bicycle helmet use: experience in Victoria, Australia. World J Surg. 1992 May-Jun;16(3):389–397. doi: 10.1007/BF02104437. [DOI] [PubMed] [Google Scholar]
  40. Watson G. S., Zador P. L., Wilks A. The repeal of helmet use laws and increased motorcyclist mortality in the United States, 1975-1978. Am J Public Health. 1980 Jun;70(6):579–585. doi: 10.2105/ajph.70.6.579. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Williams A. F. Evaluation of the Tennessee Child Restraint Law. Am J Public Health. 1979 May;69(5):455–458. doi: 10.2105/ajph.69.5.455. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Injury Prevention are provided here courtesy of BMJ Publishing Group

RESOURCES