Skip to main content
PMC home page
The BMJ logoLink to The BMJ
. 1995 Aug 5;311(7001):376–380. doi: 10.1136/bmj.311.7001.376

Consensus methods for medical and health services research.

J Jones 1, D Hunter 1
PMCID: PMC2550437  PMID: 7640549

Abstract

Health providers face the problem of trying to make decisions in situations where there is insufficient information and also where there is an overload of (often contradictory) information. Statistical methods such as meta-analysis have been developed to summarise and to resolve inconsistencies in study findings--where information is available in an appropriate form. Consensus methods provide another means of synthesising information, but are liable to use a wider range of information than is common in statistical methods, and where published information is inadequate or non-existent these methods provide a means of harnessing the insights of appropriate experts to enable decisions to be made. Two consensus methods commonly adopted in medical, nursing, and health services research--the Delphi process and the nominal group technique (also known as the expert panel)--are described, together with the most appropriate situations for using them; an outline of the process involved in undertaking a study using each method is supplemented by illustrations of the authors' work. Key methodological issues in using the methods are discussed, along with the distinct contribution of consensus methods as aids to decision making, both in clinical practice and in health service development.

Full text

PDF
376

Images in this article

377p377-a
on p.377

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Attala J. M., Gresley R. S., McSweeney M., Jobe M. A. Health needs of school-age children in two midwestern counties. Issues Compr Pediatr Nurs. 1993 Jan-Mar;16(1):51–60. doi: 10.3109/01460869309078266. [DOI] [PubMed] [Google Scholar]
  2. Beers M. H., Ouslander J. G., Rollingher I., Reuben D. B., Brooks J., Beck J. C. Explicit criteria for determining inappropriate medication use in nursing home residents. UCLA Division of Geriatric Medicine. Arch Intern Med. 1991 Sep;151(9):1825–1832. [PubMed] [Google Scholar]
  3. Bellamy N., Anastassiades T. P., Buchanan W. W., Davis P., Lee P., McCain G. A., Wells G. A., Campbell J. Rheumatoid arthritis antirheumatic drug trials. III. Setting the delta for clinical trials of antirheumatic drugs--results of a consensus development (Delphi) exercise. J Rheumatol. 1991 Dec;18(12):1908–1915. [PubMed] [Google Scholar]
  4. Brchan M. S., Hegge M. J., Stenvig T. E. A tiger by the tail: tackling barriers to differentiated practice. J Contin Educ Nurs. 1991 May-Jun;22(3):109–112. doi: 10.3928/0022-0124-19910501-08. [DOI] [PubMed] [Google Scholar]
  5. Chin J., Sato P. A., Mann J. M. Projections of HIV infections and AIDS cases to the year 2000. Bull World Health Organ. 1990;68(1):1–11. [PMC free article] [PubMed] [Google Scholar]
  6. Crotty M. The emerging role of the British nurse teacher in Project 2000 programmes: a Delphi survey. J Adv Nurs. 1993 Jan;18(1):150–157. doi: 10.1046/j.1365-2648.1993.18010150.x. [DOI] [PubMed] [Google Scholar]
  7. Elder O. C., Jr, Andrew M. E. Important curriculum content for baccalaureate allied health programs: a survey of deans. J Allied Health. 1992 Spring;21(2):105–115. [PubMed] [Google Scholar]
  8. Fasser C. E., Smith Q. W., Luchi R. J. Geriatrics fellows' perceptions of the quality of their research training. Acad Med. 1992 Oct;67(10):696–698. doi: 10.1097/00001888-199210000-00017. [DOI] [PubMed] [Google Scholar]
  9. Felson D. T. Choosing a core set of disease activity measures for rheumatoid arthritis clinical trials. J Rheumatol. 1993 Mar;20(3):531–534. [PubMed] [Google Scholar]
  10. Fink A., Kosecoff J., Chassin M., Brook R. H. Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984 Sep;74(9):979–983. doi: 10.2105/ajph.74.9.979. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Gallagher M., Hares T., Spencer J., Bradshaw C., Webb I. The nominal group technique: a research tool for general practice? Fam Pract. 1993 Mar;10(1):76–81. doi: 10.1093/fampra/10.1.76. [DOI] [PubMed] [Google Scholar]
  12. Hayward R. S., Wilson M. C., Tunis S. R., Bass E. B., Rubin H. R., Haynes R. B. More informative abstracts of articles describing clinical practice guidelines. Ann Intern Med. 1993 May 1;118(9):731–737. doi: 10.7326/0003-4819-118-9-199305010-00012. [DOI] [PubMed] [Google Scholar]
  13. Hunter D. J., McKee C. M., Sanderson C. F., Black N. A. Appropriate indications for prostatectomy in the UK--results of a consensus panel. J Epidemiol Community Health. 1994 Feb;48(1):58–64. doi: 10.1136/jech.48.1.58. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Jones J., Sanderson C., Black N. What will happen to the quality of care with fewer junior doctors? A Delphi study of consultant physicians' views. J R Coll Physicians Lond. 1992 Jan;26(1):36–40. [PMC free article] [PubMed] [Google Scholar]
  15. Kahan J. P., Bernstein S. J., Leape L. L., Hilborne L. H., Park R. E., Parker L., Kamberg C. J., Brook R. H. Measuring the necessity of medical procedures. Med Care. 1994 Apr;32(4):357–365. doi: 10.1097/00005650-199404000-00004. [DOI] [PubMed] [Google Scholar]
  16. Kitzinger J. Qualitative research. Introducing focus groups. BMJ. 1995 Jul 29;311(7000):299–302. doi: 10.1136/bmj.311.7000.299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Liang M. H., Katz J. N., Phillips C., Sledge C., Cats-Baril W. The total hip arthroplasty outcome evaluation form of the American Academy of Orthopaedic Surgeons. Results of a nominal group process. The American Academy of Orthopaedic Surgeons Task Force on Outcome Studies. J Bone Joint Surg Am. 1991 Jun;73(5):639–646. [PubMed] [Google Scholar]
  18. Manning D., Balson P. M., Barenberg N., Moore T. M. Susceptibility to AIDS: what college students do and don't believe. J Am Coll Health. 1989 Sep;38(2):67–73. doi: 10.1080/07448481.1989.9938418. [DOI] [PubMed] [Google Scholar]
  19. McGlynn E. A., Kosecoff J., Brook R. H. Format and conduct of consensus development conferences. Multi-nation comparison. Int J Technol Assess Health Care. 1990;6(3):450–469. doi: 10.1017/s0266462300001045. [DOI] [PubMed] [Google Scholar]
  20. McKee M., Priest P., Ginzler M., Black N. How representative are members of expert panels? Qual Assur Health Care. 1991;3(2):89–94. doi: 10.1093/intqhc/3.2.89. [DOI] [PubMed] [Google Scholar]
  21. McKee M., Priest P., Ginzler M., Black N. Which tasks performed by pre-registration house officers out of hours are appropriate? Med Educ. 1992 Jan;26(1):51–57. doi: 10.1111/j.1365-2923.1992.tb00123.x. [DOI] [PubMed] [Google Scholar]
  22. Mobily P. R., Herr K. A., Kelley L. S. Cognitive-behavioral techniques to reduce pain: a validation study. Int J Nurs Stud. 1993 Dec;30(6):537–548. doi: 10.1016/0020-7489(93)90025-p. [DOI] [PubMed] [Google Scholar]
  23. Moscovice I., Armstrong P., Shortell S., Bennett R. Health services research for decision-makers: the use of the Delphi technique to determine health priorities. J Health Polit Policy Law. 1977;2(3):388–410. doi: 10.1215/03616878-2-3-388. [DOI] [PubMed] [Google Scholar]
  24. Neidlinger S. H., Ljutic P. M., Moed A. B., Chin P. P., Kowalczyk M. E., Anton R. S. Defining the major nursing administration issue: doing more with less. J Nurs Adm. 1993 May;23(5):9–10. [PubMed] [Google Scholar]
  25. Passannante M. R., Restifo R. A., Reichman L. B. Preventive therapy for the patient with both universal indication and contraindication for isoniazid. Chest. 1993 Mar;103(3):825–831. doi: 10.1378/chest.103.3.825. [DOI] [PubMed] [Google Scholar]
  26. Perry S., Kalberer J. T., Jr The NIH consensus-development program and the assessment of health-care technologies: the first two years. N Engl J Med. 1980 Jul 17;303(3):169–172. doi: 10.1056/NEJM198007173030334. [DOI] [PubMed] [Google Scholar]
  27. Perry S. The NIH Consensus Development Program. A decade later. N Engl J Med. 1987 Aug 20;317(8):485–488. doi: 10.1056/NEJM198708203170806. [DOI] [PubMed] [Google Scholar]
  28. Rainhorn J. D., Brudon-Jakobowicz P., Reich M. R. Priorities for pharmaceutical policies in developing countries: results of a Delphi survey. Bull World Health Organ. 1994;72(2):257–264. [PMC free article] [PubMed] [Google Scholar]
  29. Rizzolo M. A. Factors influencing the development and use of interactive video in nursing education. A Delphi study. Comput Nurs. 1990 Jul-Aug;8(4):151–159. [PubMed] [Google Scholar]
  30. Scott E. A., Black N. Appropriateness of cholecystectomy in the United Kingdom--a consensus panel approach. Gut. 1991 Sep;32(9):1066–1070. doi: 10.1136/gut.32.9.1066. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Smith D. M., Murphy W. M. Histologic changes in prostate carcinomas treated with leuprolide (luteinizing hormone-releasing hormone effect). Distinction from poor tumor differentiation. Cancer. 1994 Mar 1;73(5):1472–1477. doi: 10.1002/1097-0142(19940301)73:5<1472::aid-cncr2820730525>3.0.co;2-m. [DOI] [PubMed] [Google Scholar]
  32. Ziemba S. E., Hubbell F. A., Fine M. J., Burns M. J. Resting electrocardiograms as baseline tests: impact on the management of elderly patients. Am J Med. 1991 Dec;91(6):576–583. doi: 10.1016/0002-9343(91)90209-g. [DOI] [PubMed] [Google Scholar]

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Publishing Group

RESOURCES