Skip to main content
. 2007 Feb;53(2):277–286.

Table 1.

Procedures of the 5-round Delphi survey

DELPHI ROUND PURPOSE PROCEDURES
Round 1 posted for12 days (86% response) Identify and describe rewards and challenges Participants were asked to do the following
  • Complete a demographic questionnaire:

  • Describe significant rewards and challenges they have experienced in practice

  • Include reasons for their choices

Round 2 posted for37 days (96% response) Clarify rewards and challenges and identify any new rewards or challenges 34 themes from round 1 were posted for review. Participants were asked to do the following:
  • Rate how well the theme rejected their comments(1—not at all, 4—very well) and comment

  • Rate themes’ importance and effect on family medicine(1—not at all, 5—very important) and provide reasons for ratings

  • Review themes rated as important for “breadth and completeness” and “clarify”

  • Reject on the breadth and completeness of rewards and challenges as described and add any others and rate them

Round 3 posted for 12 days (89% response) Develop consensus on key rewards and challenges and obtain feedback 53 themes from round 2 were posted for review (divided into rewards and challenges). Participants were asked to do the following
  • Select up to 10 key rewards and challenges each:

  • Provide comments and feedback

Round 4 posted for 17 days (89% response) Validate and clarify key rewards and challenges identified, develop a priority list of rewards and challenges, explore Potential solutions including the role organizations could play, determine whether other rewards or challenges should be considered, and obtain feedback Rewards and challenges chosen were posted along with the results of previous rounds. Participants were asked to do the following:
  • Rate how well the list represents the key rewards and challenges(1—not at all, 5—very well)

  • Clarify whether “maintaining and acquiring skills and knowledge” represents 2 separate issues or the same issue

  • Clarify whether “medicolegal issues, paperwork, and motor vehicle accidents” could be included with “paperwork, telephone calls, and forms”

  • Comment on proposed list and add any items that should be included

  • Select the 5 most important rewards and challenges and rank them on a scale of 1 to 5 relative to each other. Repeat this process to identify the least important items

  • Rate the need to address challenges (1—no need, 5—very strong need).

Provide ideas for addressing challenges
  • Reject on the key rewards and challenges and provide salient and concrete suggestions on the precise way specific organizations could assist

  • Provide any other ideas, comments, feedback, or suggestions

Round 5 posted for 27 days (86% response) Obtain further clarification determine whether new, challenges identified in round 4 should be included, and obtain feedback Summarized results from round 4 were posted, including 3 new potential challenges with descriptions of what could be done to address each challenge. Participants were asked to do the following:
  • Clarify the wording of “rewards of maintaining and acquiring skills and knowledge” and “medicolegal issues, insurance paperwork, and motor vehicle accidents”

  • Comment on and rate the need to address the new challenge(1—no need, 5—very strong need)

  • Decide whether the new challenge should be a key challenge

  • Provide ideas on solutions and the role key organizations could play

  • Answer the questionnaire soliciting feedback