Table 3.
Study |
Conduct |
Analyses |
||||||
---|---|---|---|---|---|---|---|---|
Mode of administration | Opportunities for revision | Format/software | Training | Piloting | Pooling | Fitting | Pooled distribution used directly within the decision model? | |
Garthwaite et al. [14] | Individual face-to-face and remote (telephone) interviews | Unclear | Interview and specialized software | NR | No | No pooling | Independently elicited quantities: NR; dependency elicitation: yes, generalized linear model | No, each expert’s distributions used directly |
Leal et al. [10] | Remote (email) and individual face-to-face interviews | Yes | Excel-based | NR | Yes | Linear pooling | Yes, maximum likelihood | Yes |
Girling et al. [15] | Group face-to-face interviews | Yes | NA | NR | NR | – | Yes, method NR | Yes |
Stevenson et al. [16] | NR | NR | NR | NR | NR | NR | NR | Yes |
Meads et al. [12] | Group face-to-face and individual face-to-face interviews | NR | Paper | Yes | NR | Linear pooling | NR | No, Bayesian updating with existing evidence |
McKenna et al. [19] | NR | NR | Excel-based | Yes | Yes | Linear pooling | Yes, method NR | Yes |
Haakma et al. [13] | Individual face-to-face interviews | Yes | Excel-based | NR | Yes | Linear pooling | Yes, Project Evaluation and Review Technique software | Yes |
Stevenson et al. [17] | Group face-to-face interviews | Yes | NR | NR | NR | NA | Yes, least squares | NR |
Speight et al. [25] | NR | NR | Paper | NR | NR | NR | Yes, method NR | Yes |
Sperber et al. [22] | Remote (telephone) interviews | Yes | Excel-based | NR | Yes | Linear pooling | Yes, least squares (EasyFit software) | NR |
Colbourn et al. [28] | NR | NR | NR | NR | NR | Predictive distribution from random-effects meta-analysis | Yes, method NR | Yes |
Soares et al. [9] | Group face-to-face interviews | Yes | Excel-based | Yes | Yes | Linear pooling | Yes, method of moments | No, Bayesian updating with existing evidence |
Bojke et al. [18] | Individual face-to-face interviews | Yes | Excel-based | Yes | NR | Linear pooling and random-effects meta-analysis | Yes, method of moments | Yes |
Cao et al. [11] | NR | NR | NR | NR | NR | Linear pooling | Yes (BetaBuster software) | Yes |
Fischer et al. [23] | Group face-to-face, individual face-to-face, and remote (telephone) interviews | NR | Paper | Yes | Yes | Linear pooling | No, empirical distribution used | NR |
Poncet et al. [27] | NR | NR | NR | NR | NR | Linear pooling | NR | Yes |
Grigore et al. [24] | Individual face-to-face interviews | Yes | Excel-based | Yes | Yes | Linear pooling | Yes, method NR | Yes |
Wilson et al. [20] | NR | NR | SHELF | NR | NR | NR | NR | Yes |
Meeyai et al. [21] | NR | NR | SHELF | NR | NR | NR | NR | No, Bayesian updating with existing evidence |
Grimm et al. [35] | NR | NR | NR | NR | NR | Linear pooling | Yes, least squares | Yes |
NA, not applicable; NR, not reported; SHELF, Sheffield Elicitation Framework.