Skip to main content
. Author manuscript; available in PMC: 2022 Jul 1.
Published in final edited form as: Med Decis Making. 2021 Oct 25;42(5):684–703. doi: 10.1177/0272989X211053794
Criterion Description
Research rationale The need for using an expert elicitation exercise should be described
Research problem All uncertain quantities (model input parameters) that will be elicited should be described
Measurement type of uncertain quantities The rationale for the measure type of each uncertain quantity elicited should be described
Definition of an expert The nature of the expert population should be described to clearly state what topic of expertise they represent and why
Number of experts The selection criteria and final number of experts recruited to provide expert judgment should be reported
Preparation There should be clear reference made to a protocol that describes the design and conduct of the elicitation exercise
Piloting It should be clearly reported if the elicitation exercise process was piloted and a summary of any modifications made
Data collection The approach to collect the data should be reported
Administration The mode of administering the elicitation exercise should be reported
Training The use of training materials should be reported and made available
The exercise The number and framing of questions used in the exercise should be reported and made available; alternatively in Delphi consensus building exercises the number of sessions and processes for building consensus should be reported
Data aggregation The type of aggregation method (mathematical or behavioral) should be reported together with a description of the method or process used to aggregate the data
Measures of performance for data aggregation The processes followed to estimate measures of performance (calibration/information) for data aggregation need to be fully described
Presentation of results The individual, and aggregated, point estimate(s) and distribution for each uncertain quantity (quantities) should be presented
Interpretation of results The interpretation of uncertain quantities elicited should be presented together with a description of how the results will be used in the model-based analysis
Parameter impact The modeling results explicitly describe how changes in the elicited parameter(s) impact the results and conclusions of the study