TABLE 2.
Item | Development or validation? | Checklist item | Latorre 2015 | Pan 2019 | Wang 2011 | Zhou 2016 | Barry 2018 | Cui 2017 | Duffy 2018 | Miotto 2013 | Qi 2012 | Zhang 2013 | Alipoor 2019 | Hu 2019 | de Araujo 2019 | Chen 2017 | Huang 2018 | Qian 2018 | Huang 2018 | Huang 2018 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Development | Identify the study as developing and/or validating a multivariable prediction model, the target population, and the outcome to be predicted | Yes | Yes | No | Yes | No | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes |
2 | Development | Provide a summary of objectives, study design, setting, participants, sample size, predictors, outcome, statistical analysis, results, and conclusions | No | Yes | No | No | Yes | Yes | No | Yes | No | Yes | No | Yes | Yes | No | Yes | No | No | Yes |
3a | Development | Explain the medical context (including whether diagnostic or prognostic) and rationale for developing or validating the multivariable prediction model, including references to existing models | Yes | Yes | No | No | Yes | Yes | Yes | No | Yes | No | Yes | Yes | No | No | Yes | No | Yes | Yes |
3b | Development | Specify the objectives, including whether the study describes the development or validation of the model, or both | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
4a | Development | Describe the study design or source of data (for example, randomized trial, cohort, or registry data), separately for the development and validation data sets, if applicable | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
4b | Development | Specify the key study dates, including start of accrual; end of accrual; and, if applicable, end of follow‐up | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes |
5a | Development | Specify key elements of the study setting (for example, primary care, secondary care, general population) including number and location of centres | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
5b | Development | Describe eligibility criteria for participants | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes |
5c | Development | Give details of treatments received, if relevant | No | No | Yes | No | Yes | No | Yes | No | Yes | Yes | No | Yes | Yes | Yes | No | No | No | No |
6a | Development | Clearly define the outcome that is predicted by the prediction model, including how and when assessed | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
6b | Development | Report any actions to blind assessment of the outcome to be predicted | No | No | Yes | No | No | No | No | No | No | No | No | Yes | No | No | Yes | No | No | No |
7a | Development | Clearly define all predictors used in developing the multivariable prediction model, including how and when they were measured | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
7b | Development | Report any actions to blind assessment of predictors for the outcome and other predictors | No | No | Yes | No | No | No | No | No | No | No | No | Yes | No | No | Yes | No | No | No |
8 | Development | Explain how the study size was arrived at. | No | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes |
9 | Development | Describe how missing data were handled (for example, complete‐case analysis, single imputation, multiple imputation) with details of any imputation method | No | No | Yes | No | No | No | Yes | No | No | No | No | Yes | No | Yes | Yes | No | No | No |
10a | Development | Describe how predictors were handled in the analyses | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
10b | Development | Specify type of model, all model‐building procedures (including any predictor selection), and method for internal validation | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
10c | Validation | For validation, describe how the predictions were calculated | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
10d | Development | Specify all measures used to assess model performance and, if relevant, to compare multiple models | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
10e | Validation | Describe any model updating (for example, recalibration) arising from the validation, if done | No | No | Yes | No | No | No | Yes | Yes | Yes | Yes | No | Yes | Yes | No | No | No | No | No |
11 | Development | Provide details on how risk groups were created, if done | NAb | Yes | NA | NA | NA | Yes | NA | NA | NA | Yes | NA | NA | NA | NA | NA | Yes | Yes | Yes |
12 | Validation | For validation, identify any differences from the development data in setting, eligibility criteria, outcome, and predictors | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | No | Yes | Yes | No | Yes | Yes |
13a | Development | Describe the flow of participants through the study, including the number of participants with and without the outcome and, if applicable, a summary of the follow‐up time. A diagram may be helpful | No | Yes | Yes | Yes | Yes | Yes | No | Yes | No | Yes | No | Yes | No | Yes | Yes | No | Yes | Yes |
13b | Development | Describe the characteristics of the participants (basic demographics, clinical features, available predictors), including the number of participants with missing data for predictors and outcome | No | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes |
13c | Validation | For validation, show a comparison with the development data of the distribution of important variables (demographics, predictors and outcome). | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | No | Yes | Yes | No | Yes | Yes |
14a | Development | Specify the number of participants and outcome events in each analysis | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
14b | Development | If done, report the unadjusted association between each candidate predictor and outcome | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
15a | Development | Present the full prediction model to allow predictions for individuals (that is, all regression coefficients, and model intercept or baseline survival at a given time point) | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
15b | Development | Explain how to use the prediction model | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
16 | Development | Report performance measures (with CIs) for the prediction model | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
17 | Validation | If done, report the results from any model updating (that is, model specification, model performance) | NA | NA | NA | Yes | NA | NA | NA | NA | Yes | Yes | NA | Yes | Yes | NA | NA | NA | NA | NA |
18 | Development | Discuss any limitations of the study (such as nonrepresentative sample, few events per predictor, missing data) | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | No | No | Yes |
19a | Validation | For validation, discuss the results with reference to performance in the development data, and any other validation data | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
19b | Development | Give an overall interpretation of the results, considering objectives, limitations, results from similar studies, and other relevant evidence | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
20 | Development | Discuss the potential clinical use of the model and implications for future research | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
21 | Development | Provide information about the availability of supplementary resources, such as study protocol, Web calculator, and data sets | No | Yes | Yes | No | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | No | Yes |
22 | Development | Give the source of funding and the role of the funders for the present study | No | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
a: Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis. b: Not applicable.