Table.2 –
TRIPOD Checklist
| Subbe 2001 [6] | Cretikos 2007 [17] | Duckitt 2007 [22] | Cuthbertson 2007 [23] | Prytherch 2010 [18] | Cuthbertson 2010 [24] | Bleyer 2011 [25] | Tarassenko 2011 [26] | Kellett 2012 [19] | Churpek 2012 [27] | Escobar 2012 [28] | RCP 2012 [20] | Alveraz 2013 [29] | Jarvis 2013 [30] | Kirkland 2013 [31] | Mohammed 2013 [32] | Badriyah 2014 [33] | Churpek 2014 [34] | Churpek 2014 [35] | Churpek 2016 [36] | Churpek 2016 [37] | Kipnis 2016 [38] | Moore 2017 [39] | Dziadzko 2018 [40] | Faisal 2018 [41] | Ghosh 2018 [42] | Luis 2018 [21] | Redfern 2018 [43] | Watkinson 2018 [44] | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model Type | D | V | D/V | D | D | D | D | D | V | D | D/V | D/V | D/V | D/V | D/V | D/V | D | D | D/V | D/V | D/V | D/V | D | D/V | D/V | D/V | V | D/V | D/V | |
| Title and abstract | ||||||||||||||||||||||||||||||
| Title | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 0 |
| Abstract | 2 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 1 |
| Introduction | ||||||||||||||||||||||||||||||
| Background and objectives | 3a | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 3b | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Methods | ||||||||||||||||||||||||||||||
| Source of data | 4a | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 4b | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Participants | 5a | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 5b | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | |
| 5c | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Outcome | 6a | 1 | 1 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 |
| 6b | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Predictors | 7a | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 1 | 0 | 0 | 1 | 1 |
| 7b | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Sample size | 8 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Missing data | 9 | 1a | 1 | 1a | 1 | 0 | 0 | 0 | 0 | 1a | 1 | 1 | 0 | 0 | 0 | 0 | 1a | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1a | 1 | 1 |
| Statistical analysis methods | 10a | 0 | NA | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 |
| 10b | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 | |
| 10c | NA | 1 | 1 | NA | NA | NA | NA | NA | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | NA | NA | 1 | 1 | 1 | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | |
| 10d | 0b | 0b | 1 | 0b | 0b | 0b | 0b | 0 | 1 | 0b | 0b | 0b | 1 | 0b | 0b | 0b | 0b | 0b | 0b | 0b | 1 | 1 | 0b | 0b | 1 | 0b | 1 | 1 | 1 | |
| 10e | NA | 1 | NA | NA | NA | NA | NA | NA | 0 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | 1 | NA | NA | |
| Risk groups | 11 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA |
| Development vs. validation | 12 | NA | 0 | 1 | NA | NA | NA | NA | NA | 0 | NA | 0e | 0 | 0e | 0 | 1 | 0e | NA | NA | 1 | 0 | 0 | 1 | NA | 1 | 1 | 1 | 0 | 1 | 1 |
| Results | ||||||||||||||||||||||||||||||
| Participants | 13a | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 0 |
| 13b | 0 | 1 | 1 | 0 | 0 | 0 | 0d | 0 | 0d | 0d | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0d | 1 | 1 | 0 | 0d | 0d | 0d | 0d | |
| 13c | NA | 0 | 0 | NA | NA | NA | NA | NA | 0 | NA | 0e | 0 | 0e | 0 | 1 | 0e | NA | NA | 1 | 0 | 0 | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | |
| Model development | 14a | 0 | NA | 0 | 0 | 0 | 1 | 0 | 0 | NA | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 |
| 14b | NA | NA | NA | 1 | NA | 1 | NA | 0 | NA | 0 | NA | NA | 1 | NA | 1 | NA | NA | NA | NA | 0 | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Model specification | 15a | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 | 1 | 0f | 1 | 1 | 1 | 1 | 0f | 0f | 0 | 0 | 0f | 1 | 0 | 1 | 0 | NA | 1 | 1 |
| 15b | 1 | NA | 1 | 1 | 1 | 1 | 1 | 1 | NA | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | NA | 1 | 1 | |
| Model performance | 16 | 1 | 1 | 1 | 1 | 1 | 0c | 0c | 0 | 1 | 0c | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0c | 1 | 1 | 1 |
| Model-updating | 17 | NA | 1 | NA | NA | NA | NA | NA | NA | 1 | NA | NA | 1 | NA | NA | NA | NA | NA | NA | NA | NA | NA | 1 | NA | NA | NA | NA | 1 | NA | 1 |
| Discussion | ||||||||||||||||||||||||||||||
| Limitations | 18 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| Interpretation | 19a | NA | 1 | NA | NA | NA | NA | NA | NA | 1 | NA | NA | 1 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | 1 | NA | 1 |
| 19b | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | |
| Implications | 20 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| Other information | ||||||||||||||||||||||||||||||
| Supplementary information | 21 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 |
| Funding | 22 | 1 | 1 | 0 | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
1: (D;V) Identify the study as developing and/or validating a multivariable prediction model, the target population, and the outcome to be predicted.
2: (D;V) Provide a summary of objectives, study design, setting, participants, sample size, predictors, outcome, statistical analysis, results, and conclusions.
3a: (D;V) Explain the medical context (including whether diagnostic or prognostic) and rationale for developing or validating the multivariable prediction model, including references to existing models.
3b: (D;V) Specify the objectives, including whether the study describes the development or validation of the model or both.
4a: (D;V) Describe the study design or source of data (e.g., randomized trial, cohort, or registry data), separately for the development and validation data sets, if applicable.
4b: (D;V) Specify the key study dates, including start of accrual; end of accrual; and, if applicable, end of follow-up.
5a: (D;V) Specify key elements of the study setting (e.g., primary care, secondary care, general population) including number and location of centres.
5b: (D;V) Describe eligibility criteria for participants.
5c: (D;V) Give details of treatments received, if relevant.
6a: (D;V) Clearly define the outcome that is predicted by the prediction model, including how and when assessed.
6b: (D;V) Report any actions to blind assessment of the outcome to be predicted.
7a: (D;V) Clearly define all predictors used in developing or validating the multivariable prediction model, including how and when they were measured.
7b: (D;V) Report any actions to blind assessment of predictors for the outcome and other predictors.
8: (D;V) Explain how the study size was arrived at.
9: (D;V) Describe how missing data were handled (e.g., complete-case analysis, single imputation, multiple imputation) with details of any imputation method.
10a: (D) Describe how predictors were handled in the analyses.
10b: (D) Specify type of model, all model-building procedures (including any predictor selection), and method for internal validation.
10c: (V) For validation, describe how the predictions were calculated.
10d: (D;V) Specify all measures used to assess model performance and, if relevant, to compare multiple models.
10e: (V) Describe any model updating (e.g., recalibration) arising from the validation, if done.
11: (D;V) Provide details on how risk groups were created, if done.
12: (V) For validation, identify any differences from the development data in setting, eligibility criteria, outcome, and predictors.
13a: (D;V) Describe the flow of participants through the study, including the number of participants with and without the outcome and, if applicable, a summary of the follow-up time. A diagram may be helpful.
13b: (D;V) Describe the characteristics of the participants (basic demographics, clinical features, available predictors), including the number of participants with missing data for predictors and outcome.
13c: (V) For validation, show a comparison with the development data of the distribution of important variables (demographics, predictors and outcome).
14a: (D) Specify the number of participants and outcome events in each analysis.
14b: (D) If done, report the unadjusted association between each candidate predictor and outcome.
15a: (D) Present the full prediction model to allow predictions for individuals (i.e., all regression coefficients, and model intercept or baseline survival at a given time point).
15b: (D) Explain how to the use the prediction model.
16: (D;V) Report performance measures (with CIs) for the prediction model.
17: (V) If done, report the results from any model updating (i.e., model specification, model performance).
18: (D;V) Discuss any limitations of the study (such as nonrepresentative sample, few events per predictor, missing data).
19a: (V) For validation, discuss the results with reference to performance in the development data, and any other validation data.
19b: (D;V) Give an overall interpretation of the results, considering objectives, limitations, results from similar studies, and other relevant evidence.
20: (D;V) Discuss the potential clinical use of the model and implications for future research.
21: (D;V) Provide information about the availability of supplementary resources, such as study protocol, Web calculator, and data sets.
22: (D;V) Give the source of funding and the role of the funders for the present study.
a: Complete-case analysis
b: Did not report calibration of models
c: Did not report confidence interval of AUC
d: Did not report the number of participants with missing data for predictors and outcome.
e: Randomly splitting a single data set into a development and a validation data set
f: Did not report intercept of the multivariable model