Technical development |
Training Set 1 |
23/1326 |
Index |
Reviewer 1 |
Simple random sample |
Train the neural network model for artery localization and segmentation |
|
Validation Set 1 |
2/117 |
Index |
Reviewer 1 |
|
Monitor the training procedure and tune parameters |
Fine tuning and Validation |
Training Set 2 |
100/7372 |
Index |
N/A |
Stratified random sample enriched with high-risk subjects |
Further model tuning in a larger dataset, with reviewer’s help to identify mistakes and confirm improvements |
|
Validation Set 2 |
10/743 |
Index |
Reviewer 1 (N = 10), Reviewer 2 (N = 10) |
|
Contours drawn by both reviewers to compare quantitatively to decide when to stop tuning. Also assess inter-rater variability |
|
Testing Set 1 |
25/1843 |
Index |
Reviewer 1 (N = 12), Reviewer 2 (N = 13) |
|
Used for performance evaluation in the quantitative assessment |
|
Testing Set 2 |
225/16633 |
Index |
N/A |
|
Used for performance evaluation in the qualitative assessment |
Performance evaluation |
Testing Set 3 |
50/3711(24 mo), 50/3738 (30 mo) |
Index |
N/A |
Simple random sample |
Used for performance evaluation in the repeatability assessment |
|
Testing Set 4 |
50/3562 (high risk), 50/3536 (low risk) |
Both |
N/A |
Stratified random samples of the high-risk and low-risk groups |
Used for evaluating feature differences between high and low risk subjects |