Table 5.
The diagnosis accuracy on 14 common thorax diseases from the NIH ChestX-ray dataset.
| Methods | Year | Ratio of training data | Atelectasis | Cardiomegaly | Consolidation | Edema | Effusion | Emphysema | Fibrosis | Hernia | Infiltration | Mass | Nodule | Pleural thickening | Pneumonia | Pneumothorax |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NIH69 | 2017 | 1% | 73.3 | 69.6 | 76.0 | 81.7 | 80.5 | 67.1 | 64.9 | 64.8 | 65.8 | 67.0 | 62.3 | 65.7 | 65.0 | 74.0 |
| Context Restoration105 | 2019 | 1% | 69.1 | 64.4 | 73.2 | 73.8 | 78.1 | 70.0 | 62.1 | 70.2 | 65.2 | 62.4 | 59.1 | 65.0 | 62.2 | 73.8 |
| C2L83 | 2020 | 1% | 75.1 | 67.1 | 77.6 | 75.1 | 83.4 | 71.5 | 66.8 | 70.0 | 63.8 | 70.1 | 66.2 | 68.1 | 65.7 | 74.4 |
| Model Genesis82 | 2021 | 1% | 72.1 | 67.1 | 75.8 | 76.1 | 80.6 | 72.6 | 64.8 | 73.5 | 65.7 | 65.2 | 62.2 | 67.6 | 64.8 | 76.2 |
| TransVW81 | 2021 | 1% | 74.5 | 68.9 | 76.7 | 79.8 | 81.1 | 67.9 | 68.7 | 68.2 | 66.8 | 66.5 | 66.2 | 68.5 | 68.8 | 75.0 |
| REFERS32 | 2022 | 1% | 77.5 | 85.6 | 78.6 | 84.9 | 85.4 | 79.5 | 72.3 | 77.1 | 67.5 | 76.2 | 66.5 | 71.6 | 69.3 | 81.7 |
| Med-MLLM | Ours | 1% | 80.1 | 88.2 | 82.5 | 89.4 | 89.2 | 90.4 | 80.0 | 87.8 | 74.2 | 81.6 | 75.9 | 77.9 | 77.2 | 87.3 |
| NIH69 | 2017 | 100% | 78.3 | 89.3 | 77.6 | 87.9 | 85.9 | 87.4 | 78.5 | 88.8 | 65.9 | 79.9 | 70.7 | 74.5 | 71.0 | 84.7 |
| Context Restoration105 | 2019 | 100% | 75.8 | 82.9 | 76.4 | 86.6 | 84.8 | 88.2 | 78.6 | 83.0 | 70.0 | 79.6 | 69.5 | 73.2 | 69.4 | 84.0 |
| C2L83 | 2020 | 100% | 81.1 | 90.2 | 81.0 | 88.1 | 88.0 | 88.3 | 80.8 | 86.8 | 72.0 | 82.7 | 74.1 | 76.2 | 75.3 | 85.9 |
| Model Genesis82 | 2021 | 100% | 78.8 | 84.5 | 79.2 | 87.8 | 86.6 | 89.7 | 81.0 | 85.2 | 71.1 | 81.9 | 73.2 | 75.8 | 73.0 | 85.6 |
| TransVW81 | 2021 | 100% | 79.8 | 85.0 | 80.0 | 88.2 | 87.1 | 90.1 | 81.8 | 85.9 | 72.3 | 82.6 | 74.4 | 76.6 | 74.0 | 86.1 |
| REFERS32 | 2022 | 100% | 83.0 | 92.3 | 82.1 | 90.2 | 88.7 | 91.4 | 83.9 | 93.3 | 74.1 | 85.5 | 76.7 | 78.5 | 77.0 | 89.1 |
| Med-MLLM | Ours | 100% | 85.4 | 94.1 | 84.7 | 91.3 | 90.2 | 95.0 | 88.2 | 94.6 | 76.9 | 88.7 | 79.3 | 82.8 | 79.1 | 89.9 |
All values are reported in percentage (%). The best results are in bold.