TABLE III.
Quantitative results on the COPD and COVID-19 test sets. IOU and ASSD (in mm) metrics are given in mean ± standard deviation. Boldface denotes the result significantly better than others (p < 0.01 with Bonferroni correction).
| (a) COPD results | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | MAC | #Param | Metric | Overall | Lungs | LUL | LLL | RUL | RLL | RML | interlobar |
| 3DU-Net [24] | 10.5G | 16.32M | IOU ASSD |
0.915±0.037 1.214±0.948 |
0.965±0.007 0.514±0.202 | 0.944±0.033 0.766±0.839 |
0.937±0.007 0.951±1.017 |
0.918±0.043 1.264±1.050 | 0.937±0.032 0.936±1.069 | 0.840±0.032 2.153±2.738 |
N/A 2.054±1.691 |
| FRV-Net [12] | 7.2G | 15.5M | IOU ASSD |
0.918±0.038 1.408±1.190 |
0.965±0.014 0.602±0.393 |
0.950±0.038 0.818±1.535 | 0.932±0.050 1.030±1.481 | 0.917±0.050 1.557±1.779 | 0.942±0.033 0.957±1.414 |
0.848±0.103 2.680±3.441 | N/A 2.292±2.218 |
| PDV-Net [13] | 7.2G | 15.5M | IOU ASSD |
0.912±0.049 3.027±5.544 |
0.951±0.031 1.665±2.982 | 0.937±0.032 1.802±2.926 |
0.926±0.044 2.772±6.286 |
0.912±0.066 2.885±6.600 |
0.926±0.050 3.109±7.520 |
0.854±0.109 4.540±7.800 | N/A 2.541±3.460 |
| RTSU-Net (ours) | 14.5G | 13.1M | IOU ASSD |
0.949±0.026 0.607±0.537 |
0.976±0.010 0.326±0.166 |
0.962±0.020 0.482±0.534 |
0.959±0.023 0.465±0.446 |
0.952±0.030 0.668±1.020 |
0.960±0.010 0.534±0.518 |
0.912±0.080 0.885±1.412 |
N/A 0.947±0.800 |
| (b) COVID-19 results | |||||||||||
| Method | MAC | #Param | Metric | Overall | Lungs | LUL | LLL | RUL | RLL | RML | interlobar |
| 3DU-Net [24] | 10.5G | 16.3M | IOU ASSD |
0.904±0.051 1.388±1.055 |
0.946±0.030 0.840±0.666 |
0.936±0.031 0.894±0.910 |
0.890±0.104 1.491±1.560 | 0.911±0.068 1.392±1.753 | 0.914±0.075 1.454±2.215 |
0.870±0.093 1.710±1.806 |
N/A 2.213±2.025 |
| FRV-Net [12] | 9.3G | 15.5M | IOU ASSD |
0.905±0.049 1.236±1.058 |
0.952±0.029 0.711±0.742 | 0.936±0.029 0.796±0.695 |
0.907±0.075 1.248±1.607 | 0.909±0.065 1.346±1.569 | 0.914±0.083 1.250±2.484 |
0.862±0.096 1.541±1.500 | N/A 1.950±1.934 |
| PDV-Net [13] | 9.3G | 15.5M | IOU ASSD |
0.891±0.051 1.908±1.727 | 0.943±0.030 0.877±0.771 |
0.927±0.035 1.379±2.158 | 0.885±0.086 1.582±1.596 |
0.896±0.075 3.451±5.194 | 0.903±0.082 1.425±2.409 | 0.844±0.097 1.705±1.464 | N/A 2.718±2.343 |
| RTSU-Net (ours) | 14.5G | 13.1M | IOU ASSD |
0.922±0.040 0.866±0.729 |
0.956±0.020 0.581±0.425 |
0.944±0.020 0.603±0.310 |
0.922±0.041 0.793±0.586 |
0.927±0.061 0.969±1.391 |
0.924±0.061 0.917±1.348 |
0.893±0.082 1.049±1.284 |
N/A 1.226±1.508 |
RUL, RML, RLL, LUL, LLL: Right upper. Right middle, Right lower, Left upper, Left lower lobes. Overall: per-lobe mean.