Table 5.
Optimal Specificity/Sensitivity points across all categories. For probabilistic methods, the optimal operating point is calculated across all the points within the category. For binary methods, the optimal operating point is the original binary submission. (Categories 1: Principal, 2: Small Vessels, 3: Medium Vessels, 4: Large Vessels, 5: Vessel/Airway Wall, 6: Vessel/Dense Lesion, 7: Vessel/Mucus-filled bronchi, 8: Vessel-in-lesion/Lesion, 9: Vessel/Nodules).
| Specificity/Sensitivity score for each category
|
|||||||||
|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | |
| Probabilistic | |||||||||
| B | 0.99/0.68 | 1.00/0.34 | 0.99/0.78 | 0.99/0.90 | 0.94/0.68 | 0.56/0.68 | 0.44/0.68 | 0.55/0.62 | 0.56/0.68 |
| C | 0.98/0.64 | 0.98/0.19 | 0.98/0.74 | 0.98/0.95 | 0.66/0.64 | 0.44/0.64 | 0.25/0.64 | 0.66/0.82 | 0.32/0.64 |
| D | 0.95/0.95 | 0.94/0.94 | 0.98/0.95 | 0.98/0.97 | 0.82/0.95 | 0.37/0.95 | 0.29/0.95 | 0.50/0.83 | 0.06/0.95 |
| E | 0.92/0.74 | 0.98/0.36 | 0.95/0.85 | 0.95/0.95 | 0.52/0.74 | 0.33/0.74 | 0.21/0.74 | 0.53/0.84 | 0.16/0.74 |
| G | 0.94/0.90 | 0.92/0.84 | 0.96/0.93 | 0.95/0.93 | 0.83/0.90 | 0.35/0.90 | 0.18/0.90 | 0.50/0.82 | 0.15/0.90 |
| H | 0.94/0.95 | 0.91/0.94 | 0.96/0.95 | 0.99/0.98 | 0.70/0.95 | 0.26/0.95 | 0.11/0.95 | 0.08/0.97 | 0.03/0.95 |
| I | 0.95/0.94 | 0.92/0.93 | 0.96/0.96 | 0.97/0.96 | 0.85/0.94 | 0.39/0.94 | 0.26/0.94 | 0.56/0.78 | 0.16/0.94 |
| K | 0.91/0.96 | 0.89/0.95 | 0.93/0.97 | 0.98/0.98 | 0.38/0.96 | 0.20/0.96 | 0.06/0.96 | 0.44/0.86 | 0.03/0.96 |
| L | 0.96/0.95 | 0.94/0.96 | 0.96/0.96 | 0.98/0.98 | 0.83/0.95 | 0.37/0.95 | 0.20/0.95 | 0.49/0.84 | 0.07/0.95 |
| M | 0.95/0.95 | 0.93/0.95 | 0.95/0.96 | 0.98/0.94 | 0.83/0.95 | 0.43/0.95 | 0.29/0.95 | 0.58/0.77 | 0.16/0.95 |
| N | 0.94/0.92 | 0.93/0.95 | 0.96/0.91 | 0.98/0.90 | 0.95/0.92 | 0.57/0.92 | 0.43/0.92 | 0.60/0.59 | 0.17/0.92 |
| Q | 0.95/0.17 | 0.95/0.01 | 0.95/0.02 | 0.95/0.45 | 0.79/0.17 | 0.88/0.17 | 0.70/0.17 | 0.93/0.36 | 0.98/0.17 |
| Binary | |||||||||
| F | 0.83/0.56 | 0.33/0.65 | 0.78/0.61 | 0.98/0.97 | 0.28/0.56 | 0.42/0.56 | 0.14/0.56 | 0.57/0.91 | 0.29/0.56 |
| J | 0.56/0.60 | 0.41/0.59 | 0.51/0.58 | 0.94/0.84 | 0.08/0.60 | 0.31/0.60 | 0.00/0.60 | 0.34/0.96 | 0.53/0.60 |
| O | 0.75/0.59 | 0.43/0.59 | 0.76/0.59 | 0.98/0.89 | 0.26/0.59 | 0.42/0.59 | 0.02/0.59 | 0.63/0.79 | 0.59/0.59 |
| P | 0.95/0.84 | 0.94/0.71 | 0.96/0.88 | 0.96/0.92 | 0.74/0.84 | 0.48/0.84 | 0.16/0.84 | 0.60/0.64 | 0.35/0.84 |
| Reference | |||||||||
| R1 | 0.92/0.91 | 0.85/0.91 | 0.96/0.97 | 0.98/0.99 | 0.50/0.91 | 0.21/0.91 | 0.12/0.91 | 0.44/0.86 | 0.02/0.91 |
| R2 | 0.88/0.89 | 0.85/0.89 | 0.89/0.88 | 0.90/0.89 | 0.89/0.89 | 0.57/0.89 | 0.38/0.89 | 0.69/0.70 | 0.53/0.89 |
| Post-ISBI’12 submissions | |||||||||
| S | 0.94/0.95 | 0.93/0.93 | 0.95/0.95 | 0.96/0.96 | 0.75/0.95 | 0.29/0.95 | 0.13/0.95 | 0.48/0.80 | 0.07/0.95 |
| T | 0.96/0.89 | 0.87/0.96 | 0.96/0.95 | 0.99/0.96 | 0.78/0.89 | 0.32/0.89 | 0.22/0.89 | 0.49/0.84 | 0.02/0.89 |
| U | 0.97/0.74 | 0.97/0.59 | 0.97/0.72 | 0.97/0.91 | 0.93/0.74 | 0.57/0.74 | 0.44/0.74 | 0.66/0.58 | 0.46/0.74 |
| V | 0.94/0.77 | 0.73/0.54 | 0.94/0.92 | 0.94/0.96 | 0.77/0.77 | 0.25/0.77 | 0.09/0.77 | 0.56/0.82 | 0.11/0.77 |
| W | 0.97/0.77 | 0.96/0.42 | 0.97/0.92 | 0.98/0.95 | 0.85/0.77 | 0.34/0.77 | 0.13/0.77 | 0.56/0.81 | 0.12/0.77 |