Table 2.
Efficiency and risk of automated label cleaning in optical coherence tomography
| NR | Six-Iteration strategy | DQS-guided strategy | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ACC | CMR | EMR | MR | FLR | ACC | CMR | EMR | MR | FLR | |
| 0% | 0.993 ± 0.004 | - | - | - | 0.7% ± 0.7% | 1.000 ± 0.000 | - | - | - | 0.0% ± 0.0% |
| 5% | 0.984 ± 0.008 | 94.6% ± 9.4% | 4.1% ± 7.1% | 1.4% ± 2.4% | 1.4% ± 0.5% | 0.988 ± 0.006 | 94.6% ± 9.4% | 2.7% ± 4.7% | 2.7% ± 4.7% | 1.0% ± 0.5% |
| 10% | 0.982 ± 0.003 | 94.6% ± 2.6% | 3.4% ± 1.6% | 2.0% ± 1.0% | 1.4% ± 0.6% | 0.986 ± 0.005 | 92.5% ± 6.2% | 2.0% ± 1.8% | 5.4% ± 5.0% | 0.8% ± 0.3% |
| 15% | 0.978 ± 0.003 | 95.0% ± 2.1% | 3.9% ± 2.2% | 1.1% ± 1.0% | 1.7% ± 0.1% | 0.979 ± 0.001 | 94.8% ± 1.7% | 3.9% ± 2.2% | 1.4% ± 1.2% | 1.6% ± 0.2% |
| 20% | 0.978 ± 0.002 | 95.1% ± 2.1% | 4.4% ± 2.1% | 0.5% ± 0.0% | 1.5% ± 0.3% | 0.979 ± 0.002 | 94.4% ± 1.3% | 4.3% ± 1.9% | 1.4% ± 0.8% | 1.3% ± 0.5% |
| 25% | 0.975 ± 0.007 | 95.2% ± 1.6% | 3.7% ± 1.8% | 1.1% ± 0.2% | 1.7% ± 0.4% | 0.975 ± 0.005 | 94.8% ± 1.7% | 3.9% ± 2.0% | 1.2% ± 0.4% | 1.5% ± 0.1% |
| 30% | 0.973 ± 0.006 | 95.6% ± 1.4% | 3.5% ± 1.4% | 0.9% ± 0.4% | 1.9% ± 0.3% | 0.972 ± 0.006 | 95.4% ± 1.7% | 3.4% ± 1.2% | 1.2% ± 0.5% | 2.0% ± 0.3% |
| 35% | 0.964 ± 0.008 | 95.7% ± 1.4% | 2.9% ± 1.2% | 1.4% ± 0.9% | 3.2% ± 0.6% | 0.962 ± 0.004 | 94.3% ± 1.1% | 3.8% ± 0.5% | 1.9% ± 1.0% | 2.7% ± 0.1% |
| 40% | 0.966 ± 0.009 | 95.0% ± 1.2% | 4.2% ± 1.1% | 0.9% ± 0.5% | 2.2% ± 0.9% | 0.964 ± 0.005 | 94.6% ± 1.2% | 4.1% ± 0.9% | 1.3% ± 1.0% | 2.4% ± 0.4% |
| 45% | 0.961 ± 0.005 | 95.2% ± 1.5% | 3.9% ± 1.2% | 1.0% ± 0.3% | 3.1% ± 1.1% | 0.960 ± 0.008 | 95.0% ± 1.5% | 3.8% ± 1.1% | 1.2% ± 0.5% | 3.2% ± 1.0% |
| 50% | 0.961 ± 0.009 | 95.2% ± 1.7% | 3.9% ± 1.9% | 1.0% ± 0.7% | 2.9% ± 0.5% | 0.950 ± 0.018 | 92.9% ± 3.4% | 4.2% ± 2.2% | 2.9% ± 1.2% | 2.9% ± 0.8% |
| 55% | 0.957 ± 0.010 | 94.6% ± 1.0% | 3.9% ± 1.0% | 1.5% ± 1.0% | 2.9% ± 1.6% | 0.950 ± 0.013 | 94.0% ± 0.9% | 4.0% ± 0.5% | 2.0% ± 1.2% | 3.8% ± 2.0% |
| 60% | 0.944 ± 0.013 | 93.7% ± 1.5% | 4.8% ± 0.9% | 1.5% ± 0.7% | 4.5% ± 1.8% | 0.941 ± 0.019 | 93.0% ± 3.0% | 5.1% ± 1.9% | 1.9% ± 1.1% | 4.3% ± 1.6% |
| 65% | 0.937 ± 0.006 | 92.7% ± 1.4% | 5.4% ± 1.3% | 1.9% ± 0.5% | 4.7% ± 1.0% | 0.932 ± 0.012 | 92.3% ± 2.0% | 5.7% ± 1.5% | 2.0% ± 0.7% | 5.0% ± 0.3% |
| 70% | 0.886 ± 0.033 | 86.6% ± 4.3% | 10.6% ± 3.8% | 2.8% ± 0.9% | 10.7% ± 4.8% | 0.890 ± 0.027 | 88.8% ± 2.2% | 9.1% ± 1.6% | 2.1% ± 1.1% | 10.6% ± 4.1% |
NR noise rate, ACC label accuracy, CMR correct modification rate, EMR error modification rate, MR miss rate, FLR false labeling rate.