Table 5.
Multiclass segmentation task results of all 13 CoW component classes (mean ± standard deviation) for the CTA (Top) and MRA (Bottom) tracks in Dice scores and β0 errors. The arrow indicates the favorable direction. The top three values for each metric are marked as gold, silver and bronze cells in decreasing order. The winning team names are in bold.
| CTA per class segmentation performance | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Team | BA | R-PCA | L-PCA | R-ICA | R-MCA | L-ICA | L-MCA | R-Pcom | L-Pcom | Acom | R-ACA | L-ACA | 3rd-A2 |
| Dice (%) ↑ | |||||||||||||
| agaldran | 1.33 ± 6.02 | 0.00 ± 0.00 | 0.02 ± 0.09 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 |
| gl | 75.48 ± 24.75 | 59.25 ± 29.61 | 58.99 ± 34.52 | 70.88 ± 28.46 | 65.83 ± 31.94 | 71.84 ± 26.06 | 63.52 ± 31.93 | 11.33 ± 20.97 | 10.28 ± 21.75 | 0.00 ± 0.00 | 59.89 ± 29.90 | 55.55 ± 35.09 | 0.00 ± 0.00 |
| IWantToGoToCanada | 90.47 ± 5.28 | 85.70 ± 7.46 | 86.83 ± 5.56 | 87.80 ± 7.44 | 84.78 ± 13.84 | 89.49 ± 5.33 | 85.79 ± 8.39 | 42.10 ± 34.98 | 31.23 ± 37.51 | 46.14 ± 34.01 | 81.63 ± 11.93 | 83.55 ± 10.68 | 9.62 ± 24.74 |
| junqiangchen | 91.37 ± 3.77 | 85.32 ± 7.54 | 85.78 ± 7.58 | 87.17 ±4.75 | 86.57 ± 7.49 | 86.01 ± 15.42 | 84.73 ± 7.50 | 34.42 ± 34.21 | 26.81 ± 36.16 | 42.47 ± 33.34 | 80.79 ± 13.01 | 82.03 ± 12.19 | 4.05 ± 15.34 |
| lWM | 86.25 ± 16.57 | 86.71 ± 6.52 | 83.32 ± 14.25 | 87.41 ± 6.18 | 87.20 ± 7.63 | 87.53 ± 6.67 | 85.01 ± 9.82 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 82.17 ± 12.16 | 84.84 ± 9.73 | 0.00 ± 0.00 |
| NexToU | 90.00 ± 6.34 | 86.91 ± 6.63 | 88.34 ± 5.36 | 89.21 ± 4.65 | 87.80 ± 6.68 | 89.36 ± 4.41 | 85.84 ± 7.46 | 61.68 ± 26.86 | 42.68 ± 36.62 | 59.49 ± 29.33 | 84.67 ± 9.12 | 86.22 ± 9.25 | 0.00 ± 0.00 |
| NIC-VICOROB-1 | 92.15 ± 3.89 | 52.17 ± 41.78 | 51.09 ± 40.27 | 52.48 ± 41.72 | 49.51 ± 38.49 | 46.72 ± 42.92 | 36.22 ± 40.34 | 31.78 ± 37.15 | 27.92 ± 36.65 | 50.79 ± 34.54 | 49.74 ± 40.65 | 50.09 ± 39.20 | 52.70 ± 45.65 |
| NIC-VICOROB-2 | 83.54 ± 11.97 | 76.93 ± 12.82 | 72.57 ± 15.52 | 81.02 ± 9.52 | 78.34 ± 12.07 | 81.00 ± 11.15 | 73.30 ± 12.22 | 27.57 ± 27.74 | 12.00 ± 18.36 | 11.73 ± 18.70 | 67.89 ± 17.16 | 71.47 ± 12.91 | 0.63 ± 1.56 |
| Organizers | 93.37 ± 3.02 | 84.40 ± 21.61 | 82.69 ± 22.28 | 86.40 ± 16.14 | 82.83 ± 20.02 | 88.12 ± 11.70 | 81.47 ± 22.13 | 43.27 ± 37.54 | 32.21 ± 33.62 | 57.36 ± 30.57 | 80.72 ± 16.59 | 84.06 ± 12.00 | 43.15 ± 42.25 |
| sjtu_eiee_2–426lab | 93.12 ± 2.98 | 72.93 ± 34.68 | 70.48 ± 36.17 | 70.75 ± 36.46 | 68.92 ± 36.24 | 69.56 ± 36.41 | 65.29 ± 39.76 | 46.18 ± 35.55 | 38.62 ± 39.07 | 54.86 ± 35.92 | 66.76 ± 35.46 | 67.54 ± 35.65 | 33.93 ± 42.17 |
| WilliWillsWissen | 91.29 ± 6.55 | 89.59 ± 5.07 | 89.56 ± 5.72 | 89.74 ± 4.61 | 89.05 ± 7.09 | 90.57 ± 3.75 | 87.32 ± 7.69 | 57.49 ± 31.84 | 52.00 ± 34.48 | 56.65 ± 31.73 | 88.04 ± 6.21 | 88.73 ± 5.60 | 39.19 ± 36.73 |
| β0 error ↓ | |||||||||||||
| agaldran | 0.71 ± 0.52 | 1.49 ± 1.31 | 1.71 ± 2.11 | 0.94 ± 0.34 | 0.94 ± 0.24 | 1.03 ± 0.17 | 0.89 ± 0.40 | 0.94 ± 0.24 | 1.00 ± 0.00 | 1.00 ± 0.00 | 1.17 ± 0.66 | 0.94 ± 0.54 | 1.00 ± 0.00 |
| gl | 0.06 ± 0.24 | 0.09 ± 0.28 | 0.09 ± 0.28 | 0.11 ± 0.32 | 0.14 ± 0.36 | 0.14 ± 0.55 | 0.20 ± 0.41 | 0.71 ± 0.55 | 0.79 ± 0.42 | 1.00 ± 0.00 | 0.11 ± 0.32 | 0.06 ± 0.24 | 1.00 ± 0.00 |
| IWantToGoToCanada | 0.31 ± 0.76 | 0.74 ± 1.24 | 0.80 ± 1.08 | 0.40 ± 1.01 | 0.11 ± 0.40 | 0.60 ± 1.17 | 0.23 ± 0.49 | 1.41 ± 1.37 | 1.36 ± 1.11 | 0.50 ± 0.79 | 1.66 ± 1.57 | 1.06 ± 1.45 | 1.80 ± 1.26 |
| junqiangchen | 0.06 ± 0.24 | 0.43 ± 0.74 | 0.80 ± 1.02 | 0.06 ± 0.24 | 0.20 ± 0.47 | 0.14 ± 0.36 | 0.26 ± 0.61 | 1.62 ± 1.58 | 2.12 ± 1.37 | 0.37 ± 0.60 | 0.54 ± 0.70 | 0.66 ± 1.00 | 6.97 ± 3.30 |
| lWM | 0.03 ± 0.17 | 0.43 ± 0.65 | 0.26 ± 0.66 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.06 ± 0.24 | 1.00 ± 0.00 | 1.00 ± 0.00 | 1.00 ± 0.00 | 0.57 ± 0.78 | 0.31 ± 0.68 | 1.00 ± 0.00 |
| NexToU | 0.03 ± 0.17 | 0.17 ± 0.38 | 0.14 ± 0.49 | 0.09 ± 0.37 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.14 ± 0.36 | 0.37 ± 0.83 | 0.53 ± 0.70 | 0.14 ± 0.36 | 0.20 ± 0.47 | 0.23 ± 0.55 | 1.00 ± 0.00 |
| NIC-VICOROB-1 | 0.09 ± 0.28 | 0.23 ± 0.43 | 0.46 ± 0.95 | 0.34 ± 0.54 | 0.34 ± 0.48 | 0.17 ± 0.45 | 0.34 ± 0.48 | 1.14 ± 1.46 | 0.78 ± 0.81 | 0.19 ± 0.40 | 0.94 ± 1.61 | 0.66 ± 0.87 | 0.33 ± 0.58 |
| NIC-VICOROB-2 | 2.80 ± 2.49 | 2.20 ± 2.10 | 3.34 ± 2.81 | 2.63 ± 2.34 | 1.23 ± 1.65 | 1.46 ± 1.79 | 1.63 ± 2.22 | 2.32 ± 1.54 | 1.88 ± 1.58 | 1.32 ± 1.04 | 3.91 ± 3.23 | 3.23 ± 2.47 | 0.67 ± 0.52 |
| Organizers | 0.00 ± 0.00 | 0.09 ± 0.37 | 0.20 ± 0.53 | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.00 ± 0.00 | 0.06 ± 0.24 | 0.93 ± 0.92 | 1.04 ± 0.88 | 0.19 ± 0.40 | 0.40 ± 0.95 | 0.37 ± 0.84 | 0.33 ± 0.58 |
| sjtu_eiee_2–426lab | 0.00 ± 0.00 | 0.31 ± 0.63 | 0.26 ± 0.74 | 0.06 ± 0.34 | 0.09 ± 0.37 | 0.14 ± 0.43 | 0.17 ± 0.45 | 0.45 ± 0.60 | 0.56 ± 0.86 | 0.23 ± 0.50 | 0.49 ± 1.07 | 0.31 ± 0.63 | 0.50 ± 0.58 |
| WilliWillsWissen | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.03 ± 0.17 | 0.00 ± 0.00 | 0.06 ± 0.24 | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.48 ± 0.81 | 0.56 ± 0.89 | 0.23 ± 0.43 | 0.09 ± 0.37 | 0.20 ± 0.47 | 0.33 ± 0.58 |
| MRA per class segmentation performance | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BA | R-PCA | L-PCA | R-ICA | R-MCA | L-ICA | L-MCA | R-Pcom | L-Pcom | Acom | R-ACA | L-ACA | 3rd-A2 | |
| Dice (%) ↑ | |||||||||||||
| agaldran | 0.12 ± 0.71 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.00 ± 0.00 | 0.01 ± 0.08 | 0.00 ± 0.00 |
| gbCoW | 93.47 ± 3.33 | 83.52 ± 16.12 | 80.25 ± 24.23 | 90.03 ± 17.82 | 84.43 ± 14.95 | 90.11 ± 22.69 | 84.38 ± 22.02 | 64.54 ± 31.21 | 53.67 ± 39.72 | 56.48 ± 33.34 | 82.16 ± 24.18 | 85.50 ± 18.15 | 49.88 ± 36.82 |
| gl | 90.10 ± 15.96 | 87.21 ± 11.44 | 86.93 ± 12.86 | 92.47 ± 11.32 | 88.93 ± 6.92 | 94.15 ± 7.27 | 89.17 ± 6.02 | 45.83 ± 38.72 | 49.41 ± 39.38 | 51.77 ± 35.94 | 81.23 ± 22.66 | 87.10 ± 9.42 | 24.57 ± 39.36 |
| junqiangchen | 87.81 ± 16.05 | 83.89 ± 17.97 | 82.44 ± 20.90 | 93.06 ± 5.68 | 85.03 ± 10.57 | 94.27 ± 4.27 | 88.56 ± 6.27 | 50.17 ± 34.35 | 35.85 ± 38.24 | 44.76 ± 33.36 | 82.55 ± 18.29 | 85.13 ± 14.50 | 5.73 ± 19.50 |
| lWM | 90.11 ± 7.97 | 87.01 ± 8.20 | 83.59 ± 20.23 | 93.28 ± 8.47 | 87.92 ± 9.00 | 94.87 ± 3.17 | 88.11 ± 6.21 | 58.98 ± 31.39 | 0.00 ± 0.00 | 42.80 ± 35.83 | 82.22 ± 17.69 | 86.28 ± 11.75 | 0.00 ± 0.00 |
| NexToU | 90.56 ± 6.71 | 89.04 ± 7.20 | 88.89 ± 11.50 | 92.92 ± 8.82 | 88.39 ± 9.26 | 94.83 ± 3.55 | 89.20 ± 6.28 | 66.42 ± 25.83 | 64.61 ± 32.00 | 48.51 ± 34.71 | 84.55 ± 18.12 | 88.93 ± 7.83 | 54.63 ± 25.45 |
| NIC-VICOROB-1 | 93.17 ± 3.91 | 83.50 ± 23.65 | 80.57 ± 27.07 | 85.96 ± 26.77 | 77.17 ± 29.78 | 86.18 ± 28.27 | 79.78 ± 29.52 | 60.22 ± 33.74 | 47.92 ± 40.23 | 58.20 ± 31.40 | 75.77 ± 32.97 | 80.05 ± 29.98 | 20.40 ± 40.79 |
| NIC-VICOROB-2 | 86.21 ± 6.96 | 80.52 ± 13.29 | 79.20 ± 12.87 | 90.36 ± 9.90 | 76.57 ± 16.03 | 91.78 ± 5.12 | 79.77 ± 11.87 | 25.03 ± 28.08 | 26.05 ± 33.29 | 19.36 ± 22.34 | 72.30 ± 18.87 | 74.66 ± 14.75 | 3.41 ± 13.20 |
| Organizers | 93.61 ± 3.21 | 90.77 ± 7.00 | 89.08 ± 10.57 | 94.18 ± 9.43 | 88.75 ± 7.59 | 95.88 ± 2.09 | 90.35 ± 4.98 | 67.98 ± 25.66 | 50.17 ± 38.18 | 54.99 ± 33.33 | 85.39 ± 18.43 | 88.97 ± 9.07 | 25.98 ± 40.07 |
| refrain | 93.15 ± 3.21 | 88.93 ± 5.30 | 88.51 ± 8.06 | 93.59 ± 5.96 | 86.95 ± 8.78 | 94.94 ± 1.72 | 88.23 ± 4.47 | 61.61 ± 30.65 | 64.39 ± 27.74 | 52.96 ± 31.02 | 83.76 ± 16.49 | 87.61 ± 6.73 | 38.68 ± 30.16 |
| WilliWillsWissen | 92.97 ± 3.99 | 89.04 ± 9.95 | 89.95 ± 7.88 | 93.64 ± 8.83 | 85.89 ± 12.19 | 95.79 ± 2.01 | 88.51 ± 7.51 | 67.12 ± 26.91 | 68.32 ± 29.27 | 54.39 ± 32.73 | 84.76 ± 22.19 | 90.60 ± 5.77 | 0.00 ± 0.00 |
| β0 error ↓ | |||||||||||||
| agaldran | 0.91 ± 0.28 | 1.26 ± 1.50 | 1.20 ± 1.08 | 1.06 ± 0.24 | 1.03 ± 0.17 | 1.06 ± 0.24 | 1.03 ± 0.17 | 0.91 ± 0.43 | 1.00 ± 0.00 | 1.00 ± 0.00 | 0.74 ± 0.44 | 0.94 ± 0.59 | 1.00 ± 0.00 |
| gbCoW | 0.00 ± 0.00 | 0.46 ± 0.61 | 0.40 ± 0.81 | 0.14 ± 0.55 | 0.14 ± 0.43 | 0.17 ± 0.45 | 0.20 ± 0.41 | 0.38 ± 0.77 | 0.55 ± 0.60 | 0.34 ± 0.65 | 0.37 ± 0.81 | 0.40 ± 0.74 | 0.25 ± 0.50 |
| gl | 0.03 ± 0.17 | 0.03 ± 0.17 | 0.00 ± 0.00 | 0.06 ± 0.24 | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.35 ± 0.49 | 0.28 ± 0.46 | 0.30 ± 0.47 | 0.06 ± 0.34 | 0.09 ± 0.28 | 0.67 ± 0.52 |
| junqiangchen | 0.06 ± 0.24 | 0.20 ± 0.41 | 0.31 ± 0.53 | 0.23 ± 0.73 | 0.11 ± 0.32 | 0.11 ± 0.40 | 0.69 ± 1.45 | 1.72 ± 1.87 | 2.07 ± 1.78 | 0.44 ± 0.66 | 0.34 ± 0.73 | 0.51 ± 0.98 | 4.86 ± 2.24 |
| lWM | 0.09 ± 0.28 | 0.29 ± 0.62 | 0.23 ± 0.49 | 0.09 ± 0.28 | 0.03 ± 0.17 | 0.11 ± 0.32 | 0.14 ± 0.36 | 0.35 ± 0.65 | 1.00 ± 0.00 | 0.33 ± 0.48 | 0.40 ± 0.65 | 0.57 ± 0.92 | 1.00 ± 0.00 |
| NexToU | 0.00 ± 0.00 | 0.26 ± 0.56 | 0.06 ± 0.24 | 0.11 ± 0.40 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.35 ± 0.78 | 0.35 ± 0.49 | 0.36 ± 0.60 | 0.14 ± 0.36 | 0.20 ± 0.41 | 0.33 ± 0.58 |
| NIC-VICOROB-1 | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.00 ± 0.00 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.09 ± 0.28 | 0.09 ± 0.28 | 0.29 ± 0.62 | 0.50 ± 0.59 | 0.37 ± 0.72 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.75 ± 0.50 |
| NIC-VICOROB-2 | 1.69 ± 3.11 | 2.51 ± 3.74 | 2.97 ± 4.76 | 2.40 ± 4.11 | 1.63 ± 2.90 | 1.69 ± 3.02 | 1.20 ± 2.70 | 3.03 ± 2.56 | 1.85 ± 1.29 | 2.26 ± 1.87 | 6.80 ± 12.90 | 4.23 ± 3.67 | 2.33 ± 2.16 |
| Organizers | 0.00 ± 0.00 | 0.17 ± 0.38 | 0.14 ± 0.49 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.39 ± 0.58 | 0.43 ± 0.51 | 0.29 ± 0.59 | 0.20 ± 0.41 | 0.29 ± 0.52 | 0.80 ± 0.84 |
| refrain | 0.00 ± 0.00 | 0.20 ± 0.41 | 0.29 ± 0.67 | 0.09 ± 0.37 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.17 ± 0.38 | 0.58 ± 0.93 | 0.38 ± 0.81 | 0.32 ± 0.48 | 0.17 ± 0.45 | 0.31 ± 0.63 | 0.00 ± 0.00 |
| WilliWillsWissen | 0.00 ± 0.00 | 0.03 ± 0.17 | 0.03 ± 0.17 | 0.06 ± 0.24 | 0.03 ± 0.17 | 0.03 ± 0.17 | 0.03 ± 0.17 | 0.09 ± 0.29 | 0.06 ± 0.25 | 0.19 ± 0.40 | 0.03 ± 0.17 | 0.09 ± 0.28 | 1.00 ± 0.00 |