Table 4.
The results of pooled (for all experts) agreement analysis of categorized data using Kendall's tau-b analysis for interobserver variability on the WSI from sets A and B separately. The data are grouped in categories, grade I and grade II, while grade III was excluded from the analysis because of the small number of WSIs (3) in this category. TM means classical expert microscopic review, Human means the mean of the pathologists, and AU means the proposed automatic method.
| Human | TM | AU | |
|---|---|---|---|
| A—grade I | |||
| Human | 0.60606 (0.54545 : 0.69697) | 0.78788 (0.66667 : 0.78788) | |
| TM | 0.60606 (0.54545 : 0.69697) | 0.39394 (0.27273 : 0.42424) | |
| AU | 0.78788 (0.66667 : 0.78788) | 0.39394 (0.27273 : 0.42424) | |
|
| |||
| A—grade II | |||
| Human | 0.86667 (0.46667 : 0.86667) | 0.86667 (0.46667 : 0.86667) | |
| TM | 0.86667 (0.46667 : 0.86667) | 1 (0.46667 : 1) | |
| AU | 0.86667 (0.46667 : 0.86667) | 1 (0.46667 : 1) | |
|
| |||
| B—grade I | |||
| Human | 0.33333 (0.28105 : 0.39608) | 0.77778 (0.75163 : 0.80392) | |
| TM | 0.33333 (0.28105 : 0.39869) | 0.32026 (0.26797 : 0.35948) | |
| AU | 0.77778 (0.75163 : 0.80392) | 0.32026 (0.26928 : 0.35948) | |
|
| |||
| B—grade II | |||
| Human | 0.42857 (0.2381 : 0.52381) | 0.80952 (0.71429 : 0.90476) | |
| TM | 0.42857 (0.2381 : 0.52381) | 0.2381 (0.047619 : 0.33333) | |
| AU | 0.80952 (0.71429 : 0.90476) | 0.2381 (0.047619 : 0.33333) | |