Table 3.
Inter grader agreement in e-ROP Study
| Inter-Grader Variability for the Samples of Contemporaneous Variability. All Samples Combined (n=80) | ||
|---|---|---|
| Variable | Percent Agreement | Weighted Kappa |
| Pupil Quality | 94% | 0.73 (0.56, 0.91) |
| Disc Center Quality | 66% | 0.47 (0.30, 0.65) |
| Disc Up Quality | 74% | 0.56 (0.43, 0.69) |
| Disc Down Quality | 78% | 0.40 (0.25, 0.56) |
| Disc Temporal Quality | 81% | 0.66 (0.51, 0.81) |
| Disc Nasal Quality | 74% | 0.49 (0.34, 0.64) |
| Posterior Pole Vessels | 80% | 0.60 (0.39, 0.82) |
| Preplus/plus in each quadrant | ||
| ST Quadrant | 79% | 0.69 (0.52, 0.86) |
| IT Quadrant | 71% | 0.59 (0.42, 0.76) |
| IN Quadrant | 71% | 0.49 (0.32, 0.67) |
| SN Quadrant | 78% | 0.59 (0.42, 0.76) |
| Total Quadrants of Plus/Preplus | 65% | 0.68 (0.51, 0.84) |
| Total Quadrants of Plus | 88% | 0.50 (0.32, 0.68) |
| Dominant Feature | 71% | 0.58 (0.42, 0.75) |
| Any ROP | 95% | 0.89 (0.68, 1.00) |
| Demarcation Line | 99% | 0.74 (0.56, 0.92) |
| Ridge | 83% | 0.65 (0.45, 0.86) |
| Extra Retinal Fibrovascular Proliferation | 83% | 0.67 (0.47, 0.88) |
| Flat Pre-retinal Neovascular Proliferation | 100% | 1.00 (1.00, 1.00) |
| Retinal Detachment | 100% | 1.00 (1.00, 1.00) |
| Highest Stage | 81% | 0.85 (0.67, 1.00) |
| Lowest Zone | 80% | 0.81 (0.63, 0.99) |
| Plus Disease | 90% | 0.57 (0.37, 0.77) |
| Zone 1 ROP | 83% | 0.43 (0.24, 0.63) |
| Stage 3 or Worse | 83% | 0.67 (0.47, 0.88) |
| Referral-Warranted ROP | 85% | 0.72 (0.52, 0.93) |