Table 4.
Inter-coder Within-pair Reliability (PABAK) for Internal and External Coders at Specified Intervals
| Coder Pairs | Study Site | |||
|---|---|---|---|---|
| Minnesota | Case Western | Vanderbilt | Stanford | |
| Internal Coders | ||||
| 1% -10% | .74 | .68 | .63 | .83 |
| 11% -50% | .74 | .54 | .44 | .81 |
| 51% -100% | .83 | .80 | .59 | .76 |
| External Coders (Pair 1) | ||||
| 1% -10% | .69 | .67 | - | - |
| 11% -50% | .76 | .85 | - | - |
| 51% -100% | .81 | .83 | - | - |
| External Coders (Pair 2) | ||||
| 1%-10% | - | - | .85 | .85 |
| 11%-50% | - | - | .81 | .85 |
| 51%-100% | - | - | .85 | .94 |
Note. PABAK = Prevalence and Bias-adjusted Kappa