Skip to main content
. 2020 Jun 3;8:e9300. doi: 10.7717/peerj.9300

Table 1. Interrater reliability of article coding process.

Question Percentage agreement Cohen’s kappa 95% CI N
Basic information all primary antibodies complete? 100% 1.00 1.00–1.00 16
Any validation information present (at least one antibody)? 75% 0.50 0.13–0.87 16
All primary antibodies validated? 94% IND / 16
If validated:
Reference to validation by antibody supplier? 100% IND / 8
Reference to validation in the literature? 88% 0.75 0.31–1.00 8
Reference to validation information in database? 100% IND / 8
Antibody validation carried out by authors of article? 63% −0.20 −0.49–0.088 8
If carried out by authors, which method?
Molecular weight similar to target (in WB)? 83% 0.57 −0.12–1.00 6
Spatial localization? 100% 1.00 1.00–1.00 6
Pre-adsorption/blocking peptide? 100% 1.00 1.00–1.00 6
Using secondary antibody without primary? 100% IND / 6
One of the five pillars? 100% 1.00 1.00–1.00 6
Positive control? 67% 0.33 −0.23–0.90 6
Negative control? 67% IND / 6
Other validation method? 50% 0.00 −0.75–0.75 6
Question ICC 95% CI N
How many antibodies were used? 0.995 0.986–0.998 15
How many antibodies were validated? 0.684 0.263–0.886 14
Percentage of validated antibodies? 0.663 0.226–0.878 14