. 2020 Feb 3;3:923. Originally published 2019 Mar 21. [Version 2] doi: 10.12688/gatesopenres.12916.2

Table 1b. Definitions of measures of agreement.

Measure

Definition

Calculation

PP difference in
coverage

Difference between coverage level estimated by the two sources

C o v e r a g e_{C o m p a r a t o r} - C o v e r a g e_{R e f e r e n c e}

Concordance

% of children with the same vaccination status from both sources

\frac{T r u e N e g a t i v e + T r u e P o s i t i v e}{T o t a l C h i l d r e n}

Kappa statistic

Measure of concordance that corrects for chance agreements.
Interpretation: <0.2 = poor; 0.21-0.4 = fair; 0.41-0.6 = moderate;
0.61-0.8 = substantial; 0.81-1.0 = near perfect

\frac{O b s e r v e d A g r e e m e n t - E x p e c t e d a g r e e m e n t}{1 - E x p e c t e d A g r e e m e n t}

Sensitivity

% of children vaccinated according to the reference source that
are vaccinated according to the comparator source

\frac{T r u e P o s i t i v e}{T r u e P o s i t i v e + F a l s e N e g a t i v e}

Specificity

% of children unvaccinated according to the reference source
that are unvaccinated according to the comparator source

\frac{T r u e N e g a t i v e}{T r u e N e g a t i v e + F a l s e P o s i t i v e}

Positive
predicative
values

% of children vaccinated according to the comparator source
who were vaccinated according to the reference source

\frac{T r u e P o s i t i v e}{T r u e P o s i t i v e + F a l s e P o s i t i v e}

Negative
predictive values

% of children unvaccinated according to the comparator source
who were unvaccinated according to the reference source

\frac{T r u e N e g a t i v e}{T r u e N e g a t i v e + F a l s e N e g a t i v e}