Skip to main content
. 2019 Apr 4;9(4):e027241. doi: 10.1136/bmjopen-2018-027241

Table 3.

Criteria for evaluating the quality of the psychometric properties

Measurement property Rating* Criteria
Reliability + Intraclass correlation coefficient or weighted Kappa ≥ 0.70
? Intraclass correlation coefficient or weighted Kappa not reported
Intraclass correlation coefficient or weighted Kappa < 0.70
Measurement error + Smallest detectable change or limits of agreement < minimal important change†
? Minimal important change not defined
Smallest detectable change or limits of agreement > minimal important change†
Hypotheses testing for + The results are in accordance with the hypothesis‡
construct validity ? Hypothesis is not defined (by the review committee)
The result is not in agreement with the hypothesis‡
Criterion validity + Correlation with gold/reference standard ≥ 0.70 or area under the curve ≥ 0.70
? Not all information for ‘+’ reported
Correlation with gold/reference standard < 0.70 or area under the curve < 0.70
Responsiveness + The results are in agreement with the hypothesis‡ or area under the curve ≥ 0.70
? Hypothesis is not defined (by the review committee)
The result is not in agreement with the hypothesis‡ or area under the curve < 0.70

The criteria list has been adapted from Prinsen et al.53

*Rating: ‘+’=sufficient, ‘?’=indeterminate, ‘– ‘=insufficient.

†This rating of evidence may be obtained from different studies.

‡The findings of all studies must be complied together and then it must be decided if 75% of the findings are in agreement with the hypotheses.