Table 3.
Second step of the critical appraisal: psychometric criteria according to the Critical Appraisal Tool [23]
| Item from the CAT | BAT-Back | PaBS | TIPPA | |
|---|---|---|---|---|
| 1 | If human subjects were used, did the authors give a detailed description of the sample of subjects used to perform the (index) test? | Yes | Yes | No |
| 2 | Did the authors clarify the qualification, or competence of the rater(s) who performed the (index) test? | No | Yes | No |
| 4 | If interrater reliability was tested, were raters blinded to the findings of other raters? | No | Yes | No |
| 5 | If intrarater reliability was tested, were raters blinded to their own prior findings of the test under evaluation? | n/a | Yes | n/a |
| 6 | Was the order of examination varied? | n/a | No | n/a |
| 8 | Was the stability (or theoretical stability) of the variable being measured taken into account when determining the suitability of the time interval between repeated measures? | n/a | No | n/a |
| 10 | Was the execution of the (index) test described in sufficient detail to permit replication of the test? | Yes | Yes | No |
| 12 | Were withdrawals from the study explained? | Yes | Yes | Yes |
| 13 | Were the statistical methods appropriate for the purpose of the study? | Yes | Yes | No |
| Ratio between the number of items with a positive answer and the total number of “applicable” items | 4/6 | 7/9 | 1/6 | |
| Percentage | 66.7% | 77.8% | 16.7% | |
| Decision before extraction | Retain | Retain | Reject |
No: no information or insufficient information
Yes: sufficient information
n/a: not applicable