Table 4.
COSMIN Risk of bias assessment for studies of the measurement properties of anaesthetists' intraoperative non-technical skills assessment tools
| Assessment tool | Study of validity or reliability | COSMIN Risk of bias Assessment |
|||
|---|---|---|---|---|---|
| No risk: There are multiple studies of at least adequate quality, or there is one study of very good quality available | Serious risk: there are multiple studies of doubtful quality available, or there is only one study of adequate quality | Very serious risk: There are multiple studies of inadequate quality, or there is only one study of doubtful quality available | Extremely serious: there is only one study of inadequate quality available | ||
| Anaesthetists' Non-Technical Skills (ANTS) | Content validity | X | |||
| Concurrent validity | X | ||||
| Internal consistency | X | ||||
| Inter-rater reliability | X | ||||
| Ottawa Global Rating Scale (GRS) | Content validity | X | |||
| Concurrent validity | X | ||||
| Internal consistency | X | ||||
| Inter-rater reliability | X | ||||
| Structured coding framework | Content validity | X | |||
| Structured rating form | Inter-rater reliability | X | |||
| Unnamed tool, Blum 2014 | Content validity | X | |||
| Construct validity | X | ||||
| Inter-rater reliability | X | ||||
| BARS tool | Content validity | X | |||
| Inter-rater reliability | X | ||||
| Workplace-based assessment tool | Inter-rater reliability | X | |||