Table 3.
Intra-class correlation coefficient for inter-rater reliability between live reviewer and the two video recorded reviewers
| N | ICC | 95% CI | |
|---|---|---|---|
| Exposure | |||
| Trocars introduction | 35 | 0.805 | 0.690–0.888 |
| Peritoneal incision | 38 | 0.810 | 0.702–0.890 |
| Execution | 36 | 0.772 | 0.628–0,874 |
| Cystic artery and duct identification | 36 | 0.751 | 0.6–0.862 |
| Dissection | |||
| Hemostasis control | 42 | 0.563 | 0.362–0.737 |
| Cystic artery and duct dissection | 42 | 0.669 | 0.515–0.793 |
| Execution | 42 | 0.524 | 0.332–0.696 |
| Final result | 42 | 0.763 | 0.551–0.921 |
| Cholangiography | |||
| Cystic duct incision | 29 | 0.805 | 0.695–0.886 |
| Catheter use | 31 | 0.774 | 0.638–0.870 |
| Execution | 30 | 0.807 | 0.702–0.884 |
| Cholangiography | NA | – | – |
| Resection | |||
| Use of tissue handlers | 42 | 0.776 | 0.660–0.863 |
| Use of non-dominant hand | 41 | 0.689 | 0.546–0.805 |
| Execution | 41 | 0.751 | 0.626–0.846 |
| Gallbladder resection | 42 | 0.829 | 0.736–0.897 |
| OSATS | |||
| Respect for tissue | 42 | 0.797 | 0.690–0.877 |
| Time and motion | 40 | 0.821 | 0.724–0.892 |
| Instrument handling | 42 | 0.753 | 0.621–0.847 |
| Knowledge of instruments | 42 | 0.45 | 0.361–0.615 |
| Use of assistants | 42 | 0.684 | 0.537–0.802 |
| Flow of operation | 40 | 0.683 | 0.538–0.801 |
| Knowledge of specific procedure | 40 | 0.446 | 0.248–0.633 |
| VAS | |||
| Exposition | 36 | 0.652 | 0.497–0.779 |
| Calot’s triangle dissection | 36 | 0.744 | 0.617–0.842 |
| Cholangiography | 29 | 0.787 | 0.675–0.870 |
| Resection | 36 | 0.662 | 0.511–0.786 |
| Autonomy statement | 42 | 0.806 | 0.702–0.882 |
ICC value < 0.5, between 0.5 and 0.75, between 0.75 and 0.9 and > 0.90 were indicative of poor, moderate, good, and excellent reliability respectively
ICC intra-class correlation coefficient, CI confidence interval, OSATS objective structured assessment of technical skills, VAS Visual Analog Scale