Table 1.
Agreement Between Expert and Crowd Scores According to Skills Task Assessment
| Minimum | Maximum | Mean | SD | |
|---|---|---|---|---|
| Task 1: open knot tie (OSATS) | ||||
| Expert | 6.36 | 14.5 | 11.24 | 2.29 |
| Crowd | 14.45 | 17.43 | 16.38 | 0.85 |
| Agreement | Cronbach's α = 0.623 | |||
| Task 2: laparoscopic peg transfer (GOALS) | ||||
| Expert | 3.5 | 13.5 | 8.83 | 2.83 |
| Crowd | 4.81 | 11.75 | 7.5 | 2.01 |
| Agreement | Cronbach's α = 0.916 | |||
| Task 3: robotic suture (GEARS) | ||||
| Expert | 4.5 | 14 | 8.15 | 2.80 |
| Crowd | 10.9 | 19.84 | 15.04 | 2.09 |
| Agreement | Cronbach's α = 0.864 | |||
GOALS = Global Operative Assessment of Laparoscopic Skills; OSATS = Objective Structured Assessment of Technical Skills; SD = standard deviation.