Table 3.
Time (seconds; median and interquartile range) spent on individual quiz actions for each question (n = 121).
| Questiona | Total time spent on a question, between the first opening and quiz submission | Time spent performing tasksa | Time reading all table segments during answering a question | Time reading target table segments during answering a questionb | Time reading non-target table segments during answering a question |
|---|---|---|---|---|---|
| Q1: Which outcome do you think is the most important one?c | 278.8 (165.6–369.1) | 29.56 (19.0–51.7) | 96.1 (0.0–159.1) | – | 96.1 (1.7–175.4) |
| Q2: Which outcome has the biggest improvement with the intervention? | 231.7 (182.0–295.9) | 43.6 (24.0–65.4) | 114.2 (73.4–172.4) | 82.7 (38.8–132.7) | 22.9 (2.8–49.7) |
| Q3: What is the setting for patients included in this evidence assessment?c | 49.6 (31.3–87.7) | 9.1 (6.6–21.9) | 0.0 (0.0–0.0) | – | 0.0 (0.0–8.1) |
| Q4: Based on the information from this Summary of Findings Table, how would you formulate a recommendation for clinical practice? | 277.3 (159.6–391.4) | 105.8 (64.4–172.1) | 72.8 (30.3–144.9) | 35.0 (0.0–77.6) | 29.6 (0.0–59.4) |
| Q5: How many participants were there in trials that assessed death as an outcome? | 94.2 (49.8–139.4) | 12.3 (6.5–27.7) | 34.6 (10.0–72.1) | 7.3 (1.2–20.6) | 18.2 (3.0–51.3) |
| Q6: Why was the quality of evidence for the outcome of adverse events graded as very low? | 108.5 (69.6–144.6) | 40.7 (29.4–55.1) | 29.0 (14.7–51.0) | 12.5 (0.0–20.2) | 14.5 (5.4–35.0) |
| Q7: Now look at the “Comments” column. Are the comments different from your recommendation? Please explain how | 144.1 (69.1–222.5) | 64.7 (31.6–105.0) | 36.7 (8.7–73.7) | 29.3 (0.0–61.7) | 0.0 (0.0–8.1) |
aTarget SoF table segments: Q1–n one (cells with outcomes in the first table column of the SoF table were visible at all times); Q2–all cells under table columns “Placebo or standard care alone” or “Risk difference with remdesivir”; Q3–none (segment is visible at all times); Q4–all cells except for those in the table column “No of participants (studies)”; Q5–the cell in the table column “No of participants (studies)” and the row “All-cause mortality up to day 28”; the cell in the table column “Certainty of the evidence (GRADE)” and the row “Adverse events (any grade) at up to day 28”; Q7–all of the cells in the table column “Comments”.
bTotal time for actions of clicking on the table cells or changing between the table and question screen.
cFor these questions there were no target table cells as the answers were in the unblurred parts of the SoF table.