Table 3.
Comparison of accuracy between symptom checkers and participants.
| SCa,b name | Accuracyc, n (%) | Participants | Comparison | |
|
|
|
Percent accuracyd,e, mean (SD) | 95% CI | Percentage of participants outperforming the SC (95% CI)d,e |
| HMSf Family Health Guide, n=40 | 32 (80) | 59.5 (7.1) | 58.0-60.9 | 0 (0-0) |
| Healthy Children, n=15 | 11 (73) | 49.9 (10.1) | 47.7-52.1 | 1.1 (0-3.3) |
| Steps2Care, n=42 | 30 (71) | 59.7 (7.2) | 58.2-61.1 | 1.1 (0-3.3) |
| Symptify, n=40 | 28 (70) | 60.2 (7.2) | 58.2-61.7 | 5.5 (1.1-11.0) |
| Symptomateg, n=14 | 9 (64) | 60.9 (11.6) | 58.6-63.2 | 26.4 (17.6-35.2) |
| Drugs.com, n=42 | 25 (59) | 60.6 (6.5) | 59.3-61.9 | 51.6 (41.8-61.5) |
| FreeMD, n=44 | 26 (59) | 60.2 (6.7) | 58.9-61.6 | 56.0 (45.1-65.9) |
| Doctor Diagnose, n=16 | 10 (62) | 69.5 (10.9) | 67.3-71.7 | 63.7 (53.8-73.6) |
| Family Doctor, n=41 | 22 (53) | 58.1 (7.0) | 56.7-59.6 | 68.1 (58.2-78.0) |
| Early Doc, n=17 | 9 (52) | 63.4 (11.4) | 61.1-65.7 | 76.9 (68.1-85.7) |
| Isabelg, n=45 | 23 (51) | 60.9 (6.8) | 59.4-62.2 | 89 (82.4-94.5) |
| NHSh, n=44 | 23 (52) | 62.0 (6.9) | 60.9-63.4 | 89 (82.4-94.5) |
| Symcatg, n=45 | 20 (44) | 60.9 (6.8) | 59.5-62.2 | 97.8 (94.5-100) |
| Healthwise, n=44 | 19 (43) | 61.2 (7) | 59.7-62.6 | 98.9 (96.7-100) |
| iTriageh,i, n=43 | 14 (32) | 60.5 (6.9) | 59.1-61.9 | 100 (100-100) |
aSC: symptom checkers
bSCs are listed in order by the proportion of participants outperforming them.
cMost SCs did not evaluate every case vignette. Their accuracy is given as the proportion of correctly solved vignettes of the total vignettes that they evaluated.
dThe participants’ accuracy is based on their assessment of the same case vignettes assessed by the respective SC.
eFor the participant sample, 95% CIs were calculated using bootstrapping.
fHMS: Harvard Medical School.
gFour SCs were apparently designed never to recommend self-care.
hNHS: National Health Service.
iOne SC advised seeking emergency care for all case vignettes.