Table A2.
Results of simulated screening experiments on 26 datasets using active learning and recall estimation with δ = 2. Mean and standard deviation over 30 trials with initially randomized order.
Records from Search | % Screened | Cost | Theoretical WSS@95 | Obtained WSS@95 | Estimated Recall | Obtained True Recall | |
---|---|---|---|---|---|---|---|
Transgenerational inheritance of health effects | 48,638 | 0.371 | 0.128 | 0.742 (0.003) | 0.613 (0.001) | 0.950 | 0.986 (0.001) |
Neuropathic pain | 29,207 | 0.402 | 0.040 | 0.613 (0.001) | 0.573 (0.022) | 0.950 | 0.976 (0.014) |
USDA 2 | 9,103 | 0.332 | 0.099 | 0.755 (0.004) | 0.655 (0.010) | 0.950 | 0.987 (0.001) |
Bisphenol A (BPA) and obesity | 7,700 | 0.354 | 0.161 | 0.807 (0.010) | 0.646 (0.013) | 0.950 | 1.000 (0.000) |
PFOA/PFOS and immunotoxicity | 6,331 | 0.448 | 0.280 | 0.833 (0.009) | 0.552 (0.010) | 0.950 | 1.000 (0.000) |
Fluoride and neurotoxicity in animal models | 4,479 | 0.443 | 0.324 | 0.862 (0.018) | 0.538 (0.009) | 0.950 | 0.981 (0.004) |
Statins | 3,465 | 0.576 | 0.024 | 0.399 (0.035) | 0.375 (0.015) | 0.950 | 0.951 (0.002) |
Ace inhibitors | 2,544 | 0.550 | 0.333 | 0.758 (0.023) | 0.425 (0.013) | 0.950 | 0.976 (0.000) |
Beta blockers | 2,072 | 0.629 | 0.262 | 0.586 (0.016) | 0.324 (0.014) | 0.950 | 0.953 (0.004) |
Opioids | 1,915 | 0.856 | 0.114 | 0.257 (0.028) | 0.144 (0.038) | 0.950 | 1.000 (0.000) |
USDA 1 | 1,776 | 0.445 | 0.116 | 0.659 (0.007) | 0.543 (0.009) | 0.950 | 0.988 (0.004) |
Skeletal muscle relaxants | 1,643 | 0.902 | 0.191 | 0.289 (0.065) | 0.098 (0.013) | 0.950 | 1.000 (0.000) |
USDA 5 | 1,570 | 0.704 | 0.328 | 0.624 (0.040) | 0.296 (0.018) | 0.950 | 1.000 (0.000) |
Mammalian | 1,442 | 0.580 | 0.121 | 0.529 (0.015) | 0.408 (0.014) | 0.950 | 0.988 (0.004) |
Proton pump inhibitors | 1,333 | 0.743 | 0.139 | 0.397 (0.018) | 0.257 (0.009) | 0.950 | 1.000 (0.000) |
Calcium Channel Blockers | 1,218 | 0.620 | 0.194 | 0.563 (0.021) | 0.369 (0.024) | 0.950 | 0.989 (0.005) |
Atypical Antipsychotics | 1,120 | 0.680 | −0.070 | 0.165 (0.020) | 0.235 (0.014) | 0.950 | 0.915 (0.016) |
ADHD | 851 | 0.694 | 0.474 | 0.734 (0.046) | 0.259 (0.017) | 0.950 | 0.953 (0.013) |
Triptans | 671 | 0.782 | 0.240 | 0.458 (0.030) | 0.218 (0.012) | 0.950 | 1.000 (0.000) |
USDA 3 | 608 | 0.863 | 0.094 | 0.231 (0.068) | 0.137 (0.018) | 0.950 | 1.000 (0.000) |
Oral Hypoglycemics | 503 | 0.835 | −0.009 | 0.092 (0.018) | 0.101 (0.019) | 0.951 | 0.936 (0.039) |
Nonsteroidal anti-inflammatory | 393 | 0.632 | 0.254 | 0.621 (0.019) | 0.368 (0.013) | 0.950 | 1.000 (0.000) |
Estrogens | 368 | 0.664 | 0.129 | 0.454 (0.021) | 0.325 (0.013) | 0.951 | 0.989 (0.006) |
Urinary Incontinence | 327 | 0.798 | 0.199 | 0.401 (0.018) | 0.202 (0.020) | 0.951 | 1.000 (0.000) |
Antihistamines | 310 | 0.829 | −0.042 | 0.072 (0.034) | 0.115 (0.025) | 0.951 | 0.944 (0.019) |
USDA 4 | 104 | 0.846 | 0.325 | 0.479 (0.070) | 0.154 (0.019) | 0.952 | 1.000 (0.000) |