Skip to main content
. Author manuscript; available in PMC: 2020 Aug 6.
Published in final edited form as: Text Retr Conf. 2017 Nov;26:https://trec.nist.gov/pubs/trec26/papers/Overview-PM.pdf.

Table 3.

Descriptive statistics (per-topic) of manual judgments (both results assessment and relevance assessment) for both literature articles and clinical trials.

Literature Articles Clinical Trials
Type Class Total Mean Median Min Max Total Mean Median Min Max
PM Human PM 8,738 291 277 65 627 3,959 132 119 18 428
Animal PM 536 18 17 2 71 2 0 0 0 1
Not PM 13,368 446 435 92 881 9,480 316 314 80 565

Disease Exact 4,149 138 120 9 506 1,093 36 26 0 139
More Specific 1,273 42 20 0 358 723 24 6 0 249
More General 938 31 18 0 139 679 23 17 0 92
Not Disease 2,914 97 85 0 275 1,466 49 41 0 179

1st Gene Exact 4,421 147 154 10 331 1,486 50 37 0 230
Missing Variant 1,419 47 3 0 464 452 15 5 0 108
Different Variant 560 19 10 0 110 243 8 2 0 91
Missing Gene 2,874 96 60 0 378 1,780 59 35 0 391

2nd Gene Exact 540 18 0 0 287 119 4 0 0 55
Missing Variant 230 8 0 0 218 127 4 0 0 121
Different Variant 91 3 0 0 83 17 1 0 0 14
Missing Gene 964 32 0 0 264 579 19 0 0 170

3rd Gene Exact 104 3 0 0 104 47 2 0 0 47
Missing Variant 6 0 0 0 6 0 0 0 0 0
Different Variant 0 0 0 0 0 2 0 0 0 2
Missing Gene 136 5 0 0 136 124 4 0 0 124

Demographics Matches 658 22 10 0 91 3,221 107 105 0 402
Not Discussed 7,736 258 226 37 578 376 13 1 0 197
Excludes 880 29 17 0 141 364 12 3 0 57

Other Matches 789 26 2 0 220 1,114 37 3 0 208
Not Discussed 8,320 277 283 0 646 2,736 91 81 0 425
Excludes 165 6 1 0 45 111 4 0 0 63

Relevance Definitely Relevant 2,022 67 44 1 221 436 15 5 0 98
Partially Relevant 1,853 62 27 1 476 735 25 15 0 120
Not Relevant 18,767 626 624 259 1,209 12,270 409 418 165 606

Note: only 6 topics had a 2nd Gene and only 1 had a 3rd Gene, but means are still provided across 30 topics.