Table 1.
Manual versus automated (using tfc and tfx weightings) evaluation (N=27).
| Criteria | Manual | Automated | |||||||||
|
|
|
tfc | tfx | ||||||||
|
|
|
Truea | Falseb | Otherc | Truea | Falseb | Otherc | ||||
|
|
|
– | + | – | + |
|
– | + | – | + |
|
| Authority | 21 | 4 | 1 | 10 | 2 | 10 | 4 | 4 | 14 | 2 | 3 |
| Complementarity | 26 | 1 | 0 | 21 | 0 | 5 | 1 | 2 | 23 | 0 | 1 |
| Privacy | 24 | 1 | 14 | 9 | 2 | 1 | 3 | 14 | 10 | 0 | 0 |
| Reference (attribution) | 16 | 5 | 0 | 6 | 6 | 10 | 8 | 4 | 7 | 3 | 5 |
| Justifiability | 6 | 14 | 1 | 1 | 7 | 4 | 8 | 3 | 3 | 13 | 0 |
| Contact details | 26 | 1 | 6 | 16 | 0 | 4 | 1 | 15 | 8 | 0 | 3 |
| Financial disclosure | 17 | 8 | 1 | 9 | 2 | 7 | 9 | 0 | 16 | 1 | 1 |
| Advertising policy | 16 | 9 | 0 | 13 | 2 | 3 | 10 | 1 | 13 | 1 | 2 |
| Date (attribution) | 21 | 6 | 0 | 16 | 0 | 5 | 6 | 0 | 21 | 0 | 0 |
a True negative: both manual and automated did not find criterion was satisfied; true positive: both manual and automated did find criterion was satisfied.
b False negative: automated system did not find criterion was satisfied but manual review did; false positive: automated system did find criterion was satisfied but manual review did not.
c Criterion detected on a Web page different to the one designated in the manual review.