Table 2.
Overall Accuracy Comparison of the Same Chemicals between BCOP (LLBO), BCOP (OP-KIT), EpiOcular, ICE, Ocular Irritection, OptiSafe, and STE
| Test Comparisons | n | False Negative |
False Positive |
Accuracy (%) | Balanced Accuracy(%) | ||
|---|---|---|---|---|---|---|---|
| % (missed/total) | Commonly Missed |
% (missed/total) | Commonly Missed |
||||
| % (same/total) | % (same/total) | ||||||
|
| |||||||
| BCOP (LLBO) | 112 | 7.2 (6/83) | 45.5 (5/11) | 58.6 (17/29) | 88.2 (15/17) | 79.5 (89/112) | 67.1 |
| BCOP (OPKIT) | 12.0 (10/83) | 51.7 (15/29) | 77.7 (87/112) | 68.1 | |||
|
| |||||||
| BCOP (LLBO) | 104 | 6.3 (5/79) | 0.0 (0/7) | 48.0 (12/25) | 38.5 (5/13) | 83.7 (87/104) | 72.8 |
| EpiOcular | 2.5 (2/79) | 24.0 (6/25) | 92.3 (96/104) | 86.7 | |||
|
| |||||||
| BCOP (LLBO) | 37 | 7.1 (2/28) | 0.0 (0/4) | 66.7 (6/9) | 50.0 (4/8) | 78.4 (29/37) | 63.1 |
| ICE | 7.1 (2/28) | 66.7 (6/9) | 78.4 (29/37) | 63.1 | |||
|
| |||||||
| BCOP (LLBO) | 32 | 9.5 (2/21) | 0.0 (0/3) | 45.5 (5/11) | 66.7 (4/6) | 78.1 (25/32) | 72.5 |
| Ocular Irritection | 4.8 (1/21) | 45.5 (5/11) | 81.3 (26/32) | 74.9 | |||
|
| |||||||
| BCOP (LLBO) | 41 | 3.6 (1/28) | 0.0 (0/1) | 30.8 (4/13) | 75.0 (3/4) | 87.8 (36/41) | 82.8 |
| OptiSafe | 0.0 (0/28) | 23.1 (3/13) | 92.7 (38/41) | 88.5 | |||
|
| |||||||
| BCOP (OP-KIT) | 111 | 10.2 (9/88) | 10.0 (1/10) | 47.8 (11/23) | 63.6 (7/11) | 82.0 (91/111) | 71.0 |
| EpiOcular | 2.3 (2/88) | 30.4 (7/23) | 91.9 (102/111) | 83.6 | |||
|
| |||||||
| BCOP (OP-KIT) | 61 | 6.8 (3/44) | 0.0 (0/5) | 64.7 (11/17) | 66.7 (10/15) | 77.0 (47/61) | 64.2 |
| ICE | 4.5 (2/44) | 82.4 (14/17) | 73.8 (45/61) | 56.6 | |||
|
| |||||||
| BCOP (OP-KIT) | 44 | 9.1 (3/33) | 0.0 (0/5) | 45.5 (5/11) | 66.7 (4/6) | 81.8 (36/44) | 72.7 |
| Ocular Irritection | 6.1 (2/33) | 45.5 (5/11) | 84.1 (37/44) | 74.2 | |||
|
| |||||||
| BCOP (OP-KIT) | 43 | 8.8 (3/34) | 0.0 (0/3) | 33.3 (3/9) | 100.0 (3/3) | 86.0 (37/43) | 78.9 |
| OptiSafe | 0.0 (0/34) | 33.3 (3/9) | 93.0 (40/43) | 83.3 | |||
|
| |||||||
| EpiOcular | 43 | 2.9 (1/34) | 50.0 (1/2) | 44.4 (4/9) | 42.9 (3/7) | 88.4 (38/43) | 76.3 |
| ICE | 5.9 (2/34) | 66.7 (6/9) | 81.4 (35/43) | 63.7 | |||
|
| |||||||
| EpiOcular | 58 | 3.3 (1/30) | 0.0 (0/3) | 35.7 (10/28) | 90.9 (10/11) | 81.0 (47/58) | 80.5 |
| Ocular Irritection | 6.7 (2/30) | 39.3 (11/28) | 77.6 (45/58) | 77.0 | |||
|
| |||||||
| EpiOcular | 56 | 2.9 (1/35) | 0.0 (0/1) | 33.3 (7/21) | 55.6 (5/9) | 85.7 (48/56) | 81.9 |
| OptiSafe | 0.0 (0/35) | 33.3 (7/21) | 87.5 (49/56) | 83.3 | |||
|
| |||||||
| ICE | 28 | 4.8 (1/21) | 0.0 (0/1) | 100.0 (7/7) | 42.9 (3/7) | 71.4 (20/28) | 47.6 |
| Ocular Irritection | 0.0 (0/21) | 42.9 (3/7) | 89.3 (25/28) | 78.6 | |||
|
| |||||||
| ICE | 24 | 10.0 (2/20) | 0.0 (0/2) | 75.0 (3/4) | 66.7 (2/3) | 79.2 (19/24) | 57.5 |
| OptiSafe | 0.0 (0/20) | 50.0 (2/4) | 91.7 (22/24) | 75.0 | |||
|
| |||||||
| Ocular Irritection | 46 | 8.7 (2/23) | 0.0 (0/2) | 47.8 (11/23) | 61.5 (8/13) | 71.7 (33/46) | 71.7 |
| OptiSafe | 0.0 (0/23) | 43.5 (10/23) | 78.3 (36/46) | 78.3 | |||
|
| |||||||
| STE | 69 | *20.8 (10/48) | 10.0 (1/10) | *0.0 (0/21) | 0.0 (0/9) | 85.5 (59/69) | 89.6 |
| BCOP (LLBO) | *2.1 (1/47) | *40.9 (9/22) | 85.5 (59/69) | 78.5 | |||
|
| |||||||
| STE | 84 | *19.7 (12/61) | 14.3 (2/14) | *17.4 (4/23) | 23.1 (3/13) | 81.0 (68/84) | 81.5 |
| BCOP (OP-KIT) | *6.7 (4/60) | *50.0 (12/24) | 81.0 (68/84) | 71.7 | |||
|
| |||||||
| STE | 80 | 23.5 (12/51) | 7.7 (1/13) | 10.3 (3/29) | 18.2 (2/11) | 81.3 (65/80) | 83.1 |
| EpiOcular | 3.9 (2/51) | 34.5 (10/29) | 85.0 (68/80) | 80.8 | |||
|
| |||||||
| STE | 41 | 25.0 (7/28) | 14.3 (1/7) | 15.4 (2/13) | 22.2 (2/9) | 78.0 (32/41) | 79.8 |
| ICE | 3.6 (1/28) | 69.2 (9/13) | 75.6 (31/41) | 63.6 | |||
|
| |||||||
| STE | 40 | 33.3 (7/21) | 0.0 (0/7) | 10.5 (2/19) | 11.1 (1/9) | 77.5 (31/40) | 78.1 |
| Ocular Irritection | 0.0 (0/21) | 42.1 (8/19) | 80.0 (32/40) | 78.9 | |||
|
| |||||||
| STE | 56 | 31.0 (9/29) | 0.0 (0/9) | 7.4 (2/27) | 28.6 (2/7) | 80.4 (45/56) | 80.8 |
| OptiSafe | 0.0 (0/29) | 25.9 (7/27) | 87.5 (49/56) | 87.0 | |||
Table 2. Overall accuracy comparison of chemicals in common.
n is the number of chemicals in common between the test methods compared.
False negative (FN) is the number of positives misclassified as negatives [((FN) / (FN + TP)) • 100].
False positive (FP) is the number of negatives misclassified as positives [((FP) / (FP + TN)) • 100].
% (Missed/total) is the misclassification rate for chemicals in common. Commonly missed is the percent overlapping FNs or FPs.
Accuracy is the total correct predictions divided by the n in common. [((TP + TN) / (TP + TN + FP + FN)) • 100].
Balanced accuracy equally weights positives and negatives [((Sensitivity + Specificity) / 2) • 100].
BCOP = Bovine Corneal Opacity and Permeability; LLBO = Laser Light-Based Opacitometer; ICE = Isolated Chicken Eye; STE = Short Time Exposure. TP = True Positive; TN = True Negative; Sensitivity = [(TP) / (TP + FN)]; Specificity = [(TN) / (TN + FP)].
= has differing total FN and FP values in common due to differing in vivo classification of cetylpyridinium bromide. The in vivo classification of cetylpyridinium bromide for LLBO and OP-KIT was not classified (NC) and the classification for STE was category 1.