Table 3.
Percentage of frames correctly identified by emotion type by each classifier: Azure (Azure Cognitive Services), AWS (Amazon Web Services), SH (Sighthound), and Google (Google Cloud Vision). These results only include frames in which there was a face, and the two manual raters agreed on the class. Note: Google Vision API does not support the neutral or disgust labels.
| Classifier | Frame type | |||||
|
|
Neutral (n=1394), n (%) | Happy (n=864), n (%) | Sad (n=60), n (%) | Surprised (n=165), n (%) | Disgusted (n=69), n (%) | Angry (n=51), n (%) |
| AWS | 679 (48.74) | 709 (82.0) | 19 (31) | 94 (56.9) | 4 (5) | 3 (5) |
| Sighthound | 902 (64.75) | 545 (63.0) | 13 (21) | 90 (54.5) | 10 (14) | 6 (11) |
| Azure | 744 (53.41) | 695 (80.4) | 20 (33) | 80 (48.4) | 0 (0) | 3 (5) |
| N/Aa | 676 (78.2) | 10 (16) | 93 (56.3) | N/A | 6 (11) | |
aN/A: not applicable.