Table 1.
Non-exhaustive annotated list of face emotion expression stimuli databases.
| No. | Reference | Database name | Ethnicities (N) | Age range (N) | Sex (N) | No. of unique face identities | Total no. of photographs | Emotion expressionsa | Expression methodb | Validation methodc | Color |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Friesen and Ekman (1976) | Pictures of Facial Affect (PoFA) | Caucasian | Not specified | Male (6), Female (8) | 14 | 110 | H, Sa, D, F, Su, A, N | FACS | Uni-emotional ratings by Caucasian individuals | Grayscale |
| 2 | Mandal (1987) | - | Oriental North Indian (29) | Not specified | Male (15), Female (14) | 29 | 195 | H, Sa, D, F, Su, A | Free posing | Uni-emotional ratings by local sample | Not specified |
| 3 | Matsumoto and Ekman (1988) | Japanese and Caucasian Facial Expressions of Emotion (JACFEE) | Japanese (28), Caucasian (28) | Not specified | Male (28), Female (28) | 56 | 56 | H, Sa, D, F, Su, A, N | FACS | Uni-emotional ratings across several countries | Color |
| 4 | Mazurski and Bond (1993) | - | Not specified | 8–12 years (6), 18–40 years (10) | Male (8), Female (8) | 16 | 175 | H, Sa, D, F, Su, A, N | Free posing | Uni-emotional ratings by local student sample | Color |
| 5 | Lundqvist et al. (1998) | Karolinska Directed Emotional Faces (KDEF) | Caucasian | 20–30 years (70) | Male (35), Female (35) | 70 | 4,900 | H, Sa, D, F, Su, A, N | Free posing | - | Color |
| 6 | Lyons et al. (1998) | - | Japanese (10) | Not specified | Female (10) | 10 | 219 | H, Sa, D, F, Su, A, N | Free posing | Multi-emotional ratings by local female student sample | Grayscale |
| 7 | Wang and Markham (1999) | - | Chinese (17) | 20–28 years (17) | Male (10), Female (7) | 17 | 75 | H, Sa, D, F, Su, A | Free posing | Uni-emotional ratings by local student sample | Grayscale |
| 8 | Beaupré et al. (2000) | Montreal Set of Facial Displays of Emotion (MSFDE) | French Canadian (8), Chinese (8), sub-Saharan African (8) | Not specified | Male (12), Female (12) | 24 | 144 | H, Sa, D, F, A, N | FACS | Multi-emotional ratings by local sample | Grayscale |
| 9 | Gur et al. (2002) | - | Caucasian (91), African American (23), Asian (6), Hispanic (10) | 10–85 years (139) | Male (70), Female (69) | 139 | 5,560 | H, Sa, D, F, A, N | English method; Evoked | Uni-emotional ratings by local sample | Color |
| 10 | Minear and Park (2004) | - | Caucasian (435), African American (89), Others (52) | 18–29 years (219), 30–49 years (76), 50–69 years (123), 70–93 years (158) | Male (219), Female (357) | 576 | 1,142 | Smile, N, profile | Free posing | Not specified | Color |
| 11 | Chen and Yen (2007) | Taiwanese Facial Expression Image Database (TFEID) | Chinese (20) | Not specified | Male (20), Female (20) | 20 | 7,200 | H, Sa, D, F, Su, A, N | Not specified | Not specified | Color |
| 12 | Gao et al. (2008) | CAS-PEAL | Chinese (1,040) | 18–74 years (1,040) | Male (595), Female (445) | 1,040 | 99,594 | N, Smile, Frown, Su, Close eyes, Open mouth | Free posing | Database for face recognition without known emotion-related validation | Color |
| 13 | Tottenham et al. (2009) | NimStim | Caucasian (25), Latin American (2), African American (10), Asian (6) | 21–30 years (43) | Male (25), Female (18) | 43 | 646 | H, Sa, D, F, Su, A, Calm, N | Controlled posing | Uni-emotional ratings by local sample | Color |
| 14 | Tracy et al. (2009) | University of California, Davis, Set of Emotion Expressions (UCDSEE) | Caucasian (2), West African (2) | Not specified | Male (2), Female (2) | 4 | 46 | H, Sa, D, F, Su, A, N, Shame, Embarrassment, Pride | FACS; additional guidelines for self-conscious emotions; upper half body postures | Uni-emotional ratings by local student sample | Color |
| 15 | Ebner et al. (2010) | FACES | Caucasian (179) | 19–31 years (58), 39–55 years (56), 69–80 (57) | Male (86), Female (85) | 171 | 2,052 | H, Sa, D, F, A, N | FACS | Uni-emotional ratings by local sample Multi-emotional ratings by local sample in Riediger et al. (2011) | Color |
| 16 | Langner et al. (2010) | Radbound Faces Database (RFD) | Caucasian (49) | Adult (39), Children (10) | Male (24), Female (25) | 49 | 5,880 | H, Sa, D, F, Su, A, N, Contempt | FACS | Uni-emotional ratings by local sample | Color |
| 17 | Zhang et al. (2010) | PolyU Near Infrared Face Database (PolyU-NIRFD) | Chinese (350) | Not specified | Not specified | 350 | 35,000 | Not specified | Free posing | Database for face recognition without known emotion-related validation | Grayscale |
| 18 | Flanagan (2011) | Face Recognition Technology (FERET) | Not specified | Not specified | Not specified | 1,199 | 14,126 | Not specified | Not specified | Database for face recognition without known emotion-related validation | Color |
| 19 | van der Schalk et al. (2011) | Amsterdam Dynamic Facial Expression Set (ADFES) | Caucasian (12), Mediterranean (10) | 18–25 years | Male (12), Female (10) | 22 | 648 (videos) | H, Sa, D, F, Su, A, N, Contempt, Embarrassment, Pride | FACS | Uni-emotional ratings by local sample | Grayscale |
| 20 | Kaulard et al. (2012) | Max Planck Institute (MPI) Facial Expression Database | Caucasian (19) | 20–30 years | Male (9), Female (10) | 19 | 19,152 | 56 different expressions including H, Sa, D, F, A, N | Controlled posing | Uni-emotional ratings by local sample | Color |
| 21 | Chen et al. (2013) | - | Chinese (29) | 18–53 years (28), 67 years (1) | Male (15), Female (14) | 29 | 2,273 | H, Sa, D, F, Su, A, N | FACS | Multi-emotional ratings by local sample | Color |
| 22 | Olszanowski et al. (2015) | Warsaw Set of Emotional Facial Expression Pictures (WSEFEP) | Caucasian (30) | 20–30 years | Male (14), Female (16) | 30 | 210 | H, Sa, D, F, Su, A, N | Controlled posing using Stanislavski acting method; selected using FACS | Multi-emotional ratings by local sample | Color |
a
H, Happy; Sa, Sad; D, Disgust; F, Fearful; Su, Surprise; A, Anger; N, Neutral.
b
FACS, Facial Action Coding System.
c
Uni-emotional rating approaches require raters to select the single best emotion to categorize face stimuli; multi-emotional rating approaches require raters to indicate the extent to which a given face stimulus portrays various different emotion categories.