Skip to main content
NCBI home page
Proceedings of the Royal Society B: Biological Sciences logoLink to Proceedings of the Royal Society B: Biological Sciences
. 2004 Apr 7;271(1540):663–668. doi: 10.1098/rspb.2003.2660

Detecting hemifacial asymmetries in emotional expression with three-dimensional computerized image analysis.

Michael E R Nicholls 1, Brooke E Ellis 1, John G Clement 1, Mineo Yoshino 1
PMCID: PMC1691649  PMID: 15209097

Abstract

Emotions are expressed more clearly on the left side of the face than the right: an asymmetry that probably stems from right hemisphere dominance for emotional expression (right hemisphere model). More controversially, it has been suggested that the left hemiface bias is stronger for negative emotions and weaker or reversed for positive emotions (valence model). We examined the veracity of the right hemisphere and valence models by measuring asymmetries in: (i) movement of the face; and (ii) observer's rating of emotionality. The study uses a precise three-dimensional (3D) imaging technique to measure facial movement and to provide images that simultaneously capture the left or right hemifaces. Models (n = 16) with happy, sad and neutral expressions were digitally captured and manipulated. Comparison of the neutral and happy or sad images revealed greater movement of the left hemiface, regardless of the valence of the emotion, supporting the right hemisphere model. There was a trend, however, for left-sided movement to be more pronounced for negative than positive emotions. Participants (n = 357) reported that portraits rotated so that the left hemiface was featured, were more expressive of negative emotions whereas right hemiface portraits were more expressive for positive emotions, supporting the valence model. The effect of valence was moderated when the images were mirror-reversed. The data demonstrate that relatively small rotations of the head have a dramatic effect on the expression of positive and negative emotions. The fact that the effect of valence was not captured by the movement analysis demonstrates that subtle movements can have a strong effect on the expression of emotion.

Full Text

The Full Text of this article is available as a PDF (340.1 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Asthana H. S., Mandal M. K. Hemiregional variations in facial expression of emotions. Br J Psychol. 1997 Aug;88(Pt 3):519–525. doi: 10.1111/j.2044-8295.1997.tb02654.x. [DOI] [PubMed] [Google Scholar]
  2. Bartlett M. S., Hager J. C., Ekman P., Sejnowski T. J. Measuring facial expressions by computer image analysis. Psychophysiology. 1999 Mar;36(2):253–263. doi: 10.1017/s0048577299971664. [DOI] [PubMed] [Google Scholar]
  3. Borod J. C., Caron H. S. Facedness and emotion related to lateral dominance, sex and expression type. Neuropsychologia. 1980;18(2):237–241. doi: 10.1016/0028-3932(80)90070-6. [DOI] [PubMed] [Google Scholar]
  4. Borod J. C., Haywood C. S., Koff E. Neuropsychological aspects of facial asymmetry during emotional expression: a review of the normal adult literature. Neuropsychol Rev. 1997 Mar;7(1):41–60. doi: 10.1007/BF02876972. [DOI] [PubMed] [Google Scholar]
  5. Borod J. C., Kent J., Koff E., Martin C., Alpert M. Facial asymmetry while posing positive and negative emotions: support for the right hemisphere hypothesis. Neuropsychologia. 1988;26(5):759–764. doi: 10.1016/0028-3932(88)90013-9. [DOI] [PubMed] [Google Scholar]
  6. Borod J. C., Koff E., White B. Facial asymmetry in posed and spontaneous expressions of emotion. Brain Cogn. 1983 Apr;2(2):165–175. doi: 10.1016/0278-2626(83)90006-4. [DOI] [PubMed] [Google Scholar]
  7. Borod J. C., Koff E., Yecker S., Santschi C., Schmidt J. M. Facial asymmetry during emotional expression: gender, valence, and measurement technique. Neuropsychologia. 1998 Nov;36(11):1209–1215. doi: 10.1016/s0028-3932(97)00166-8. [DOI] [PubMed] [Google Scholar]
  8. Dimberg U., Petterson M. Facial reactions to happy and angry facial expressions: evidence for right hemisphere dominance. Psychophysiology. 2000 Sep;37(5):693–696. [PubMed] [Google Scholar]
  9. Gilbert C., Bakan P. Visual asymmetry in perception of faces. Neuropsychologia. 1973 Jul;11(3):355–362. doi: 10.1016/0028-3932(73)90049-3. [DOI] [PubMed] [Google Scholar]
  10. Heilman K. M., Bowers D., Speedie L., Coslett H. B. Comprehension of affective and nonaffective prosody. Neurology. 1984 Jul;34(7):917–921. doi: 10.1212/wnl.34.7.917. [DOI] [PubMed] [Google Scholar]
  11. Heilman K. M. The neurobiology of emotional experience. J Neuropsychiatry Clin Neurosci. 1997 Summer;9(3):439–448. doi: 10.1176/jnp.9.3.439. [DOI] [PubMed] [Google Scholar]
  12. Heller W., Levy J. Perception and expression of emotion in right-handers and left-handers. Neuropsychologia. 1981;19(2):263–272. doi: 10.1016/0028-3932(81)90110-x. [DOI] [PubMed] [Google Scholar]
  13. Hook-Costigan M. A., Rogers L. J. Lateralized use of the mouth in production of vocalizations by marmosets. Neuropsychologia. 1998 Dec;36(12):1265–1273. doi: 10.1016/s0028-3932(98)00037-2. [DOI] [PubMed] [Google Scholar]
  14. Koff E., Borod J. C., White B. Asymmetries for hemiface size and mobility. Neuropsychologia. 1981;19(6):825–830. doi: 10.1016/0028-3932(81)90096-8. [DOI] [PubMed] [Google Scholar]
  15. Levy J., Heller W., Banich M. T., Burton L. A. Asymmetry of perception in free viewing of chimeric faces. Brain Cogn. 1983 Oct;2(4):404–419. doi: 10.1016/0278-2626(83)90021-0. [DOI] [PubMed] [Google Scholar]
  16. Magnussen S., Sunde B., Dyrnes S. Patterns of perceptual asymmetry in processing facial expression. Cortex. 1994 Jun;30(2):215–229. doi: 10.1016/s0010-9452(13)80194-3. [DOI] [PubMed] [Google Scholar]
  17. Moreno C. R., Borod J. C., Welkowitz J., Alpert M. Lateralization for the expression and perception of facial emotion as a function of age. Neuropsychologia. 1990;28(2):199–209. doi: 10.1016/0028-3932(90)90101-s. [DOI] [PubMed] [Google Scholar]
  18. Natale M., Gur R. E., Gur R. C. Hemispheric asymmetries in processing emotional expressions. Neuropsychologia. 1983;21(5):555–565. doi: 10.1016/0028-3932(83)90011-8. [DOI] [PubMed] [Google Scholar]
  19. Nicholls M. E., Clode D., Wood S. J., Wood A. G. Laterality of expression in portraiture: putting your best cheek forward. Proc Biol Sci. 1999 Aug 7;266(1428):1517–1522. doi: 10.1098/rspb.1999.0809. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Nicholls Michael E. R., Wolfgang Bradley J., Clode Danielle, Lindell Annukka K. The effect of left and right poses on the expression of facial emotion. Neuropsychologia. 2002;40(10):1662–1665. doi: 10.1016/s0028-3932(02)00024-6. [DOI] [PubMed] [Google Scholar]
  21. Oldfield R. C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971 Mar;9(1):97–113. doi: 10.1016/0028-3932(71)90067-4. [DOI] [PubMed] [Google Scholar]
  22. Pihan H., Altenmüller E., Ackermann H. The cortical processing of perceived emotion: a DC-potential study on affective speech prosody. Neuroreport. 1997 Feb 10;8(3):623–627. doi: 10.1097/00001756-199702100-00009. [DOI] [PubMed] [Google Scholar]
  23. Richardson C. K., Bowers D., Bauer R. M., Heilman K. M., Leonard C. M. Digitizing the moving face during dynamic displays of emotion. Neuropsychologia. 2000;38(7):1028–1039. doi: 10.1016/s0028-3932(99)00151-7. [DOI] [PubMed] [Google Scholar]
  24. Sackeim H. A., Gur R. C. Lateral asymmetry in intensity of emotional expression. Neuropsychologia. 1978;16(4):473–481. doi: 10.1016/0028-3932(78)90070-2. [DOI] [PubMed] [Google Scholar]
  25. Sackeim H. A., Gur R. C., Saucy M. C. Emotions are expressed more intensely on the left side of the face. Science. 1978 Oct 27;202(4366):434–436. doi: 10.1126/science.705335. [DOI] [PubMed] [Google Scholar]
  26. Schwartz G. E., Ahern G. L., Brown S. L. Laterlized facial muscle response to positive and negative emotional stimuli. Psychophysiology. 1979 Nov;16(6):561–571. doi: 10.1111/j.1469-8986.1979.tb01521.x. [DOI] [PubMed] [Google Scholar]
  27. Silberman E. K., Weingartner H. Hemispheric lateralization of functions related to emotion. Brain Cogn. 1986 Jul;5(3):322–353. doi: 10.1016/0278-2626(86)90035-7. [DOI] [PubMed] [Google Scholar]
  28. Strömland K., Chen Y., Michael G., Svensson E., Gustavsson T. Assessment of facial features with a range camera. Scand J Plast Reconstr Surg Hand Surg. 1998 Mar;32(1):91–96. doi: 10.1080/02844319850158976. [DOI] [PubMed] [Google Scholar]
  29. Wylie D. R., Goodale M. A. Left-sided oral asymmetries in spontaneous but not posed smiles. Neuropsychologia. 1988;26(6):823–832. doi: 10.1016/0028-3932(88)90052-8. [DOI] [PubMed] [Google Scholar]
  30. Yecker S., Borod J. C., Brozgold A., Martin C., Alpert M., Welkowitz J. Lateralization of facial emotional expression in schizophrenic and depressed patients. J Neuropsychiatry Clin Neurosci. 1999 Summer;11(3):370–379. doi: 10.1176/jnp.11.3.370. [DOI] [PubMed] [Google Scholar]
  31. Yoshino M., Matsuda H., Kubota S., Imaizumi K., Miyasaka S. Computer-assisted facial image identification system using a 3-D physiognomic range finder. Forensic Sci Int. 2000 Apr 10;109(3):225–237. doi: 10.1016/s0379-0738(00)00149-3. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the Royal Society B: Biological Sciences are provided here courtesy of The Royal Society

RESOURCES