September 2018
Volume 18, Issue 10
Open Access
Vision Sciences Society Annual Meeting Abstract  |   September 2018
Emotion Algebra reveals the richness of meanings of facial expressions
Author Affiliations
  • Carmel Sofer
    Ben Gurion University of Negev, Beer Sheva, Israel
  • Dan Vilenchik
    Ben Gurion University of Negev, Beer Sheva, Israel
  • Ron Dotsch
    Utrecht University, Netherlands
  • Galia Avidan
    Ben Gurion University of Negev, Beer Sheva, Israel
Journal of Vision September 2018, Vol.18, 193. doi:
  • Views
  • Share
  • Tools
    • Alerts
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Carmel Sofer, Dan Vilenchik, Ron Dotsch, Galia Avidan; Emotion Algebra reveals the richness of meanings of facial expressions. Journal of Vision 2018;18(10):193.

      Download citation file:

      © ARVO (1962-2015); The Authors (2016-present)

  • Supplements

Studies of emotional facial expressions generally reveal consensus among human participants about the social meanings of only six to fifteen basic expressions. Here we argue that perceivers use sequences of these expressions as the basis for generating a much larger, richer vocabulary of emotion states. Participants reviewed combinations of eight most consensual, static basic facial expressions, presented as a sequence of two images out of 8x8=64 possible sequences. They were required to describe in one word the "state of mind" of the person whose sequence of images was presented. To explore the perceivers' vocabulary of emotion states, we relied on computational methods, utilizing word embedding methods (Global Vectors for Word Representation) adapted from the field of Natural Language Processing. Our findings reveal that the perceived meanings of the sequences of facial expressions were a weighted average of the single expressions comprising them, resulting in 22 new emotion states, in addition to the eight basic expressions used in the experiment. An interaction between the first and the second expression in each sequence, indicated that each facial expression influenced the perception of the other expression, as well as the interpretation of the sequence as a whole. We also found that the product (i.e., interaction) of the vectors representing two sequential facial expressions predicted the consensus among participants about whether the sequence is commonly seen or not in daily life. This result supports the notion that algebraic vector operations can predict human perception, shaped by past natural experience. Together, our findings suggest that the vocabulary of emotion states conveyed by facial expressions is rich and not limited, as it is the outcome of different combinations of these expressions that together creates a continuous space in which every emotion state is a weighted combination of the 8 basic emotions.

Meeting abstract presented at VSS 2018


This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.