Kim, H;
Küster, D;
Girard, JM;
Krumhuber, EG;
(2023)
Human and machine recognition of dynamic and static facial expressions: prototypicality, ambiguity, and complexity.
Frontiers in Psychology
, 14
, Article 1221081. 10.3389/fpsyg.2023.1221081.
Preview |
Text
fpsyg-14-1221081.pdf - Published Version Download (1MB) | Preview |
Abstract
A growing body of research suggests that movement aids facial expression recognition. However, less is known about the conditions under which the dynamic advantage occurs. The aim of this research was to test emotion recognition in static and dynamic facial expressions, thereby exploring the role of three featural parameters (prototypicality, ambiguity, and complexity) in human and machine analysis. In two studies, facial expression videos and corresponding images depicting the peak of the target and non-target emotion were presented to human observers and the machine classifier (FACET). Results revealed higher recognition rates for dynamic stimuli compared to non-target images. Such benefit disappeared in the context of target-emotion images which were similarly well (or even better) recognised than videos, and more prototypical, less ambiguous, and more complex in appearance than non-target images. While prototypicality and ambiguity exerted more predictive power in machine performance, complexity was more indicative of human emotion recognition. Interestingly, recognition performance by the machine was found to be superior to humans for both target and non-target images. Together, the findings point towards a compensatory role of dynamic information, particularly when static-based stimuli lack relevant features of the target emotion. Implications for research using automatic facial expression analysis (AFEA) are discussed.
| Type: | Article |
|---|---|
| Title: | Human and machine recognition of dynamic and static facial expressions: prototypicality, ambiguity, and complexity |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.3389/fpsyg.2023.1221081 |
| Publisher version: | https://doi.org/10.3389/fpsyg.2023.1221081 |
| Language: | English |
| Additional information: | Copyright © 2023 Kim, Küster, Girard and Krumhuber. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
| Keywords: | emotion facial expression, dynamic, movement, prototypicality, ambiguity |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10179736 |
Archive Staff Only
 |
View Item |
