Lavan, N;
Smith, H;
Jiang, L;
McGettigan, C;
(2021)
Explaining face-voice matching decisions: The contribution of mouth movements, stimulus effects and response biases.
Attention, Perception, & Psychophysics
10.3758/s13414-021-02290-5.
(In press).
Preview |
Text
Lavan2021_Article_ExplainingFace-voiceMatchingDe.pdf - Published Version Download (867kB) | Preview |
Abstract
Previous studies have shown that face-voice matching accuracy is more consistently above chance for dynamic (i.e. speaking) faces than for static faces. This suggests that dynamic information can play an important role in informing matching decisions. We initially asked whether this advantage for dynamic stimuli is due to shared information across modalities that is encoded in articulatory mouth movements. Participants completed a sequential face-voice matching task with (1) static images of faces, (2) dynamic videos of faces, (3) dynamic videos where only the mouth was visible, and (4) dynamic videos where the mouth was occluded, in a well-controlled stimulus set. Surprisingly, after accounting for random variation in the data due to design choices, accuracy for all four conditions was at chance. Crucially, however, exploratory analyses revealed that participants were not responding randomly, with different patterns of response biases being apparent for different conditions. Our findings suggest that face-voice identity matching may not be possible with above-chance accuracy but that analyses of response biases can shed light upon how people attempt face-voice matching. We discuss these findings with reference to the differential functional roles for faces and voices recently proposed for multimodal person perception.
| Type: | Article |
|---|---|
| Title: | Explaining face-voice matching decisions: The contribution of mouth movements, stimulus effects and response biases |
| Location: | United States |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.3758/s13414-021-02290-5 |
| Publisher version: | https://doi.org/10.3758/s13414-021-02290-5 |
| Language: | English |
| Additional information: | This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
| Keywords: | Cross-modal, Face-voice matching, Identity perception, Mouth movements |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Speech, Hearing and Phonetic Sciences |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10126108 |
Archive Staff Only
 |
View Item |
