Physiological Representation of Social Evaluation: Modeling Human Eye Movements, Pupillary, and Neuronal Responses to Faces.
Abstract
Face-based social evaluations are ubiquitous and consequential, yet it remains unclear how these evaluations are represented in spontaneous physiological responses. Across four studies (222 participants: 142 females, 57 males, 23 unreported; 503 neurons), we used a data-driven modeling framework to examine how facial appearance shapes eye movements, pupillary responses, and neuronal activity during face viewing. We asked what these responses reveal about the underlying social evaluations. Pupillary responses and hippocampal firing during saccades were driven by facial variation associated with an integrated combination of valence and power evaluations; fixation duration on the eyes and hippocampal firing during fixations were more selectively tuned to threat-related evaluations; amygdalar firing primarily tracked approachability-related valence. A prospective validation study confirmed that novel faces synthesized along these modeled directions elicited the predicted physiological responses in new participants. We also found evidence of individual differences: social anxiety selectively heightened the sensitivity of pupillary responses to face evaluations. These findings suggest that distinct physiological responses across attention, autonomic arousal, and medial temporal lobe activity reflect distinct but related facets of face-based social evaluation.Significance Statement Everyday social decisions hinge on split-second impressions of unfamiliar faces. When we see a face, we instantly judge the person's likely intention (positive ↔ negative valence) and social influence (high ↔ low power). Across four complementary studies, we show that these evaluative processes are reflected in physiological responses to faces across overt attention, autonomic arousal, and subcortical neuronal firing. Different physiological systems reflected partially distinct but related facets of social-evaluative meaning, including integrated valence-and-power, threat-related, and approachability-related evaluation.