Skip to content
Open access

Action features dominate cortical representation during natural vision.

Oct 2026 · Proceedings of the National Academy of Sciences of the United States of America · Vol 123 43, pp. e2625018123 · 0 citations · 113 references
Medicine

Abstract

Cortical resources are allocated into systems specialized for processing ecologically relevant features of the world. These features are typically studied in isolation using controlled experimental stimuli, making it difficult to assess the relative importance of different kinds of features that tend to overlap during natural vision. In the current study, we evaluated the relative contributions of action, agent, and scene features in predicting cortical activity while participants viewed a 1-h nature documentary. We tested four sets of model features: semantic vectors capturing the observed action, agent, and scene features derived from an annotation of the stimulus, as well as low-level visual motion-energy features. We used banded ridge regression to fit vertex-wise encoding models from the combination of all four sets of features. While each set of features predicted neural activity in the expected areas, the action features predicted more widespread activity. A variance partitioning analysis revealed that the action features captured the most unique variance in neural activity across a much larger extent of cortex than the agent or scene features. Our findings suggest that cortical activity during dynamic, natural vision is dominated by features for understanding the actions of others.

Read PDF

Similar papers

Open access Nov 2026

The representation of object-concept primitives across the macaque brain.

The results provide a blueprint for how the brain encodes object concepts and suggest how concept representations engage perceptual representations through feedback during vision.

Spencer R. Loggia, Helen E. Feibes, S. Duffield et al. · 0 citations
Open access Sep 2026

Behaviorally-relevant features of observed actions dominate cortical representational geometry in natural vision

We effortlessly extract behaviorally relevant information from dynamic visual input to understand the actions of others. Here, we compare behavioral judgments of action meaning against other models capturing semantic and visual features. We measured brain activity using fMRI while participants viewed 90 video clips dep...

Jane Han, Vassiki S. Chauhan, Rebecca Philip et al. · 1 citation
Open access Oct 2026

Latent encoding of movement in primary visual cortex

A latent encoding of information where subtle, spatially distributed modulations of V1 activity may convey fine information about stimulus motion is suggested, pointing to a novel primary sensory encoding mechanism despite complex co-variation of responses to multiple attributes across V1 neurons.

Hannah Germaine, I. Choi, Stephen D. Van Hooser et al. · 0 citations
Open access Oct 2026

High-level visual and motor regions are doubly dissociated in controlled tasks but only at specific times during natural behaviors

Our knowledge of the neural basis of sensory and motor information processing comes largely from recording brain activity in controlled settings. This approach, while insightful, blinds us from understanding natural behaviors, which involve far richer visual inputs and far larger range of movements. The prevailing beli...

Shubhankar Saha, Sini Simon, Surbhi Munda et al. · 0 citations

Receptive-field-constrained stimulus optimization for human early and intermediate visual cortex

An ongoing challenge in sensory neuroscience is to characterize the feature dimensions encoded by cortical populations. Recent approaches probe feature selectivity in a data-driven way, by synthesizing a most-exciting-input (MEI) for a target neural population. While this approach has been successfully applied to human...

Jun-Ru Zhao, Han-Fei Guo, Andrew F. Luo et al. · 0 citations
Preprint Oct 2026

Recurrent network dynamics explain the time course of perceptual grouping in natural scenes

A mechanistic framework in which recurrent interactions propagate enhanced neuronal activity within and between cortical areas is proposed, which links computational principles, neural circuitry and perceptual psychology and generates testable predictions for neuro-physiological and psychophysical experiments.

Sami Mollard, A. Ashok, L. Goetschalckx et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.