Skip to content

What You Can’t See Is What You Learn: Restricted Evidence Visibility Favors Compositional Generalization in Shared-Genome Language-Model Societies

· 2 citations · 35 references

TL;DR

Under this protocol, restricted visibility is not necessary for composition; under this protocol it substantially increases the probability of learning a generalizing relay and favors a reusable, value-indexed interface.

View source

Similar papers

Preprint Aug 2026

What You Can't See Is What You Learn: Slot-Selective Evidence Masking Favors Compositional Generalization in Shared-Genome Language-Model Societies

Multi-module neural systems often expose every module to the full input. We test whether a slot-selective evidence-masking regime -- restricting each module to its own evidence span -- changes which solutions gradient-based training discovers. Four-cell societies share one frozen pretrained language model and one low-r...

Narcis Marincat · 1 citation
#artificial intelligence Preprint Sep 2026

What You Can't See Is Still What You Learn: A Preregistered Sixty-Society Confirmation That Evidence Masking Drives Compositional Generalization

A preregistered confirmation with sixty four-cell systems sharing a frozen language-model backbone and communicating through learned continuous packets confirms a large advantage of the tested masking regime, while leaving its finer attribution and generality open.

Narcis Marincat · 0 citations
Preprint Aug 2026

TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint

This paper shows that Vision-Language Models (VLMs) can internally distinguish when abstention is required, but fail to express it anyway, and introduces Penalized Epistemic Calibration Score (PECS), a new robust metric that requires models to both answer correctly when the outcome is knowable, and abstain when the out...

Fnu Pramono, J. Cai, Sourabh Kulkarni · 5 citations · ⚡1
#artificial intelligence Preprint Sep 2026

Portable Semantics, Private Dialects: Reuse and Negative Transfer in Latent Communication Between Language-Model Cells

In shared-genome language-model societies, restricted evidence visibility favors reusable, value-indexed latent packet interfaces, whereas the sole high-performing globally visible model in the parent study learned an episode-entangled code. This companion study asks whether independently trained societies share one pa...

Narcis Marincat · 1 citation
#machine learning Preprint Sep 2026

Visual Jev: Accurate and Efficient Decisions from Shared Visual Context

Many vision applications ask several independent, forced-choice questions about the same image. Visual Jev encodes the image and public context once, executes isolated question suffixes as a batch, and reads candidate probabilities from the backbone's language-model head. Across four benchmarks, answer-supervised post-...

Guan-Xu Yu, Yu-Hang Yao · 10 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.