Skip to content
Open access

DisenTE: Sparse Pattern–Context Modeling for Interpretable Translation-Efficiency Matrix Completion

Sep 2026 · bioRxiv · 0 citations · 25 references
Biology

TL;DR

DisenTE, a sequence-conditioned neural model that combines separate sequence and context branches with a sparse low-rank pattern–context channel, is presented, a sequence-conditioned neural model that combines separate sequence and context branches with a sparse low-rank pattern–context channel.

Abstract

Partially observed object-by-context matrices arise across data-rich science, where dominant object effects can obscure smaller but informative context-dependent variation. We study this problem in a translation-efficiency atlas of 9,494 5′ UTRs across 78 cellular and tissue contexts. We present DisenTE, a sequence-conditioned neural model that combines separate sequence and context branches with a sparse low-rank pattern–context channel. Each module pairs a sequence-derived activation with context-specific deployment weights, forming a dictionary whose sequence and context components can be examined separately. Under five-fold within-panel entry masking, DisenTE achieves a UTR-centered residual Spear-man correlation of 0.641±0.005, compared with 0.304±0.003 for the strongest reference model. The learned dictionary retains 11 of 20 candidate modules. CTM 6 has the largest overlap with an external TOP set and a cap-proximal pyrimidine pattern; CTMs 5 and 7 also overlap the set but have purine-containing consensuses. The evidence supports CTM 6 as a TOP sequence anchor and CTMs 5 and 7 as TOP-set-associated factors. On this dataset, DisenTE improves completion over the evaluated references and provides module-level summaries of its fitted context-dependent variation.

Read PDF

Similar papers

Book Open access Nov 2026

LSRTopic: Contextual Sparse Topic Modeling via Corpus-Vocabulary Alignment

Topic modeling still struggles to combine contextual expressiveness with lexical interpretability. Sparse models are transparent but semantically limited, whereas dense contextual models capture meaning at the cost of direct interpretability. We argue that Learned Sparse Representations (LSR) offer a promising alternat...

A. Machado, C. França, Antônio Pereira et al. · 0 citations
Open access 2026

NRD: A Hybrid Disentanglement Framework for Mitigating Interference in Multilingual Machine Translation

NDR (Neuron Representation Disentanglement) is proposed, a two-stage hybrid framework that couples training-time specialization with inference-time filtering that effectively purifies semantic representations by mitigating syntactic interference, paving the way for more robust cross-lingual generalization.

Jia-Rui Zhang, Yi-Fan Deng · 0 citations
#artificial intelligence Preprint Sep 2026

Rules Amortize, Pairings Don't: Linguistic Structure Determines What Latent Task Representations Can Replace In-Context Learning

In-context learning (ICL) can be amortized into latent objects (task vectors, function vectors, context vectors) that recover few-shot behavior at zero-shot inference cost, but recent theory shows a static vector acts as a single synthetic demonstration and must fail on high-rank mappings such as word-level bijections....

Gunmay Jhingran · 0 citations
#artificial intelligence Preprint Oct 2026

How Language Models Organize Task Information

Dense linear probes assess task readability from language model (LM) representations, but do not directly reveal how many features suffice for prediction. We measure readout sparsity with \(k^*\), the smallest feature count found by a fixed search protocol that recovers 95% of dense-probe AUROC above chance. We evaluat...

Kai-Yang Wan, Yu-Xia Wang · 0 citations
#natural language process... Preprint Sep 2026

MWE-ECL: Recoverable Long-Range Context Does Not Always Override Local Lexical Priors

This work introduces Multiword Expression Effective Context Length (MWE-ECL), a bilingual diagnostic whose matched anchor-retrieval, no-anchor prior, and interpretation prompts measure explicit recoverability, model-observed defaults, and anchor-conditioned decisions, respectively.

Wei He, Aline Villavicencio, R. Wilkens et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.