Author

Wan-Yang Hong

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Oct 2026

Compression Does Not End at Selection: Post-Selection Positional Geometry for Sparse KV Caches

Sparse KV compression reduces long-context inference costs by retaining selected historical states, yet these states typically keep their coordinates from the full history. Under Rotary Position Embedding (RoPE), gaps left by evicted tokens continue to affect query-key matching, potentially limiting the use of retained...

Wan-Yang Hong, Zhao-Ning Zhang · 0 citations

#natural language process... Preprint Oct 2026

Role-aware Heuristic Episodic Attention for Conversational LLMs

Large language models often lose track of persistent instructions and relevant information as multi-turn conversations grow. We study this cumulative contextual decay through three related failure modes: attention pollution, dilution, and drift. We propose REA (Role-aware Heuristic Episodic Attention), a context-manage...

Wan-Yang Hong, Zhao-Ning Zhang, Yi Chen et al. · 0 citations