InvPT applies semantic-preserving transformations to the corpus and combines masked language modeling with multi-positive supervised contrastive learning that treats all augmentations of the same source function as positives, mixing self-contrast pairs with invariant-contrast pairs for positives of varying difficulty.
Yifeng He, Yun-Di Xu, Christopher Castro Gaw Gonzalo et al.· Proceedings of the 2nd ACM S...· 0 citations
ForkLeft, a distillation framework that resolves a fundamental mismatch between autoregressive teacher predicts from a left prefix and NTP teacher under the same context, is introduced, showing that DLMs can learn NTP-style reasoning without sacrificing native parallel generation.
Jun-Ming Liu, Ji-Cheng Wang, Yifeng He et al.· 1 citation
The first controlled study of the pattern is run, comparing raw-document navigation and several designs of Agent Skills packs against a classical hybrid retriever across three agent harnesses and three model families on InfiniteBench.
Yifeng He, Yin Zhao, Jicheng Wang et al.· arXiv.org· 2 citations
LISA iteratively generates API sequences and program invariants guided by API n-gram feedback, achieving higher bug-detection rates and competitive code coverage compared with both fuzzing and prior LLM-based test generation approaches, and reporting each finding as a high-confidence bug candidate for developer confirm...
