Wolof is spoken by 23M people, mostly in Senegal, but remains weakly supported by open-weight language models, while API models raise cost, governance, and sovereignty constraints for local deployments. In this paper, we present 0.6B-14B open-weight models adapted to Wolof through instruction tuning, preference alignme...
Gw\'enol\'e Lecorv\'e, Delphine Charlet, Pierre Adam et al.· 0 citations
Image-to-text (I2T) understanding and text-to-image (T2I) generation are dual tasks in unified multimodal models (UMMs). Reconstructive post-training couples these tasks, but existing reconstruction-based methods remain perception-centric and provide limited supervision for reasoning about structure, intent, and transf...
Fei-Ze Wu, Zhi-Yuan Yan, Yuri Hong et al.· 0 citations
Automating organizational work means answering many small typed questions about one piece of state (does this email need a reply, how urgent is it, who owns it) with probabilities good enough to act on without a human. The open typed-decision model we compare against, like a standard cross-encoder, answers each questio...
A single late-layer residual-stream direction is identified: a single late-layer residual-stream direction, the initiative vector, extracted from the model's own conversations without training or annotation, which transfers a speaker's turn-taking style to the model.
Chen Yuxuan, Xiao Yang, Jack Sun et al.· 0 citations
Large language models (LLMs) trained on vast amounts of data have demonstrated impressive performance over a range of tasks, but future performance gains will require increasing amounts of data and compute. Federated Learning (FL) facilitates training on decentralized private data, but client resource limitations can m...
G. Legate, Rahaf Aljundi, Eugene Belilovsky· 0 citations
The method, adVersarial Parameter Decomposition (VPD), optimizes for decompositions of neural network parameters into simple subcomponents that preserve the network's input-output behavior even when many subcomponents are ablated, including under ablations that are adversarially selected to destroy behavior.
Lucius Bushnaq, Dan Braun, Oliver Clive-Griffin et al.· 4 citations· ⚡1
This work explores model performance on multi-step world state prediction, a high-level task that requires models to forecast successive future world states from multimodal observations and diverse references, and highlights the need for multimodal generative models that are capable of dynamic planning and reasoning wh...
Wen-Hao Yan, Hao-Dong Li, Xiao-Tong Li et al.· 1 citation
The present work is concerned with how to measure, at scale, the multi-dimensional impact of generative AI models on the individuals who use them. In service of this goal, we introduce the Open Benchmark of AI Impact on Humans, or ImpactBench. Our iterable and expert-guided platform evaluates whether model behaviors su...
Chayapatr Archiwaranguprok, Krystal Kirkland, Rachel Poonsiriwong et al.· 0 citations
Competitive Token Selection (CoTS), a training-free framework that reframes latent intervention from binary mode selection into continuous allocation at the token level, and demonstrates that CoTS consistently outperforms standard CoT and state-of-the-art training-free latent reasoning methods.
Permutation generation with language models requires both text-conditioned ranking and a global one-to-one assignment between candidates and output positions. We study this problem through three diffusion-LLM parameterizations: hard-assignment prediction over shuffled candidate-index sequences, soft-assignment predicti...
Zhe Xu, Mingfu Liang, Kavosh Asadi et al.· 0 citations
Romance scam has become a serious problem via social media, and the improvement of artificial intelligence enable to fake identify easily. In the study, a chatbot has developed to detect romance scam in real-time through Line Messaging API. Using the seven stage theories in the social science field, the stages of roman...
Yi-cheng Liu, Guan-ru Lai, Yi-cheng Lai et al.· 0 citations