Code world models represent world dynamics through explicit state and executable rules. We investigate how to coordinate object representations, behavioral revisions, and visual memory within this formulation. We present Mallea, a system for building, steering, and memorizing worlds from text. A coding agent infers obj...
Diviner (Domain-Informed Verifiable Incident Navigation through Evidence and Review), an agentic RCA system operating at Meta and organized around a four-stage reliability lifecycle is presented.
Pradipta Ghosh, Gaurav Mitra, S. Nadgowda et al.· 0 citations
Trustworthy biomedical AI requires reliable action selection when evidence is missing, stale, conflicting, or late, not only accurate answers on static inputs. We instantiate an episode-level evaluation protocol as 400 synthetic healthcare workflow episodes: 40 hand-authored semantic seeds across four task classes, two...
Zi-Hao Zheng, Jun-Yi Yao, Bai-Chuan Li et al.· 2 citations
Agentic large language models have been documented to lose reasoning capability when placed inside a harness, the software that mediates their observations and actions. To reconcile these losses, we introduce AutoOnboarder, an autonomous system that adapts an agent to a task the way a trainer onboards a new employee. I...
Tanay Arora, Cong-Lin Liu· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Rubric-based evaluation is widely used to assess large language model (LLM) outputs by decomposing quality into multiple criteria and assigning each a binary judgment from an LLM verifier. However, judgment certainty varies substantially across criteria. Existing methods uniformly aggregate these judgments into a final...
Li-Cheng Pan, Hao Yang, Hao-Xuan Li et al.· 0 citations
When a speaker says ``some students passed'', listeners infer that not all of them did. Reasoning models now let users decide how long a model thinks before it answers, but we do not know what extra thinking does to such everyday inferences. We study this directly: we keep a model's weights fixed, change only how much...
Zhizhuo Kou, Jian Yang, Pengfei Hao et al.· 0 citations
When an assistant serving a team makes a promise to Alice, who may cancel it? We call this standing: only the creditor (the person owed) or someone the creditor or operator policy authorizes may release a commitment, regardless of rank. In a controlled chat environment we vary who cancels and separate two errors: unaut...
Lan Wei, Bingyu Shen, Jia-Qi Tang et al.· 0 citations
On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. However, when conditioned on student-generated prefixes, the teacher can favor invalid continuations that violate the question's premises, causing OPD to encourage erron...
Wen-Xuan Luo, Chen-Xi Li, Hao-Yue Liu et al.· 0 citations
Modern generative models produce high-quality individual outputs but struggle to sample diversely, even when explicitly instructed to do so. We introduce MINE-SAMPLE-RENDER (MSR), a test-time approach that externalizes the diversity into an explicit, corpus-derived sampling procedure. Our pipeline (i) mines an interpre...
Latent chain-of-thought replaces written reasoning steps with continuous hidden states, giving models additional steps to compute before answering. It remains unclear what computation these steps actually perform. High task accuracy and decodable intermediate answers do not establish that a model uses its latent chain...
Jing-Jie Qiu, Sheldon Yu, Xun-Yi Jiang et al.· 0 citations
AgentEval is presented, a system that carries a contract-bound assessment record through tool execution, state and event capture, report qualification, and case maintenance that separates what the agent did, what the evidence establishes, and whether the conclusion is supported for present use.
Agent memory architectures define how LLM agents store and reuse experience across tasks, but they are typically fixed after deployment, limiting their adaptability across task types. Recent self-evolving approaches instead adapt these memory architectures using execution feedback, typically represented as evaluation s...
Miao Su, Yu-Can Guo, Zi-Xuan Li et al.· 1 citation