Oculi is introduced, a conversational platform that transforms natural language questions into comprehensive credit risk analyses, complete with data queries, statistical testing, and interactive visualizations, and demonstrates effectiveness in discovering material risk segments previously intractable through manual exploration.
Abstract
Credit risk analysis in financial institutions traditionally requires analysts to manually write SQL queries, run statistical computations, and build visualization dashboards. This is a time-consuming workflow that limits exploration to familiar segments. We introduce \textbf{Oculi}, a conversational platform that transforms natural language questions into comprehensive credit risk analyses, complete with data queries, statistical testing, and interactive visualizations. Oculi employs a three-layer architecture that separates reasoning (LLM-powered agent), execution (Model Context Protocol tool servers), and presentation (agentic UI), enabling analysts to discover high-risk portfolio segments. Within Oculi, a new segment discovery pipeline is proposed that combines deterministic statistical methods with LLM-guided feature selection, leveraging LLM semantic domain knowledge alongside data-driven metrics to identify meaningful, actionable portfolio segments. Evaluated on a mortgage portfolio with 200+ features, Oculi demonstrates effectiveness in discovering material risk segments previously intractable through manual exploration, reducing time-to-insight significantly while maintaining auditability and statistical rigor.
A multi-agent framework has been adopted to orchestrate multiple specialized agents to collaborate on the same task and is found to be a substantial improvement over a single-agent approach.
Nontawit Cheewaruangroj, Kawinwish Laobundit, Peranut Nimitsurachat et al.· 0 citations
EnterpriseBench is introduced, a benchmark that evaluates LLM agents across this spectrum, from static question answering to dynamic decision-making, and shows that it provides a practical benchmark for evaluating LLM agents in realistic enterprise strategic reasoning and decision-making.
Min Yang, Yi-Chen Pan, Jing-Hua Piao et al.· 0 citations
This work presents TRACE (TRajectory Attribution for Automated Context Engineering), an automated feedback loop that mines historical agent trajectories to diagnose and remediate context failures, showing that over 80% of context-layer failures can be automatically diagnosed and remediated by mining historical trajecto...
AnalysisBank is proposed, which distills expert reports into a reusable library of Analyses, each pairing a data signal, an analytical move, and the expert span it was derived from, to operate at the analytical rather than structural level of financial report generation.
Ya-Jing Yang, Yun-Shan Ma, Kelvin J. L. Koa et al.· 0 citations
SENTRY is a risk assessment platform that replaces questionnaire-based scoring with a deterministic machine learning pipeline built from gradient-boosted decision trees (XGBoost) and hybrid retrieval-augmented generation (RAG).
Daniel Arulpragasam, Christer Henrysson, E. Ly et al.· 0 citations
FinFIRST is the first financial benchmark to jointly evaluate answers and supporting evidence through atomic rubrics, retaining final-answer correctness as the primary objective while making the supporting research process measurable, verifiable, and diagnosable.
Wen-Qing Wang, Hai-Tao Xiang, Xin-Yi Zhao et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduSep 29, 2026
Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.