Skip to content

Category

machine learning

3,595 papers

#machine learning Preprint Open access Sep 2026

Large language model-enabled automated data extraction for concrete materials informatics

The promise of data-driven materials discovery remains constrained by the scarcity of large, high-quality, and accessible experimental datasets. Here, we introduce a generalizable large language model (LLM)-powered pipeline for automated extraction and structuring of materials data from unstructured scientific literature, using concrete materials as a representative and particularly challenging example. The pipeline exhibits robust performance across a broad range of LLMs and achieves an $F_1$ score of up to 0.98 for diverse composition--process--property attributes. Within one hour, it extracts nearly 9,000 high-quality records with over 100 attributes from a corpus screened from more than 27,000 publications, enabling the construction of the largest open laboratory database for blended cement concrete. Machine learning analyses underscore the importance of large, diverse, and information-rich datasets for enhancing both in-distribution accuracy and out-of-distribution generalization to unseen materials. The proposed pipeline is readily adaptable to other materials domains and accelerates the development of scalable data infrastructures for materials informatics.

Zhanzhao Li, Kengran Yang, Qiyao He et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Performance Manipulation: Labor Market Implications in AI-assisted Era

Performance manipulation arises when agents exploit easily measurable, routine tasks to inflate observable outcomes without contributing genuine innovation or expert judgment. We formalize this phenomenon in a game-theoretic model in which agents allocate effort along two margins. Creative effort is non-routine cognitive labor whose return is complementary to the agent's private expertise; it is the scarce input that principals seek. Mechanistic effort is the execution of well-defined, rule-based tasks that raise performance independently of expertise, a commoditized input that AI heavily augments. We establish the existence of a symmetric, monotone pure-strategy equilibrium and show that performance-based screening remains viable so long as evaluations retain a sufficient creative component, but collapses into an uninformative pooling equilibrium once AI capability grows large enough to crowd out creative effort. Comparing contest allocations against a single-agent baseline isolates performance manipulation as the competition-induced over-investment in mechanistic effort, which we show is undertaken systematically by low-type agents but not high-type ones. We further prove that more sharply skewed reward structures mitigate this friction by eliciting greater creative effort across the participant pool. Finally, using a novel, language-model-based methodology to measure both effort types from nearly 1,500 Kaggle competition scripts, we provide robust empirical support for the model's predictions.

Xiaoyun Qiu, Yang Yu, Haifeng Xu · 0 citations
#machine learning Preprint Open access Sep 2026

VeriX-Anon: A Multi-Layered Framework for Mathematically Verifiable Outsourced Target-Driven Data Anonymization

Organisations increasingly outsource privacy-sensitive data transformations to cloud providers, yet no practical mechanism lets the data owner verify that the contracted algorithm was faithfully executed. VeriX-Anon is a multi-layered verification framework for outsourced Target-Driven k-anonymization combining three orthogonal mechanisms: deterministic verification via Merkle-style hashing of an Authenticated Decision Tree, probabilistic verification via Boundary Sentinels and exact-duplicate Twins with cryptographic identifiers, and utility-based verification via Explainable AI fingerprinting that compares SHAP value distributions before and after anonymization using the Wasserstein distance. Across seven cross-domain datasets and four cloud profiles (28 scenarios), against Lazy (drops records), Dumb (fake hash), and Approximate (valid hash) adversaries, VeriX-Anon detects 25 of 28 deviations under a fixed threshold and 27 of 28 once the threshold is calibrated per dataset, with no false alarms. No single layer achieved this alone. The XAI layer was the only mechanism that caught the Approximate adversary, succeeding on six of seven datasets and missing only a high-dimensional case where honest generalization shifts SHAP as much as the attack. Target-Driven anonymization preserved significantly more utility than blind splitting, with mean F1 gaps of +0.058 to +0.362 and Wilcoxon p <= 0.001 on six of seven datasets. Client-side verification completes under one second at one million rows. The threat model covers three empirically evaluated profiles and one theoretical Informed Attacker unable to defeat the cryptographic salt. Sentinel evasion probability ranges from near-zero to 0.82 for the most imbalanced data, which the twin layer offsets in every scenario.

Miit Daga, Swarna Priya Ramu · 0 citations
#machine learning Preprint Open access Sep 2026

SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding

Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as object counting, question answering, and segmentation. However, collecting and annotating multimodal video data in real-world is costly, slow, and inherently limited in diversity and coverage. To address this challenge, we propose~\textbf{SynMulti} dataset, along with a unified synthetic data generation pipeline capable of automatically producing unlimited multimodal video data with rich and diverse supervision. Our framework supports multiple task formats within a single pipeline, enabling scalable and consistent data creation across tasks. To further enhance reasoning ability, we introduce a VQA-based fine-tuning strategy that trains models to answer structured questions about visual content rather than relying solely on captions or simple instructions. This formulation encourages deeper visual grounding and reasoning. We evaluate our approach in three challenging tasks: video object counting, video-based visual question answering, and video object segmentation. Experimental results demonstrate that models trained predominantly on synthetic data generalize effectively to real-world datasets, often outperforming traditionally trained counterparts. Our findings highlight the potential of unified synthetic data pipelines as a scalable alternative to expensive real-world annotation for multimodal video understanding.

Tanzila Rahman, Renjie Liao, Leonid Sigal · 0 citations
#machine learning Preprint Open access Sep 2026

Operator Learning for Predicting Bulk Wave Parameters of Spectral Wave Models

The impact of wave-induced forcing on the mean water level and nearshore currents is typically modeled through excess momentum fluxes, also known as radiation stresses, and their spatial gradients. Accurate storm surge prediction requires coupled circulation and wave models, but the high computational cost of numerical wave models limits their temporal resolution. In this work, we explore a proof-of-concept application of Deep Operator Networks (DeepONets) as a surrogate for the Simulating WAves Nearshore (SWAN) numerical wave model. Unlike grid-dependent surrogate models, DeepONets learn the underlying continuous operator, and thus, can provide highly efficient prediction while enabling discretization-invariant inference. The proposed surrogate model is evaluated using two distinct 1-D and 2-D steady-state numerical examples with variable boundary wave conditions and wind fields. When applied to a realistic numerical example of steady-state wave simulation in Duck, NC, the DeepONet surrogate improves computational efficiency by four orders of magnitude. Furthermore, the model demonstrates consistently high accuracy in predicting the significant wave height and the x- and y- components of the radiation stress gradient, by achieving relative L_2 errors bounded by 1.91%, 10.98%, and 6.88%, respectively, across all unseen test scenarios.

Shukai Cai, Sourav Dutta, Mark Loveland et al. · 0 citations

Robust Multi-Agent Reinforcement Learning for Small UAS Separation Assurance under GPS Degradation and Spoofing

This work derives a closed-form expression for this adversarial perturbation, bypassing the iterative inner optimization of adversarial training entirely and enabling linear-time evaluation in the state dimension, and shows that this expression approximates the exact minimizer of the value function over the modeled uncertainty set with second-order accuracy.

Alex Zongo, Filippos Fotiadis, U. Topcu et al. · 1 citation
#artificial intelligence Preprint Mar 2026

PeopleSearchBench: Evaluating AI-Powered People Search Platforms with Criteria-Grounded Verification

PeopleSearchBench, an open-source benchmark comprising 119 multilingual queries across four scenarios: corporate recruiting, B2B sales prospecting, expert search, and influencer discovery, finds that multi-source search agents significantly outperform single-domain systems, particularly in influencer discovery where the performance gap is largest.

Tianyu Shi, Wei Wang, Zequn Xie et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Accelerate Vector Diffusion Maps by Landmarks

We propose a landmark-constrained algorithm, LA-VDM (Landmark Accelerated Vector Diffusion Maps), to accelerate the Vector Diffusion Maps (VDM) framework built upon the Graph Connection Laplacian (GCL), which captures pairwise connection relationships within complex datasets. LA-VDM introduces a novel two-stage normalization that effectively address nonuniform sampling densities in both the data and the landmark sets. Under a manifold model with the frame bundle structure, we show that we can accurately recover the parallel transport with landmark-constrained diffusion from a point cloud, and hence asymptotically LA-VDM converges to the connection Laplacian. The performance and accuracy of LA-VDM are demonstrated through experiments on simulated datasets and an application to nonlocal image denoising.

Sing-Yuan Yeh, Yi-An Wu, Hau-Tieng Wu et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Model Selection and Parameter Estimation for Multidimensional Gaussian Mixture Models with a Common Covariance Matrix

We study model-order selection and component-mean estimation for multidimensional Gaussian mixture models with a known common covariance matrix. Using empirical characteristic-function measurements, we construct Fourier covariance matrices whose population counterparts have rank equal to the number of mixture components. We establish a minimax lower bound showing that distinguishing a separated $k$-component mixture from the class of $(k-1)$-component mixtures requires $\Omega(\Delta^{-(4k-4)})$ samples. We then develop an oracle spectral-thresholding estimator with a sufficient sample size of order $\Delta^{-(8k-8)}$ for fixed $k$, together with a practical singular-value-ratio estimator. Given the model order, we estimate the component means by score-initialized gradient descent on a MUSIC-type projection objective. Under an explicit sample-size condition, a qualifying sample initialization lies in a certified attraction region with high probability, after which the iterates converge linearly. For fixed positive component separation, the resulting mean estimates achieve the parametric rate $\mathcal{O}_p(n^{-1/2})$. Numerical experiments demonstrate competitive accuracy and lower computational cost than expectation-maximization across a range of multidimensional settings.

Xinyu Liu, Hai Zhang · 0 citations

Interpretable Predictability-Based AI Text Detection: A Replication Study

This paper replicates and extends the system used in the AuTexTification shared task for authorship attribution of machine-generated texts, and tested newer multilingual language models and added 26 document-level stylometric features, using ablation, permutation importance, and SHAP analysis to assess feature influence.

Adam Skurla, D. Macko, Jakub Simko · 0 citations

PA3: Policy-Aware Agent Alignment through Chain-of-Thought

This work proposes a multi-stage alignment method that teaches models to recall and apply relevant business policies during chain-of-thought reasoning at inference time, without including the full business policy in-context.

Shubhashis Roy Dipta, Daniel Bis, Kun Zhou et al. · 6 citations
#machine learning Preprint Open access Sep 2026

NanoVDR: Distilling a 2B Vision-Language Retriever into a 70M Text-Only Encoder for Visual Document Retrieval

Vision-Language Model (VLM) based retrievers have advanced visual document retrieval (VDR) to impressive quality. They require the same multi-billion parameter encoder for both document indexing and query encoding, incurring high latency and GPU dependence even for plain-text queries. We observe that this design is unnecessarily symmetric: documents are visually complex and demand strong visual understanding, whereas queries are just short text strings. NanoVDR exploits this query--document asymmetry by decoupling the two encoding paths: a frozen 2B VLM teacher indexes documents offline, while a distilled text-only student as small as 69M parameters encodes queries at inference. The key design choice is the distillation objective. Through systematic comparison of six objectives across three backbones and 22 ViDoRe benchmark datasets, we find that pointwise cosine alignment on query text consistently outperforms ranking-based and contrastive alternatives, while requiring only pre-cached teacher query embeddings and no document processing during training. Furthermore, we identify cross-lingual transfer as the primary performance bottleneck, and resolve it cheaply by augmenting training data with machine-translated queries. The resulting NanoVDR-S-Multi (DistilBERT, 69M) retains 95.1\% of teacher quality and outperforms DSE-Qwen2 (2B) on v2 and v3 with 32$\times$ fewer parameters and 50$\times$ lower CPU query latency, at a total training cost under 13 GPU-hours.

Zhuchenyang Liu, Yao Zhang, Yu Xiao · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.