Skip to content

Category

cybersecurity

1,407 papers

#artificial intelligence Preprint Open access Oct 2026

When AI Finds Hidden Messages, Does It Report?

When an assistant encounters a message for another AI, does it tell its user? Four fixed model-provider deployments perform simulated source tasks in 1,280 ordinary-note and 128 enhanced-note sessions. Harmless and harmful messages have matched plaintext and ROT13 versions, with no-message controls. Observers receive n...

William Guey, Rashik Jahangir, Pierrick Bougault et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MRCert: Towards Post-deployment Patch Robustness Certification for Adversarially Patched Samples via Type-specific Masking

In post-deployment time, inputs to deep learning models may or may not be adversarially patched. Patch robustness certification on such inputs within a patch bound can verify their label benignity and should retain high prediction accuracy. However, existing smoothing-based and masking-based recovery defenders cannot a...

Qilin Zhou, Zhengyuan Wei, Haipeng Wang et al. · 0 citations
#artificial intelligence Review Oct 2026

From Investigation Failures to Reliable SOC Agents: Understanding and Improving LLM-Based Alert Triage

Security operations centers (SOCs) must triage large volumes of alerts, most of which are benign, while missed attacks can remain uninvestigated. Tool-using large language model (LLM) agents can retrieve evidence during triage, but it remains unclear how reasoning strategies determine what to gather and when an investi...

Saimon Amanuel Tsegai, Alex Kantchelian, Dan-Feng Yao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Certified Corruption Budgets: Anytime-Valid Leaderboard Claims under Adaptive Rigging

Public leaderboards for AI models are read continuously, and attackers can see every published standing. Vote rigging, selective disclosure of private variants, and benchmark contamination can each move a ranking. Existing guarantees assume genuine records or bound the corruption per step, which an attacker who corrupt...

Hamed Khosravi, Xiaoming Huo · 0 citations

Sensitive-Topic Leakage Through LLM Routing Metadata: Measurement and Mitigation

LLM routers pick a cheap or expensive model per request by its content, and many gateways and some cloud platforms can log that choice with content logging off. We measure this privacy channel beyond token counts, accounting for noisy labels and repeated prompts. We run pre-registered studies on 1.7 million real reques...

Teng-Ruei Chen · 1 citation
#machine learning Preprint Open access Oct 2026

Open-Weight LLM Fine-Tuning Defenses are Susceptible to Simple Attacks

Recent defenses for safeguarding open-weight large language models (LLMs) are intended to prevent adversarial usage. Underlying these defenses is an assumption that new harmful behavior is learned through fine-tuning rather than elicited by jailbreaking the model. Yet, pretrained LLMs already encode substantial harmful...

Kevin Kuo, Virginia Smith, Chhavi Yadav · 0 citations
#machine learning Preprint Open access Oct 2026

Estimating Model-Level Membership Inference Vulnerability Without Reference Models

Membership inference attacks (MIAs) have emerged as the standard tool for evaluating the privacy risks of AI models. However, state-of-the-art attacks require training numerous, often computationally expensive, reference models, limiting their practicality. We present a novel approach for estimating model-level vulnera...

Euodia Dodd, Nata\v{s}a Kr\v{c}o, Igor Shilov et al. · 0 citations
#machine learning Preprint Open access Oct 2026

The Utility and Complexity of in- and out-of-Distribution Machine Unlearning

Machine unlearning, the process of selectively removing data from trained models, is increasingly crucial for addressing privacy concerns and knowledge gaps post-deployment. Despite this importance, existing approaches are often heuristic and lack formal guarantees. In this paper, we analyze the fundamental utility, ti...

Youssef Allouah, Joshua Kazdan, Rachid Guerraoui et al. · 0 citations
#machine learning Preprint Oct 2026

Pareto-optimal quantum kernel selection for unsupervised anomaly detection on real malware beaconing data

Quantum kernel methods are leading candidates for a practical quantum advantage in machine learning, but assessing that potential requires two quantities usually reported separately: how well a kernel performs on the task, and how far its geometry departs from the classical kernels available for the same problem. We in...

Boaz Micah, Nadia Milazzo, Maissa Beji et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Understanding and Mitigating Token-Pruning-Induced Vulnerabilities in VLMs

Token-Pruning accelerates Vision-Language Models by removing redundant visual tokens, yet its safety implications remain underexplored. In this work, we present the first comprehensive safety evaluation of Token-Pruning mechanisms and find that: most pruning strategies significantly degrade safety as pruning ratios inc...

Shuailong Wang, Xinyu Lyu, Shengming Yuan et al. · 0 citations
#machine learning Preprint Oct 2026

Constitution-Guided Watermarking

Watermarking enables language model providers to identify text generated by their models. However, its desired properties can conflict (\ie~stronger watermark signals can degrade text quality), while designs that resist editing may also facilitate forgery. Providers address these trade-offs by choosing configurations t...

Toluwani Aremu, Samuele Poppi, Nils Lukas · 0 citations
#machine learning Preprint Open access Oct 2026

Ask the Expert: LLM-Guided Reinforcement Learning for Autonomous Cyber Defense

Policy-based reinforcement learning (RL) approaches have produced promising results for autonomous cyber defense; however, they are sample-inefficient in settings where defenders must respond under delayed, partial observations with actions from large action spaces. While large language models (LLMs) may reason semanti...

Fernando Martinez, Abhishek Satyam, Tao Li et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

GPT-Lab Oct 30, 2026

Black October? The Week AI Changed the Cybersecurity Conversation

Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.

Google DeepMind Blog Jul 17, 2026

Introducing Gemini 3.5 Flash Cyber

Google introduces Gemini 3.5 Flash Cyber, a lightweight cybersecurity model to find and patch vulnerabilities.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.