Skip to content

Category

cybersecurity

1,407 papers

#machine learning Preprint Oct 2026

Evaluating and Improving the Robustness of Large Language Models to Input Sequence Variations

Large language models (LLMs) in production systems face prompt injections, trojans (backdoors), and manipulation of automatic quality metrics. This thesis develops models, methods, and algorithms for evaluating and improving LLM robustness to adversarial input sequence variations. We propose R_stab(f), a generative rob...

N. Maloyan · 0 citations
#machine learning Preprint Oct 2026

Intent-Hiding Jailbreaks: An Information-Theoretic Framework for Compositional Attacks

Recent work has shown that large language models (LLMs) can be vulnerable to jailbreak attacks in which harmful intent is obscured through composition with benign tasks. A harmful request refused in isolation may elicit a different response when embedded within a larger, seemingly benign query. We study these compositi...

Feng-Wei Tian, Ravi Tandon · 0 citations
#machine learning Preprint Oct 2026

Inner Momentum for Differentially Private Muon

It is shown that a finite Newton-Schulz iteration preserves the polar factor of its input under these spectral conditions, confirming that the correction survives orthogonalization.

Bishnu Bhusal, M. Vu, B. Southworth et al. · 0 citations
#machine learning Preprint Oct 2026

Differential Privacy of Gradient Descent on Perturbed Objectives

Objective perturbation adds a random linear term to a regularized empirical risk and releases the exact perturbed minimizer. We study the finite computation obtained by releasing the $N$-th iterate of deterministic gradient descent on $w\mapsto F(w;S)+\langle z,w\rangle$, where $z\sim\mathcal N(0,\sigma^2I_d)$ is drawn...

Austin Watkins, Raman Arora · 0 citations
#machine learning Preprint Open access Oct 2026

From Mathematical to Executable Certificates for Machine Unlearning

Machine unlearning is needed when data must be removed because of deletion requests, outdated records, or data-quality concerns, while retraining from scratch can be costly. Certified machine unlearning methods provide mathematical guarantees, while deployed systems release concrete finite-precision artifacts produced...

Ziyu Zhao, Xinyu Wang, Xiaowen Chang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Interrupting the Chain: Human Perception of AI-Generated Disinformation Through a Kill Chain Lens

Generative AI enables customized misinformation at scale, yet defenses remain largely reactive. We present empirical findings from a human-subject study (n=504 participants, n=2,438 judgments) in which users classified news fragments by origin (human vs. machine) and veracity (real vs. fake). We organize results using...

Alexander Loth, Martin Kappes, Marc-Oliver Pahl · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis

Learned classifiers deployed in agentic pipelines face a fundamental reliability problem: predictions are probabilistic inferences, not verified conclusions, and acting on them without grounding in observable evidence leads to compounding failures across downstream stages. Software vulnerability analysis makes this cos...

Jugal Gajjar · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Cocoon: A System Architecture for Differentially Private Training with Correlated Noises

Machine learning (ML) models memorize and leak training data, causing serious privacy issues to data owners. Training algorithms with differential privacy (DP) have been gaining attention as a solution. However, these algorithms add noise at each training iteration and degrade accuracy, limiting their real-world adopti...

Donghwan Kim, Xin Gu, Jinho Baek et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mitigating Watermark Forgery in Generative Models via Randomized Key Selection

Watermarking enables GenAI providers to verify whether content was generated by their models. A watermark is a hidden signal in the content, whose presence can be detected using a secret watermark key. A core security threat are forgery attacks, where adversaries insert the provider's watermark into content \emph{not}...

Toluwani Aremu, Noor Hussein, Munachiso Nwadike et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Counterfactual Evidence Audits Predict LLM-Agent Susceptibility to Ranked Context

LLM agents increasingly decide from evidence assembled by upstream systems: retrievers choose documents, recommenders choose posts, and memory systems choose prior events. Existing evaluations usually hold this evidence fixed, missing failures in which individually ordinary items form a systematically one-sided context...

Rana Muhammad Usman · 0 citations
#artificial intelligence Preprint Oct 2026

Threat-Preserving Representation Sensitivity in Agent-Security Benchmarks

Security benchmarks for LLM-based agents often report the attack success rate (ASR) as a measure of model robustness and use these scores to compare different models and defense mechanisms, assuming that they describe the security of the agent. In this paper, we explore whether it also influences the benchmark's measur...

Neeraj Karamchandani, Piyush Nagasubramaniam, Xin-Hong Xie et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

GPT-Lab Oct 30, 2026

Black October? The Week AI Changed the Cybersecurity Conversation

Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.

Google DeepMind Blog Jul 17, 2026

Introducing Gemini 3.5 Flash Cyber

Google introduces Gemini 3.5 Flash Cyber, a lightweight cybersecurity model to find and patch vulnerabilities.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.