Skip to content

Category

cybersecurity

1,407 papers

#machine learning Preprint Oct 2026

Weight Oracles: Reading Neural Network Weights with Language Models

Interpretability methods for neural networks are predominantly reactive: they analyse activations produced during specific forward passes, requiring known inputs to find hidden capabilities such as backdoors. We propose Weight Oracles, fine-tuned language models that diagnose properties of a target network by reading i...

Krish Kabra, Constantin Venhoff, Christian Schroeder de Witt · 0 citations
#machine learning Preprint Oct 2026

ATLAS-AL: Adaptive Trust-Region for Latent Adversarial Searches via Active Learning

Security evaluation of learning-based systems requires more than just testing the system against a fixed collection of attacks. It requires adaptive mechanisms that can efficiently discover \textit{sets} of inputs that induce model failure. We introduce ATLAS (Adaptive Trust-Regions for Latent Adversarial Searches), wh...

Marsalis T. Gibson, Claire J. Tomlin, S. Sastry · 0 citations
#machine learning Preprint Open access Oct 2026

Reward-Driven Learning under Prompt-Level Differential Privacy

Reinforcement learning with verifiable rewards (RLVR) trains a language model on problems that may themselves be confidential, and the trained model can reveal which problems it saw. We study RLVR under prompt-level differential privacy: the released weights must be ({\epsilon},{\delta})-differentially private with res...

Jiachen Zhao, Antonia Januszewicz, Taeho Jung · 0 citations
#natural language process... Preprint Open access Oct 2026

Cross-Lingual Summarization as a Black-Box Watermark Removal Attack

Watermarking has been proposed as a lightweight mechanism to identify AI-generated text, with schemes typically relying on perturbations to token distributions. While prior work shows that paraphrasing can weaken such signals, these attacks remain partially detectable or degrade text quality. We demonstrate that cross-...

Gokul Ganesan · 0 citations
#natural language process... Preprint Open access Oct 2026

TSCheater: Generating High-Quality Tibetan Adversarial Texts via Visual Similarity

Language models based on deep neural networks are vulnerable to textual adversarial attacks. While rich-resource languages like English are receiving focused attention, Tibetan, a cross-border language, is gradually being studied due to its abundant ancient literature and critical language strategy. Currently, there ar...

Xi Cao, Quzong Gesang, Yuan Sun et al. · 0 citations
#natural language process... Conference Open access Oct 2026

DP-ES: Differentially Private Evolution Strategies for Prompt Optimization

Token-level differentially private (DP) prompt optimization methods such as DP-OPT can become unstable under tight privacy budgets: on GSM8K, DP-OPT obtains $49.5\pm28.5\%$ across 30 runs, and a logged search trajectory reveals prompt-template drift and noise-sensitive irreversible choices. We diagnose these as structu...

Zi-Niu Liu, Ai-Ping Li, Yue Han et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

StegoMemory: Agentic Memory Acts as Covert Steganographic Channel

Is agentic memory robust against stealthy steganographic attacks? We carry out a large-scale red-teaming exercise to test whether agents can encode attacker-controlled strings in one session and recover them in another without triggering safety oversight. Following SHADE-Arena-style tasks, we embed malicious side tasks...

Snehasis Mukhopadhyay, Arun Nair · 0 citations
#natural language process... Preprint Oct 2026

The Same Zero: Why Identical ASR Can Imply Different Guarantees in LLM-Agent Security

LLM-agent security has produced a dense landscape of defenses - prompt hardening, content filters, permission gates, sandboxes - yet no framework tells a deployer what a defense actually guarantees, or where that guarantee comes from. We apply Verification Autonomy Levels (VAL) - L0: LLM self-declaration; L1: determini...

Ya-Jie Yin · 0 citations
#natural language process... Preprint Open access Oct 2026

Large Language Models and Augmented Democracy

Artificial intelligence enables computational agents to represent political preferences and take part in collective decision-making. In this thesis, I investigate the opportunities and challenges of digital twins (DTs) based on Large Language Models (LLMs) as intermediaries in augmented democracy, focusing on individua...

Jairo Gudi\~no-Rosero · 0 citations
#natural language process... Preprint Oct 2026

Red-TTT: Test-Time Training for Automated Jailbreaking Large Language Models

Red-TTT is proposed, which updates the attacker's parameters during the attack on each behavior, and requires only sampling access to the victim and integrates into existing attack pipelines with no other changes, increasing attack success rate and cracking many behaviors previous method cannot.

Tong-Yan Hu, Hao Li, Xiaogeng Liu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

EXHIB: A Benchmark for Realistic and Diverse Evaluation of Function Similarity in the Wild

Binary Function Similarity Detection (BFSD) is a core problem in software security, supporting tasks such as vulnerability analysis, malware classification, and patch provenance. In the past few decades, numerous models and tools have been developed for this application; however, due to the lack of a comprehensive univ...

Yiming Fan (The Ohio State University), Jun Yeon Won (The Ohio State University), Ding Zhu (The Ohio State University) et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Logit-Gap Steering: A Forward-Pass Diagnostic for Alignment Robustness

RLHF-style alignment trains language models to refuse unsafe requests, but how much operational margin does this refusal rest on? We introduce the refusal-affirmation logit gap: the difference between the top refusal-token logit and the top affirmative-token logit at the first decoding step. This single scalar quantifi...

Tung-Ling Li, Hongliang Liu · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

GPT-Lab Oct 30, 2026

Black October? The Week AI Changed the Cybersecurity Conversation

Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.

Google DeepMind Blog Jul 17, 2026

Introducing Gemini 3.5 Flash Cyber

Google introduces Gemini 3.5 Flash Cyber, a lightweight cybersecurity model to find and patch vulnerabilities.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.