Skip to content

Category

cybersecurity

1,407 papers

#artificial intelligence Preprint Aug 2026

Influence Is Not Authority: When Causal Guardrail Signals Make Legitimate Tool Use Look Like an Attack in Tool-Using LLM Agents

The results show that the studied causal signal reveals what shaped an action without reliably encoding whether the action was authorized, and that reference construction and routing are integral to the effective security decision.

Tanzim Ahad, Ismail Hossain, Md Jahangir Alam et al. · 1 citation
#artificial intelligence Preprint Aug 2026

Safe to Resume? Breaking Execution Continuity of Agent Execution via Rollback

This paper presents the first systematic security study of checkpoint and rollback in existing agent systems, and develops a multi-agent analysis pipeline that reconstructs execution semantics, identifies violations of the five failure conditions, and validates them through actual rollback.

Guan-Long Wu, Da-Hui Li, Ke Jiang et al. · 2 citations
#artificial intelligence Preprint Aug 2026

Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding

CoVeil is proposed, a defense mechanism which dynamically optimizes transmitted signals to suppress leakage during decoding time while preserving the collaborative quality, and consistently improves the privacy-utility trade-off over existing baselines by reducing data leakage.

Ke-Jia Zhang, Tianyuan Zou, Zi-Xuan Gu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Single Canonical Prompts Underestimate LLM Safety's Surface-Form Sensitivity

A benchmark score is a measurement instrument, yet most benchmarks read each item at a single canonical surface form. We ask whether that reading is faithful: when an item's intent is held fixed and only its meaning-preserving surface form varies, does the canonical-form score estimate model behavior well, and how much...

Yongxin Zhou, Jun-Wei Yao, Yuanzhe Liu et al. · 1 citation

An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic

This work forms model extraction monitoring as benign-calibrated traffic-window distribution testing: embed incoming queries into a semantic space and test whether their aggregate distribution deviates from historical benign traffic.

Shu-Ze Liu, Qian-Wen Guo, Yushun Dong · 1 citation

Breaking MCP with Function Hijacking Attacks: Novel Threats for Function Calling and Agentic Models

A novel function hijacking attack (FHA) that manipulates the tool selection process of agentic models to force the invocation of an attacker-chosen function and is largely agnostic to the context semantics and remains effective across domains and function sets.

Yannis Belkhiter, Giulio Zizzo, Sergio Maffeis et al. · 1 citation

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

A trajectory-aware evolutionary search method, T-MAP, which leverages execution trajectories to guide the discovery of adversarial prompts and enables the automatic generation of attacks that not only bypass safety guardrails but also reliably realize harmful objectives through actual tool interactions.

Hyomin Lee, Sangwoo Park, Yumin Choi et al. · 8 citations · ⚡1

More Haste, Less Speed: Weaker Single-Layer Watermark Improves Distortion-Free Watermark Ensembles

This work proposes a general framework that utilizes weaker single-layer watermarks to preserve the entropy required for effective multi-layer ensembling and demonstrates that this counter-intuitive strategy mitigates signal decay and consistently outperforms strong baselines in both detectability and robustness.

Ruibo Chen, Yihan Wu, Xuehao Cui et al. · 2 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

GPT-Lab Oct 30, 2026

Black October? The Week AI Changed the Cybersecurity Conversation

Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.

Google DeepMind Blog Jul 17, 2026

Introducing Gemini 3.5 Flash Cyber

Google introduces Gemini 3.5 Flash Cyber, a lightweight cybersecurity model to find and patch vulnerabilities.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.