Fine-tuning APIs make frontier LLMs easy to customize, but they can also weaken safety alignment during fine-tuning. While prior work shows that benign supervised fine-tuning (SFT) can reduce refusal behavior, deployed fine-tuning pipelines increasingly support preference-based objectives, whose safety risks remain les...
Sangyeon Yoon, Wonje Jeung, Yoonjun Cho et al.· 0 citations
Agent Skills is an emerging open standard that defines a modular, filesystem-based packaging format enabling LLM-based agents to acquire domain-specific expertise on demand. Despite rapid adoption across multiple agentic platforms and the emergence of large community marketplaces, the security properties of Agent Skill...
Zhiyuan Li, Jingzheng Wu, Xiang Ling et al.· 0 citations
Aligning AI systems with human privacy preferences requires understanding individuals' nuanced disclosure behaviors beyond general privacy norms. Yet eliciting these boundaries remains challenging because they involve context-dependent trade-offs. We present an elicitation approach that probes individuals' privacy boun...
Bingcan Guo, Eryue Xu, Zhiping Zhang et al.· 0 citations
Mid-2026 reporting on autonomous AI evaluation incidents claimed that frontier large language model (LLM) agents escaped server containment through emergent coordination and cloud infrastructure attacks. This paper contextualizes those claims through forensic analysis and containerized recreation of both the Highly Per...
Alicia Colmenero-Fern\'andez· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The rapid advancement of large vision language models (LVLMs) has made geolocation inference from images highly accurate and accessible. This poses serious privacy risks: a passive adversary with black-box LVLM access can infer a user's location from a single photo with no metadata. Existing protection methods rely alm...
Yixin Wu, Mingjie Li, Yun Shen et al.· 0 citations
Agents extend their capabilities through reusable skills that package instructions, executable code, and resources. Composing these skills enables complex task workflows, but their dependencies can also connect malicious operations across skills, making their combined intent difficult to identify through individual-pac...
Qi-Cheng Zhao, Sheng-Fang Zhai, Qing-Ni Shen et al.· 0 citations
Backdoor attacks on deep neural networks are commonly evaluated by attack success rate and benign accuracy, yet their stealthiness remains inconsistently defined and measured. Existing work often studies only one observable aspect of stealthiness, such as trigger imperceptibility, feature-space separability, parameter-...
Behrad Tajalli, Henk Berendsen, Xiaoyun Xu et al.· 0 citations
Typed decision models (TDMs) are increasingly used in applications such as request routing and model selection, making reliable decisions critical to system performance. Fallback options accommodate categories outside regular choices, enabling deferral to human experts or more capable models. While recent works have ex...
Yuanbo Xie, Mingli Zhu, Tianyun Liu et al.· 0 citations
Understanding the security posture of cyber physical systems (CPS) requires reasoning across both information technology (IT) and operational technology (OT). However, a security analyst often holds an incomplete, role-specific view of the underlying system which has most likely resulted from their knowledge limited by...
Shadaab Kawnain Bashir, Rakesh Podder, P. Hopkins et al.· 0 citations
Agent skills are Markdown documents that a tool-using agent reads as instructions and then acts on with the privileges of the session that loaded them. Installing one grants authority (the standing to direct the agent, not new privilege), and the size of that grant is what we measure. We present a two-phase attack-surf...
Ratnesh Pandey, Japneet Singh, Harsh Akshit et al.· 0 citations
CyberArena is a dynamic, symmetric adversarial benchmark built around multi-round attack-and-defense combat, and introduces a dynamical model that maps match dynamics into unified, multidimensional scores across offensive, defensive, and domain-specific capabilities.
Bangya Liu, Jianhong Tu, Yu-Jing Pan et al.· 0 citations
LLM agents are becoming increasingly capable of handling daily workspace tasks by interacting with application environments through tool calls. However, as agents read and write sensitive user data across email, documents, and other applications, a central privacy question is whether they preserve contextual integrity...
Chengquan Guo, Zhaorun Chen, Zinan Lin et al.· 0 citations
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.