The EU Artificial Intelligence Act (AIA) establishes different legal principles for different types of AI systems. While prior work has sought to clarify some of these principles, little attention has been paid to robustness and cybersecurity. This paper aims to fill this gap. We identify legal challenges and shortcomi...
Henrik Nolte, Miriam Rateike, Mich\`ele Finck· 0 citations
MalwareFormer is presented, a transformer-based, byte-level malware detection framework that operates directly on raw bytes, without requiring domain knowledge or feature extraction, demonstrating that transformers provide a powerful and scalable approach for byte-level malware detection.
A. el-Jamal, Abdeltawab M. Hendawi· International Conference on...· 0 citations
JevProbe is presented, the first automated framework to evaluate JPDH by tracing adversarial influence from reachable context surfaces through program-consumed decisions to downstream security consequences in real-world Jev applications, and further construct JevProbeBench to support systematic evaluation of JPDH in re...
Yang Luo, Tian-Tian Ji, Zi-Feng Kang et al.· 0 citations
Direct Preference Optimization (DPO) has become a widely adopted approach for aligning vision-language models (VLMs), yet the security of multimodal preference data remains largely unexplored. Existing preference poisoning attacks either corrupt explicit supervision signals or require visible triggers, making them dete...
Cheng-Tao Jian, Kai Yang· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Federated fine-tuning of large language models (LLMs) allows multiple clients to collaboratively adapt models without sharing raw data, offering strong privacy benefits. However, this setting is highly vulnerable to backdoor attacks, in which malicious clients manipulate their updates to induce targeted behaviors while...
Xi Chen, Chun-Yi Zhou, Rui Zeng et al.· 0 citations
This work evaluates Caesar and layered variants across eight models and 139 injection-task pairs, separating instruction recovery from attack success, and highlights the risk of promoting decoded, untrusted content into actionable instructions.
While AI agents are useful for many tasks, they regularly misbehave in destructive ways, such as deleting important data. While prior work has focused on preventing such misbehavior, we consider how to recover after an agent misbehaves. We propose verifiable agent insurance (VAI), a framework for agent providers to com...
Hua Cheng, Taro Tsuchiya, Nicolas Christin et al.· 0 citations
LLM agents now act as delegated communication intermediaries: they read private context, draft messages, and send externally visible emails on behalf of a user. Existing checker-repair defenses can reduce inappropriate disclosure, but they rely on repeated calls to a remote action LLM (the model that drafts and repairs...
ProtoArena is introduced, a black-box, multi-component, dynamic benchmark with 80 cross-component vulnerability-exploitation environments spanning 11 protocol and application domains and 7 attack categories and success with limited black-box information remains low and varies across domains and attack categories.
Fa-Sheng Miao, Zhao-Yu Hu, Xiang Li et al.· 0 citations
TypeSafe AI's Jev is a new kind of safety judge. It generates no text and no label: it answers questions the developer defines in advance and returns a probability for each answer. The vendor admits that adversarial input can change these answers but gives no numbers. In this paper, we present the first controlled adve...
Agent skills turn natural-language instructions into actions, creating a security challenge: legitimate automation and malicious behaviour can look deceptively similar. A practical screen must catch nearly every attack while keeping the review load manageable. We present SkillScreen, a compact decision model trained to...
Jerrold Huang, Junwei Quan, Saiyue Lyu et al.· 0 citations
With recent developments in Artificial Intelligence (AI), the adoption of distributed learning paradigms such as Federated Learning (FL) has emerged. In simple terms, FL enables multiple entities to collaboratively train AI models without sharing local data. The FL paradigm is particularly valuable in privacy-sensitive...
Maria Ivan, O. Ermis, Ruxandra F. Olimid· 0 citations
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.