EmbGA is presented, an embedding-space genetic algorithm that recovers concepts present in a set of images but absent from the prompt that generated them, and runs much faster than language-model-guided search.
This work first proposes a model inversion attack on FL systems using Deep Convolutional Generative Adversarial Networks (DCGANs) in the context of large-scale medical imaging, and examines the effect of client-side differential privacy (DP) in mitigating privacy leakage and incorporate personalized FL to improve model...
Beneath the apparent diversity of foundation models lies an increasingly homogeneous technical stack of common training pipelines, distillation methods, and data. These shared algorithmic choices can expose an otherwise distinct model ecosystem to concentrated risks leading to a vulnerability monoculture. Yet current p...
Leo Elmecker-Plakolm, Lukasz Szpruch, Avishek Joey Bose et al.· 0 citations
Large language models are deployed globally, yet safety alignment and evaluation remain concentrated in English: harmful requests refused in English can elicit unsafe completions when translated into low-resource languages. We evaluate ten widely deployed LLMs across 79 languages (English plus 78 low-resource) under a...
Jalil Alva, David Harper, Abigail E. Thornton et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Large language models can detect vulnerable code, yet the form of vulnerability encoding in their representations remains unclear. We analyze 8 code models spanning 6.7B-15B parameters on C programs using three datasets (DELTASECOMMITS, SVEN, and PRECISE-BUGS), comparing two diagnostic tasks on the same representations...
Rui Melo, Andre Catarino, Claudia Mamede et al.· 0 citations
This work introduces AutoRedClaw, an automated red-teaming framework that generates end-to-end attacks together with the environments needed to execute them, and constructs RedClaw-Bench, a 330-case benchmark that yields substantially higher attack success rates (ASRs) than AgentDojo, AgentDyn, and DTap.
Hao Li, Tong-Yan Hu, Weidi Luo et al.· 0 citations
Profile-DP is introduced, a policy-aware local differential privacy framework designed specifically for user-profile release in personalized LLM inference, which provably bounds the release of user-withheld facts while treating public instructions, profile schemas, and authorized facts as public side information.
Mingchen Li, Zi-Fan Peng, Ke-Wei Sha et al.· 0 citations
Neural networks (NNs) are increasingly deployed on edge devices such as mobile and IoT platforms, offering low latency and improved privacy compared to cloud-based deployment. However, on-device models embedded in mobile applications can be unpacked and exposed to adversaries, enabling cross-node attacks in centrally d...
Yuyang Zhang, Kangjie Chen, Yihui Jin et al.· 0 citations
A novel method is proposed, BMO, that obfuscates model parameters to diversify the decision boundary further resisting cross-node attack while preserving its benign accuracy, and achieves comparable performance in benign accuracy compared with baselines.
Yu-Yang Zhang, Yi-Hui Jin, Kangjie Chen et al.· 0 citations
Traffic cameras support useful analysis, but their outputs can reveal private information. Replacing images with text reduces direct visual exposure. It does not place a formal bound on disclosure. The published reinforcement learning and mixture-of-experts framework refines scene descriptions through relevance, covera...
Statistical privacy audits are essential for verifying the theoretical privacy guarantees of differentially private (DP) mechanisms. Auditors typically use Membership Inference Attacks (MIAs) to estimate a lower bound on the true privacy leakage of DP mechanisms at a specified confidence level, which should not exceed...
It is shown that intervention history can change subsequent attack behavior, but its effect depends on both the model and the retained context, and its effect depends on both the model and the retained context.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Critical flaws, compromised release channels and agentic AI threats landed within days of each other in mid-October 2026. Why “Black October” may say more about how well we now find weaknesses than about the attacks themselves. The post Black October? The Week AI Changed the Cybersecurity Conversation appeared first on GPT-Lab.