Skip to content

DynGraphAgentBench: A Benchmark for Agentic Lifecycle Control in Dynamic Graph Anomaly Detection

Sep 2026 · arXiv.org · Vol abs/2609.33980 · 0 citations · 38 references
Computer Science

TL;DR

DynGraphAgentBench, an executable benchmark for agentic lifecycle control under delayed feedback, is introduced, an executable benchmark for agentic lifecycle control under delayed feedback that measures detection utility with average precision and capture at fixed review depth, and characterize adaptation through model switches and compute.

Abstract

Dynamic graph anomaly detection requires repeated decisions as graph structure and class prevalence drift, yet detector benchmarks usually score a fixed pipeline after current labels are known. We introduce DynGraphAgentBench, an executable benchmark for agentic lifecycle control under delayed feedback. It comprises seven temporal graph datasets with node- and edge-level anomaly tasks, eleven selectable detectors, and eight chronological deployment windows per dataset. In each window, a controller sees only time-causal aggregate context, registered model cards, and its own matured history. It must choose a detector before current-window training or candidate scores exist. A sandboxed executor trains the chosen architecture on mature data, scores a hidden deployment window, and releases the outcome after a one-window delay. A deterministic verifier checks decision timing, leakage guards, legal actions, training scope, and persisted artifacts. We measure detection utility with average precision and capture at fixed review depth, and characterize adaptation through model switches and compute. Complete eight-window trajectories from two primary controllers and a no-memory reference on four datasets, together with three additional controllers on three datasets, expose useful, costly, and ineffective reactions to delayed evidence without granting an exhaustive current-window oracle.

View source

Similar papers

Preprint Aug 2026

Automata from Agent Traces: Failure and Next-Step Prediction

Behavioral topology is shaped more by the deployment harness than by the LLM, providing a model-agnostic structural primitive for safety auditing and runtime monitoring, and addresses both prediction goals.

Seonglae Cho, F. Fernandez, Umar Mohammed et al. · 4 citations · ⚡1
Book Open access Aug 2026

DyGADBench: A Comprehensive Benchmark for Anomaly Detection in Dynamic Graphs

An extensive empirical study of state-of-the-art DGAD models is conducted, revealing that detection difficulty increases consistently with anomaly complexity, from simple localized irregularities to coordinated and temporally persistent structures.

Mohamed Nazim Mezhoudi, Guillaume Lachaud, Yan-Lei Diao et al. · 0 citations
#edge computing Preprint Aug 2026

Beat the Counter First: A Baseline for Temporal-Graph Anomaly Detectors

SimpleCount is proposed, a reference with no parameter fitting that selects one scalar feature per dataset from a fixed pool of counts, recencies, first-occurrence indicators, and count-derived transforms that matches or exceeds SLADE on three of six datasets and exceeds IsoForest on all six.

Omair Shafi Ahmed, Zohair Shafi · 0 citations
#artificial intelligence Preprint Sep 2026

Skynet: Workflow-Level Anomaly Detection for Agentic AI via Semantic and Structural Modeling

It is argued that anomaly detection for agentic AI must reason at the workflow level, where global execution structure exposes signals that local checks cannot see, and presents Skynet, a principled workflow-level anomaly detection framework that turns observed multi-agent execution into directed workflow graphs and sc...

Chao-Yu Zhang, He-Xuan Yu, Heng Jin et al. · 0 citations

Related blog posts

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.