Skip to content
Open access

From Compression to Execution: What Helps Large Language Models Digest Urban Graphs for Spatial QA?

Sep 2026 · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · Vol XII-4/W2-2026, pp. 155-162 · 0 citations · 11 references

TL;DR

These results should be interpreted as a comparison of graph-language interaction designs rather than a fully input-matched ablation, but they suggest that exposing task-relevant structural information is an important factor for urban spatial QA.

Abstract

Urban graphs are central to smart-city analytics, but they remain difficult for language-guided models, specifically LLMs, to use effectively in spatial question answering. This paper studies how urban graph structure can be exposed to such models through different graph-language interaction designs. We construct a controlled multi-task urban graph QA benchmark over three cities that covers adjacency count, adjacency binary, reachability, shortest path, and centrality, and compare seven mechanisms spanning compression, memory, retrieval, execution, and structural reasoning, alongside text-only and GNN-only baselines. Within this benchmark, methods using more explicit structural evidence generally outperform compression and memory-based approaches: Path Tokens reaches 78.1% average accuracy, Graph Tool 87.4%, and Counterfactual 71.7%, while centrality remains the most difficult task. These results should be interpreted as a comparison of graph-language interaction designs rather than a fully input-matched ablation, but they suggest that exposing task-relevant structural information is an important factor for urban spatial QA.

Read PDF

Similar papers

#artificial intelligence Preprint Oct 2026

GraphDecisionBench: Benchmarking System One Models on Graph Tasks

GraphDecisionBench is introduced, a model-independent benchmark that combines structural task profiles, matched graph-text input contrasts and heuristic-proposal controls to diagnose graph decision performance and illustrates the benchmark's central distinctions.

Xian-Liang Yang, Ya-Pu Zhang, Li Zhao · 0 citations
Review Open access Oct 2026

Verifiable reasoning of large language models over structured spatial data

Large language models increasingly answer questions grounded in structured spatial data such as road networks: in navigation assistants, in conversational interfaces to geographic information, and in tools that maintain digital maps. Their answers are fluent but not verifiable, and in spatial domains a claim about a tu...

Kamal Essam, Ryszard S. Romaniuk · 1 citation
Preprint Oct 2026

How Benchmark Graph Construction Shapes Multi-Hop KG Navigation: A Controlled Audit of PathQuestion and PathQuestion-Large

Multi-hop knowledge-graph question answering (KGQA) benchmarks are often treated as fixed language-and-reasoning tasks, but for navigation-based methods, difficulty also depends on the graph in which those tasks are instantiated. This makes graph construction a consequential but often entangled part of the navigation t...

Eduin E. Hernandez, Sergio A. Diaz, Luis F. García et al. · 0 citations
Open access Sep 2026

PoP-RAG: Holistic Query Planning for GraphRAG

PoP-RAG is proposed, which features a passage-on-edge (PoE) graph that links the passages with graph edges to resolve the one-to-many entity-passage mapping problem and enables targeted retrieval for each sub-query and ensures transparent response derivation logic, thus enhancing explainability.

Xin-Tong Hu, Qi-Ming Zeng, Yu-Hao Lin et al. · 1 citation
Open access Nov 2026

Graph reachability queries: A unified multi-metric framework with dynamic evaluation and practical guidelines

Reachability queries are a fundamental operation in large graph analysis, with applications in domains such as social networks, finance, program analysis, and XML query processing. Although many reachability indexes have been proposed, existing empirical studies remain limited in benchmark diversity, evaluation dimensi...

Huangleshuai He, Zheng-Yi Yang, Dong Wen et al. · 0 citations
Book Open access Nov 2026

Benchmarking Agentic Text-to-SPARQL for Multi-Hop Scholarly Knowledge Graph Exploration

Conversational access to scholarly knowledge graphs promises more intuitive ways of exploring research fields, but current approaches remain limited by two major barriers: the lack of realistic multi-hop benchmarks and the brittleness of Text-to-SPARQL methods over real-world schemas. We address these gaps by introduci...

Tim Gollub, Furqan Shuja, Benno Stein · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.