Skip to content
#small language model Open access

Vision Without Surveillance

Oct 2026 · Street Art & Urban Creativity · Vol 12, pp. 691-708 · 0 citations
Urban Design and Spatial Analysis

TL;DR

A scalable, privacy-preserving vision-language model (VLM) pipeline is developed that leverages zero-shot CLIP to extract 150+ interpretable urban design features from street-level imagery and enables scalable, evidence-based urban planning across cities.

Abstract

Municipalities need current, granular built-environment data to support effective planning. However, current collection methods are expensive, challenging to scale, and present privacy concerns. To address this gap, the authors collaborated with the U.S. Department of Transportation (USDOT) through a Small Business Innovation Research (SBIR) initiative. We developed a scalable, privacy-preserving vision-language model (VLM) pipeline that leverages zero-shot CLIP to extract 150+ interpretable urban design features from street-level imagery. Applied to Philadelphia’s bus network, the pipeline processed over two million images and generated block-level predictions for more than 8,000 blocks. This approach enables scalable, evidence-based urban planning across cities.

Read PDF

Similar papers

2026

Map Construction With Multiobservation on Geographic Perspective

Online vectorized map construction is essential for autonomous driving, yet camera-based approaches suffer significant performance degradation under adverse conditions due to limited sensing range and perspective constraints. We propose MapGeoTR, a multisource fusion framework that augments onboard perception with sate...

Man Luo, Yang Chen, Bao-Ding Zhou et al. · 0 citations
Conference Sep 2026

Improving UAV Assisted Spatial Monitoring with Semiautomated Fine Tuning of Vision Language Models

Detecting low-metal anti-personnel mines (e.g., PFM-1) challenges traditional clearance methods, while standard UAV computer vision often generates high falsepositive rates in cluttered environments. To address this, we propose a multilevel edge-ground-cloud architecture that escalates ambiguous ground-station detectio...

S. Robotko, O. Gerasin, Andrei Lesko et al. · 0 citations
Review Open access Sep 2026

End-to-End Pothole Detection and Semantic 3D City Model Enrichment Using LoRA-Adapted Foundation Models and Open Street-Level Imagery

Regular road inspection is essential for maintaining pavement service life and ensuring traffic safety. Conventional approaches require specialized survey vehicles and sensor payloads, while damage assessment relies predominantly on supervised computer vision models trained on large annotated datasets. Recent advances...

B. Ouzougarh, Jannik Matijevic, Huynh Duc An Son Nguyen et al. · 0 citations
#artificial intelligence Review Aug 2026

Polis: 3D Self-Supervision at City Scale

The results show that distributionally-regularized joint embedding architectures can be successful on challenging city-scale 3D scenes, and that transfer improves when self-supervision is designed for the capture geometry and spatial context of this domain while also revealing the limits of this specialization.

A. Rusnak, S. Kovalenko, Jingru Wang et al. · 0 citations
Open access Aug 2026

SVI2LoD3: Agent-Driven Reconstruction of LoD3 Façade Openings in Semantic 3D City Models from Volunteered Street View Imagery using Large Language and Visual Models

An end-to-end, agent-driven pipeline for the LoD3 reconstruction of façade openings in 3D city models, producing directly usable CityGML-conform outputs and a novel evaluation metric for façade reconstruction, termed Facade Feature Distance.

Elmehdi Kanna, Lukas Arzoumanidis, Huynh Duc An Son Nguyen et al. · 1 citation
Preprint Oct 2026

NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation

Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe, independent mobility for blind and low-vision (BLV) users. Yet these categories are underrepresented in existing large-s...

Hochul Hwang, Jahir Sadik Monon, Soowan Yang et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.