Ilya Olkov

Finetuning Vision-Language Models for Grid-Based Navigation

We present a method for teaching vision-language models (VLMs) to perform spatial navigation in grid-based environments using structured supervision derived from distance fields. Our approach combines binary space partitioning for maze generation, Dijkstra-based distance field computation, and A* pathfinding to create...