FieldRT is presented, an algorithm-hardware co-design methodology that uses a common analysis of geometric sensitivity and data lifetime to derive both the deployment profile and its spatial realization, and translates the retained geometric structure into a parameterized streaming architecture that shares field access and storage across spatial operators.
Abstract
Geometric perception on edge must simultaneously achieve two goals that are rarely addressed together: preserve accurate spatial understanding for object localization and operate within stringent latency, memory, energy, and precision constraints. This coupling is particularly evident in oriented bird's-eye-view (BEV) detection, where global context, multi-scale interactions, and geometric fusion affect both prediction quality and hardware dataflow. Conventional deployment flows first compress a model using aggregate quality or complexity proxies and then map the compressed operations to a fixed accelerator interface. This separation risks removing geometric structures that appear redundant under coarse metrics but are critical for precise localization, while leaving hardware-level efficiencies in the retained geometry unexploited. We present FieldRT, an algorithm-hardware co-design methodology that uses a common analysis of geometric sensitivity and data lifetime to derive both the deployment profile and its spatial realization. We deploy FieldRT with Axis-Fusion Network (AFN), a sub-million-parameter oriented-BEV detector, and construct controlled profiles that vary the capacity and organization of its geometric processing. The experiments show that redundancy is task-dependent rather than uniform across metrics. Dense prediction can improve while real instance detection deteriorates; coarse localization may remain stable while strict-IoU precision degrades. Moreover, transformations that are individually safe can become detrimental when combined. FieldRT translates the retained geometric structure into a parameterized streaming architecture that shares field access and storage across spatial operators. The resulting custom-PL primitives achieve production-scale numerical closure on an AMD Kria KV260 and make otherwise infeasible multi-dilation execution realizable.
Resource-constrained robots and autonomous vehicles need scene memories that localize a camera and render nearby views without a desktop GPU. Scene-coordinate regression (SCR) and 3D Gaussian splatting (3DGS) fit because they avoid an SfM stage, but ACEsplat-style pipelines are GPU-centered, and moving them to an edge...
Hao-Hua Que, Ming-Kai Liu, Tian-Le Zhu et al.· 0 citations
Ray tracing (RT) is increasingly used in interactive graphics and edge rendering, but efficient deployment remains difficult because its two major phases, BVH construction and BVH traversal, have fundamentally different computation patterns, precision requirements, and architectural affinities. Existing designs largely...
Zhi-Yuan Zhang, Zhi-Hua Fan, Jing Xue et al.· ACM Transactions on Architec...· 0 citations
Modern autonomous driving systems rely on bird's-eye-view (BEV) perception models that fuse camera and LiDAR inputs to detect objects in 3D space. These models are accurate, but they cannot be deployed through standard inference runtimes. The reason is an operator mismatch between dense convolutions (which runtimes han...
GSPIM is presented, a temporal-locality-aware 4DGS accelerator for PIM-enabled edge devices that achieves a 4.15x geometric-mean speedup and a 4.99x geometric-mean energy-efficiency improvement over a fully optimized frame-by-frame GPU baseline.
Zi-Rui Ma, Zhi-Hua Fan, Hai-Bin Wu et al.· 0 citations
Depth estimation and Gaussian reconstruction share a need for multi-scale feature processing, yet use different prediction interfaces and training objectives. Whether a decoder's internal computation can be optimized once and reused across these systems remains a structural design question. Search over primitive config...
Field-programmable gate array (FPGA)-based acceleration for 3-D object detection has attracted significant attention due to its potential for high efficiency and low latency. However, existing fully sparse 3-D Transformer accelerators suffer from inefficient dataflows and limited parallelism, mainly caused by irregular...
Qiang Zhang, Xin-Yu Xu, Hussain A. Alzaher· IEEE Transactions on Very La...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.