Chuan-Jun Song

Real-time quantized BEV-LLM autonomous driving under varying traffic densities

Closed-loop autonomous driving at 10 Hz leaves approximately 100 ms for perception and control inference, making fullprecision 7B large language models unsuitable for deployment. This paper evaluates whether GPTQ 4-bit quantization and paged inference can reduce decision latency enough for BEV-to-text driving control a...