Beyond Fresh Starts: Stateful Inference for Streaming ASR in Conversational Voice Agents
Modern voice-agent systems rely on streaming speech recognition models that operate under stringent latency constraints. This study shows that, due to the limited memory constraints of real-time processing, these systems are adversely impacted by conversational phenomena such as long silences and backchannels. While ma...