Skip to content

X2-NativeCursor: Native-Token Text Progress Tracking for Incremental-Text Streaming Codec TTS

Sep 2026 · 0 citations · 21 references
Computer Science

TL;DR

X2-NativeCursor is proposed, a lightweight observer that tracks progress from native speech tokens before waveform decoding without changing the TTS generator, and its normalization plan links spoken labels to their original-text spans.

Abstract

Incremental-text streaming text-to-speech (TTS) needs online text progress tracking for synchronized highlighting, interruption handling, and dialogue-history updates. Input text arrives before it is spoken, so text arrival alone cannot indicate speech progress. Existing waveform-based alignment requires complete audio or adds acoustic processing during streaming. We propose X2-NativeCursor, a lightweight observer that tracks progress from native speech tokens before waveform decoding without changing the TTS generator. Its normalization plan links spoken labels to their original-text spans. Text and native-token encoders feed a local matcher that estimates the current label position. A separate output rule converts revisable position estimates into a cursor that never moves backward. Mean absolute error against an automatic reference is 0.151 Chinese characters with 80-ms lookahead, versus 1.253 characters with 320-ms lookahead for an online waveform baseline. Alignment real-time factor also decreases from 0.3598 to 0.0180 relative to this baseline. Lower tracking error is retained under a second automatic alignment reference. We evaluate X2-NativeCursor on Qwen3-TTS and validate its adaptation to CosyVoice2 by training a separate observer for each backbone. Code is publicly available at https://github.com/X-Square-Robot/X2Streaming-TTS.

View source

Similar papers

Preprint Sep 2026

StreamTN: A Low-Latency Streaming Chinese Text Normalization Model for Streaming TTS in Dialogue Systems

StreamTN is proposed, a lightweight LLM-based Chinese streaming TN model that employs a dual-track streaming framework in which input tokens and output tokens are processed on two parallel tracks, enabling low-latency real-time inference without complex prompting.

Wen-Hao Li, Jin-Rui Liang, Hao-Yu Zhang et al. · 0 citations
#natural language process... Preprint Sep 2026

StreamAlign: Streaming Text-Aligned Speech Tokenization

StreamAlign performs online speech-text alignment by combining character-level RNN-Transducer alignment with word-level ASR guidance, mitigating ASR-LLM vocabulary mismatch while preserving recognition accuracy, and achieves the lowest WER and highest UTMOS among evaluated tokenizers.

Kang-wook Kim, Jinyoung Park, Jinsoo Kim et al. · 0 citations
#natural language process... Preprint Sep 2026

Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis, which delivers a step-change improvement over the latest internal dubbing system with large gains in prosody similarity, voice similarity, naturalness, and shareability.

Sanyuan Chen, Min-Jae Hwang, Sho Inoue et al. · 0 citations
#machine learning Preprint Sep 2026

FuseAlign: Forced Alignment in the Wild

FuseAlign, a transformer-based aligner trained on large-scale pseudo-labeled speech with online label correction, is introduced, a transformer-based aligner trained on large-scale pseudo-labeled speech with online label correction that substantially outperforms all baselines and remains robust under real ASR transcript...

Mithilesh Vaidya, Stephen W. Bailey, Sumukh Badam et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.