Skip to content

Building and Evaluating Fixed-Voice Thai TTS from Synthetic Speech

Sep 2026 · 1 citation · 21 references
Computer Science

TL;DR

The resulting 82M-parameter model, Wayu-Paxa-TTS-Edge, enables on-device Thai TTS without reference audio and achieves the lowest pause-placement error and intra-word pause rates among the three systems.

Abstract

In low-resource settings, deploying TTS typically requires choosing between a large voice-cloning model with costly inference or a compact fixed-voice system that requires a speaker-specific corpus. We study a third route: using a large voice-cloning model as a programmable data source to turn a short voice reference (e.g., 15 seconds) into a compact fixed-voice student trained entirely on synthetic speech. This setting makes pipeline design consequential: teacher errors become training targets, while filtering failed generations can reduce coverage of difficult texts. Thai further introduces challenges from ambiguous word boundaries, lexical tone, names and loanwords, numeric verbalization, and Thai-English code-switching. We study how text preparation, synthetic generation, quality filtering, rejection sampling, and frontend choices affect the resulting student, and where teacher limitations remain. We evaluate CER, Challenge-Set Keyword Accuracy, Prosody Pause Accuracy, speaker similarity, and speaking rate. The resulting 82M-parameter model, Wayu-Paxa-TTS-Edge, enables on-device Thai TTS without reference audio. It achieves 68.2% Challenge-Set Keyword Accuracy (85.5% of Gemini 3.1) and 91.4% pause precision, outperforming its OmniVoice teacher (89.9%) and reaching 94.8% of Gemini 3.1. It also achieves the lowest pause-placement error and intra-word pause rates among the three systems, and 3.7% and 1.1% CER on Thai and English, respectively. We open-source the model and evaluation framework for Thai TTS development.

View source

Similar papers

#machine learning Preprint Sep 2026

Deterministic Prompting for Speaker-Stable Low-Resource Greek TTS

A data curation recipe that transforms audiobook recordings into TTS-ready data via WhisperX alignment and filtering is proposed, and Parler-TTS (880M), a prompt-based multilingual model whose pre-training encodes phonetic priors transferable to Greek is fine-tune.

Georgios Syllas, Efthymios Georgiou, Kosmas Kritsis et al. · 0 citations
Preprint Sep 2026

Cross-Lingual F5-TTS 2: A Simplified Framework for Language-Agnostic Voice Cloning

Zero-shot text-to-speech (TTS) can clone a speaker's voice from a short audio prompt, yet most TTS systems still require the audio prompt transcript during inference. This dependency prevents cross-lingual voice cloning when the audio prompt transcript is unavailable, particularly for unseen languages. Cross-Lingual F5...

Qingyun Liu, Rixi Xu, Yu-Shen Chen et al. · 0 citations
Preprint Aug 2026

Phoneme-guided TTS augmentation for ASR: A unified pipeline and multilingual evaluation

A phoneme-guided text-to-speech augmentation pipeline for ASR that connects multilingual speech generation with candidate-text selection and reference-speech quality control, and proposes phoneme-frequency-guided selection (PFGS), which uses phoneme frequencies from real ASR training transcripts to prioritize candidate...

Zhen Wang, Tian-Rui Wu, Rong-Qi Han et al. · 0 citations
Preprint Sep 2026

Taming Long-form Text-to-Speech

Localized Attention-Constrained Inference (LACI), an inference-only method to detect TTS errors in near real-time, roll back to the error onset and regenerate with temporary guardrails, adding negligible computational overhead to demonstrate the efficacy of LACI on voice cloning reliability.

Rong-Xiang Wang, Berkin Durmus, Aysegul Orhon et al. · 0 citations
#natural language process... Preprint Sep 2026

mu-bench: A Multilingual Utterance Transcription Benchmark

Voice agents depend on accurate automatic speech recognition (ASR) to act on what callers say, yet ASR is evaluated on read, English-centric speech with word error rate (WER), which penalizes surface rather than semantic differences. We introduce mu-bench, a dataset of 4,270 caller utterances from 250 phone calls to an...

Andrea Li, Soham Ray · 0 citations

Language Interpreter: Evaluating Speech Recognition Errors in Speech to Text Translation

This study presents a reproducible synthetic benchmark for evaluating error propagation in a speech-to-text pipeline that links acoustic condition, transcription-error type, deterministic normalization, phrase-aware mapping, sentence correctness, and semantic preservation on the same records.

U. A. D. Priyanka D. Vaidya · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.