Zhiyong Wu

LoSATok: Low-dimensional Semantic-Acoustic Tokenizer for Cross-Domain Audio Understanding and Generation

A Semantic Bottleneck that compresses 1280-dimensional semantic encoder features into 128 dimensions, regularized by the proposed time-relation loss for temporal feature consistency is introduced and a dual-level semantic supervision method is designed that leverages both high- and low-dimensional semantic signals, ena...