It is suggested that synthetic AMT data should prioritize coverage of note-level attributes and their timbral realizations over realistic joint score structure because of an asymmetry between the two factors.
Abstract
Automatic music transcription (AMT) is limited by the scarcity of audio recordings paired with precise symbolic annotations. Synthetic data can provide supervision at scale, but it remains unclear whether effective transfer depends on realistic score structure or broad timbral coverage. We study these factors separately through an online sampler--renderer pipeline. A unified corruption sampler ranges from unmodified MIDI clips through partial corruption to deeply randomized note-event distributions. The renderer converts these events to audio while independently controlling instrument and timbral coverage. A fixed transcription model is trained jointly on offline recordings and newly rendered examples. Controlled ablations reveal an asymmetry between the two factors: moderate corruption of the note-event distribution does not impair transfer and can improve it, whereas broader renderer-side timbral support consistently improves out-of-domain generalization under a fixed note-event distribution. Finally, online-rendered examples complement real and existing synthetic data in a strong combined-data regime. These results suggest that synthetic AMT data should prioritize coverage of note-level attributes and their timbral realizations over realistic joint score structure.
Transcribing music into a human-readable score requires a coherent understanding of rhythm, harmony, melody, and form. Two obstacles limit this goal: annotated recordings are scarce, and accurate local predictions can still produce inconsistent musical sequences. We present SheetSage2, a unified music transcription fra...
Jun-Yan Jiang, Rui-Bin Yuan, Jia-Hao Pan et al.· 1 citation· ⚡1
This paper formulate polyphonic piano transcription as a frame-level multi-label classification problem across the standard 88 piano pitches, and proposes two architectural adaptations tailored to recurrent temporal representations: a modified additive attention module and a modified multihead attention mechanism equip...
Phu-Anh-Tai Do, Huu-Hoang Nguyen, Duc-Hoang Nguyen et al.· 0 citations
Piano transcription models have achieved very high performance in recent state-of-the-art systems, but their performance tends to degrade in ensemble settings where the piano is played alongside other instruments. While some approaches attempt to address this issue by incorporating multi-instrumental datasets, the prob...
This work examines representations generated by Wav2Vec2, HuBERT, and CLAP on FSD50K and CHiME-Home datasets and notes that all three models exhibit reconstruction residuals, revealing limits of additive compositionality such as nonlinear or non-compositional audio structure.
Music audio generation spans instrumental clips, full songs with vocals, edits of existing recordings, and systems that play alongside a musician in real time. This monograph explains the methods behind these systems for readers familiar with neural-network training who are new to music generation. It introduces neural...
M. Modrzejewski, Joanna Kurkowska, Dorien Herremans· 0 citations
Aligned audio, performance MIDI, and musical scores provide valuable supervision for music analysis and performance modeling, yet datasets that jointly align all three modalities remain scarce and limited in scale and genre diversity. We introduce Gangqinpu, a multi-genre piano dataset containing 18,786 score-performan...
Wei Zeng, Anvay Mathur, Ye Wang· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.