Aug 2026· arXiv.org· Vol abs/2608.04072· 0 citations· 16 references
Computer Science
TL;DR
It is demonstrated that deep learning can reliably recognize sound order in overlapping conditions, supporting practical HRI scenarios and providing an extended discussion on generalization, ecological validity, and deployment challenges in real-room environments.
Abstract
Recognizing the temporal order of overlapping sounds is an underexplored challenge in human-robot interaction (HRI), with direct relevance to applications such as first responder detection systems. This paper presents a deep learning framework for real-time sound order recognition using recordable buzzers that emit distinct non-verbal sounds (cat meows, dog barks, helicopter noises). A multi-branch convolutional neural network (CNN) processes Mel spectrograms, Mel-frequency cepstral coefficients (MFCCs), and short-time Fourier transform (STFT) features, with an attention-based fusion mechanism to emphasize critical temporal cues. Experiments were conducted under same-amplitude, varied-amplitude, and unseen sound conditions. The proposed system achieved 99% accuracy in balanced overlaps, 91% under amplitude variation, and 74% on unseen test data with normalization. These results demonstrate that deep learning can reliably recognize sound order in overlapping conditions, supporting practical HRI scenarios. While experiments were conducted on carefully controlled synthetic overlaps, we additionally report latency benchmarks demonstrating real-time feasibility and provide an extended discussion on generalization, ecological validity, and deployment challenges in real-room environments.
Voice-controlled interaction in industrial settings is hampered by acoustic noise, which severely degrades audio-only speech recognition. Audio-visual speech recognition (AVSR) addresses this by fusing lip-motion cues with the audio stream, but state-of-the-art pipelines rely on three-dimensional convolutions, recurren...
Traditional convolutional neural networks (CNNs) for underwater acoustic target recognition (UATR) are limited by restricted local receptive fields, and reliance on frequency-domain inputs alone can discard temporal information present in the raw waveform. This study proposes TFMSUATR, a model that fuses a raw-waveform...
Gang Hu, Yi-Fei Song, Mohamad Farhan Mohamad Mohsin· International Journal of Adv...· 0 citations
It has long been recognized that the accurate classification of audio signals is a major challenge in the field of speech and signal processing research. Applications range from speaker recognition, speech emotion detection, and environmental sound categorization. This is especially challenging due to the dynamic natur...
Jayapadmini Kanchan, K. S. Pradyuthi, C. V. Swaraj et al.· International Conference on...· 0 citations
This paper presents a multitask learning framework for the simultaneous recognition of piano playing dynamics and articulation from audio recordings. The proposed system integrates advanced audio feature extraction methods, including mel-frequency cepstral coefficients and constant-Q transforms, with precise onset and...
Si-Yuan He, Si-Xian He, Xin Gao· The International Conference...· 0 citations
Musical-instrument recognition is a fundamental music information retrieval (MIR) task supporting transcription, source separation, and audio understanding. Despite significant algorithmic progress, there is still room for improvement in recognizing acoustically similar instruments, particularly in polyphonic mixtures....
This paper presents a supervised attention-based deep learning approach for separating single-channel audio signals that establishes a low complexity, scalable, and interpretable solution to realistic problems in source separation.