The Intermodal Dual-MAE Framework with a Similarity-based RL Masking Strategy (SRLM) is proposed, which adaptively masks informative positions by leveraging cross-modal similarity and reinforcement learning, thus narrowing the modality gap.
Zhi-Xin Cheng, Jia-Cheng Deng, Xiao-Tian Yin et al.· IEEE transactions on multime...· 0 citations
A novel Acoustically Grounded Cost Learning (AGCL) framework is proposed to transform the static, audio-agnostic visual-text priors into dynamic, audio-grounded cost representations and significantly outperforms previous state-of-the-art approaches, particularly on unseen categories.
Tianrui Hui, Shao-Fei Huang, Qi-Song Han et al.· 0 citations
A novel self-supervised framework for relational reasoning over RDBs that treats context sparsity as a controllable curriculum variable and leverages it to induce a progressive shift from semantic-dominant inference to structure-aware relational reasoning.
Yujie Tian, Kun Zhang, Qiu-Yuan Li et al.· Proceedings of the 32nd ACM...· 0 citations
Relational databases (RDBs) play an essential role in real-world scenarios, such as e-commerce, social media, and industry. Recently, with the rapid development of Large Language Models (LLMs), using LLMs to exploit RDBs has become a significant trend. Plenty of works have been proposed to use natural language to descr...
Yujie Tian, Kun Zhang, Qiuyuan Li et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.