This work designs a dual-backbone feature extraction architecture for food nutrition estimation, and introduces the Adaptive Spatial Feature Fusion (ASFF), which fuse ingredient semantic features with visual features through Softmax weighted interaction to enhance feature fusion.
This paper studies the problem of text-video retrieval, where the goal is to learn accurate cross-modal alignment between videos and text. This problem is challenging because of the matching ambiguity caused by the inherent gap between the heterogeneous video and text modalities. In particular, the differences in the i...
Dong-Lin Zhang, Zheng-Hao Rao, Xing Xu et al.· IEEE Transactions on Image P...· 0 citations
Convolution Transformer Integration Network (CTNet) is proposed, a hybrid architecture that couples a residual CNN branch for local detail mining with a Transformer branch for global dependency modeling and achieves effectiveness in food recognition.