Semantic-Enhanced Sparse Temporal Modeling for Dynamic Engagement Estimation in Multimodal Interactions
The proposed SEST is a Semantically-Enhanced Sparse Temporal framework that models engagement-related information from both semantic and temporal perspectives, and leverages Multimodal Large Language Models to extract multimodal semantic embeddings, providing dialogue-aware contextual information beyond conventional fr...