Jeng-Lin Li

TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection

Existing multimodal video highlight detectors typically assume that visual, audio, and textual streams are continuously available. In practice, however, inputs may suffer from localized frame missingness or complete-stream outage. We formulate this robustness challenge along two dimensions: temporal missingness, where...