TimeHome: Heterogeneous Mixture-of-Experts for Time-Series Foundation Model
TimeHome is a universal sparse transformer basic model for handling heterogeneous time series that incorporates a Heterogeneous Mixture-of-Experts (H-MoE) component, where different expert types are chosen dynamically based on a low-rank temperature-controlled gating mechanism to fit various sequence features.