DA-Lion: Efficient Neural Video Representation via Direction-Aware Optimization
Direction-Aware Lion (DA-Lion), a task-driven optimizer tailored for NVR, introduces a direction-consistency criterion that switches between sign update and momentum update based on gradient--momentum alignment, and a learning-rate-aware magnitude modulation that stabilizes effective step sizes across training phases.