Le Li

Gesture-aware adaptive interface design using vision-language models for enhanced human–computer interaction

GAUID (Gesture-Aware UI Design), a novel framework that leverages vision-language models to jointly understand hand gestures, voice commands, and interaction context for adaptive interface generation, is proposed.