Gaze-to-text Generation: Beyond Categorical Decoding of Human Attention
G Gazette, the first gaze-to-text decoding framework, is introduced, based on multimodal large language models (MLLMs), which learns to decode gaze scanpaths into natural language for goals that may extend beyond categorical labels and require articulation in natural language.