Jindu Wang

RegulAR: Graph-Grounded Error Recognition and Assistance for Procedural Tasks in AR

RegulAR models task instructions as a hierarchical dependency graph and combines this structure with a Multimodal Large Language Model (MLLM) to interpret egocentric observations during execution and enables RegulAR to track progress, identify deviations by error type, estimate their impact on later steps, and deliver...