Material replacement is a common interior-design operation: changing the material of a selected surface while preserving its geometry, surroundings, and illumination. Despite its commercial relevance, no public benchmark isolates this task, and evaluating it is challenging. Reference-based metrics penalize valid output...
Ming-Zhe Du, T. Nguyen, Nguyen Tran Cong Duy et al.· 0 citations
STRAND is introduced, a benchmark of human-verified object-centric facts that evaluates intermediate reasoning by decomposing queries into sub-questions, distinguishing genuine temporal understanding from coincidental correctness and an object-centric framework that explicitly constructs and reasons over structured obj...
T. Nguyen, C. Trinh, Khoi M. Le et al.· 0 citations
DynaPix (Dynamic Pixels), a benchmark that makes prediction checkable, exposes a temporal-anchoring gap: models attach a prediction to an event far better than to time itself.
T. Nguyen, Vinh-Hien Do, Quynh T. N. Vo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.