RepProbe: Can Video Language Models Count Repeated Actions? A Diagnostic Benchmark
RepProbe, a benchmark of 42K real and synthetic video clips containing exactly k in [1, 20] complete repetitions, finds a consistent representation-to-output dissociation: substantial count information remains linearly decodable even when models fail to report the correct count.