Ceiling of a Task: When Can a Transformer Succeed Without Its Chain of Thought?
The ceiling of a task therefore answers when a transformer can succeed without its chain of thought, and the best accuracy that a shallow circuit can reach on a task the ceiling of the task, and a task is serial if its ceiling lies below one.
Jia-Shu He, Jin-Xuan Fan, Xiao Xiao et al.
· 0 citations