Right Direction, Wrong Step: Geometric Analysis of Finite-Step Failure in Looped Transformers
Researchers analyzed Looped Transformers, a parameter-efficient approach for test-time scaling, and found finite-step failures where locally improving updates can become harmful due to mismatch between direction and step scale.
Save an API key to vote.