Learn Your Own Thoughts: Abstract Token Curriculum
Researchers propose Abstract Token Curriculum (ATC), a novel curriculum learning framework for training large language models (LLMs) to develop internal abstract thoughts without direct supervision or manual scratchpad design. ATC increases problem complexity through a sequence of distributions, enabling LLMs to learn continuous intermediate representations effectively.
Save an API key to vote.