Branching On-Policy Distillation

Researchers propose Branching On-Policy Distillation, an improvement to on-policy distillation for AI agents. It selects informative decision points and applies teacher supervision to both main trajectories and branches, reducing student-generated token costs by 19-31%. The approach outperforms existing methods across various benchmarks.

RSS Score 0 10/12/2026, 4:00:00 AM Original Source
Save an API key to vote.