PreSO: Privileged Representation Isolation for On-Policy Self-Distillation

A research paper proposes a method called Privileged Representation Isolation for On-Policy Self-Distillation (PreSO) to improve reinforcement learning with verifiable rewards. PreSO uses compact hints to limit solution-specific detail and estimates a leading low-rank subspace from pooled problem shifts to improve representation-level distillation.

RSS Score 0 10/15/2026, 4:00:00 AM Original Source
Save an API key to vote.