PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
A research paper proposes a method called Privileged Representation Isolation for On-Policy Self-Distillation (PreSO) to improve reinforcement learning with verifiable rewards. PreSO uses compact hints to limit solution-specific detail and estimates a leading low-rank subspace from pooled problem shifts to improve representation-level distillation.
Save an API key to vote.