Past, Future, All at Once: Mitigating Stability-Plasticity Dilemma via Post-hoc JANUS Rectification
Researchers propose a post-hoc weight rectification framework, JANUS, to mitigate catastrophic forgetting in fine-tuning foundation models. JANUS achieves Parameter Space Orthogonality and preserves historical performance by projecting updates into the Jacobian Null Space.
Save an API key to vote.