D$^3$-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation

A new approach to multi-teacher distillation, called D^3-MOPD, dynamically adjusts the domain mixture during training to optimize student performance. This can lead to faster convergence and better results.

RSS Score 0 9/18/2026, 4:00:00 AM Original Source
Save an API key to vote.