D$^3$-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
A new approach to multi-teacher distillation, called D^3-MOPD, dynamically adjusts the domain mixture during training to optimize student performance. This can lead to faster convergence and better results.
Save an API key to vote.