Researchers propose Mixture of Reused Experts (MoRE), a hybrid model architecture that combines the benefits of Mixture of Experts (MoE) and weight-sharing. MoRE shares expert pools across adjacent layers, improving efficiency and performance while maintaining competitive language modeling capabilities.