Dossier
Mixture of Experts
Coverage of Mixture of Experts in the Nexus archive.
- LongCat-2.0, a large-scale MoE model with 1.6T total and 48B Active
LongCat-2.0 is a large-scale Mixture of Experts (MoE) model with 1.6 trillion total parameters and 48 billion active parameters. The article provides links to the model's blog and Hacker News discussion thread.
- Granite 4.1: IBM's 8B Model Matching 32B MoE
IBM has open-sourced its Granite 4.1 model, an 8B parameter model that matches the performance of a 32B Mixture of Experts (MoE) model. The release highlights IBM's advancements in efficient AI model development.