ZAYA1-8B: An 8B Moe Model with 760M Active Params Matching DeepSeek-R1 on Math

ZAYA1-8B is an open-source math coding model with 760M active parameters, matching DeepSeek-R1's performance. The model has been released and is available for use. It achieved this on mathematical tasks.