Moonshot AI releases Kimi K3 — a 2.8T open-weights MoE model with million-token context
Kimi K3 is a 2.8T-parameter open-weights MoE model built on Kimi Delta Attention and Attention Residuals, with 1M-token context and native vision. Weights to follow by July 27.