large language models

1 article

← All topics

Moonshot AI Kimi K3: 2.8T open-weights MoE model

moonshot-aikimikimi-k3open-weightsmoe+3+4

Kimi K3 is a 2.8T-parameter open-weights MoE model built on Kimi Delta Attention and Attention Residuals, with 1M-token context and native vision. Weights to follow by July 27.