Kimi K3.1 Pro open weights (Hugging Face model card)
Mixture-of-experts: 2.8T total and 104B activated parameters, 93 layers, 896 experts with 16 selected per token, 1M-token context, 401M-parameter vision encoder; text and image input.
2.8T / 104Btotal and activated parameters of the mixture-of-experts model