vLLM Delivers Day-0 Support for Kimi K3.1 Pro
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
vLLM has added day-0 support for Moonshot AI's Kimi K3.1 Pro, a 2.8T-parameter open-weight multimodal MoE model with a 1M-token context. The main change is DSA sparse attention in its 24 full-attention layers, which cuts the memory reads per decode step at long context to roughly a quarter of dense…