Day 0 support for Mistral Large 4 on vLLM
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
vLLM added day-0 support for Mistral Large 4, a 1T-parameter mixture-of-experts multimodal model with 49B active parameters per token, on NVIDIA and AMD MI350 GPUs. Its built-in DSpark drafter accepts about 2.9 tokens per step and roughly doubles TP8 output throughput. Decode context parallelism raises KV capacity about 8x at some decode-speed cost. NVFP4 tracks FP8 quality in the vendors' evals. These figures come from the vLLM and Mistral team's own benchmarks and were not independently verified.