The story’s score and claims

Comments on No. 67 of 137 · vLLM Blog · edition of Friday 13 November 2026

DeepSeek-V4.1-Flash on Vera Rubin NVL72: 58x Throughput vs. GB300 NVL72 at 387 tokens/s

Summary

A vLLM blog post reports that on one NVIDIA Vera Rubin NVL72 rack, DeepSeek-V4.1-Flash serves 1.7M tokens/s per GPU with 387 tokens/s per user, about 58 times GB300 NVL72 per-user throughput, and 1,810 tokens/s for a single user.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules