DeepSeek-V4.1-Flash on Vera Rubin NVL72: 58x Throughput vs. GB300 NVL72 at 387 tokens/s
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A vLLM blog post reports that on one NVIDIA Vera Rubin NVL72 rack, DeepSeek-V4.1-Flash serves 1.7M tokens/s per GPU with 387 tokens/s per user, about 58 times GB300 NVL72 per-user throughput, and 1,810 tokens/s for a single user.