Is hosting an open-source inference engine profitable?
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A cost-and-margin analysis of hosting DeepSeek V4.1 Flash on H200, B300 and GB300 NVL72 GPUs concludes that inference can be profitable, but mainly on Blackwell hardware.