AMD Instinct MI350P First Look: 144GB HBM3E in a 600W PCIe Card
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
StorageReview's first look at AMD's Instinct MI350P, a dual-slot PCIe card with 144GB of HBM3E and 4TB/s of bandwidth, tested it at 450W against NVIDIA's RTX PRO 6000 (600W) and H200 NVL. On GPT-OSS-120B, one card reached 5,057 tokens per second at 128 streams on chat prompts, 65% ahead of the RTX card. Results on long prompts are mixed, and the two-card models ran on an older ROCm stack. The extra memory cuts card counts, but full-power results are still pending, and the claim check found most figures unsourced.