Blackwell Brings NUMA Back, Inside One GPU
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Blackwell B200 and B300 GPUs are physically two dies joined by NV-HBI, so memory on one die is faster to reach from its own SMs than from the other.