We brought ViT-H coordination below a 16 GB memory budget
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A systems engineering write-up by Denis Voronko reports that coordinating a full ViT-H/14 fine-tuning run peaked at 9.6 GB of process RAM, down from 29.4 GB, on a shared MI300X test setup.