Training a 1T-Params MoE on EU public infrastructure
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Domyn, Fraunhofer IAIS and Fraunhofer IIS describe training a roughly 1-trillion-parameter Mixture-of-Experts model on Jupiter, a Hopper-based EuroHPC supercomputer built for scientific workloads, using only user-level access.