JAX single controller used to train Gemini is now GA on GCP
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Google's developer blog announces general availability of Pathways on Google Cloud Platform, the distributed system Google uses to train Gemini. Pathways uses a single Python client that describes the whole computation as a graph, while a distributed runtime places it, moves tensors, and keeps accelerators busy.