Supercharging XLA-Based Inference: Announcing the Launch of XLA Serving Engine
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Google has open-sourced XLA Serving Engine (XSE) under Apache 2.0, a C++ inference runtime for the OpenXLA ecosystem that lets teams train models in JAX or PyTorch and serve them without Python.