Warmctl – Fast cold starts for vLLM inference
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
warmctl is an open-source beta that checkpoints a warmed-up vLLM engine, including its processes, GPU state and weights, and restores it on a matching host. The project reports GLM-5.3-Flash on 8×H100 coming up in 37 seconds versus a 650-second vLLM cold start.