llama.cpp v1.0
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
llama.cpp and ggml both reached v1.0.0, and the maintainers say API and ABI breaks will now be signaled with major-version bumps. The release removes 35 deprecated functions from llama.h, moves the NextN/speculative API into it, and adds FP8 KV caches, a host-memory MoE expert cache, new model architectures, a /v1/audio/speech endpoint and llama-server security fixes (SSRF, CORS, DNS rebinding). Downstream builders should check for removed calls before upgrading. The details come from the project's release notes; the claims were not independently verified.