An inference server for AMD GPUs, in C++ and HIP
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Radiance, published on Codeberg by StillDeadcode, is a C++ and HIP inference server for AMD GPUs. It serves language, image, video, speech and music models behind OpenAI-, Anthropic- and llama-server-compatible APIs, with architectures and kernels loaded as plugins. Bundled kernels target RDNA4 cards. The README gives throughput figures, such as 166 tok/s for GLM-5.3-Flash on eight Radeon AI PRO R9700s, but they come from the author's own runs without independent sources, and four-rank speed against two ranks is stated as unmeasured.