Writing GPU kernels in Rust: how I made speakrs 60× faster than pyannote
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
speakrs, an open-source Rust speaker diarization library, replaced its ONNX Runtime dependency with its own GPU kernels written in Rust via cuda-oxide, and can now build with only the NVIDIA driver.