Spinf-serve – inference server for bulk scoring and decisions
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
spinf-serve is an Apache 2.0 inference server for bulk classification and decision scoring on a single 24 GB NVIDIA GPU, exposing an OpenAI-compatible API. It reads each piece of content once and answers many questions about it in one pass, returning calibrated probabilities over fixed options rather than generated text.…