How RL Judge affects your models reasoning

This post tests whether an LLM judge that assigns per-span credit during reinforcement learning on math problems can make a model's reasoning more efficient, not just its final answers more correct. The author trains Qwen3.5-4B with GRPO under three conditions (outcome-only, and judge credit at two strengths).