Multi-Token Prediction Done Right

The paper introduces Soft-MTP, a one-line change to multi-token prediction training that removes a noisy residual from the cross-entropy gradient and keeps only the KL self-distillation signal pulling MTP heads toward the model's next-token distribution. Using a "KL gradient-recovery" trick with straight-through routing, it avoids materializing vocabulary-sized logits.