The story’s score and claims

Comments on No. 34 of 62 · nikita-pavlichenko.com · edition of Sunday 15 November 2026

I Tried Every LLM Architecture Change Since 2020

Summary

A practitioner ran over 1,000 controlled experiments comparing LLM architecture changes from 2020 to 2026 on a shared setup, measuring quality in bits per byte and serving cost on a fixed GPU budget. Many individual changes were tested alone, then stacked to see whether gains survived.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules