I Tried Every LLM Architecture Change Since 2020
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A practitioner ran over 1,000 controlled experiments comparing LLM architecture changes from 2020 to 2026 on a shared setup, measuring quality in bits per byte and serving cost on a fixed GPU budget. Many individual changes were tested alone, then stacked to see whether gains survived.