AI Is Getting Better. Running It Yourself Is Getting Harder

Open-weight AI models are growing in total size, so they can become cheaper to compute per token while becoming harder to host. Large mixture-of-experts models like DeepSeek-V3 and Llama 4 Maverick need all their weights available even though only a fraction is active per token.