Latent Lattice Language Models
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
The paper "Latent Lattice Language Models" by Shivam Duggal, Zongze Wu, William T. Freeman, Antonio Torralba, Richard Zhang, and Eli Shechtman (MIT and Adobe) proposes the Lattice of Latents, which adds per-layer horizontal latent streams that persist across tokens alongside the usual depth-wise residual stream.