A Transformer-Derived Iterative Preconditioner
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Researchers Haris, Gangrade, Saligrama, and colleagues at Boston University report that a transformer trained on in-context linear systems implicitly improves the conditioning of the Gram matrix XX^T, and they extract this mechanism into RAPID, a standalone anytime preconditioner for symmetric positive definite systems.