Proving and Improving the Platonic Representation Hypothesis with JEPAs
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
This paper argues that the Platonic Representation Hypothesis, the observation that separately trained vision and language models converge to similar representations, can be proven for Joint-Embedding Predictive Architectures.