Almost isn't good enough: Introducing VybBench, our Design Fidelity Benchmark
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
VybBench is a new benchmark that measures how faithfully generative image models preserve a user's taste across edits, covering font fidelity (IoU against Google Fonts renderings), color fidelity (per-channel RGB error on requested hex codes), and edit fidelity (share of unintended pixels changed, plus an LLM check that the edit…