Tencent releases weights of Hy4 Flash (220B size)
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Tencent has released open weights for Hy4 Flash, a 220B-parameter mixture-of-experts model with 12B active parameters per token, a 1M-token context window, and text-plus-image input, along with an FP8 variant and a base model. Its architecture combines hybrid sparse and sliding-window attention, LatentMoE routing, and n-gram embeddings.