Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size
By Matthias Bastian
Tencent released Hy3, an open-source 295 billion parameter mixture-of-experts model with only 21 billion active parameters, claiming it matches models two to five times larger. Tencent also reports halving the hallucination rate to about 5.4 percent.