Zyphra Releases ZAYA1-8B-Diffusion-Preview: The First MoE Diffusion Model Converted From an Autoregressive LLM With Up to 7.7x Speedup
By Asif Razzaq
Zyphra released ZAYA1-8B-Diffusion-Preview, the first Mixture-of-Experts diffusion model converted from an autoregressive LLM, achieving up to 7.7x inference speedup with no systematic loss in evaluation performance. This demonstrates a viable path to much faster LLM inference through diffusion-based decoding.