vLLM v0.21.0 is out! 367 commits from 202 contributors (49 new). 🎉 Highlights: KV Offload + HMA, sp...
By @vllm_project
vLLM v0.21.0 official release announcement - 367 commits from 202 contributors, highlighting KV Offload + HMA, spec decode with thinking budget, TOKENSPEED_MLA on Blackwell, DeepSeek V4 pipeline parallelism