As hybrid models (Qwen 3.5 / Nemotron Ultra) run agents with massive context, Gated-DeltaNet / Mamba...
By @tri_dao
Tri Dao shares a technical insight on speeding up hybrid SSM models (Qwen 3.5, Nemotron Ultra) by recomputing rather than storing Gated-DeltaNet/Mamba states, unlocking speculative decoding for state-space models at roughly 2x speed.