NVIDIA AI Releases Nemotron 3 Ultra: An Open 550B Mixture-of-Experts Hybrid Mamba-Transformer for Long-Running Agents
By Asif Razzaq
Following yesterday's News roundup, here's a deeper look at Nemotron 3 Ultra, Nvidia released Nemotron 3 Ultra, an open 550B-parameter Mixture-of-Experts model with 55B active parameters using a hybrid Mamba-Attention architecture for long-running agents. It targets keeping accuracy high while cutting inference cost and latency.