On the Limits of Self-Improving in LLMs and Why AGI, ASI and the Singularity Are Not Near Without Symbolic Model Synthesis
By Hector Zenil
Formalizes recursive LLM self-training as discrete-time dynamical system, proving inevitable degenerative dynamics as training data becomes self-generated. Identifies two failure modes: entropy decay (mode collapse) and variance amplification (truth drift).