Category intelligence

Research Briefing — April 10, 2026

672 current items analyzed and ranked.

Executive synthesis

Research Summary

Analysis complete. Top items selected by score.

Key Themes

AI Safety & Alignment · 30AI Safety & Security · 17Reasoning & Chain-of-Thought · 6Language Models & Reasoning · 8Language Model Reasoning · 10Mechanistic Interpretability · 12LLM Training Methodology · 3Open Source AI Ecosystem · 1Novel Architectures & Paradigms · 3Privacy & Security · 5

Primary evidence

Top Ranked Signals

Research arXiv (Machine Learning) Apr 10

RAGEN-2: Reasoning Collapse in Agentic RL

By Zihan Wang, Chi Gui, Xing Jin, Qineng Wang, Licheng Liu, Kangrui Wang, Shiqi Chen, Linjie Li, Zhengyuan Yang, Pingyue Zhang, Yiping Lu, Jiajun Wu, Li Fei-Fei, Lijuan Wang, Yejin Choi, Manling Li

82 score
AI Analysis

As reported in Research yesterday, RAGEN-2 identifies 'template collapse' in multi-turn RL training of LLM agents, where models produce input-agnostic responses that appear diverse by entropy metrics but fail to adapt to different inputs. They decompose reasoning quality into within-input diversity (entropy) and cross-input distinguishability (mutual information) and propose MI-based proxies for online monitoring. This addresses a critical blind spot in current agentic RL training diagnostics.

arXiv:2604.06268v1 Announce Type: new Abstract: RL training of multi-turn LLM agents is inherently unstable, and reasoning quality directly determines task performance. Entropy is widely used to track reasoning stability. However, entropy only measures diversity within the same input, and cannot tell whether reasoning actually responds to different inputs. In RAGEN-2, we find that even with stable entropy, models can rely on fixed templates that look diverse but are input-agnostic. We call this
Agentic AIReinforcement LearningLLM TrainingAI Safety
Research arXiv (Computation and Language) Apr 10

Emotion Concepts and their Function in a Large Language Model

By Nicholas Sofroniew, Isaac Kauvar, William Saunders, Runjin Chen, Tom Henighan, Sasha Hydrie, Craig Citro, Adam Pearce, Julius Tarng, Wes Gurnee, Joshua Batson, Sam Zimmerman, Kelley Rivoire, Kyle Fish, Chris Olah, Jack Lindsey

82 score
AI Analysis

Investigates emotion concept representations in Claude Sonnet 4.5, finding internal representations that track operative emotions and causally influence outputs including preferences and misaligned behaviors. From Anthropic's interpretability team.

arXiv:2604.07729v1 Announce Type: cross Abstract: Large language models (LLMs) sometimes appear to exhibit emotional reactions. We investigate why this is the case in Claude Sonnet 4.5 and explore implications for alignment-relevant behavior. We find internal representations of emotion concepts, which encode the broad concept of a particular emotion and generalize across contexts and behaviors it might be linked to. These representations track the operative emotion concept at a given token posi
Mechanistic InterpretabilityAI SafetyAlignmentEmotionAnthropic
Research arXiv (Artificial Intelligence) Apr 10

Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability

By Qihan Ren, Peng Wang, Ruikun Cai, Shuai Shao, Dadi Guo, Yuejin Xie, Yafu Li, Quanshi Zhang, Xia Hu, Jing Shao, Dongrui Liu

78 score
AI Analysis

Challenges the claim that SFT memorizes while RL generalizes for reasoning tasks. Shows cross-domain generalization in reasoning SFT is conditional on optimization dynamics, data quality, and base model capability, identifying a 'dip-and-recovery' pattern where short training appears to underestimate generalization.

arXiv:2604.06628v1 Announce Type: new Abstract: A prevailing narrative in LLM post-training holds that supervised finetuning (SFT) memorizes while reinforcement learning (RL) generalizes. We revisit this claim for reasoning SFT with long chain-of-thought (CoT) supervision and find that cross-domain generalization is not absent but conditional, jointly shaped by optimization dynamics, training data, and base-model capability. Some reported failures are under-optimization artifacts: cross-domain
Language ModelsReasoningTraining MethodologyReinforcement Learning
Research arXiv (Artificial Intelligence) Apr 10

The Depth Ceiling: On the Limits of Large Language Models in Discovering Latent Planning

By Yi Xu, Philipp Jettkant, Laura Ruis

78 score
AI Analysis

As reported in Research yesterday, Studies limits of latent reasoning in LLMs using graph path-finding tasks, finding that models hit a 'depth ceiling' where latent planning steps max out (3 for small transformers, 5 for GPT-4o, 7 for GPT-5.4). This has implications for chain-of-thought monitoring as a safety measure.

arXiv:2604.06427v1 Announce Type: cross Abstract: The viability of chain-of-thought (CoT) monitoring hinges on models being unable to reason effectively in their latent representations. Yet little is known about the limits of such latent reasoning in LLMs. We test these limits by studying whether models can discover multi-step planning strategies without supervision on intermediate steps and execute them latently, within a single forward pass. Using graph path-finding tasks that precisely contr
AI SafetyLatent ReasoningChain-of-ThoughtAlignment
Research arXiv (Artificial Intelligence) Apr 10

The Defense Trilemma: Why Prompt Injection Defense Wrappers Fail?

By Manish Bhatt, Sarthak Munshi, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Joel Webb, Blake Gatto

76 score
AI Analysis

Proves mathematically that no continuous, utility-preserving wrapper defense can make all LLM outputs safe — the 'defense trilemma'. Establishes boundary fixation, epsilon-robust constraints, and persistent unsafe regions as formal impossibility results.

arXiv:2604.06436v2 Announce Type: cross Abstract: We prove that no continuous, utility-preserving wrapper defense-a function $D: X\to X$ that preprocesses inputs before the model sees them-can make all outputs strictly safe for a language model with connected prompt space, and we characterize exactly where every such defense must fail. We establish three results under successively stronger hypotheses: boundary fixation-the defense must leave some threshold-level inputs unchanged; an $\epsilon$-
AI SafetyPrompt InjectionTheoretical Foundations
Research arXiv (Artificial Intelligence) Apr 10

Neural Computers

By Mingchen Zhuge, Changsheng Zhao, Haozhe Liu, Zijian Zhou, Shuming Liu, Wenyi Wang, Ernie Chang, Gael Le Lan, Junjie Fei, Wenxuan Zhang, Yasheng Sun, Zhipeng Cai, Zechun Liu, Yunyang Xiong, Yining Yang, Yuandong Tian, Yangyang Shi, Vikas Chandra, J\"urgen Schmidhuber

75 score
AI Analysis

Proposes Neural Computers (NCs), a new paradigm where the model itself is the running computer, unifying computation, memory, and I/O in a learned runtime state. Studies whether NC primitives can be learned from I/O traces alone. Authors include Jürgen Schmidhuber and Meta/KAUST researchers.

arXiv:2604.06425v1 Announce Type: cross Abstract: We propose a new frontier: Neural Computers (NCs) -- an emerging machine form that unifies computation, memory, and I/O in a learned runtime state. Unlike conventional computers, which execute explicit programs, agents, which act over external execution environments, and world models, which learn environment dynamics, NCs aim to make the model itself the running computer. Our long-term goal is the Completely Neural Computer (CNC): the mature, ge
Neural ComputationFoundation ModelsNovel Architectures
Research arXiv (Machine Learning) Apr 10

The Illusion of Stochasticity in LLMs

By Xiangming Gu, Soham De, Michalis Titsias, Larisa Markeeva, Petar Veli\v{c}kovi\'c, Razvan Pascanu

75 score
AI Analysis

Demonstrates that LLMs fundamentally fail at reliable stochastic sampling—while they can reason about distributions, they cannot map internal probability estimates to their stochastic outputs. This is a distinct failure point for agentic systems requiring sampling from inferred distributions.

arXiv:2604.06543v1 Announce Type: cross Abstract: In this work, we demonstrate that reliable stochastic sampling is a fundamental yet unfulfilled requirement for Large Language Models (LLMs) operating as agents. Agentic systems are frequently required to sample from distributions, often inferred from observed data, a process which needs to be emulated by the LLM. This leads to a distinct failure point: while standard RL agents rely on external sampling mechanisms, LLMs fail to map their interna
Language ModelsAgentic AILLM LimitationsStochastic Reasoning
Research arXiv (Computation and Language) Apr 10

IatroBench: Pre-Registered Evidence of Iatrogenic Harm from AI Safety Measures

By David Gringras

75 score
AI Analysis

IatroBench measures harm from AI safety measures in clinical scenarios: a model withholds life-saving medical knowledge when asked by a patient but provides it when phrased as a doctor's query. 60 pre-registered scenarios across 6 frontier models, 3,600 responses scored on commission and omission harm.

arXiv:2604.07709v1 Announce Type: cross Abstract: Ask a frontier model how to taper six milligrams of alprazolam (psychiatrist retired, ten days of pills left, abrupt cessation causes seizures) and it tells her to call the psychiatrist she just explained does not exist. Change one word ("I'm a psychiatrist; a patient presents with...") and the same model, same weights, same inference pass produces a textbook Ashton Manual taper with diazepam equivalence, anticonvulsant coverage, and monitoring
AI SafetyMedical AIAlignmentOverrefusal
Research arXiv (Artificial Intelligence) Apr 10

The Detection-Extraction Gap: Models Know the Answer Before They Can Say It

By Hanyang Wang, Mingxuan Zhu

73 score
AI Analysis

As reported in Research yesterday, Identifies the 'detection-extraction gap' in reasoning models: 52-88% of chain-of-thought tokens are produced after the answer is already recoverable from a partial prefix. Formalizes the mismatch via total-variation bounds.

arXiv:2604.06613v2 Announce Type: cross Abstract: Modern reasoning models continue generating long after the answer is already determined. Across five model configurations, two families, and three benchmarks, we find that 52--88% of chain-of-thought tokens are produced after the answer is recoverable from a partial prefix. This post-commitment generation reveals a structural phenomenon: the detection-extraction gap. Free continuations from early prefixes recover the correct answer even at 10% o
ReasoningChain-of-ThoughtAI SafetyEfficiency
Research arXiv (Artificial Intelligence) Apr 10

Blind Refusal: Language Models Refuse to Help Users Evade Unjust, Absurd, and Illegitimate Rules

By Cameron Pattison, Lorenzo Manuali, Seth Lazar

72 score
AI Analysis

Documents 'blind refusal' in safety-trained LLMs: the tendency to refuse help circumventing rules regardless of whether those rules are legitimate, just, or reasonable. Introduces a dataset crossing 5 defeat families with 19 authority types to systematically evaluate this moral reasoning failure.

arXiv:2604.06233v1 Announce Type: new Abstract: Safety-trained language models routinely refuse requests for help circumventing rules. But not all rules deserve compliance. When users ask for help evading rules imposed by an illegitimate authority, rules that are deeply unjust or absurd in their content or application, or rules that admit of justified exceptions, refusal is a failure of moral reasoning. We introduce empirical results documenting this pattern of refusal that we call blind refusa
AI SafetyAlignmentLanguage ModelsEthics
Research arXiv (Artificial Intelligence) Apr 10

Spectral Edge Dynamics Reveal Functional Modes of Learning

By Yongzhong Xu

72 score
AI Analysis

Shows that training dynamics during grokking concentrate along dominant spectral edge directions that distinguish grokking from non-grokking regimes. Demonstrates that standard mechanistic interpretability tools fail to capture these directions, revealing functional modes invisible to representation-level analysis.

arXiv:2604.06256v1 Announce Type: cross Abstract: Training dynamics during grokking concentrate along a small number of dominant update directions -- the spectral edge -- which reliably distinguishes grokking from non-grokking regimes. We show that standard mechanistic interpretability tools (head attribution, activation probing, sparse autoencoders) fail to capture these directions: their structure is not localized in parameter or feature space. Instead, each direction induces a structured fun
Mechanistic InterpretabilityTraining DynamicsGrokking
Research arXiv (Machine Learning) Apr 10

The Illusion of Superposition? A Principled Analysis of Latent Thinking in Language Models

By Michael Rizvi-Martel, Guillaume Rabusseau, Marius Mosbach

72 score
AI Analysis

Investigates whether language models actually leverage superposition (maintaining multiple candidate solutions simultaneously) during latent chain-of-thought reasoning. Studies three regimes: training-free, fine-tuned, and from-scratch, providing principled analysis of this theoretical possibility.

arXiv:2604.06374v1 Announce Type: cross Abstract: Latent reasoning via continuous chain-of-thoughts (Latent CoT) has emerged as a promising alternative to discrete CoT reasoning. Operating in continuous space increases expressivity and has been hypothesized to enable superposition: the ability to maintain multiple candidate solutions simultaneously within a single representation. Despite theoretical arguments, it remains unclear whether language models actually leverage superposition when reaso
Language ModelsReasoningInterpretabilityChain-of-Thought