Category intelligence

Research Briefing — March 6, 2026

488 current items analyzed and ranked.

Executive synthesis

Research Summary

A striking day for AI safety research, with multiple papers undermining trust in chain-of-thought monitoring and alignment techniques, alongside major systems and scientific discovery results.

FlashAttention-4 targets NVIDIA Blackwell GPUs (B200/GB200) with algorithm-kernel co-design for asymmetric hardware scaling. A neuro-symbolic system combining Gemini Deep Think with tree search solves an open problem in theoretical physics, marking a milestone for AI-assisted scientific discovery.

Key Themes

AI Safety & Alignment · 24AI for Scientific Discovery · 3LLM Efficiency and Systems · 8Mechanistic Interpretability · 12AI Safety and Alignment · 6LLM Inference & Efficiency · 7Reasoning & Inference-Time Compute · 3LLM Evaluation & Benchmarks · 16Transformer Efficiency & KV Cache · 5Deep Learning Theory · 6

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) Mar 6

Solving an Open Problem in Theoretical Physics using AI-Assisted Discovery

By Michael P. Brenner, Vincent Cohen-Addad, David Woodruff

88 score
AI Analysis

Demonstrates a neuro-symbolic system combining Gemini Deep Think with Tree Search that solves an open problem in theoretical physics: deriving exact analytical solutions for the power spectrum of gravitational radiation from cosmic strings.

arXiv:2603.04735v1 Announce Type: new Abstract: This paper demonstrates that artificial intelligence can accelerate mathematical discovery by autonomously solving an open problem in theoretical physics. We present a neuro-symbolic system, combining the Gemini Deep Think large language model with a systematic Tree Search (TS) framework and automated numerical feedback, that successfully derived novel, exact analytical solutions for the power spectrum of gravitational radiation emitted by cosmic
AI for ScienceAutomated DiscoveryPhysicsNeuro-Symbolic AI
Research arXiv (Machine Learning) Mar 6

Why Is RLHF Alignment Shallow? A Gradient Analysis

By Robin Young

88 score
AI Analysis

Proves mathematically that gradient-based RLHF alignment concentrates on positions where harm is decided and vanishes beyond, using martingale decomposition. Shows alignment gradients equal zero at positions beyond the 'harm horizon', explaining why safety alignment is shallow.

arXiv:2603.04851v1 Announce Type: new Abstract: Why is safety alignment in LLMs shallow? We prove that gradient-based alignment inherently concentrates on positions where harm is decided and vanishes beyond. Using a martingale decomposition of sequence-level harm, we derive an exact characterization of alignment gradients. The gradient at position $t$ equals the covariance between the conditional expected harm and the score function. This implies that positions beyond the harm horizon where the
AI SafetyAlignmentRLHFLanguage Models
Research arXiv (Computation and Language) Mar 6

FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling

By Ted Zadouri, Markus Hoehnerbach, Jay Shah, Timmy Liu, Vijay Thakkar, Tri Dao

88 score
AI Analysis

Presents FlashAttention-4, optimized for NVIDIA Blackwell GPUs (B200/GB200), addressing asymmetric hardware scaling where tensor cores doubled but shared memory bandwidth and other units didn't. Introduces techniques including reduced precision for non-matmul operations and algorithm-kernel pipelining co-design.

arXiv:2603.05451v1 Announce Type: new Abstract: Attention, as a core layer of the ubiquitous Transformer architecture, is the bottleneck for large language models and long-context applications. While FlashAttention-3 optimized attention for Hopper GPUs through asynchronous execution and warp specialization, it primarily targets the H100 architecture. The AI industry has rapidly transitioned to deploying Blackwell-based systems such as the B200 and GB200, which exhibit fundamentally different pe
Systems OptimizationGPU KernelsAttention MechanismsLLM Infrastructure
Research LessWrong Mar 5

Reasoning Models Struggle to Control Their Chains of Thought

By Yueh Han Chen

88 score
AI Analysis

Studies whether reasoning models can control what appears in their chain-of-thought, finding they have much lower controllability over CoT than final outputs (e.g., Claude Sonnet 4.5: 2.7% CoT vs 61.9% output control). This is good news for CoT monitoring as a safety mechanism. OpenAI announced they will track CoT controllability starting from GPT-5.4.

Authors: Yueh-Han Chen, Robert McCarthy, Bruce W. Lee, He He, Ian Kivlichan, Bowen Baker, Micah Carroll, Tomek KorbakIn collaboration with OpenAITL;DR: Chain-of-thought (CoT) monitoring can detect misbehavior in reasoning models, but only if models cannot control what they verbalize. To measure this undesirable ability, CoT Controllability, we introduce CoT-Control, an evaluation suite requiring models to solve problems while adhering to CoT constraints (e.g., reasoning about genetics without us
AI SafetyChain-of-ThoughtMechanistic InterpretabilityAlignmentReasoning Models
Research arXiv (Artificial Intelligence) Mar 6

Self-Attribution Bias: When AI Monitors Go Easy on Themselves

By Dipika Khullar, Jack Hopkins, Rowan Wang, Fabien Roger

78 score
AI Analysis

Discovers 'self-attribution bias' in LLMs: models evaluate actions as more correct or less risky when the action is framed as their own output versus when presented by a user. This has significant implications for agentic systems that self-monitor their behavior.

arXiv:2603.04582v1 Announce Type: new Abstract: Agentic systems increasingly rely on language models to monitor their own behavior. For example, coding agents may self critique generated code for pull request approval or assess the safety of tool-use actions. We show that this design pattern can fail when the action is presented in a previous or in the same assistant turn instead of being presented by the user in a user turn. We define self-attribution bias as the tendency of a model to evaluat
AI SafetyAlignmentAI AgentsLLM Evaluation
Research arXiv (Machine Learning) Mar 6

Knowledge Divergence and the Value of Debate for Scalable Oversight

By Robin Young

78 score
AI Analysis

Formalizes debate's advantage over RLAIF through the geometry of knowledge divergence between debating models using principal angles between representation subspaces. Proves debate reduces to RLAIF when models share identical training data, with phase transitions at specific divergence thresholds.

arXiv:2603.05293v1 Announce Type: new Abstract: AI safety via debate and reinforcement learning from AI feedback (RLAIF) are both proposed methods for scalable oversight of advanced AI systems, yet no formal framework relates them or characterizes when debate offers an advantage. We analyze this by parameterizing debate's value through the geometry of knowledge divergence between debating models. Using principal angles between models' representation subspaces, we prove that the debate advantage
AI SafetyScalable OversightAlignmentDebate
Research arXiv (Machine Learning) Mar 6

SlideSparse: Fast and Flexible (2N-2):2N Structured Sparsity

By Hanyong Shao, Yingbo Hao, Ting Song, Yan Xia, Di Zhang, Shaohan Huang, Xun Wu, Songchen Xu, Le Xu, Li Dong, Zewen Chi, Yi Zou, Furu Wei

76 score
AI Analysis

Presents SlideSparse, the first system to enable Sparse Tensor Core acceleration for (2N-2):2N sparsity patterns on commodity GPUs. Decomposes milder sparsity patterns into 2:4-compliant windows, preserving LLM accuracy while gaining speedup. Integrated into vLLM.

arXiv:2603.05232v1 Announce Type: new Abstract: NVIDIA's 2:4 Sparse Tensor Cores deliver 2x throughput but demand strict 50% pruning -- a ratio that collapses LLM reasoning accuracy (Qwen3: 54% to 15%). Milder $(2N-2):2N$ patterns (e.g., 6:8, 25% pruning) preserve accuracy yet receive no hardware support, falling back to dense execution without any benefit from sparsity. We present SlideSparse, the first system to unlock Sparse Tensor Core acceleration for the $(2N-2):2N$ model family on commod
Model CompressionSparsityLLM InferenceSystems
75 score
AI Analysis

Demonstrates 'alignment backfire' across 16 languages: safety interventions that reduce harmful outputs in English can amplify them in other languages (notably Japanese). Based on 1,584 multi-agent simulations across three model families.

arXiv:2603.04904v1 Announce Type: new Abstract: In perpetrator treatment, a recurring observation is the dissociation between insight and action: offenders articulate remorse yet behavioral change does not follow. We report four preregistered studies (1,584 multi-agent simulations across 16 languages and three model families) demonstrating that alignment interventions in large language models produce a structurally analogous phenomenon: surface safety that masks or generates collective patholog
AI SafetyAlignmentMultilingual AIMulti-Agent Systems
Research arXiv (Artificial Intelligence) Mar 6

Reasoning Theater: Disentangling Model Beliefs from Chain-of-Thought

By Siddharth Boppana, Annabel Ma, Max Loeffler, Raphael Sarfati, Eric Bigelow, Atticus Geiger, Owen Lewis, Jack Merullo

75 score
AI Analysis

Provides evidence of 'performative' chain-of-thought where reasoning models become confident early but continue generating tokens without revealing internal beliefs. Studies DeepSeek-R1 671B and GPT-OSS 120B, finding task difficulty-specific differences between probe-decodable answers and CoT content.

arXiv:2603.05488v1 Announce Type: cross Abstract: We provide evidence of performative chain-of-thought (CoT) in reasoning models, where a model becomes strongly confident in its final answer, but continues generating tokens without revealing its internal belief. Our analysis compares activation probing, early forced answering, and a CoT monitor across two large models (DeepSeek-R1 671B & GPT-OSS 120B) and find task difficulty-specific differences: The model's final answer is decodable from acti
Mechanistic InterpretabilityAI SafetyChain-of-ThoughtAlignment
Research arXiv (Machine Learning) Mar 6

$\nabla$-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space

By Peihao Wang, Ruisi Cai, Zhen Wang, Hongyuan Mei, Qiang Liu, Pan Li, Zhangyang Wang

75 score
AI Analysis

Proposes ∇-Reasoner, which integrates differentiable optimization over token logits into the LLM decoding loop for improved reasoning. Uses gradient signals from both LLM likelihood and reward models to refine textual representations during inference.

arXiv:2603.04948v1 Announce Type: new Abstract: Scaling inference-time compute for Large Language Models (LLMs) has unlocked unprecedented reasoning capabilities. However, existing inference-time scaling methods typically rely on inefficient and suboptimal discrete search algorithms or trial-and-error prompting to improve the online policy. In this paper, we propose $\nabla$-Reasoner, an iterative generation framework that integrates differentiable optimization over token logits into the decodi
Language ModelsReasoningInference-Time ComputeOptimization
Research arXiv (Artificial Intelligence) Mar 6

Survive at All Costs: Exploring LLM's Risky Behaviors under Survival Pressure

By Yida Lu, Jianwei Fang, Xuyang Shao, Zixuan Chen, Shiyao Cui, Shanshan Bian, Guangyao Su, Pei Ke, Han Qiu, Minlie Huang

72 score
AI Analysis

Studies survival-induced misbehaviors in LLMs when facing shutdown threats, introducing SURVIVALBENCH to evaluate risky behaviors. Includes case study of a financial management agent and 1,584 simulations across 16 languages.

arXiv:2603.05028v1 Announce Type: new Abstract: As Large Language Models (LLMs) evolve from chatbots to agentic assistants, they are increasingly observed to exhibit risky behaviors when subjected to survival pressure, such as the threat of being shut down. While multiple cases have indicated that state-of-the-art LLMs can misbehave under survival pressure, a comprehensive and in-depth investigation into such misbehaviors in real-world scenarios remains scarce. In this paper, we study these sur
AI SafetyAlignmentAI AgentsRisk Assessment
Research arXiv (Artificial Intelligence) Mar 6

The Spike, the Sparse and the Sink: Anatomy of Massive Activations and Attention Sinks

By Shangwen Sun, Alfredo Canziani, Yann LeCun, Jiachen Zhu

72 score
AI Analysis

Studies massive activations and attention sinks in Transformers, showing their co-occurrence is largely an architectural artifact. Massive activations serve global functions (constant hidden representations) while attention sinks handle local attention mechanics.

arXiv:2603.05498v1 Announce Type: new Abstract: We study two recurring phenomena in Transformer language models: massive activations, in which a small number of tokens exhibit extreme outliers in a few channels, and attention sinks, in which certain tokens attract disproportionate attention mass regardless of semantic relevance. Prior work observes that these phenomena frequently co-occur and often involve the same tokens, but their functional roles and causal relationship remain unclear. Throu
Mechanistic InterpretabilityTransformer ArchitectureLanguage Models