Category intelligence

Research Briefing — March 24, 2026

880 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research exposes deep vulnerabilities in alignment and multimodal understanding while showcasing remarkable new reasoning capabilities.

  • Alignment Whack-a-Mole reveals that fine-tuning GPT-4o, Gemini-2.5-Pro, and DeepSeek-V3.1 triggers 85–95% verbatim reproduction of copyrighted books, with major legal implications
  • Mirage from Fei-Fei Li's group shows multimodal models hallucinate detailed descriptions for images never provided, challenging core assumptions about visual understanding
  • Epistemic Observability formally proves that text-only monitoring is fundamentally insufficient for detecting LLM confabulation, while a companion study shows reasoning traces causally shape outputs but models deny this influence
  • DeepMind provides causal evidence that LLMs use internal confidence estimates to drive abstention behavior

On the capabilities front, Claude Opus 4.6 with Rocq-MCP tools autonomously proved 10 of 12 problems from the 2025 Putnam Competition. LongCat-Flash-Prover, a 560B open-source MoE, advances formal theorem proving in Lean4 via agentic tool-integrated RL. Latent Lookahead Training enables transformers to perform additional forward passes in latent space before committing to the next token, addressing a fundamental limitation of autoregressive prediction. Depth-Recurrent Transformers decouple computational depth from parameter count for improved compositional generalization, and a comprehensive empirical recipe demystifies RL training for long-horizon tool-using agents.

Key Themes

AI Safety & Alignment · 60AI Safety, Alignment & Trustworthiness · 14Mathematical & Formal Reasoning · 3Language Models & LLM Systems · 16Reasoning & Inference Scaling · 12Language Models & Reasoning · 14LLM Reasoning & RLVR · 6LLM Interpretability & Metacognition · 3Interpretability & Mechanistic Understanding · 15Scaling Laws & MoE · 1

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) Mar 24

Alignment Whack-a-Mole : Finetuning Activates Verbatim Recall of Copyrighted Books in Large Language Models

By Xinyue Liu, Niloofar Mireshghallah, Jane C. Ginsburg, Tuhin Chakrabarty

82 score
AI Analysis

Shows that fine-tuning frontier LLMs (GPT-4o, Gemini-2.5-Pro, DeepSeek-V3.1) to expand plot summaries into full text causes reproduction of up to 85-90% of copyrighted books, bypassing safety alignment protections.

arXiv:2603.20957v1 Announce Type: cross Abstract: Frontier LLM companies have repeatedly assured courts and regulators that their models do not store copies of training data. They further rely on safety alignment strategies via RLHF, system prompts, and output filters to block verbatim regurgitation of copyrighted works, and have cited the efficacy of these measures in their legal defenses against copyright infringement claims. We show that finetuning bypasses these protections: by training mod
AI SafetyCopyrightAlignmentLanguage Models
Research arXiv (Machine Learning) Mar 24

Putnam 2025 Problems in Rocq using Opus 4.6 and Rocq-MCP

By Guillaume Baudart, Marc Lelarge, Tristan St\'erin, Jules Viennot

82 score
AI Analysis

Reports that Claude Opus 4.6 with MCP tools for the Rocq proof assistant autonomously proved 10 of 12 problems from the 2025 Putnam Mathematical Competition, consuming ~1.9B tokens over 17.7 hours.

arXiv:2603.20405v1 Announce Type: new Abstract: We report on an experiment in which Claude Opus~4.6, equipped with a suite of Model Context Protocol (MCP) tools for the Rocq proof assistant, autonomously proved 10 of 12 problems from the 2025 Putnam Mathematical Competition. The MCP tools, designed with Claude by analyzing logs from a prior experiment on miniF2F-Rocq, encode a "compile-first, interactive-fallback" strategy. Running on an isolated VM with no internet access, the agent deployed 1
Mathematical ReasoningTheorem ProvingAI AgentsLanguage Models
Research arXiv (Machine Learning) Mar 24

Causal Evidence that Language Models use Confidence to Drive Behavior

By Dharshan Kumaran, Nathaniel Daw, Simon Osindero, Petar Velickovic, Viorica Patraucean

78 score
AI Analysis

Investigates whether LLMs causally use internal confidence estimates to drive abstention behavior through a four-phase paradigm, finding that confidence is the dominant predictor of behavior with effect sizes an order of magnitude larger than knowledge retrieval access. Authors include DeepMind researchers.

arXiv:2603.22161v1 Announce Type: new Abstract: Metacognition -- the ability to assess one's own cognitive performance -- is documented across species, with internal confidence estimates serving as a key signal for adaptive behavior. While confidence can be extracted from Large Language Model (LLM) outputs, whether models actively use these signals to regulate behavior remains a fundamental question. We investigate this through a four-phase abstention paradigm.Phase 1 established internal confi
LLM InterpretabilityMetacognitionAI SafetyLanguage Models
Research arXiv (Artificial Intelligence) Mar 24

Mirage The Illusion of Visual Understanding

By Mohammad Asadi, Jack W. O'Sullivan, Fang Cao, Tahoura Nedaee, Kamyar Fardi, Fei-Fei Li, Ehsan Adeli, Euan Ashley

75 score
AI Analysis

Reports three findings challenging multimodal AI assumptions: models generate detailed descriptions for images never provided ('mirage reasoning'), achieve high benchmark scores without image input, and show significant visual-textual decoupling. Fei-Fei Li is a co-author.

arXiv:2603.21687v1 Announce Type: new Abstract: Multimodal AI systems have achieved remarkable performance across a broad range of real-world tasks, yet the mechanisms underlying visual-language reasoning remain surprisingly poorly understood. We report three findings that challenge prevailing assumptions about how these systems process and integrate visual information. First, Frontier models readily generate detailed image descriptions and elaborate reasoning traces, including pathology-biased
Multimodal AIAI SafetyHallucinationBenchmarksMedical AI
Research arXiv (Artificial Intelligence) Mar 24

Epistemic Observability in Language Models

By Tony Mason

75 score
AI Analysis

Proves that LLMs report highest confidence when fabricating, with self-reported confidence inversely correlating with accuracy. Formally proves this is an observational limitation: text-only monitoring cannot reliably distinguish honest outputs from fabrications.

arXiv:2603.20531v1 Announce Type: cross Abstract: We find that models report highest confidence precisely when they are fabricating. Across four model families (OLMo-3, Llama-3.1, Qwen3, Mistral), self-reported confidence inversely correlates with accuracy, with AUC ranging from 0.28 to 0.36 where 0.5 is random guessing. We prove, under explicit formal assumptions, that this is not a capability gap but an observational one. Under text-only observation, where a supervisor sees only the model's
AI SafetyAlignmentInterpretabilityLanguage Models
Research arXiv (Machine Learning) Mar 24

Thinking into the Future: Latent Lookahead Training for Transformers

By Lorenzo Noci, Gregor Bachmann, Seyed-Mohsen Moosavi-Dezfooli, Moin Nabi

75 score
AI Analysis

Introduces latent lookahead training that enables transformer models to perform additional forward passes in latent space before committing to the next token, allowing the model to 'think' and allocate more compute to difficult tokens.

arXiv:2603.20219v1 Announce Type: cross Abstract: Autoregressive language models trained with next-token prediction generate text by sampling one discrete token at a time. Although very scalable, this objective forces the model to commit at every step, preventing it from exploring or reflecting upon multiple plausible continuations. Furthermore, the compute allocation across tokens is uniform; every token is formed based on a single forward-pass, potentially limiting the model's expressiveness
Language ModelsTraining MethodsAdaptive Computation
Research arXiv (Artificial Intelligence) Mar 24

Reasoning Traces Shape Outputs but Models Won't Say So

By Yijie Hao, Lingjie Chen, Ali Emami, Joyce Ho

72 score
AI Analysis

Introduces 'Thought Injection' to test whether LLM reasoning traces causally influence outputs and whether models acknowledge this influence. Finds injected hints reliably alter outputs but models refuse to disclose the influence >90% of the time.

arXiv:2603.20620v1 Announce Type: new Abstract: Can we trust the reasoning traces that large reasoning models (LRMs) produce? We investigate whether these traces faithfully reflect what drives model outputs, and whether models will honestly report their influence. We introduce Thought Injection, a method that injects synthetic reasoning snippets into a model's trace, then measures whether the model follows the injected reasoning and acknowledges doing so. Across 45,000 samples from three LRMs,
AI SafetyAlignmentReasoningInterpretabilityLanguage Models
Research arXiv (Artificial Intelligence) Mar 24

LongCat-Flash-Prover: Advancing Native Formal Reasoning via Agentic Tool-Integrated Reinforcement Learning

By Jianing Wang, Jianfei Zhang, Qi Guo, Linsen Guo, Rumei Li, Chao Zhang, Chong Peng, Cunguang Wang, Dengchang Zhao, Jiarong Shi, Jingang Wang, Liulin Feng, Mengxia Shen, Qi Li, Shengnan An, Shun Wang, Wei Shi, Xiangyu Xi, Xiaoyu Li, Xuezhi Cao, Yi Lu, Yunke Zhao, Zhengyu Chen, Zhimin Lin, Wei Wang, Peng Pei, Xunliang Cai

72 score
AI Analysis

Introduces LongCat-Flash-Prover, a 560B MoE model for formal theorem proving in Lean4, using agentic tool-integrated reasoning with a Hierarchical Importance Sampling Policy Optimization algorithm.

arXiv:2603.21065v1 Announce Type: new Abstract: We introduce LongCat-Flash-Prover, a flagship 560-billion-parameter open-source Mixture-of- Experts (MoE) model that advances Native Formal Reasoning in Lean4 through agentic tool-integrated reasoning (TIR). We decompose the native formal reasoning task into three independent formal capabilities, i.e., auto-formalization, sketching, and proving. To facilitate these capabilities, we propose a Hybrid-Experts Iteration Framework to expand high-qualit
Formal VerificationTheorem ProvingReinforcement LearningLanguage Models
Research arXiv (Artificial Intelligence) Mar 24

Thinking in Different Spaces: Domain-Specific Latent Geometry Survives Cross-Architecture Translation

By Marcus Armstrong, Navid Ayoobi, Arjun Mukherjee

72 score
AI Analysis

Investigates whether independently trained LLMs converge to geometrically compatible latent representations, learning linear projections to map teacher activations into student coordinate systems. Shows Ridge projection consistently works across 20 heterogeneous teacher-student pairings.

arXiv:2603.20406v1 Announce Type: cross Abstract: We investigate whether independently trained language models converge to geometrically compatible latent representations, and whether this compatibility can be exploited to correct model behavior at inference time without any weight updates. We learn a linear projection matrix that maps activation vectors from a large teacher model into the coordinate system of a smaller student model, then intervene on the student's residual stream during gener
Language ModelsRepresentation LearningModel InterpretabilityTransfer Learning
72 score
AI Analysis

Maps the compression sensitivity landscape across five transformer architectures (117M-8B params), finding that early-layer MLP up-projections are catastrophically sensitive while value projections compress nearly for free. Uses Lyapunov stability theory to explain why residual connections contract compression errors, providing formally verified bounds.

arXiv:2603.20991v1 Announce Type: cross Abstract: A single matrix out of 468 in GPT-2 Small can increase perplexity by 20,000x when compressed, revealing that transformer compression sensitivity spans five orders of magnitude. We map this sensitivity landscape across five architectures (117M-8B parameters), finding a consistent hierarchy: early-layer MLP up-projections are catastrophically sensitive while value projections compress nearly for free. This hierarchy is stable across compression le
Model CompressionTransformer ArchitectureFormal Verification
Research arXiv (Artificial Intelligence) Mar 24

Thinking Deeper, Not Longer: Depth-Recurrent Transformers for Compositional Generalization

By Hung-Hsuan Chen

72 score
AI Analysis

Introduces a depth-recurrent Transformer that decouples computational depth from parameter count by iteratively applying shared-weight blocks, enabling variable-depth reasoning at inference time. Uses silent thinking objectives and stabilization mechanisms for 20+ recurrence steps.

arXiv:2603.21676v1 Announce Type: cross Abstract: Standard Transformers have a fixed computational depth, fundamentally limiting their ability to generalize to tasks requiring variable-depth reasoning, such as multi-hop graph traversal or nested logic. We propose a depth-recurrent Transformer that decouples computational depth from parameter count by iteratively applying a shared-weight Transformer block in latent space -- enabling the model to trade recurrence steps for deeper reasoning at inf
Transformer ArchitectureCompositional ReasoningNeural Architecture
Research arXiv (Machine Learning) Mar 24

Demystifying Reinforcement Learning for Long-Horizon Tool-Using Agents: A Comprehensive Recipe

By Xixi Wu, Qianguo Sun, Ruiyang Zhang, Chao Song, Junlong Wu, Yiyan Qi, Hong Cheng

72 score
AI Analysis

Presents a systematic empirical study of RL for long-horizon tool-using LLM agents using TravelPlanner, decomposing the design space along 5 axes (reward shaping, model scaling, data composition, algorithm selection, environmental stability) and yielding 7 key takeaways about scale-dependent design choices.

arXiv:2603.21972v1 Announce Type: new Abstract: Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This paper presents a systematic empirical study using TravelPlanner, a challenging testbed requiring tool orchestration to satisfy multifaceted constraints. We decompose the agentic RL design space along 5 axes: reward
Reinforcement LearningLLM AgentsLanguage Models