Category intelligence

Research Briefing — May 7, 2026

502 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research spans AI infrastructure at scale, fundamental theoretical limits, and safety/alignment advances.

Safety and interpretability see notable advances: authority laundering reveals how adversarial perturbations cause VLMs to give confidently wrong answers, while the predictive-causal gap proves optimal predictive encoders fundamentally diverge from causal ones across 2695 neural configurations. Paul Christiano and Jacob Hilton contribute a sampling-free method for estimating wide MLP outputs using cumulant expansions. TRIBE v2 bridges neuroscience and AI with a tri-modal foundation model predicting brain activity across 720 subjects.

Key Themes

AI Infrastructure & Distributed Training · 5AI Safety & Alignment · 28Foundation Models and Neuroscience · 1AI Agents & Capabilities · 3Transformer Theory and ICL · 3AI Alignment & RLHF · 5LLM Training & Fine-Tuning · 7Mechanistic Interpretability · 5Language Models & Alignment · 14AI Security and Adversarial Attacks · 5

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) May 7

Resilient AI Supercomputer Networking using MRC and SRv6

By Joao Araujo, Alex Chow, Mark Handley, Ryder Lewis, Christoph Paasch, Jitendra Padhye, Michael Papamichael, Greg Steinbrecher, Amin Tootoonchian, Lihua Yuan, S. Anantharamu, Abhishek Dosi, Mohit Garg, Mahdieh Ghazi, Torsten Hoefler, Deepal Jayasinghe, Jithin Jose, Abdul Kabbani, Guohan Lu, Yang Wang, K. Doddapaneni, Murali Garimella, Vipin Jain, Yanfang Le, H. Nagulapalli, S. Narayanan, Rong Pan, Rathina Sabesan, Raghava Sivaramu, Rip Sohan, Eric Davis, Dragos Dumitrescu, Mohan Kalkunte, Bhaswar Mitra, Guglielmo Morandin, Adrian Popa, Costin Raiciu, Eric Spada, John Spillane, Niranjan Vaidya, Aviv Barnea, Idan Burstein, Elazar Cohen, Yamin Friedman, Noam Katz, Masoud Moshref, Yuval Shpigelman, Shahaf Shuler, Shy Shyman, Sayantan Sur

88 score
AI Analysis

Describes MRC (a new RDMA-based transport protocol) and SRv6 static source-routing for AI supercomputer networking at OpenAI and Microsoft, enabling training clusters over 100K GPUs. The approach eliminates flow collisions via multi-path spraying, uses multi-plane Clos topologies, and bypasses failures without retraining.

arXiv:2605.04333v1 Announce Type: cross Abstract: Tail latency dominates the performance of synchronous pretraining jobs when running at very large scales. We describe a three-pronged approach: (1) a new RDMA-based transport protocol, MRC, sprays across many paths and actively load-balances between them, eliminating the issue of flow collisions (2) the use of multi-plane Clos topologies to get the benefits of high switch radix and redundancy, allowing training clusters well over 100K GPUs to be
AI InfrastructureDistributed TrainingSystems
Research arXiv (Artificial Intelligence) May 7

The Impossibility Triangle of Long-Context Modeling

By Yan Zhou

78 score
AI Analysis

Proves a fundamental impossibility triangle for long-context models: no model can simultaneously achieve per-step efficiency independent of sequence length, compact state size, and recall proportional to sequence length. Uses information-theoretic tools (Data Processing Inequality, Fano's Inequality) to establish the bound.

arXiv:2605.05066v1 Announce Type: cross Abstract: We identify and prove a fundamental trade-off governing long-sequence models: no model can simultaneously achieve (i) per-step computation independent of sequence length (Efficiency), (ii) state size independent of sequence length (Compactness), and (iii) the ability to recall a number of historical facts proportional to sequence length (Recall). We formalize this trade-off within an Online Sequence Processor abstraction that unifies Transformer
Deep Learning TheoryLong-Context ModelsInformation TheoryTransformers
Research arXiv (Artificial Intelligence) May 7

Design Conductor 2.0: An agent builds a TurboQuant inference accelerator in 80 hours

By The Verkor Team, Ravi Krishna, Suresh Krishna, David Chin

75 score
AI Analysis

Introduces Design Conductor 2.0, a multi-agent system powered by April 2026 frontier models that autonomously builds an LLM inference accelerator (VerTQ) with TurboQuant support in 80 hours — handling 80x larger tasks than its predecessor which built a RISC-V CPU.

arXiv:2605.05170v1 Announce Type: cross Abstract: Driven by a rapid co-evolution of both harness and underlying models, LLM agents are improving at a dizzying pace. In our prior work (performed in Dec. 2025), we introduced "Design Conductor" (or just "Conductor"), a system capable of building a 5-stage Linux-capable RISC-V CPU in 12 hours. In this work, we introduce an updated multi-agent harness powered by frontier models released in April 2026, which is able to handle 80x larger tasks, at hig
AI AgentsHardware DesignLLM Applications
Research arXiv (Machine Learning) May 7

Laundering AI Authority with Adversarial Examples

By Jie Zhang, Pura Peetathawatchai, Florian Tram\`er, Avital Shafran

75 score
AI Analysis

Demonstrates 'AI authority laundering' where adversarial perturbations to images cause VLMs to give confident, authoritative responses about wrong inputs. Shows standard CLIP attacks transfer to production VLMs including GPT and Claude.

arXiv:2605.04261v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and moderating content. Users implicitly trust that these systems perceive the same visual content as they do. We show that adversarial examples break this assumption, enabling \emph{AI authority laundering}: an attacker subtly perturbs an image so that the VLM produces confident and authoritative responses
AI SecurityAdversarial ExamplesVision-Language ModelsAI Safety
Research arXiv (Machine Learning) May 7

Explaining and Preventing Alignment Collapse in Iterative RLHF

By Etienne Gauthier, Francis Bach, Michael I. Jordan

74 score
AI Analysis

Derives analytical decomposition of RLHF optimization gradient into standard policy gradient and parameter-steering term, showing standard iterative RLHF suffers 'alignment collapse' as policy exploits RM blind spots. Proposes corrections based on the Stackelberg game formulation.

arXiv:2605.04266v1 Announce Type: new Abstract: Reinforcement learning from human feedback (RLHF) typically assumes a static or non-strategic reward model (RM). In iterative deployment, however, the policy generates the data on which the RM is retrained, creating a feedback loop. Building on the Stackelberg game formulation of this interaction, we derive an analytical decomposition of the policy's true optimization gradient into a standard policy gradient and a parameter-steering term that capt
AI SafetyAlignmentRLHFGame Theory
Research arXiv (Artificial Intelligence) May 7

Efficiently Aligning Language Models with Online Natural Language Feedback

By Christine Ye, Joe Benton

72 score
AI Analysis

Develops methods for aligning LLMs in 'fuzzy' domains where verification is difficult, using online natural language feedback from experts. The approach iteratively optimizes against proxy reward signals while collecting fresh expert supervision and updating the proxy reward model.

arXiv:2605.04356v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards has been used to elicit impressive performance from language models in many domains. But, broadly beneficial deployments of AI may require us to train models with strong capabilities in "fuzzy", hard-to-supervise domains. In this paper, we develop methods to align language models in fuzzy domains where human experts are still able to provide high-quality supervision signal, but only for a small numb
AI AlignmentReinforcement Learning from Human FeedbackLanguage Models
Research arXiv (Machine Learning) May 7

Understanding In-Context Learning for Nonlinear Regression with Transformers: Attention as Featurizer

By Alexander Hsu, Zhaiming Shen, Wenjing Liao, Rongjie Lai

72 score
AI Analysis

Provides theoretical analysis of in-context learning (ICL) for nonlinear regression, showing how attention mechanisms can construct nonlinear features like polynomial or spline bases. Establishes a framework analyzing end-to-end in-context nonlinear regression beyond the linear setting.

arXiv:2605.05176v1 Announce Type: new Abstract: Pre-trained transformers are able to learn from examples provided as part of the prompt without any weight updates, a remarkable ability known as in-context learning (ICL). Despite its demonstrated efficacy across various domains, the theoretical understanding of ICL is still developing. Whereas most existing theory has focused on linear models, we study ICL in the nonlinear regression setting. Through the interaction mechanism in attention, we ex
In-Context LearningTransformer TheoryNonlinear Regression
Research arXiv (Machine Learning) May 7

A foundation model of vision, audition, and language for in-silico neuroscience

By St\'ephane d'Ascoli, J\'er\'emy Rapin, Yohann Benchetrit, Teon Brooks, Katelyn Begany, Jos\'ephine Raugel, Hubert Banville, Jean-R\'emi King

72 score
AI Analysis

Introduces TRIBE v2, a tri-modal (video, audio, language) foundation model predicting human brain activity across diverse conditions. Uses 1,000+ hours of fMRI across 720 subjects and enables in-silico experimentation for neuroscience.

arXiv:2605.04326v1 Announce Type: cross Abstract: Cognitive neuroscience is fragmented into specialized models, each tailored to specific experimental paradigms, hence preventing a unified model of cognition in the human brain. Here, we introduce TRIBE v2, a tri-modal (video, audio and language) foundation model capable of predicting human brain activity in a variety of naturalistic and experimental conditions. Leveraging a unified dataset of over 1,000 hours of fMRI across 720 subjects, we dem
NeuroscienceFoundation ModelsMultimodal LearningBrain-AI Alignment
70 score
AI Analysis

Proves a fundamental predictive-causal gap: across 2695 neural network configurations, optimal predictive encoders track the environment rather than the system of interest. Shows this is structural (not an optimization artifact) and worsens with dimensionality.

arXiv:2605.05029v1 Announce Type: new Abstract: We report a systematic failure mode in predictive representation learning. Across 2695 neural network configurations trained to predict linear-Gaussian dynamics, the optimal encoder tracks the environment rather than the system it is meant to model. The mean causal fidelity -- the fraction of encoder sensitivity allocated to system degrees of freedom -- is 0.49, and only 2.5% of configurations exceed 0.70. The failure intensifies with dimension: a
Representation LearningCausal InferenceTheoretical MLSystem Identification
Research arXiv (Artificial Intelligence) May 7

From Parameter Dynamics to Risk Scoring : Quantifying Sample-Level Safety Degradation in LLM Fine-tuning

By Xiao Wang, Yifei Zhang, YongKang Liu, Xiaocui Yang, Zihan Wang, Shi Feng, Daling Wang

68 score
AI Analysis

Uncovers a mechanism underlying safety degradation during LLM fine-tuning: benign fine-tuning causes parameters to cumulatively drift toward danger-aligned directions. Proposes a sample-level risk scoring method to identify high-risk training samples before fine-tuning.

arXiv:2605.04572v1 Announce Type: new Abstract: Safety alignment of Large Language Models (LLMs) is extremely fragile, as fine-tuning on a small number of benign samples can erase safety behaviors learned from millions of preference examples. Existing studies attempt to explain this phenomenon by comparing parameters and hidden states before and after fine-tuning, but overlook their dynamic evolution during fine-tuning. In this paper, we uncover a critical mechanism underlying safety degradatio
AI SafetyFine-tuningAlignmentLanguage Models
Research arXiv (Machine Learning) May 7

Single-Position Intervention Fails: Distributed Output Templates Drive In-Context Learning

By Bryan Cheng, Jasper Zhang

68 score
AI Analysis

Reveals that single-position activation intervention achieves 0% task transfer across all 28 layers of Llama-3.2-3B despite 100% probing accuracy, demonstrating task encoding is fundamentally distributed. Multi-position intervention at demonstration output tokens achieves up to 90% transfer.

arXiv:2605.04061v1 Announce Type: new Abstract: Understanding how large language models encode task identity from few-shot demonstrations is a central open problem in mechanistic interpretability. Prior work uses linear probing to localize task representations, reporting high classification accuracy at specific layers. We reveal a striking dissociation: probing accuracy completely fails to predict causal importance. Single-position activation intervention achieves 0% task transfer across all 28
Mechanistic InterpretabilityIn-Context LearningLanguage Models
Research arXiv (Machine Learning) May 7

Power Distribution Bridges Sampling, Self-Reward RL, and Self-Distillation

By Akiyoshi Tomihari, Issei Sato

68 score
AI Analysis

Shows that the power distribution (target of power sampling) unifies sampling, self-reward KL-regularized RL, and self-distillation for LLMs. Demonstrates that local approximations cannot reproduce sequence-level power without suffix information, providing theoretical clarity on RL vs. sampling debates.

arXiv:2605.04542v1 Announce Type: new Abstract: Recent analyses question whether reinforcement learning (RL) is responsible for strong reasoning in large language models (LLMs). At the same time, distillation and inference-time sampling, including power sampling, have emerged as effective ways to improve LLM performance. However, the relationship among RL, distillation, and sampling remains unclear. In this study, we focus on the power distribution, the target distribution of power sampling, an
Language ModelsReinforcement LearningTheoretical MLAI Alignment