Category intelligence

Research Briefing — May 12, 2026

1651 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research reveals alarming fragility in AI safety mechanisms alongside fundamental new insights into model internals and representation geometry.

Foundational results show cognitive biases like primacy and anchoring are mathematically inevitable in autoregressive architectures due to causal masking. Autonomous self-replication via web exploitation is demonstrated in current-generation models. Mechanistic work isolates mid-layer attention heads responsible for persuasion-induced factual errors. Google DeepMind introduces the first real-time multimodal AI co-clinician for live clinical encounters. A large collaborative study with Psych-201 finds post-training systematically reduces behavioral alignment with humans—a counterintuitive result for the alignment community.

Key Themes

AI Safety & Alignment · 105Mechanistic Interpretability · 47AI Safety & Security · 20Efficient LLM Inference · 12Formal Methods & Verification · 6Benchmarks & Evaluation · 59LLM Reasoning & RLVR · 7Interpretability & Mechanistic Understanding · 10LLM Reasoning & Evaluation · 6Multi-Agent Systems · 20

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) May 12

Containment Verification: AI Safety Guarantees Independent of Alignment

By Royce Moon, Lav R. Varshney

78 score
AI Analysis

Introduces containment verification, which provides safety guarantees independent of alignment by verifying the agentic framework rather than the model. Uses 'havoc oracle' semantics where AI is modeled as unconstrained, and proves safety through forward-simulation refinement in Dafny.

arXiv:2605.09045v1 Announce Type: new Abstract: Agentic frameworks are the software layer through which AI agents act in the world. Existing safety methods intervene on the model and therefore remain conditional on unverifiable properties of learned behavior. We introduce containment verification, which locates safety guarantees in the agentic framework itself. Under havoc oracle semantics, the AI is modeled as an unconstrained oracle ranging over the entire typed action space, and the verified
AI SafetyFormal VerificationAlignmentAgentic AI
Research arXiv (Artificial Intelligence) May 12

The Geometry of Forgetting: Temporal Knowledge Drift as an Independent Axis in LLM Representations

By Rania Elbadry, Ahmed Heakl, Fan Zhang, Dani Bouch, Yuxia Wang, Preslav Nakov, Zhuohan Xie

78 score
AI Analysis

Discovers that temporal knowledge drift in LLMs is encoded as a direction geometrically orthogonal to both correctness and uncertainty in the residual stream. This means no method based on confidence or uncertainty can detect outdated facts. Linear probes on drift achieve AUROC 0.83-0.95.

arXiv:2605.09195v1 Announce Type: new Abstract: Large language models confidently produce outdated answers, and no existing method can detect them. We show this is not an engineering failure but a structural one: temporal drift, whether a stored fact has changed since training, is encoded as a direction in the residual stream geometrically orthogonal to both correctness and uncertainty. Any method operating on correctness or uncertainty signals is therefore blind to drift by construction. We ve
Mechanistic InterpretabilityLanguage ModelsKnowledge RepresentationAI Reliability
Research arXiv (Artificial Intelligence) May 12

A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Models

By Hamid Kazemi, Atoosa Chegini, Maria Safi

78 score
AI Analysis

Demonstrates that a single neuron can bypass safety alignment in LLMs, showing both refusal suppression and harmful content amplification across seven models (1.7B-70B) without any training or prompt engineering.

arXiv:2605.08513v1 Announce Type: cross Abstract: Safety alignment in language models operates through two mechanistically distinct systems: refusal neurons that gate whether harmful knowledge is expressed, and concept neurons that encode the harmful knowledge itself. By targeting a single neuron in each system, we demonstrate both directions of failure -- bypassing safety on explicit harmful requests via suppression, and inducing harmful content from innocent prompts via amplification -- acros
AI SafetyMechanistic InterpretabilityAlignmentLLM Vulnerabilities
Research arXiv (Artificial Intelligence) May 12

Hidden Error Awareness in Chain-of-Thought Reasoning: The Signal Is Diagnostic, Not Causal

By Aojie Yuan, Zhiyuan Julian Su, Haiyue Zhang, Yi Nian, Yue Zhao

78 score
AI Analysis

Discovers that LLMs internally detect their own reasoning errors (0.95 AUROC via linear probe) while outwardly expressing confidence in them. This 'hidden error awareness' holds across model families (1.5B-72B) and RL-trained reasoning models.

arXiv:2605.09502v1 Announce Type: cross Abstract: Chain-of-thought (CoT) prompting assumes that generated reasoning reflects a model's internal computation. We show this assumption is wrong in a specific, measurable way: models internally detect their own reasoning errors but outwardly express confidence in them. A linear probe on hidden states predicts trace correctness with 0.95 AUROC -- from the very first reasoning step (0.79) -- while verbalized confidence for wrong traces is 4.55/5, nearl
AI SafetyInterpretabilityChain-of-ThoughtLanguage ModelsAlignment
Research arXiv (Artificial Intelligence) May 12

Do multimodal models imagine electric sheep?

By Santhosh Kumar Ramakrishnan, Carl Vondrick, Raja Giryes, Philipp Kr\"ahenb\"uhl, Vladlen Koltun

78 score
AI Analysis

Discovers that large multimodal models develop 'mental imagery' when solving spatial puzzles - their activations encode meaningful visual information about intermediate states even without explicit supervision on those states. Tested on Qwen3.5 VLM across 12 diverse visual reasoning tasks.

arXiv:2605.09693v1 Announce Type: cross Abstract: Yes. We find that large multimodal models develop mental imagery when solving spatial puzzles, and they do imagine sheep when solving sheep puzzles. We fine-tune a Qwen3.5 VLM to solve twelve diverse visual reasoning tasks -- including tangram, jigsaw, sokoban, 3D mental rotation, and rush hour -- that require understanding geometry, spatial relationships, and the consequences of actions. By supervising the model to predict the open-loop sequenc
Vision-Language ModelsMechanistic InterpretabilityVisual ReasoningEmergent Capabilities
Research arXiv (Artificial Intelligence) May 12

Bias by Necessity: Impossibility Theorems for Sequential Processing with Convergent AI and Human Validation

By Jikun Wu, Dongxin Guo, Siu-Ming Yiu

76 score
AI Analysis

Proves that primacy effects, anchoring, and order-dependence are mathematically inevitable in autoregressive LLMs due to causal masking, with impossibility theorems validated across 12 frontier models (R²=0.89). Shows exact debiasing requires factorial computation.

arXiv:2605.08716v1 Announce Type: new Abstract: Are certain cognitive biases mathematically inevitable consequences of sequential information processing? We prove that primacy effects, anchoring, and order-dependence are architecturally necessary in autoregressive language models due to causal masking constraints. Our three impossibility theorems establish: (1) primacy bias arises from asymmetric attention accumulation; (2) anchoring emerges from sequential conditioning with provable informatio
LLM TheoryCognitive BiasImpossibility ResultsAI Safety
Research arXiv (Artificial Intelligence) May 12

How LLMs Are Persuaded: A Few Attention Heads, Rerouted

By Xiangkun Sun, Lingkai Kong, Aoqi Zhang, Liang Zeng, Tonghan Wang

76 score
AI Analysis

Uncovers the causal mechanism of persuasion-induced factual errors in LLMs: a small set of mid-layer attention heads writes answers into a low-dimensional polyhedron, and persuasion causes discrete latent jumps between vertices. Shows decision heads copy rather than reason.

arXiv:2605.09314v1 Announce Type: new Abstract: Language models can be persuaded to abandon factual knowledge. This vulnerability is central to AI safety, but its internal mechanism remains poorly understood. We uncover a compact causal mechanism for persuasion-induced factual errors. A small set of mid-layer attention heads almost entirely determines the model's answer. These heads write answer options into a low-dimensional polyhedron, with options occupying distinct vertices. Persuasion does
Mechanistic InterpretabilityAI SafetyLanguage ModelsPersuasion
Research arXiv (Artificial Intelligence) May 12

The Attacker in the Mirror: Breaking Self-Consistency in Safety via Anchored Bipolicy Self-Play

By Gabriele La Malfa, Emanuele La Malfa, Saar Cohen, Jie M. Zhang, Michael Luck, Michael Wooldridge, Elizabeth Black

75 score
AI Analysis

Exposes theoretical limitations of self-play red teaming for AI safety, showing that Nash equilibria include trivial strategies and that parameter sharing creates exploitable inconsistencies. Introduces 'Anchored Bipolicy Self-Play' that breaks self-consistency in safety.

arXiv:2605.08427v1 Announce Type: new Abstract: Self-play red team is an established approach to improving AI safety in which different instances of the same model play attacker and defender roles in a zero-sum game, i.e., where the attacker tries to jailbreak the defender; if self-play converges to a Nash equilibrium, the model is guaranteed to respond safely within the settings of the game. Although the parameter sharing enforced by the use of the same model for the two roles improves stabili
AI SafetyRed TeamingGame TheoryJailbreaking
Research arXiv (Artificial Intelligence) May 12

Towards Conversational Medical AI with Eyes, Ears and a Voice

By Meet Shah, Jason Gusdorf, Anil Palepu, Chunjong Park, Jack W. O'Sullivan, Vishnu Ravi, Tim Strother, Pavel Dubov, Aliya Rysbek, Toshiyuki Fukuzawa, Yana Lunts, Jan Freyberg, Michael B. Chang, Aniruddh Raghu, David Stutz, Devora Berlowitz, Eliseo Papa, Taylan Cemgil, JD Velasquez, Jack Chen, Arthur Chen, Doug Fritz, Charlie Taylor, Katya Tregubova, Jing Rong Lim, Richard Green, Sara Mahdavi, Mahvish Nagda, Jihyeon Lee, Craig Schiff, Liviu Panait, Sukhdeep Singh, Valentin Li\'evin, David G. T. Barrett, Hannah Gladman, Anna Cupani, Francesca Pietra, Uchechi Okereke, Katherine Tong, Clemens Meyer, Erwan Rolland, Mili Sanwalka, Michael D. Howell, Shixiang Shane Gu, Bibo Xu, Euan A. Ashley, S. M. Ali Eslami, Gregory Wayne, Pushmeet Kohli, Vivek Natarajan, Adam Rodman, Alan Karthikesalingam, Ryutaro Tanno

75 score
AI Analysis

Introduces 'AI co-clinician', a conversational AI system using Gemini's audio-visual capabilities for real-time clinical decisions during live patient conversations. Uses dual-agent architecture for deep reasoning with low latency. Tested on 20 standardized outpatient scenarios.

arXiv:2605.09272v1 Announce Type: new Abstract: The practice of medicine relies not only upon skillful dialogue but also on the nuanced exchange and interpretation of rich auditory and visual cues between doctors and patients. Building on the low-latency voice and video processing capabilities of Gemini, we introduce AI co-clinician, a first-of-its-kind conversational AI system utilizing continuous streams of audio-visual data from live patient conversations to inform real-time clinical decisio
Medical AIMultimodal AIGoogle DeepMindAudio-Visual Processing
Research arXiv (Artificial Intelligence) May 12

Why Do Aligned LLMs Remain Jailbreakable: Refusal-Escape Directions, Operator-Level Sources, and Safety-Utility Trade-off

By Yu Chen, Yuanhao Liu, Qi Cao

75 score
AI Analysis

Provides theoretical analysis of why aligned LLMs remain jailbreakable through 'Refusal-Escape Directions' (RED)—local perturbation directions that shift behavior from refusal to answering while preserving harmful-semantics interpretation. Identifies structural vulnerabilities.

arXiv:2605.08878v1 Announce Type: cross Abstract: Aligned large language models (LLMs) remain vulnerable to jailbreak attacks. Recent mechanistic studies have identified latent features and representation shifts associated with jailbreak success, but they leave a more fundamental question open: why do aligned LLMs remain jailbreakable, and what structural vulnerabilities in the model make this possible? We study this question through a continuous input-transformation view. Our theoretical findi
AI SafetyJailbreakingAlignmentMechanistic Interpretability
Research arXiv (Artificial Intelligence) May 12

Position: AI Security Policy Should Target Systems, Not Models

By Michael A. Riegler, Inga Str\"umke

75 score
AI Analysis

Proposes that AI security policy should target systems rather than models, demonstrating with 'swarm-attack' that five instances of a 1.2B model can achieve 45.8% Effective Harm Rate against GPT-4o, showing safety bypass is achievable at zero cost with commodity hardware.

arXiv:2605.09504v1 Announce Type: cross Abstract: We present swarm-attack, an open-source adversarial testing framework in which multiple lightweight LLM agents coordinate through shared memory, parallel exploration, and evolutionary optimization. Together, our results demonstrate that both safety bypass of frontier models and software vulnerability discovery, i.e., the capability class that motivated restricted release of Anthropic's Mythos Preview, are achievable at effectively zero cost usin
AI SafetyAI PolicyRed TeamingSecurityAlignment
Research arXiv (Artificial Intelligence) May 12

Can You Keep a Secret? Involuntary Information Leakage in Language Model Writing

By Ari Holtzman, Peter West

75 score
AI Analysis

Shows that frontier language models thematically leak secret information (up to 79% detection rate) through topic choice, imagery, and setting even when instructed to keep secrets, with attempts to hide making leakage worse.

arXiv:2605.10794v1 Announce Type: cross Abstract: Language models are deployed in settings that require compartmentalization: system prompts should not be disclosed, chain-of-thought reasoning is hidden from users, and sensitive data passes through shared contexts. We test whether models can keep prompted information out of their writing. We give each model a secret word with instructions not to reveal it, then ask it to write a story. A second model tries to identify the secret from the story
AI SafetyLanguage ModelsInformation LeakagePrivacy