Category intelligence

Research Briefing — June 15, 2026

447 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research is anchored by optimizer theory and a deep slate of AI safety, interpretability, and agent work. A strong Muon cluster dominates optimization: Free Heavy-Tailed Lunch for Muon (Suvrit Sra) proves optimal sample complexity for non-Euclidean matrix optimizers, with Muon^p, Zeta, and Gefen adding spectral-power, dual-whitening, and memory-efficient variants. Beyond a Single Explanation of the Adam-SGD Gap debunks single-cause narratives across modalities.

Safety and interpretability are the densest theme:

Agent capability and evaluation infrastructure round out the list:

Key Themes

AI Safety and Alignment · 10AI Safety, Privacy & Alignment · 8LLM Agents and Tool Use · 11Language Models & Reasoning · 11AI Safety and Security · 17AI Agents and Memory · 12Interpretability & Evaluation · 8Robotics & Embodied AI · 20Computer Vision & Generative Media · 12Optimization & Efficiency · 5

Primary evidence

Top Ranked Signals

Research arXiv (math.OC) Jun 15

Free Heavy-Tailed Lunch for Muon: A Theoretical Justification of Empirical Success

By Florian H\"ubler, Thomas Pethick, Suvrit Sra

73 score
AI Analysis

This paper provides theoretical justification for the empirical success of non-Euclidean matrix optimizers like Muon, proving they achieve optimal sample complexity under heavy-tailed gradients while Euclidean methods incur dimension-dependent costs. It explains why Muon outperforms Adam-style methods for transformer training.

Non-Euclidean optimisation methods with matrix-valued updates, such as Muon and Scion, have recently shown strong empirical performance for training Transformer models, yet their theoretical advantages over Euclidean methods remain poorly understood. We address this gap in the heavy-tailed non-convex regime, where stochastic gradients have bounded $p$-th central moments, $p \in (1,2]$. We show that certain non-Euclidean methods achieve optimal sample complexity under stronger stationarity measur
OptimizationTheoryTransformersTraining Methods
Research arXiv (Machine Learning) Jun 15

A Low-Rank Subspace Analysis of LLM Interventions

By Angira Sharma, Christian Schroeder de Witt, Philip Torr, Anisoara Calinescu, Jialin Yu

72 score
AI Analysis

This paper introduces a diagnostic framework that models LLM behaviors (refusal, jailbreak, sycophancy) as low-rank subspaces in activation space, showing that interventions on one behavior propagate asymmetrically to others. It explains why targeted safety interventions cause unintended side-effects, which matters for designing reliable safety controls.

Interventions designed to modify a particular behavior in LLMs, such as refusal or sycophancy, often produce unintended changes in other behaviors. This lack of targeted control makes it difficult to design and implement reliable safety controls. To understand these side-effects, we introduce a diagnostic framework for analyzing interacting behaviors in LLMs. We model behaviors as low-rank subspaces in activation space, and study how interventions influence across behaviors. Across multiple inst
AI SafetyInterpretabilityLanguage ModelsAlignment
Research arXiv (Computation and Language) Jun 15

Right or Wrong, Models Comply: Directional Blindness in LLM Moral Judgment

By Jihye Kim, Jeffrey Flanigan

71 score
AI Analysis

Introduces Compliance Asymmetry, a bidirectional diagnostic comparing whether LLMs follow helpful nudges versus misleading nudges. Across 9 models and 972,000 responses, finds models selectively resist harmful nudges on factual questions but comply with both directions nearly equally on moral questions, revealing directional blindness in moral judgment.

As language models take integrated roles across many domains, the response of LLMs to user pushback becomes a critical alignment property. Yet many existing evaluations treat compliance as unidirectional, measuring whether models resist pressure but not whether they resist it selectively. We introduce Compliance Asymmetry (A = BCR/HCR), a bidirectional diagnostic that compares beneficial output change under helpful nudges with harmful change under misleading nudges. Across 9 models and 972,000 n
AlignmentLLM EvaluationAI SafetySycophancy
Research arXiv (Artificial Intelligence) Jun 15

Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results

By Jan Batzner, Sree Harsha Nelaturu, Anastassia Kornilova, Jon Crall, Tommaso Cerruti, Yanan Long, Yifan Mai, Sanchit Ahuja, Asaf Yehudai, Marek \v{S}uppa, John P. Lalor, Oluwagbemike Olowe, Jatin Ganhotra, Brian H. Hu, Eliya Habba, Andrew M. Bean, Chang Liu, Sander Land, Steven Dillmann, Aniketh Garikaparthi, Elron Bandel, Saki Imai, James Edgell, Wm. Matthew Kennedy, Jenny Chim, Patrick Meusling, Asteria Kaeberlein, Venkata Ramachandra Karthik Chundi, Manasi Patwardhan, Martin Ku, Austin Meek, Leon Knauer, Brian Wingenroth, Srishti Yadav, Usman Gohar, Felix Friedrich, Michelle Lin, Jennifer Mickel, Arman Cohan, Stella Biderman, Irene Solaiman, Zeerak Talat, Anka Reuel, Mubashara Akhtar, Gjergji Kasneci, Avijit Ghosh, Leshem Choshen

71 score
AI Analysis

Every Eval Ever introduces the first shared schema and community-crowdsourced repository for AI evaluation results, standardizing how evaluations are represented in a unified JSON document. It tackles fragmentation and inconsistency across leaderboards, harnesses, and papers.

AI evaluations are widely used for testing and understanding progress. However, the diverse evaluators bring with them inconsistencies that challenge analysis and comparison. First, results are saved in incompatible formats, scattered across leaderboards, papers, blog posts, evaluation harness logs, and custom repositories. Second, results are created by different evaluation frameworks, which produce divergent scores for nominally identical evaluations and record metadata inconsistently, hinderi
AI EvaluationBenchmarksStandardizationOpen Science
Research arXiv (Machine Learning) Jun 15

Natively Unlearnable Large Language Models

By Gaurav R. Ghosal, Pratyush Maini, Aditi Raghunathan

70 score
AI Analysis

Proposes NULLs (Natively Unlearnable LLMs), a model class with shared backbone neurons and sparsely activated per-source sinks so that source-specific information concentrates in sinks and can be disabled at deployment to unlearn data. Resolves the tension between joint learning and clean removal.

Unlearning aims to remove the influence of specific training data sources, but this has proved challenging because the contributions of different sources are entangled within the model. Isolating source contributions to disjoint parameters makes removal easier, though it obstructs joint learning across sources. We propose NULLs (Natively Unlearnable LLMs), a model class that satisfies the two opposing goals of isolating source-specific contributions and learning jointly across sources, by traini
Machine UnlearningAI SafetyLanguage ModelsPrivacy
Research arXiv (Artificial Intelligence) Jun 15

Adversarial Concept Search: Predicting Compositional Errors From Feature Geometry

By Jennifer Meng Lu, Ruochen Zhang, Isabelle Lee, David Alvarez-Melis, Ellie Pavlick, Naomi Saphra

70 score
AI Analysis

Uses an LLM's representational geometry to predict which concept combinations it will fail to compose, attributing failures to feature interference when concept encodings are near each other rather than orthogonal. Demonstrated across programmatic, multihop, and multilingual tasks.

Humans cannot always intuit what scenarios are most challenging to LLMs. Hoping to capture challenging edge cases, developers either design problems to be difficult for humans or curate extensive benchmarks. What if we could instead anticipate which scenarios a model will fail on? In this paper, we use an LLM's representational geometry to predict which concept combinations it will fail on. We attribute this compositional failure to interference between salient features. In tasks that require sy
InterpretabilityLanguage ModelsCompositional Reasoning
Research arXiv (cs.CR) Jun 15

Same-Origin Policy for Agentic Browsers

By Xilong Wang, Xiaoxing Chen, Patrick Li, Dawn Song, Neil Gong

70 score
AI Analysis

Investigates whether the same-origin policy remains effective in agentic browsers, showing the agent itself can act as a cross-origin data flow channel violating SOP. Introduces SOPBench and finds existing agentic browsers frequently violate SOP.

Agentic browsers integrate autonomous AI agents into web browsers, enabling users to accomplish web tasks through natural-language instructions. The same-origin policy (SOP) is a fundamental browser security mechanism that prevents unauthorized automated cross-origin data flows induced by scripts. However, whether SOP remains effective in agentic browsers is an open question that has not been systematically studied. In this work, we bridge this gap. We first observe that an agentic browser can i
AI SafetySecurityLLM AgentsBenchmarks
Research arXiv (Computation and Language) Jun 15

OdysSim: Building Foundation Models for Human Behavior Simulation

By Xuhui Zhou, Weiwei Sun, Weihua Du, Jiarui Liu, Haojia Sun, Qianou Ma, Tongshuang Wu, Yiming Yang, Maarten Sap

70 score
AI Analysis

OdysSim builds foundation models for simulating human behavior, addressing the homogeneous overly-agreeable register that helpfulness training induces. It introduces the SOUL taxonomy, a 21.4M-interaction corpus, a benchmark, and a training recipe for behavioral simulation.

Large language models are increasingly deployed as human simulators for interactive evaluation and social simulation. Yet helpfulness-driven post-training pulls them toward a homogeneous, overly agreeable assistant register, creating a behavioral Sim2Real gap. We present OdysSim, the largest open systematic investigation of behavioral foundation models, i.e., models trained to simulate human behavior at scale. We propose SOUL, a taxonomy of five capability axes (CONV, SS, COG, ROLE, EVAL) that u
Language ModelsHuman SimulationBenchmarksSocial AI
Research arXiv (Machine Learning) Jun 15

Running the Gauntlet: Re-evaluating the Capabilities of Agents Beyond Familiar Environments

By Mykola Vysotskyi, Runqi Lin, Grzegorz Biziel, Michal Zakrzewski, Sebastian Montagna, Damian Rynczak, Shreyansh Padarha, Kumail Alhamoud, Zihao Fu, William Lugoloobi, Kai Rawal, Hanna Yershova, Xander Davies, Taras Rumezhak, Guohao Li, Fazl Barez, Baoyuan Wu, Arkadiusz Drohomirecki, Yarin Gal, Chris Russell, Christopher Summerfield, Adam Mahdi, Volodymyr Karpiv, Philip Torr, Adel Bibi

70 score
AI Analysis

GauntletBench is a web-based benchmark evaluating AI agent generalisation in unfamiliar professional applications (3D modeling, circuit design, flight analysis) focusing on temporal perception, graphical understanding, and 3D reasoning. It probes underexplored agent capabilities where current benchmarks are saturated.

As agentic systems continue to evolve and are widely deployed in real-world scenarios, there is a growing demand to faithfully evaluate their capabilities. However, current benchmarks are typically built on popular applications with relatively simple tasks and focus on a narrow set of capabilities while overlooking broader dimensions, resulting in saturated performance on modern agents and failing to probe their limitations. To this end, we introduce GauntletBench, a web-based benchmark for eval
AI AgentsBenchmarksEvaluationMultimodal
Research arXiv (Machine Learning) Jun 15

Muon$^p$: Muon with Fractional Spectral Powers

By Yihe Dong, Will Sawin

69 score
AI Analysis

Introduces Muon^p, an optimizer generalizing Muon by using fractional spectral-power updates to interpolate between Muon and gradient descent. Proves fractional powers cannot be computed by fixed polynomial iterations and derives matrix-multiplication-only approximations.

Muon is an increasingly widely used optimizer that replaces a gradient $G=USV^\top$ with its polar factor $UV^\top$, thereby flattening the singular spectrum. However, full flattening discards singular-value information that may matter for adaptation. We introduce Muon$^p$, a Muon-style optimizer that instead uses fractional spectral-power updates $US^pV^\top$ for rational $p\in(0,1)$, interpolating between Muon and gradient descent. To make it practical, we prove that fractional spectral powers
OptimizationDeep LearningTheory
Research arXiv (Machine Learning) Jun 15

Decompose Sparsely Where You Should, Absorb Densely Where You Should No

By Ruixuan Deng, Zehao Jin, Zekun Wang, Zihan Dong

69 score
AI Analysis

Challenges the assumption that all residual stream activations suit sparse decomposition, hypothesizing a dense low-rank component unsuitable for sparse representation. Adds a small rank-r linear bottleneck parallel to sparse autoencoders, reducing dense latent count by up to 84 percent on Gemma-2-2B while improving reconstruction.

Sparse autoencoders (SAEs) are typically trained to reconstruct the \textbf{entire} residual stream through a sparse dictionary, implicitly assuming that all activation content is amenable to sparse, monosemantic decomposition. We question this assumption and hypothesize that activations contain a low-rank, dense component that is computationally important to the model yet inherently unsuitable for sparse representation, which serves as a major source of the persistent dense latents widely obser
InterpretabilitySparse AutoencodersMechanistic Interpretability
Research arXiv (Machine Learning) Jun 15

SuperThoughts: Reasoning Tokens in Superposition

By Zheyang Xiong, Shivam Garg, Max Yu, Vaishnavi Shrivastava, Haoyu Zhao, Anastasios Kyrillidis, Dimitris Papailiopoulos

68 score
AI Analysis

SuperThoughts compresses pairs of consecutive chain-of-thought tokens into single latent representations and decodes two tokens per step via multi-token prediction, doubling reasoning throughput while preserving discrete supervision. Evaluated on math reasoning benchmarks with Qwen models.

Long Chain-of-Thought (CoT) reasoning improves LLM problem-solving but is computationally expensive due to sequential token generation. While recent works explore reasoning in continuous latent spaces to bypass discrete token generation, they often struggle with training stability and fail to scale to complex, long-horizon tasks due to lack of supervision signal. We propose SuperThoughts, which compresses pairs of consecutive CoT tokens into single latent representations and decodes two tokens p
Language ModelsReasoningEfficiency