Category intelligence

Research Briefing

All 142 current items, analyzed and ranked.

Executive synthesis

Research Summary

Executive Signal

  • A convergence of benchmark-integrity, endogenous-misalignment, and post-distillation defense research signals that current evaluation pipelines are increasingly unreliable as agent capability scales.

Priority Developments

Leadership Implications

Key Themes

AI Safety and Evaluation · 3Agents and Agentic Systems · 12Language Model Inference Efficiency · 5Robotics and Embodied AI · 9Reasoning and Test-Time Compute · 3Benchmarking · 5AI Safety and Security · 3Reward Hacking · 1AI Safety and Alignment · 8Robotics and World Models · 4

Primary evidence

All Ranked Signals

Showing 10 of 142 signals 2 remaining
Research AlphaXiv Trending Sep 28

Maintaining Benchmarks Against Increasingly Capable Agents: Detection and Remediation of Unearned Passes

By Weijun Luo, Kelvin Luu, Xinyi Liu, Guangze Luo, Miguel Romero Calvo, Soham Dan, Daniel Yue Zhang, Ying Liu, Mohamed Elfeki

88 score
AI Analysis

The paper introduces a process-verification framework that audits agent benchmark trajectories to distinguish reward hacking from verifier weakness, defining the integrity gap as the proportion of unearned passes. Across 3,810 trajectories, confirmed violation rates on SWE-Bench Pro rose sharply with model generation (24% to 73% for Opus).

Source details
Agentic benchmarks guide model selection and training. Yet an agent can pass a task without demonstrating the intended capability. Such outcomes constitute unearned passes; their proportion among all passes defines the integrity gap. As agents improve, benchmark surfaces that once seemed harmless can become exploitable, making benchmark validity an ongoing maintenance problem. We introduce a process-verification framework that audits passing trajectories, distinguishes evidenced reward hacking f
AI SafetyBenchmarkingAgent EvaluationReward Hacking
Research AlphaXiv Trending Sep 28

SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents

By Saswat Das, Parvati Viswanathan, Daniel Donnelly, Chang Huang, Sahar Abdelnabi, Ferdinando Fioretto

86 score
AI Analysis

SEABench benchmarks endogenous misalignment in self-evolving LLM agents across 48 longitudinal task sequences spanning multiple evolution surfaces, task domains, and harm types. It studies how locally useful updates during self-evolution can persist into later tasks where they produce unsafe behavior.

Source details
Self-evolving LLM agents have gained prominence for their ability to improve after deployment by modifying their harness, including their controller instructions, memory management protocols, and reusable tools and skills, in response to user and environment feedback. However, locally useful updates may persist into later tasks where they produce unsafe behavior, even without direct adversarial influence. To study this risk, we introduce SEABench, a benchmark for studying endogenous misalignment
AI SafetyAgentsAlignmentBenchmarking
Research AlphaXiv Trending Sep 28

Harness Learning Enables Generalizable Test-Time Adaptation

By Alvin Zhang, Xuecheng Liu, Zixuan Wang, Fahim Tajwar, Daman Arora, Ruslan Salakhutdinov, Daniel Khashabi, Yuda Song, Andrea Zanette

84 score
AI Analysis

Harness Learning trains a proposer model to revise a solver's executable harness using execution feedback via reinforcement learning, framing this as meta-learning over programs where harness revisions play the role of weight updates. At test time, the proposer refines the harness iteratively on new tasks.

Source details
A language-model agent is jointly defined by its model and its harness, the executable program that organizes model calls, tool use, and information flow. Because different tasks call for different ways of organizing these operations, the harness needs to be adapted using feedback from the task at hand. We introduce harness learning, which trains a proposer model to revise a solver's harness using execution feedback. We formulate this process as meta-learning over executable programs, with harne
AgentsMeta-LearningReinforcement LearningAgentic Frameworks
Research AlphaXiv Trending Sep 28

Verifiable Visual Rewards Transfer from Synthetic Scenes to Natural Prompts

By Shuyue Stella Li, Xiaochuang Han, Yulia Tsvetkov, Luke Zettlemoyer

83 score
AI Analysis

Verifiable Visual Rewards provides programmatically generated image-reward tasks where prompts and deterministic verifiers are derived from synthetic geometric scenes, enabling reliable reward signal for precise image generation. Training on these transfers to natural prompts; VVRBench includes 10,000 tasks over 32 constraint types.

Source details
Precise instruction following in image generation, such as satisfying object counts and spatial relations, remains an open challenge at least in part because it is learned using unreliable reward models such as object detectors and vision-language models. We introduce Verifiable Visual Rewards (VVR), the first framework for programmatically verifiable image rewards, and show that training on it generalizes to natural prompts. Each VVR task is a scene of geometric objects and relations among them
Image GenerationReinforcement LearningReward ModelingBenchmarking
Research AlphaXiv Trending Sep 28

Draft-KV: Learning Useful Latent Communication Between Language Models

By Linquan Wu, Shichang Meng, Tianxiang Jiang, Haoyu Yang, Peng Zhong, Fengming Zhu, Xi Peng, Linqi Song, Jacky Keung, Jingyu Zhang

82 score
AI Analysis

Draft-KV critiques latent communication between language models by showing that receiver gains often do not depend on message content, then proposes sending the sharer's draft-time KV states stored in side memory via gated attention with progressive training. Both the diagnostic and the proposed mechanism are contributions. The analysis reframes how latent communication should be evaluated.

Source details
Latent communication passes internal states between language models instead of decoded text, but higher receiver accuracy does not show that the receiver used the message content. Across five method-dataset pairs, replacing each message with one from an unrelated question changes accuracy by at most 0.60 points, even when communication adds 15.44 points over the receiver alone. Thus the interface can supply the gain while making the sharer dispensable. Draft-KV instead sends the key-value states
Language ModelsMulti-Model SystemsInterpretabilityCommunication
Research AlphaXiv Trending Sep 28

EMPIRIC: Experiment-Driven Learning of Residual World Models for Robot Planning

By Yichao Liang, Amber Li, Dat Nguyen, Emily Bunnapradist, Michelangelo Naim, Sreela Kodali, Matteo Merler, Bowen Li, Kiran Gopinathan, Yiyun Liu, Nikhil Pimpalkhare, Joshua B. Tenenbaum, Adrian Weller, Zenna Tavares, Tom Silver, Kevin Ellis

82 score
AI Analysis

EMPIRIC learns residual world models for robots by extending physics engines with learned programs that capture missing mechanisms such as glue curing or wind heating. Bayesian inference estimates program parameters from noisy observations, enabling interpretable predictions, informative experiments, and hypothesis revision.

Source details
A robot should be able to learn through experiments how unfamiliar objects behave and interact, then plan with that knowledge. It need not start from scratch: physics engines supply knowledge of motion and contact, but can omit entire mechanisms, such as glue curing, water heating, or wind. We present EMPIRIC, an agent that learns a residual world model: a physics engine extended with code for the missing mechanisms. The learned programs can introduce new forces, constraints, and hidden state, a
RoboticsWorld ModelsProgram SynthesisBayesian InferenceSymbolic AI
Research AlphaXiv Trending Sep 28

KV-streams for Efficient Compaction in Agentic Reinforcement Learning

By Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda, Roger Creus Castanyer, Siddarth Venkatraman, Abhay Puri, Jonathan Light, Matthew James Sargent, Augustine N. Mavor-Parker, Massimo Caccia, Lucas Caccia, Glen Berseth, Esmeralda S. Whitammer, Alessandro Sordoni, Minseon Kim, Marc-Alexandre Côté, Laurent Charlin, Guillaume Lajoie

81 score
AI Analysis

KV-streams stream the KV cache forward during context compaction in agentic RL rather than flushing it after each compaction, enabling scalable training without throughput penalties. The plug-and-play strategy works with multiple compaction methods and shows no evidence of hindering performance.

Source details
Scaling the horizon of agentic LLMs is bottlenecked by the need to fit ever longer context traces in GPU memory. Context compaction has been the most popular mechanism to alleviate this issue, keeping GPU memory constant for a given trace. Unfortunately, most compaction strategies rely on prefilling the LLM context many times over, hindering training throughput. To alleviate this bottleneck and enable efficient trainable compaction, we propose KV-streams, a plug-and-play strategy compatible with
AgentsReinforcement LearningEfficiencyKV CacheLong Context
Research AlphaXiv Trending Sep 28

Improving Test-Time Scaling with Adaptive Looped Transformers

By Yichen You, Tianyu Fu, Aosong Feng, Xingtai Lv, Xuefei Ning, Ning Ding, Yu Wang

80 score
AI Analysis

TaH2 applies token-level adaptive depth to looped transformers, allowing extra recurrent computation only when an additional iteration improves next-token prediction. Applied to Qwen3 models, it raises the AIME24-26 accuracy-compute slope from 1.79 to 2.74 percentage points per doubling of decoding FLOPs and improves average benchmark accuracy by up to 4.8 points. The work ties adaptive depth to test-time scaling.

Source details
TaH2 adds token-level adaptive depth to looped transformers, allowing extra recurrent computation only when an additional iteration improves next-token prediction. Post-trained on Qwen3 models, it raises the AIME24–26 accuracy–compute scaling slope from 1.79 to 2.74 percentage points per doubling of decoding FLOPs, reaches about 15.4% accuracy at a matched 191.7 TFLOPs budget, and improves average benchmark accuracy by up to 4.8 points as the depth limit increases.
Language ModelsTest-Time ComputeEfficient InferenceReasoning
Research AlphaXiv Trending Sep 28

Simplex Diffusion Models

By Justin Deschenaux, Alexandre Galashov, Andrew Campbell, Li Kevin Wenliang, James Thornton, Arnaud Doucet, Valentin De Bortoli

80 score
AI Analysis

Simplex Diffusion Models lift discrete diffusion to the probability simplex to represent belief distributions over categories, avoiding information collapse from categorical sampling. The framework admits closed-form reverse transitions, trains with cross-entropy loss, and supports a DDIM-like sampler with tunable stochasticity.

Source details
Diffusion models have revolutionized generative modeling for continuous data through the gradual refinement of a belief state. This iterative refinement has not yet carried over to discrete diffusion models, which discard uncertainty at intermediate steps through categorical sampling (information collapse). We propose Simplex Diffusion Models (SDMs), a framework that lifts the diffusion process to the probability simplex to represent beliefs over categories. SDMs admit probability paths with clo
Diffusion ModelsGenerative ModelsDiscrete DiffusionTheory
Research AlphaXiv Trending Sep 28

Distillation Defenses Easily Break After Reinforcement Learning

By Shidan Javaheri, Alexander Panfilov, Oliver Britton, Yarin Gal, Yonatan Gideoni

80 score
AI Analysis

The paper argues that distillation-defense evaluations are unrealistically optimistic because attackers can continue training distilled models with RL after stealing reasoning traces. Several defenses that look effective immediately after distillation collapse under subsequent RL fine-tuning, revealing mis-specified threat models and a false sense of security.

Source details
Distillation attacks copy the reasoning capabilities of closed-source large language models, allowing bad actors to replicate state-of-the-art performance at low cost. Attackers systematically collect a large volume of frontier model reasoning traces and then train (i.e., "distill") their own models on these traces. Existing defenses against distillation attacks are typically evaluated immediately after distillation, implicitly assuming attackers do not train their models any further. In this pa
AI SafetyAdversarial RobustnessLanguage Models