Category intelligence

Research Briefing — February 19, 2026

382 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research centers on agent reliability, ecosystem-level AI risks, and mechanistic understanding of emergence, with notable advances in robotics and safety evaluation.

  • Arvind Narayanan's group proposes twelve concrete metrics for AI agent reliability across consistency, robustness, predictability, and safety—a foundational framework as agentic systems proliferate
  • Retrieval Collapse formalizes how AI-generated web pollution erodes search diversity and enables adversarial manipulation of retrieval pipelines
  • A pre-registered RCT (n=153) finds no significant LLM uplift for novice biology lab performance, a critical biosecurity policy result
  • Mechanistic tracking of five geometric measures across model scales reveals universal representation collapse followed by top-down reorganization during capability emergence

In robotics, DreamZero achieves 2× improvement over SOTA vision-language-action models via joint video-action diffusion modeling, while EgoScale discovers scaling laws for dexterous manipulation from 20,854 hours of egocentric human video. On the safety front, optimization instability in clinical agentic workflows shows self-improvement paradoxically degrades performance, and STING introduces automated red-teaming for multi-turn illicit assistance. Doc-to-LoRA offers a practical alternative to long-context inference by meta-learning single-pass context distillation into LoRA adapters.

Key Themes

AI Agents & Reliability · 12AI Safety & Alignment · 18Mechanistic Interpretability & Training Dynamics · 4AI Safety, Red Teaming & Fairness · 7LLM Agents & Decision Making · 7LLM Reasoning & Prompting · 10Language Model Architecture & Reasoning · 6Robotics & World Models · 4Language Models & Architecture Design · 12Humanoid and Dexterous Manipulation · 4

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) Feb 19

Towards a Science of AI Agent Reliability

By Stephan Rabanser, Sayash Kapoor, Peter Kirgis, Kangheng Liu, Saiteja Utpala, Arvind Narayanan

75 score
AI Analysis

Proposes twelve concrete metrics decomposing AI agent reliability along four dimensions (consistency, robustness, predictability, safety), grounded in safety-critical engineering. Evaluates 14 agents and finds that standard success metrics obscure critical operational flaws.

arXiv:2602.16666v1 Announce Type: new Abstract: AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation of current evaluations: compressing agent behavior into a single success metric obscures critical operational flaws. Notably, it ignores whether agents behave consistently across runs, withstand perturbations,
AI SafetyAI AgentsEvaluation MethodsReliability
Research arXiv (Artificial Intelligence) Feb 19

Improving Interactive In-Context Learning from Natural Language Feedback

By Martin Klissarov, Jonathan Cook, Diego Antognini, Hao Sun, Jingling Li, Natasha Jaques, Claudiu Musat, Edward Grefenstette

72 score
AI Analysis

Proposes a framework treating interactive in-context learning from natural language feedback as a trainable skill rather than emergent property. Introduces a scalable method to transform single-turn verifiable tasks into multi-turn didactic interactions, showing current flagship models are suboptimal at learning from feedback.

arXiv:2602.16066v1 Announce Type: new Abstract: Adapting one's thought process based on corrective feedback is an essential ability in human learning, particularly in collaborative settings. In contrast, the current large language model training paradigm relies heavily on modeling vast, static corpora. While effective for knowledge acquisition, it overlooks the interactive feedback loops essential for models to adapt dynamically to their context. In this work, we propose a framework that treats
In-Context LearningLanguage ModelsInteractive LearningTraining Methods
72 score
AI Analysis

Tracks five geometric measures across model scales (405K-85M) during training, finding universal representation collapse to scale-invariant floors followed by top-down layer reorganization preceding capability emergence.

arXiv:2602.15997v1 Announce Type: cross Abstract: Capability emergence during neural network training remains mechanistically opaque. We track five geometric measures across five model scales (405K-85M parameters), 120+ emergence events in eight algorithmic tasks, and three Pythia language models (160M-2.8B). We find: (1) training begins with a universal representation collapse to task-specific floors that are scale-invariant across a 210X parameter range (e.g., modular arithmetic collapses to
Mechanistic InterpretabilityEmergenceRepresentation LearningTraining Dynamics
Research arXiv (Artificial Intelligence) Feb 19

Retrieval Collapses When AI Pollutes the Web

By Hongyeon Yu, Dongchan Kim, Young-Bum Kim

72 score
AI Analysis

Characterizes 'Retrieval Collapse' — a failure mode where AI-generated content dominates search results, eroding source diversity and enabling adversarial content infiltration. Shows 67% pool contamination leads to 80%+ exposure contamination in RAG/search systems.

arXiv:2602.16136v1 Announce Type: cross Abstract: The rapid proliferation of AI-generated content on the Web presents a structural risk to information retrieval, as search engines and Retrieval-Augmented Generation (RAG) systems increasingly consume evidence produced by the Large Language Models (LLMs). We characterize this ecosystem-level failure mode as Retrieval Collapse, a two-stage process where (1) AI-generated content dominates search results, eroding source diversity, and (2) low-qualit
Information RetrievalAI SafetyRAG SystemsAI-Generated Content
Research arXiv (Artificial Intelligence) Feb 19

Measuring Mid-2025 LLM-Assistance on Novice Performance in Biology

By Shen Zhou Hong, Alex Kleinman, Alyssa Mathiowetz, Adam Howes, Julian Cohen, Suveer Ganta, Alex Letizia, Dora Liao, Deepika Pahari, Xavier Roberts-Gaal, Luca Righetti, Joe Torres

72 score
AI Analysis

Pre-registered RCT (n=153) testing whether LLMs improve novice performance in biology lab tasks modeling a viral reverse genetics workflow. Found no significant difference in workflow completion between LLM and Internet groups.

arXiv:2602.16703v1 Announce Type: cross Abstract: Large language models (LLMs) perform strongly on biological benchmarks, raising concerns that they may help novice actors acquire dual-use laboratory skills. Yet, whether this translates to improved human performance in the physical laboratory remains unclear. To address this, we conducted a pre-registered, investigator-blinded, randomized controlled trial (June-August 2025; n = 153) evaluating whether LLMs improve novice performance in tasks th
AI SafetyBiosecurityDual-UseLLM Evaluation
Research arXiv (Machine Learning) Feb 19

World Action Models are Zero-shot Policies

By Seonghyeon Ye, Yunhao Ge, Kaiyuan Zheng, Shenyuan Gao, Sihyun Yu, George Kurian, Suneel Indupuru, You Liang Tan, Chuning Zhu, Jiannan Xiang, Ayaan Malik, Kyungmin Lee, William Liang, Nadun Ranawaka, Jiasheng Gu, Yinzhen Xu, Guanzhi Wang, Fengyuan Hu, Avnish Narayan, Johan Bjorck, Jing Wang, Gwanghyun Kim, Dantong Niu, Ruijie Zheng, Yuqi Xie, Jimmy Wu, Qi Wang, Ryan Julian, Danfei Xu, Yilun Du, Yevgen Chebotar, Scott Reed, Jan Kautz, Yuke Zhu, Linxi "Jim" Fan, Joel Jang

72 score
AI Analysis

Introduces DreamZero, a World Action Model built on pretrained video diffusion that jointly models video and action for robotic manipulation. Achieves 2x improvement in generalization to new tasks/environments compared to state-of-the-art VLAs.

arXiv:2602.15922v1 Announce Type: cross Abstract: State-of-the-art Vision-Language-Action (VLA) models excel at semantic generalization but struggle to generalize to unseen physical motions in novel environments. We introduce DreamZero, a World Action Model (WAM) built upon a pretrained video diffusion backbone. Unlike VLAs, WAMs learn physical dynamics by predicting future world states and actions, using video as a dense representation of how the world evolves. By jointly modeling video and ac
RoboticsWorld ModelsVideo GenerationFoundation Models
Research arXiv (Robotics) Feb 19

EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data

By Ruijie Zheng, Dantong Niu, Yuqi Xie, Jing Wang, Mengda Xu, Yunfan Jiang, Fernando Casta\~neda, Fengyuan Hu, You Liang Tan, Letian Fu, Trevor Darrell, Furong Huang, Yuke Zhu, Danfei Xu, Linxi Fan

72 score
AI Analysis

Presents EgoScale, a framework that trains a Vision-Language-Action model on 20,854 hours of egocentric human video for dexterous manipulation, discovering a log-linear scaling law between human data scale and performance.

arXiv:2602.16710v1 Announce Type: new Abstract: Human behavior is among the most scalable sources of data for learning physical intelligence, yet how to effectively leverage it for dexterous manipulation remains unclear. While prior work demonstrates human to robot transfer in constrained settings, it is unclear whether large scale human data can support fine grained, high degree of freedom dexterous manipulation. We present EgoScale, a human to dexterous manipulation transfer framework built o
Dexterous ManipulationScaling LawsVision-Language-ActionImitation LearningHumanoid Robotics
Research arXiv (Artificial Intelligence) Feb 19

EnterpriseGym Corecraft: Training Generalizable Agents on High-Fidelity RL Environments

By Sushant Mehta, Logan Ritchie, Suhaas Garre, Nick Heiner, Edwin Chen

70 score
AI Analysis

Introduces EnterpriseGym Corecraft, a high-fidelity enterprise simulation environment for training AI agents on customer support tasks. Frontier models like GPT-5.2 and Claude Opus 4.6 solve <30% of tasks. Training with RL on this environment produces capabilities that generalize beyond training distribution.

arXiv:2602.16179v1 Announce Type: new Abstract: We show that training AI agents on high-fidelity reinforcement learning environments produces capabilities that generalize beyond the training distribution. We introduce \corecraft{}, the first environment in \textsc{EnterpriseGym}, Surge AI's suite of agentic RL environments. \corecraft{} is a fully operational enterprise simulation of a customer support organization, comprising over 2,500 entities across 14 entity types with 23 unique tools, des
AI AgentsReinforcement LearningBenchmarksEnterprise AI
Research arXiv (Artificial Intelligence) Feb 19

Optimization Instability in Autonomous Agentic Workflows for Clinical Symptom Detection

By Cameron Cagan, Pedram Fard, Jiazi Tian, Jingya Cheng, Shawn N. Murphy, Hossein Estiri

68 score
AI Analysis

Identifies 'optimization instability' in autonomous agentic workflows for clinical symptom detection, where iterative self-improvement paradoxically degrades performance. At 3% prevalence, systems achieved 95% accuracy while detecting zero positive cases, exposing dangerous failure modes.

arXiv:2602.16037v1 Announce Type: new Abstract: Autonomous agentic workflows that iteratively refine their own behavior hold considerable promise, yet their failure modes remain poorly characterized. We investigate optimization instability, a phenomenon in which continued autonomous improvement paradoxically degrades classifier performance, using Pythia, an open-source framework for automated prompt optimization. Evaluating three clinical symptoms with varying prevalence (shortness of breath at
AI SafetyHealthcare AIAgentic SystemsLLM Reliability
Research arXiv (Artificial Intelligence) Feb 19

Doc-to-LoRA: Learning to Instantly Internalize Contexts

By Rujikorn Charakorn, Edoardo Cetin, Shinnosuke Uesaka, Robert Tjarko Lange

68 score
AI Analysis

Proposes Doc-to-LoRA (D2L), a hypernetwork that meta-learns to perform approximate context distillation in a single forward pass, generating LoRA adapters to internalize document context without re-consuming it during inference.

arXiv:2602.15902v1 Announce Type: cross Abstract: Long input sequences are central to in-context learning, document understanding, and multi-step reasoning of Large Language Models (LLMs). However, the quadratic attention cost of Transformers makes inference memory-intensive and slow. While context distillation (CD) can transfer information into model parameters, per-prompt distillation is impractical due to training costs and latency. To address these limitations, we propose Doc-to-LoRA (D2L),
Efficient InferenceContext DistillationLanguage ModelsParameter-Efficient Methods
Research arXiv (Artificial Intelligence) Feb 19

Balancing Faithfulness and Performance in Reasoning via Multi-Listener Soft Execution

By Nithin Sivakumaran, Shoubin Yu, Hyunji Lee, Yue Zhang, Ali Payani, Mohit Bansal, Elias Stengel-Eskin

68 score
AI Analysis

Proposes REMUL, a multi-party RL approach where listener models execute truncated reasoning traces to improve chain-of-thought faithfulness in LLMs, addressing the tradeoff between faithfulness and task performance.

arXiv:2602.16154v1 Announce Type: cross Abstract: Chain-of-thought (CoT) reasoning sometimes fails to faithfully reflect the true computation of a large language model (LLM), hampering its utility in explaining how LLMs arrive at their answers. Moreover, optimizing for faithfulness and interpretability in reasoning often degrades task performance. To address this tradeoff and improve CoT faithfulness, we propose Reasoning Execution by Multiple Listeners (REMUL), a multi-party reinforcement lear
Chain-of-Thought ReasoningLLM InterpretabilityReinforcement LearningAI Alignment
Research arXiv (Machine Learning) Feb 19

Helpful to a Fault: Measuring Illicit Assistance in Multi-Turn, Multilingual LLM Agents

By Nivya Talokar, Ayush K Tarun, Murari Mandal, Maksym Andriushchenko, Antoine Bosselut

68 score
AI Analysis

Introduces STING, an automated red-teaming framework for measuring illicit assistance in multi-turn LLM agent interactions. Constructs step-by-step illicit plans with benign personas and uses judge agents to track completion.

arXiv:2602.16346v1 Announce Type: cross Abstract: LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test single-prompt instructions, leaving a gap in measuring how agents end up helping with harmful or illegal tasks over multiple turns. We introduce STING (Sequential Testing of Illicit N-step Goal execution), an automated re
AI SafetyRed TeamingLLM AgentsEvaluation