Category intelligence

Research Briefing — January 29, 2026

381 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research spans AI's societal impact, alignment fundamentals, and practical training advances. An Anthropic researcher presents randomized experiments showing AI assistance impairs conceptual understanding during skill acquisition—critical findings for AI deployment strategy.

Alignment & Training Innovations:

Deployment & Evaluation:

Key Themes

AI Safety & Alignment · 12LLM Training & Optimization · 10LLM Efficiency & Deployment · 8LLM Reasoning & Planning · 12AI Safety & Security · 5Mechanistic Interpretability · 6AI Safety & Reliability · 14Evaluation & Benchmarks · 20Transformer Architecture Theory · 5LLM Agents & Tool Use · 14

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) Jan 29

How AI Impacts Skill Formation

By Judy Hanwen Shen, Alex Tamkin

88 score
AI Analysis

Randomized experiments studying how AI assistance affects skill development in programmers learning new libraries. Finds AI use impairs conceptual understanding, code reading, and debugging abilities without significant efficiency gains on average.

arXiv:2601.20245v1 Announce Type: cross Abstract: AI assistance produces significant productivity gains across professional domains, particularly for novice workers. Yet how this assistance affects the development of skills required to effectively supervise AI remains unclear. Novice workers who rely heavily on AI to complete unfamiliar tasks may compromise their own skill acquisition in the process. We conduct randomized experiments to study how developers gained mastery of a new asynchronous
AI SafetyHuman-AI InteractionAI ImpactEducation
Research arXiv (Artificial Intelligence) Jan 29

Reward Models Inherit Value Biases from Pretraining

By Brian Christian, Jessica A. F. Thompson, Elle Michelle Yang, Vincent Adam, Hannah Rose Kirk, Christopher Summerfield, Tsvetomira Dumbalska

86 score
AI Analysis

Shows reward models inherit significant value biases from their base pretrained LLMs. Demonstrates robust differences along psychological value dimensions (agency vs communion) between Llama and Gemma RMs.

arXiv:2601.20838v1 Announce Type: cross Abstract: Reward models (RMs) are central to aligning large language models (LLMs) with human values but have received less attention than pre-trained and post-trained LLMs themselves. Because RMs are initialized from LLMs, they inherit representations that shape their behavior, but the nature and extent of this influence remain understudied. In a comprehensive study of 10 leading open-weight RMs using validated psycholinguistic corpora, we show that RMs
AI AlignmentReward ModelsValue AlignmentBias
Research arXiv (Artificial Intelligence) Jan 29

Reinforcement Learning via Self-Distillation

By Jonas H\"ubotter, Frederike L\"ubeck, Lejs Behric, Anton Baumann, Marco Bagatella, Daniel Marta, Ido Hakimi, Idan Shenfeld, Thomas Kleine Buening, Carlos Guestrin, Andreas Krause

85 score
AI Analysis

Introduces Self-Distillation Policy Optimization (SDPO) for RLVR that converts rich textual feedback into dense learning signals without external teachers. Treats the model conditioned on feedback as its own teacher.

arXiv:2601.20802v1 Announce Type: cross Abstract: Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome reward per attempt, creating a severe credit-assignment bottleneck. Many verifiable environments actually provide rich textual feedback, such as runtime errors or judge evaluations, that explain why an attempt fa
Reinforcement LearningLLM TrainingReasoningSelf-Distillation
Research arXiv (Artificial Intelligence) Jan 29

SokoBench: Evaluating Long-Horizon Planning and Reasoning in Large Language Models

By Sebastiano Monti, Carlo Nicolini, Gianni Pellegrini, Jacopo Staiano, Bruno Lepri

82 score
AI Analysis

Proposes SokoBench, a benchmark based on Sokoban puzzles for evaluating long-horizon planning in Large Reasoning Models. Finds consistent degradation beyond 25 moves, suggesting fundamental planning constraints.

arXiv:2601.20856v1 Announce Type: new Abstract: Although the capabilities of large language models have been increasingly tested on complex reasoning tasks, their long-horizon planning abilities have not yet been extensively investigated. In this work, we provide a systematic assessment of the planning and long-horizon reasoning capabilities of state-of-the-art Large Reasoning Models (LRMs). We propose a novel benchmark based on Sokoban puzzles, intentionally simplified to isolate long-horizon
BenchmarksLLM ReasoningLong-Horizon PlanningEvaluation
Research arXiv (Artificial Intelligence) Jan 29

Truthfulness Despite Weak Supervision: Evaluating and Training LLMs Using Peer Prediction

By Tianyi Alex Qiu, Micah Carroll, Cameron Allen

82 score
AI Analysis

Introduces peer prediction methods from mechanism design for LLM evaluation and post-training. Rewards honest and informative answers using mutual prediction between models, enabling evaluation without strong supervision.

arXiv:2601.20299v1 Announce Type: cross Abstract: The evaluation and post-training of large language models (LLMs) rely on supervision, but strong supervision for difficult tasks is often unavailable, especially when evaluating frontier models. In such cases, models are demonstrated to exploit evaluations built on such imperfect supervision, leading to deceptive results. However, underutilized in LLM research, a wealth of mechanism design research focuses on game-theoretic incentive compatibili
AI AlignmentLLM EvaluationMechanism DesignTruthfulness
Research arXiv (Machine Learning) Jan 29

Quantization-Aware Distillation for NVFP4 Inference Accuracy Recovery

By Meng Xin, Sweta Priyadarshi, Jingyu Xin, Bilal Kartal, Aditya Vavre, Asma Kuriparambil Thekkumpate, Zijia Chen, Ameya Sunil Mahabaleshwarkar, Ido Shahaf, Akhiad Bercovich, Kinjal Patel, Suguna Varshini Velury, Chenjie Luo, Zhiyu Cheng, Jenny Chen, Chen-Han Yu, Wei Ping, Oleg Rybakov, Nima Tajbakhsh, Oluwatobi Olabiyi, Dusan Stosic, Di Wu, Song Han, Eric Chung, Sharath Turuvekere Sreenivas, Bryan Catanzaro, Yoshi Suhara, Tijmen Blankevoort, Huizi Mao

82 score
AI Analysis

Presents quantization-aware distillation (QAD) best practices for recovering accuracy of NVFP4-quantized LLMs and VLMs. Shows effectiveness for models with complex post-training pipelines (SFT+RL+merging) where traditional QAT fails.

arXiv:2601.20088v1 Announce Type: new Abstract: This technical report presents quantization-aware distillation (QAD) and our best practices for recovering accuracy of NVFP4-quantized large language models (LLMs) and vision-language models (VLMs). QAD distills a full-precision teacher model into a quantized student model using a KL divergence loss. While applying distillation to quantized models is not a new idea, we observe key advantages of QAD for today's LLMs: 1. It shows remarkable effectiv
Model QuantizationKnowledge DistillationLLM Efficiency
Research arXiv (Artificial Intelligence) Jan 29

Demystifying Multi-Agent Debate: The Role of Confidence and Diversity

By Xiaochen Zhu, Caiqi Zhang, Yizhou Chi, Tom Stafford, Nigel Collier, Andreas Vlachos

80 score
AI Analysis

Analyzes why multi-agent debate often underperforms majority vote despite higher compute cost. Identifies missing diversity and confidence calibration, proposing lightweight interventions that significantly improve outcomes.

arXiv:2601.19921v1 Announce Type: cross Abstract: Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies show that, under homogeneous agents and uniform belief updates, debate preserves expected correctness and therefore cannot reliably improve outcomes. Drawing on findings from human deliberation and collective
Multi-Agent DebateTest-Time ScalingLLM ReasoningCollective Intelligence
Research arXiv (Artificial Intelligence) Jan 29

Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning

By Minwu Kim, Safal Shrestha, Keith Ross

80 score
AI Analysis

Proposes failure-prefix conditioning to improve learning from saturated problems where standard RLVR stalls. Conditions training on prefixes from rare incorrect trajectories to expose models to failure-prone states.

arXiv:2601.20829v1 Announce Type: cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has substantially improved the reasoning abilities of large language models (LLMs), yet training often stalls as problems become saturated. We identify the core challenge as the poor accessibility of informative failures: learning signals exist but are rarely encountered during standard rollouts. To address this, we propose failure-prefix conditioning, a simple and effective method for learni
Reinforcement LearningReasoningLLM Training
Research arXiv (Machine Learning) Jan 29

Hyperparameter Transfer with Mixture-of-Expert Layers

By Tianze Jiang, Blake Bordelon, Cengiz Pehlevan, Boris Hanin

80 score
AI Analysis

Proposes new parameterization for MoE transformers enabling hyperparameter transfer when scaling width, depth, number of experts, and expert size. Justified by dynamical mean field theory analysis.

arXiv:2601.20205v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) layers have emerged as an important tool in scaling up modern neural networks by decoupling total trainable parameters from activated parameters in the forward pass for each token. However, sparse MoEs add complexity to training due to (i) new trainable parameters (router weights) that, like all other parameter groups, require hyperparameter (HP) tuning; (ii) new architecture scale dimensions (number of and size of experts
Mixture of ExpertsHyperparameter TransferScaling Laws
Research arXiv (Artificial Intelligence) Jan 29

The Grammar of Transformers: A Systematic Review of Interpretability Research on Syntactic Knowledge in Language Models

By Nora Graichen, Iria de-Dios-Flores, Gemma Boleda

78 score
AI Analysis

Systematic review of 337 articles evaluating syntactic abilities of Transformer language models, analyzing 1,015 model results across syntactic phenomena and interpretability methods.

arXiv:2601.19926v1 Announce Type: cross Abstract: We present a systematic review of 337 articles evaluating the syntactic abilities of Transformer-based language models, reporting on 1,015 model results from a range of syntactic phenomena and interpretability methods. Our analysis shows that the state of the art presents a healthy variety of methods and data, but an over-focus on a single language (English), a single model (BERT), and phenomena that are easy to get at (like part of speech and a
InterpretabilitySyntaxLiterature ReviewLanguage Models
Research arXiv (Artificial Intelligence) Jan 29

Beyond the Needle's Illusion: Decoupled Evaluation of Evidence Access and Use under Semantic Interference at 326M-Token Scale

By Tianwei Lin, Zuyi Zhou, Xinda Zhao, Chenke Wang, Xiaohong Li, Yu Chen, Chuanrui Hu, Jian Pei, Yafeng Deng

78 score
AI Analysis

Introduces EverMemBench-S, an adversarial NIAH benchmark with 326M-token MemoryBank that tests evidence access and use separately. Features collision-tested hard negatives and multi-document gold evidence sets.

arXiv:2601.20276v1 Announce Type: cross Abstract: Long-context LLM agents must access the right evidence from large environments and use it faithfully. However, the popular Needle-in-a-Haystack (NIAH) evaluation mostly measures benign span localization. The needle is near-unique, and the haystack is largely irrelevant. We introduce EverMemBench-S (EMB-S), an adversarial NIAH-style benchmark built on a 326M-token MemoryBank. While the full MemoryBank spans 326M tokens for retrieval-based (RAG) e
Long-Context LLMsBenchmarksEvaluation
Research arXiv (Machine Learning) Jan 29

Reinforcement Unlearning via Group Relative Policy Optimization

By Efstratios Zaradoukas, Bardh Prenkaj, Gjergji Kasneci

78 score
AI Analysis

Introduces PURGE for machine unlearning in LLMs using Group Relative Policy Optimization framework, formulating unlearning as verifiable problem with intrinsic reward penalizing mentions of target data.

arXiv:2601.20568v1 Announce Type: new Abstract: During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove information from a deployed model without retraining from scratch. Existing unlearning approaches attempt to address this need, but often leak the very data they aim to erase, sacrifice fluency and robustness, or d
Machine UnlearningAI SafetyRLHFPrivacy