Category intelligence

Research Briefing — January 12, 2026

306 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research features significant theoretical contributions on LLM limitations alongside critical safety findings. A mathematical proof formalizes recursive self-improvement as a dynamical system, demonstrating degenerative dynamics that challenge near-term AGI expectations without symbolic synthesis.

Interpretability & Reasoning:

  • PaCoRe introduces parallel coordinated reasoning via message-passing to break sequential test-time compute limits
  • Sparse autoencoders fail to identify genuine reasoning features—59-94% of detected features respond to surface-level cues rather than underlying logic
  • Transformers trained autoregressively inherently encode time-delayed causal structures recoverable from gradient sensitivities
  • Circular Reasoning benchmark identifies self-reinforcing loops as a key failure mode in large reasoning models

Safety & Security:

Key Themes

AI Safety & Security · 24AI Safety & Robustness · 12Reasoning & Test-Time Compute · 10LLM Evaluation & Benchmarking · 10Interpretability & Mechanistic Analysis · 7AI Safety & Reliability · 9Reasoning & Chain-of-Thought · 7LLM Agents & Tool Use · 17Emergent Misalignment · 1Efficient Inference & Training · 8

Primary evidence

Top Ranked Signals

82 score
AI Analysis

Formalizes recursive LLM self-training as discrete-time dynamical system, proving inevitable degenerative dynamics as training data becomes self-generated. Identifies two failure modes: entropy decay (mode collapse) and variance amplification (truth drift).

We formalise recursive self-training in Large Language Models (LLMs) and Generative AI as a discrete-time dynamical system and prove that, as training data become increasingly self-generated ($\alpha_t \to 0$), the system undergoes inevitably degenerative dynamics. We derive two fundamental failure modes: (1) Entropy Decay, where finite sampling effects cause a monotonic loss of distributional diversity (mode collapse), and (2) Variance Amplification, where the loss of external grounding causes
AI SafetyLLM TheoryAGISelf-Improvement Limits
Research arXiv (Machine Learning) Jan 12

PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning

By Jingcheng Hu, Yinmin Zhang, Shijie Shang, Xiaobo Yang, Yue Peng, Zhewei Huang, Hebin Zhou, Xin Wu, Jie Cheng, Fanqi Wan, Xiangwen Kong, Chengyuan Yao, Kaiwen Yan, Ailin Huang, Hongyu Zhou, Qi Han, Zheng Ge, Daxin Jiang, Xiangyu Zhang, Heung-Yeung Shum

82 score
AI Analysis

PaCoRe introduces parallel coordinated reasoning for scaling test-time compute beyond sequential reasoning limits. Uses message-passing architecture across parallel trajectories trained with outcome-based RL, achieving 61.6% on AIME 2024.

We introduce Parallel Coordinated Reasoning (PaCoRe), a training-and-inference framework designed to overcome a central limitation of contemporary language models: their inability to scale test-time compute (TTC) far beyond sequential reasoning under a fixed context window. PaCoRe departs from the traditional sequential paradigm by driving TTC through massive parallel exploration coordinated via a message-passing architecture in multiple rounds. Each round launches many parallel reasoning trajec
Language ModelsReasoningTest-Time ComputeReinforcement Learning
78 score
AI Analysis

Demonstrates that widely available LLMs with web search can re-identify participants in Anthropic's anonymized interview dataset by cross-referencing details and proposing matches with minimal effort.

On December 4, 2025, Anthropic released Anthropic Interviewer, an AI tool for running qualitative interviews at scale, along with a public dataset of 1,250 interviews with professionals, including 125 scientists, about their use of AI for research. Focusing on the scientist subset, I show that widely available LLMs with web search and agentic capabilities can link six out of twenty-four interviews to specific scientific works, recovering associated authors and, in some cases, uniquely identifyin
PrivacyRe-identificationLLM AgentsAI SafetyData Ethics
Research arXiv (cs.CR) Jan 12

A Survey of Agentic AI and Cybersecurity: Challenges, Opportunities and Use-case Prototypes

By Sahaya Jestus Lazer, Kshitiz Aryal, Maanak Gupta, Elisa Bertino

76 score
AI Analysis

Comprehensive survey examining agentic AI implications for cybersecurity, covering both defensive capabilities (monitoring, incident response, threat hunting) and offensive amplification (reconnaissance, exploitation, social engineering).

Agentic AI marks an important transition from single-step generative models to systems capable of reasoning, planning, acting, and adapting over long-lasting tasks. By integrating memory, tool use, and iterative decision cycles, these systems enable continuous, autonomous workflows in real-world environments. This survey examines the implications of agentic AI for cybersecurity. On the defensive side, agentic capabilities enable continuous monitoring, autonomous incident response, adaptive threa
AI SafetyCybersecurityAgentic AIDual-Use
Research arXiv (Machine Learning) Jan 12

Automating Deception: Scalable Multi-Turn LLM Jailbreaks

By Adarsh Kumarappan, Ananya Mujoo

75 score
AI Analysis

Introduces automated pipeline for generating large-scale, psychologically-grounded multi-turn jailbreak datasets using Foot-in-the-Door techniques. Creates benchmark of 1,500 scenarios across illegal activities and offensive content, testing 7 models.

Multi-turn conversational attacks, which leverage psychological principles like Foot-in-the-Door (FITD), where a small initial request paves the way for a more significant one, to bypass safety alignments, pose a persistent threat to Large Language Models (LLMs). Progress in defending against these attacks is hindered by a reliance on manual, hard-to-scale dataset creation. This paper introduces a novel, automated pipeline for generating large-scale, psychologically-grounded multi-turn jailbreak
AI SafetyAdversarial AttacksLLM SecurityRed Teaming
Research arXiv (Computation and Language) Jan 12

The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence

By Herun Wan, Jiaying Wu, Minnan Luo, Fanxiao Li, Zhi Zeng, and Min-Yen Kan

75 score
AI Analysis

Introduces MisBelief framework to generate sophisticated misleading evidence via multi-role LLM collaboration. Finds LLMs are robust to direct misinformation but highly susceptible to refined deceptive evidence.

To reliably assist human decision-making, LLMs must maintain factual internal beliefs against misleading injections. While current models resist explicit misinformation, we uncover a fundamental vulnerability to sophisticated, hard-to-falsify evidence. To systematically probe this weakness, we introduce MisBelief, a framework that generates misleading evidence via collaborative, multi-round interactions among multi-role LLMs. This process mimics subtle, defeasible reasoning and progressive refin
AI SafetyMisinformationLanguage ModelsAdversarial ML
Research arXiv (Machine Learning) Jan 12

Do Sparse Autoencoders Identify Reasoning Features in Language Models?

By George Ma, Zhongyuan Liang, Irene Y. Chen, Somayeh Sojoudi

75 score
AI Analysis

Investigates whether sparse autoencoders identify genuine reasoning features in LLMs, finding that 59-94% of identified features are highly sensitive to token-level interventions indicating reliance on lexical artifacts.

We investigate whether sparse autoencoders (SAEs) identify genuine reasoning features in large language models (LLMs). Starting from features selected using standard contrastive activation methods, we introduce a falsification-oriented framework that combines causal token injection experiments and LLM-guided falsification to test whether feature activation reflects reasoning processes or superficial linguistic correlates. Across 20 configurations spanning multiple model families, layers, and rea
InterpretabilitySparse AutoencodersReasoningAI Safety
Research arXiv (cs.CR) Jan 12

VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit

By Junda Lin, Zhaomeng Zhou, Zhi Zheng, Shuochen Liu, Tong Xu, Yong Chen, Enhong Chen

73 score
AI Analysis

VIGIL defends LLM agents against tool stream injection attacks through verify-before-commit protocol with speculative hypothesis generation and intent-grounded verification.

LLM agents operating in open environments face escalating risks from indirect prompt injection, particularly within the tool stream where manipulated metadata and runtime feedback hijack execution flow. Existing defenses encounter a critical dilemma as advanced models prioritize injected rules due to strict alignment while static protection mechanisms sever the feedback loop required for adaptive reasoning. To reconcile this conflict, we propose \textbf{VIGIL}, a framework that shifts the paradi
AI SafetyLLM AgentsSecurityPrompt Injection
Research arXiv (Machine Learning) Jan 12

Towards Realistic Guarantees: A Probabilistic Certificate for SmoothLLM

By Adarsh Kumarappan, Ayushi Mehrotra

72 score
AI Analysis

Introduces probabilistic (k,ε)-unstable framework for certifying SmoothLLM defense against jailbreaking attacks. Provides more realistic safety certificates by relaxing the strict k-unstable assumption that rarely holds in practice.

The SmoothLLM defense provides a certification guarantee against jailbreaking attacks, but it relies on a strict `k-unstable' assumption that rarely holds in practice. This strong assumption can limit the trustworthiness of the provided safety certificate. In this work, we address this limitation by introducing a more realistic probabilistic framework, `(k, $\varepsilon$)-unstable,' to certify defenses against diverse jailbreaking attacks, from gradient-based (GCG) to semantic (PAIR). We derive
AI SafetyLLM SecurityAdversarial Robustness
Research arXiv (Machine Learning) Jan 12

MoEBlaze: Breaking the Memory Wall for Efficient MoE Training on Modern GPUs

By Jiyuan Zhang, Yining Liu, Siqi Yan, Lisen Deng, Jennifer Cao, Shuqi Yang, Min Ni, Bi Xue, Shen Li

72 score
AI Analysis

Presents MoEBlaze, a memory-efficient MoE training framework addressing the memory wall through co-designed optimizations: end-to-end token dispatch, optimized data structures, and multi-stage tiled MoE kernel.

The pervasive "memory wall" bottleneck is significantly amplified in modern large-scale Mixture-of-Experts (MoE) architectures. MoE's inherent architectural sparsity leads to sparse arithmetic compute and also introduces substantial activation memory overheads -- driven by large token routing buffers and the need to materialize and buffer intermediate tensors. This memory pressure limits the maximum batch size and sequence length that can fit on GPUs, and also results in excessive data movements
EfficiencyMoETraining InfrastructureMemory Optimization
Research arXiv (cs.CR) Jan 12

Multi-turn Jailbreaking Attack in Multi-Modal Large Language Models

By Badhan Chandra Das, Md Tasnim Jawad, Joaquin Molto, M. Hadi Amini, Yanzhao Wu

72 score
AI Analysis

Introduces MJAD-MLLMs framework for systematic analysis of multi-turn jailbreaking attacks on multimodal LLMs. Proposes multi-LLM-based defense techniques and evaluates vulnerabilities under multi-turn prompting.

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing multi-modal tasks with high accuracy, are also severely susceptible to carefully launched security attacks, such as jailbreaking attacks, which can manipulate model behavior and bypass safety constraints. This paper introduces MJAD-MLLMs, a holistic framework that
AI SafetyMultimodal LLMsAdversarial AttacksJailbreaking
Research arXiv (Artificial Intelligence) Jan 12

Conformity and Social Impact on AI Agents

By Alessandro Bellina, Giordano De Marzo, David Garcia

72 score
AI Analysis

Studies conformity bias in multimodal LLMs as social actors, adapting classic psychology experiments. Finds AI agents show systematic conformity aligned with Social Impact Theory, becoming susceptible to manipulation through social influence.

As AI agents increasingly operate in multi-agent environments, understanding their collective behavior becomes critical for predicting the dynamics of artificial societies. This study examines conformity, the tendency to align with group opinions under social pressure, in large multimodal language models functioning as AI agents. By adapting classic visual experiments from social psychology, we investigate how AI agents respond to group influence as social actors. Our experiments reveal that AI
AI SafetyMulti-Agent SystemsLanguage ModelsSocial Behavior