Category intelligence

Research Briefing — March 27, 2026

458 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research is headlined by ARC-AGI-3, a new interactive benchmark for evaluating agentic intelligence through novel turn-based environments, marking a major evolution in general intelligence measurement. Intern-S1-Pro debuts as the first trillion-parameter scientific multimodal foundation model spanning 100+ specialized tasks.

Interpretability and safety see strong contributions: new CoT interpretability benchmarks expose where GPT-5.2 monitors fail out-of-distribution, decoding-constrained beam search provides deterministic lower bounds on near-verbatim memorization risk, and a surprising finding shows LLM calibration and verbalized confidence are encoded orthogonally in representation space. Cross-lingual work reveals that social register differences cause system prompt instructions to cooperate in English but compete in Spanish.

Key Themes

AI Safety & Alignment · 14Agentic AI & Tool Use · 14LLM Evaluation & Benchmarks · 11Multimodal AI · 8Mechanistic Interpretability · 9Language Models & Reasoning · 9AI Safety & Security · 7LLM Uncertainty & Reliability · 5AI Security & Adversarial Robustness · 11Multimodal LLMs & Vision-Language Models · 10

Primary evidence

Top Ranked Signals

Research arXiv (Artificial Intelligence) Mar 27

ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence

By ARC Prize Foundation

92 score
AI Analysis

Building on yesterday's Reddit discussion, ARC Prize Foundation introduces ARC-AGI-3, a new interactive benchmark for evaluating agentic intelligence through novel, turn-based environments requiring exploration, goal inference, and planning. Humans solve 100% of environments while frontier AI systems score below 1% as of March 2026, highlighting a massive gap in fluid adaptive intelligence.

arXiv:2603.24621v1 Announce Type: new Abstract: We introduce ARC-AGI-3, an interactive benchmark for studying agentic intelligence through novel, abstract, turn-based environments in which agents must explore, infer goals, build internal models of environment dynamics, and plan effective action sequences without explicit instructions. Like its predecessors ARC-AGI-1 and 2, ARC-AGI-3 focuses entirely on evaluating fluid adaptive efficiency on novel tasks, while avoiding language and external kno
AGI BenchmarksAgentic AIEvaluation
Research arXiv (Artificial Intelligence) Mar 27

Voxtral TTS

By Alexander H. Liu, Alexis Tacnet, Andy Ehrenberg, Andy Lo, Chen-Yo Sun, Guillaume Lample, Henry Lagarde, Jean-Malo Delignon, Jaeyoung Kim, John Harvill, Khyathi Raghavi Chandu, Lorenzo Signoretti, Margaret Jennings, Patrick von Platen, Pavankumar Reddy Muddireddy, Rohin Arora, Sanchit Gandhi, Samuel Humeau, Soham Ghosh, Srijan Mishra, Van Phung, Abdelaziz Bounhar, Abhinav Rastogi, Adrien Sad\'e, Alan Jeffares, Albert Jiang, Alexandre Cahill, Alexandre Gavaudan, Alexandre Sablayrolles, Am\'elie H\'eliou, Amos You, Andrew Bai, Andrew Zhao, Angele Lenglemetz, Anmol Agarwal, Anton Eliseev, Antonia Calvi, Arjun Majumdar, Arthur Fournier, Artjom Joosen, Avi Sooriyarachchi, Aysenur Karaduman Utkur, Baptiste Bout, Baptiste Rozi\`ere, Baudouin De Monicault, Benjamin Tibi, Bowen Yang, Charlotte Cronj\"ager, Cl\'emence Lanfranchi, Connor Chen, Corentin Barreau, Corentin Sautier, Cyprien Courtot, Darius Dabert, Diego de las Casas, Elizaveta Demyanenko, Elliot Chane-Sane, Emmanuel Gottlob, Enguerrand Paquin, Etienne Goffinet, Fabien Niel, Faruk Ahmed, Federico Baldassarre, Gabrielle Berrada, Ga\"etan Ecrepont, Gauthier Guinet, Genevieve Hayes, Georgii Novikov, Giada Pistilli, Guillaume Kunsch, Guillaume Martin, Guillaume Raille, Gunjan Dhanuka, Gunshi Gupta, Han Zhou, Harshil Shah, Hope McGovern, Hugo Thimonier, Indraneel Mukherjee, Irene Zhang, Jacques Sun, Jan Ludziejewski, Jason Rute, J\'er\'emie Dentan, Joachim Studnia, Jonas Amar, Jos\'ephine Delas, Josselin Somerville Roberts, Julien Tauran, Karmesh Yadav, Kartik Khandelwal, Kilian Tep, Kush Jain, Laurence Aitchison, Laurent Fainsin, L\'eonard Blier, Lingxiao Zhao, Louis Martin, Lucile Saulnier, Luyu Gao, Maarten Buyl, Manan Sharma, Marie Pellat, Mark Prins, Martin Alexandre, Mathieu Poir\'ee, Mathieu Schmitt, Mathilde Guillaumin, Matthieu Dinot, Matthieu Futeral, Maxime Darrin, Maximilian Augustin, Mert Unsal, Mia Chiquier, Mikhail Biriuchinskii, Minh-Quang Pham, Mircea Lica, Morgane Rivi\`ere, Nathan Grinsztajn, Neha Gupta, Olivier Bousquet, Olivier Duchenne, Patricia Wang, Paul Jacob, Paul Wambergue, Paula Kurylowicz, Philippe Pinel, Philom\`ene Chagniot, Pierre Stock, Piotr Mi{\l}o\'s, Prateek Gupta, Pravesh Agrawal, Quentin Torroba, Ram Ramrakhya, Randall Isenhour, Rishi Shah, Romain Sauvestre, Roman Soletskyi, Rosalie Millner, Rupert Menneer, Sagar Vaze, Samuel Barry, Samuel Belkadi, Sandeep Subramanian, Sean Cha, Shashwat Verma, Siddhant Waghjale, Siddharth Gandhi, Simon Lepage, Sumukh Aithal, Szymon Antoniak, Tarun Kumar Vangani, Teven Le Scao, Th\'eo Cachet, Theo Simon Sorg, Thibaut Lavril, Thomas Chabal, Thomas Foubert, Thomas Robert, Thomas Wang, Tim Lawson, Tom Bewley, Tom Edwards, Tyler Wang, Umar Jamil, Umberto Tomasini, Valeriia Nemychnikova, Vedant Nanda, Victor Jouault, Vincent Maladi\`ere, Vincent Pfister, Virgile Richard, Vladislav Bataev, Wassim Bouaziz, Wen-Ding Li, William Havard, William Marshall, Xinghui Li, Xingran Guo, Xinyu Yang, Yannic Neuhaus, Yassine El Ouahidi, Yassir Bendou, Yihan Wang, Yimu Pan, Zaccharie Ramzi, Zhenlin Xu

80 score
AI Analysis

Mistral introduces Voxtral TTS, a multilingual text-to-speech model using hybrid auto-regressive semantic tokens and flow-matching acoustic tokens. Achieves 68.4% win rate over ElevenLabs Flash v2.5 in human evaluations, using only 3 seconds of reference audio for voice cloning.

arXiv:2603.25551v1 Announce Type: new Abstract: We introduce Voxtral TTS, an expressive multilingual text-to-speech model that generates natural speech from as little as 3 seconds of reference audio. Voxtral TTS adopts a hybrid architecture that combines auto-regressive generation of semantic speech tokens with flow-matching for acoustic tokens. These tokens are encoded and decoded with Voxtral Codec, a speech tokenizer trained from scratch with a hybrid VQ-FSQ quantization scheme. In human eva
Text-to-SpeechSpeech SynthesisMultimodal AI
Research arXiv (Artificial Intelligence) Mar 27

Evaluating Language Models for Harmful Manipulation

By Canfer Akbulut, Rasmi Elasmar, Abhishek Roy, Anthony Payne, Priyanka Suresh, Lujain Ibrahim, Seliem El-Sayed, Charvi Rastogi, Ashyana Kachra, Will Hawkins, Kristian Lum, Laura Weidinger

78 score
AI Analysis

Introduces a framework for evaluating harmful AI manipulation through context-specific human-AI interaction studies with 10,101 participants across three domains and three locales. Finds that AI models can produce manipulative behaviors when prompted and induce belief/behavior changes.

arXiv:2603.25326v1 Announce Type: new Abstract: Interest in the concept of AI-driven harmful manipulation is growing, yet current approaches to evaluating it are limited. This paper introduces a framework for evaluating harmful AI manipulation via context-specific human-AI interaction studies. We illustrate the utility of this framework by assessing an AI model with 10,101 participants spanning interactions in three AI use domains (public policy, finance, and health) and three locales (US, UK,
AI SafetyManipulationHuman-AI InteractionEvaluation
Research arXiv (Machine Learning) Mar 27

Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale

By Yicheng Zou, Dongsheng Zhu, Lin Zhu, Tong Zhu, Yunhua Zhou, Peiheng Zhou, Xinyu Zhou, Dongzhan Zhou, Zhiwang Zhou, Yuhao Zhou, Bowen Zhou, Zhanping Zhong, Zhijie Zhong, Haiteng Zhao, Penghao Zhao, Xiaomeng Zhao, Zhiyuan Zhao, Yechen Zhang, Jin Zhang, Wenwei Zhang, Hongjie Zhang, Zhuo Zhang, Wenlong Zhang, Bo Zhang, Chao Zhang, Chen Zhang, Yuhang Zang, Fei Yuan, Jiakang Yuan, Jiashuo Yu, Jinhui Yin, Haochen Ye, Qian Yao, Bowen Yang, Danni Yang, Kaichen Yang, Ziang Yan, Jun Xu, Yicheng Xu, Wanghan Xu, Xuenan Xu, Chao Xu, Ruiliang Xu, Shuhao Xing, Long Xing, Xinchen Xie, Ling-I Wu, Zijian Wu, Zhenyu Wu, Lijun Wu, Yue Wu, Jianyu Wu, Wen Wu, Fan Wu, Xilin Wei, Qi Wei, Bingli Wang, Rui Wang, Ziyi Wang, Zun Wang, Yi Wang, Haomin Wang, Yizhou Wang, Lintao Wang, Yiheng Wang, Longjiang Wang, Bin Wang, Jian Tong, Zhongbo Tian, Huanze Tang, Chen Tang, Shixiang Tang, Yu Sun, Qiushi Sun, Xuerui Su, Qisheng Su, Chenlin Su, Demin Song, Jin Shi, Fukai Shang, Yuchen Ren, Pengli Ren, Xiaoye Qu, Yuan Qu, Jiantao Qiu, Yu Qiao, Runyu Peng, Tianshuo Peng, Jiahui Peng, Qizhi Pei, Zhuoshi Pan, Linke Ouyang, Wenchang Ning, Yichuan Ma, Zerun Ma, Ningsheng Ma, Runyuan Ma, Chengqi Lyu, Haijun Lv, Han Lv, Lindong Lu, Kuikun Liu, Jiangning Liu, Yuhong Liu, Kai Liu, Hongwei Liu, Zhoumianze Liu, Mengjie Liu, Ziyu Liu, Wenran Liu, Yang Liu, Liwei Liu, Kaiwen Liu, Junyao Lin, Junming Lin, Tianyang Lin, Dahua Lin, Jianze Liang, Linyang Li, Peiji Li, Zonglin Li, Zehao Li, Pengze Li, Guoyan Li, Lingkai Kong, Linglin Jing, Zhenjiang Jin, Feifei Jiang, Qian Jiang, Junhao Huang, Zixian Huang, Haian Huang, Zhouqi Hua, Han Hu, Linfeng Hou, Yinan He, Conghui He, Tianyao He, Xu Guo, Qipeng Guo, Aijia Guo, Yuzhe Gu, Lixin Gu, Jingyang Gong, Qiming Ge, Jiaye Ge, Songyang Gao, Jianfei Gao, Xinyu Fang, Caihua fan, Yue Fan, Yanhui Duan, Zichen Ding, Shengyuan Ding, Xuanlang Dai, Erfei Cui, Ganqu Cui, Pei Chu, Tao Chu, Guangran Cheng, Yu Cheng, Kai Chen, Yongkang Chen, Chiyu Chen, Guanzhou Chen, Qiaosheng Chen, Sitao Chen, Xin Chen, Haojiong Chen, Yicheng Chen, Weihan Cao, Yuhang Cao, Qinglong Cao, Lei Bai

75 score
AI Analysis

Introduces Intern-S1-Pro, the first trillion-parameter scientific multimodal foundation model, covering 100+ specialized tasks across chemistry, materials, life sciences, and earth sciences. Built with XTuner/LMDeploy infrastructure for efficient RL training at scale.

arXiv:2603.25040v1 Announce Type: new Abstract: We introduce Intern-S1-Pro, the first one-trillion-parameter scientific multimodal foundation model. Scaling to this unprecedented size, the model delivers a comprehensive enhancement across both general and scientific domains. Beyond stronger reasoning and image-text understanding capabilities, its intelligence is augmented with advanced agent capabilities. Simultaneously, its scientific expertise has been vastly expanded to master over 100 speci
Foundation ModelsScientific AIMultimodal ModelsScaling
Research arXiv (Artificial Intelligence) Mar 27

When Is Collective Intelligence a Lottery? Multi-Agent Scaling Laws for Memetic Drift in LLMs

By Hidenori Tanaka

72 score
AI Analysis

Introduces Quantized Simplex Gossip (QSG), a minimal model explaining how multi-agent LLM systems reach consensus through mutual in-context learning even without individual biases. Reveals that collective intelligence in LLM populations can arise from microscopic symmetry-breaking mechanisms, raising questions about when multi-agent outcomes are genuine reasoning vs. chance.

arXiv:2603.24676v1 Announce Type: new Abstract: Multi-agent systems powered by large language models (LLMs) are increasingly deployed in settings that shape consequential decisions, both directly and indirectly. Yet it remains unclear whether their outcomes reflect collective reasoning, systematic bias, or mere chance. Recent work has sharpened this question with naming games, showing that even when no individual agent favors any label a priori, populations rapidly break symmetry and reach cons
Multi-Agent SystemsLanguage ModelsCollective Intelligence
Research arXiv (Artificial Intelligence) Mar 27

Reaching Beyond the Mode: RL for Distributional Reasoning in Language Models

By Isha Puri, Mehul Damani, Idan Shenfeld, Marzyeh Ghassemi, Jacob Andreas, Yoon Kim

72 score
AI Analysis

Proposes using RL to train language models that can generate multiple plausible hypotheses with calibrated confidence estimates, rather than collapsing to a single dominant answer. Addresses the problem of distributional reasoning for tasks with inherent ambiguity like medical diagnosis.

arXiv:2603.24844v1 Announce Type: cross Abstract: Given a question, a language model (LM) implicitly encodes a distribution over possible answers. In practice, post-training procedures for LMs often collapse this distribution onto a single dominant mode. While this is generally not a problem for benchmark-style evaluations that assume one correct answer, many real-world tasks inherently involve multiple valid answers or irreducible uncertainty. Examples include medical diagnosis, ambiguous ques
Language ModelsReinforcement LearningUncertainty QuantificationAlignment
Research arXiv (Machine Learning) Mar 27

Estimating near-verbatim extraction risk in language models with decoding-constrained beam search

By A. Feder Cooper, Mark A. Lemley, Christopher De Sa, Lea Duesterwald, Allison Casasola, Jamie Hayes, Katherine Lee, Daniel E. Ho, Percy Liang

72 score
AI Analysis

Introduces decoding-constrained beam search to efficiently estimate near-verbatim memorization extraction risk in LLMs, providing deterministic lower bounds much cheaper than Monte Carlo sampling (~100K samples). Addresses privacy and copyright risks from LLM memorization.

arXiv:2603.24917v1 Announce Type: cross Abstract: Recent work shows that standard greedy-decoding extraction methods for quantifying memorization in LLMs miss how extraction risk varies across sequences. Probabilistic extraction -- computing the probability of generating a target suffix given a prefix under a decoding scheme -- addresses this, but is tractable only for verbatim memorization, missing near-verbatim instances that pose similar privacy and copyright risks. Quantifying near-verbatim
AI SafetyLanguage ModelsPrivacyMemorization
Research arXiv (Computer Vision) Mar 27

WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching

By Yihan Wang, Jia Deng

72 score
AI Analysis

WAFT-Stereo demonstrates that cost volumes are unnecessary for strong stereo matching, replacing them with warping for improved efficiency. It ranks first on ETH3D, KITTI, and Middlebury benchmarks while being 1.8-6.7x faster than competitive methods, with 81% zero-shot error reduction on ETH3D.

arXiv:2603.24836v1 Announce Type: new Abstract: We introduce WAFT-Stereo, a simple and effective warping-based method for stereo matching. WAFT-Stereo demonstrates that cost volumes, a common design used in many leading methods, are not necessary for strong performance and can be replaced by warping with improved efficiency. WAFT-Stereo ranks first on ETH3D, KITTI and Middlebury public benchmarks, reducing the zero-shot error by 81% on ETH3D benchmark, while being 1.8-6.7x faster than competiti
Stereo Matching3D VisionEfficient Architectures
Research LessWrong Mar 26

Test your best methods on our hard CoT interp tasks

By daria

72 score
AI Analysis

Introduces nine objective benchmark tasks for chain-of-thought interpretability where GPT 5.2 monitors fail out-of-distribution. Baselines probes and TF-IDF, finding they often outperform zero/few-shot LLM monitors OOD. From Neel Nanda's MATS program.

Authors: Daria Ivanova, Riya Tyagi, Arthur Conmy, Neel NandaDaria and Riya are co-first authors. This work was done during Neel Nanda’s MATS 9.0. Claude helped write code and suggest edits for this post.TL;DR One of our best safety techniques right now is “just read the chain of thought”.But this isn’t always enough: can we learn more by going beyond just reading the reasoning?Yet it's such an effective technique that it's hard to tell if we have made much progress on improving methods.To help t
AI SafetyInterpretabilityChain of ThoughtBenchmarkingAlignment
Research arXiv (Artificial Intelligence) Mar 27

Beyond Content Safety: Real-Time Monitoring for Reasoning Vulnerabilities in Large Language Models

By Xunguang Wang, Yuguang Zhou, Qingyue Wang, Zongjie Li, Ruixuan Huang, Zhenlan Ji, Pingchuan Ma, Shuai Wang

70 score
AI Analysis

Identifies 'reasoning safety' as a new security dimension beyond content safety, proposing a nine-category taxonomy of unsafe reasoning behaviors in LLMs and developing real-time monitoring for chain-of-thought reasoning vulnerabilities.

arXiv:2603.25412v1 Announce Type: new Abstract: Large language models (LLMs) increasingly rely on explicit chain-of-thought (CoT) reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work on LLM safety focuses on content safety--detecting harmful, biased, or factually incorrect outputs -- and treats the reasoning chain as an opaque intermediate artifact. We identify reasoning safety as an orthogonal and equally critical security
AI SafetyReasoningLanguage ModelsChain-of-Thought
Research arXiv (Artificial Intelligence) Mar 27

Closing the Confidence-Faithfulness Gap in Large Language Models

By Miranda Muqing Miao, Lyle Ungar

70 score
AI Analysis

Shows that calibration and verbalized confidence in LLMs are encoded linearly but orthogonally in representation space. Reasoning disrupts verbalized confidence, and steering vectors can partially close the confidence-faithfulness gap.

arXiv:2603.25052v1 Announce Type: cross Abstract: Large language models (LLMs) tend to verbalize confidence scores that are largely detached from their actual accuracy, yet the geometric relationship governing this behavior remain poorly understood. In this work, we present a mechanistic interpretability analysis of verbalized confidence, using linear probes and contrastive activation addition (CAA) steering to show that calibration and verbalized confidence signals are encoded linearly but are
Mechanistic InterpretabilityLLM CalibrationAI SafetyLanguage Models
Research arXiv (Artificial Intelligence) Mar 27

R-C2: Cycle-Consistent Reinforcement Learning Improves Multimodal Reasoning

By Zirui Zhang, Haoyu Dong, Kexin Pei, Chengzhi Mao

69 score
AI Analysis

R-C2 introduces cycle-consistent reinforcement learning for multimodal reasoning, using cross-modal backward-forward inference cycles as a dense, label-free reward signal to resolve internal model conflicts between visual and textual modalities.

arXiv:2603.25720v1 Announce Type: new Abstract: Robust perception and reasoning require consistency across sensory modalities. Yet current multimodal models often violate this principle, yielding contradictory predictions for visual and textual representations of the same concept. Rather than masking these failures with standard voting mechanisms, which can amplify systematic biases, we show that cross-modal inconsistency provides a rich and natural signal for learning. We introduce RC2, a rein
Multimodal LLMsReinforcement LearningSelf-Supervised Learning