Category intelligence

Research Briefing — July 28, 2026

131 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's research highlights major strides in open frontier architecture scaling, training-free inference acceleration, AI control protocols, and mechanistic interpretability.

Frontier Models & Agentic Architecture

  • Kimi K3 (Moonshot AI): Releases a 2.8-trillion-parameter MoE foundation model featuring a 1-million-token context length and native agentic tool capabilities, setting a new open benchmark for ultra-long context reasoning.
  • Skill Self-Play (Skill-SP): Implements a co-evolutionary framework combining verifiable scenario-specific execution with dynamic task routing, overcoming self-evolution bottlenecks to continuously expand agent capabilities without manual data curation.

Generative Acceleration & Efficiency

AI Control, Alignment & Safety Diagnostics

  • Untrusted Advice Protocol: Establishes an AI control mechanism where a small, trusted executor model consumes monitored, short hints from a powerful untrusted advisor model, providing an effective information bottleneck that safely uplifts system capability.
  • Reality Monitoring in LLMs: Reveals critical cognitive vulnerabilities in conversational memory where models misidentify self-generated content versus user-provided facts, exposing key failure modes for persistent memory systems.
  • Reward Model Memorization: Uncovers diagnostic vulnerabilities in discriminatively trained reward models, showing they overfit to low-difficulty pairs and adopt dataset shortcuts that compromise RLHF alignment stability.

Interpretability & Internal Control

  • FEGA (Feature-Effect Geometry Analysis): Proves that Sparse Autoencoders (SAEs) encode both abstract concepts and operational functions, establishing a geometric framework to trace downstream feature activation onto token output distributions.
  • Multi-Head Latent Control: Replaces token-level generation overhead with a lightweight layer that decodes internal hidden-state trajectories, providing real-time decision routing for agentic workflows.

Multimodal & Embodied Intelligence

  • ClinFusion (Alibaba DAMO Academy): Combines 2D/3D vision encoders with tool-using agentic workflows, setting a unified standard for compositional multimodal reasoning in clinical AI systems.
  • $\tau$ (Tau) VLA: Integrates high-dimensional tactile sensing into Vision-Language-Action models using future visual supervision, markedly improving precision during physical robotic manipulation.

Key Themes

Agentic Workflows & Reasoning · 12Robotics & Embodied AI · 16AI Safety & Alignment · 14Multimodal Models & Vision · 22AI Safety, Alignment & Interpretability · 9Model Distillation & Efficient Inference · 10Data-Centric AI & Pretraining · 6Agentic Frameworks & Applications · 6Computer Vision & Generative Models · 11Mechanistic Interpretability & Feature Representation · 5

Primary evidence

Top Ranked Signals

Research AlphaXiv Trending Jul 27

Kimi K3: Open Frontier Intelligence

By Kimi Team, Tongtong Bai, Yifan Bai, Yiping Bao, M. C., Jianfeng Cai, Xinyuan Cai, Peizhou Cao, Yuxuan Cao, Ziwei Chai, Y. Charles, H.S. Che, Guanduo Chen, Guangyu Chen, Guanzheng Chen, Huarong Chen, Jia Chen, Jianlong Chen, Jun Chen, Kexin Chen, Peng Chen, Ruijue Chen, Wentao Chen, Xin Chen, Yang Chen, Yanru Chen, Yifei Chen, Yingjiang Chen, Yuankun Chen, Yujie Chen, Yutian Chen, Zhirong Chen, Dazhi Cheng, Yean Cheng, Jialei Cui, Jingbing Cui, Anqi Dai, Jiaqi Deng, Hao Ding, Rui Ding, Shaofeng Ding, Mengfan Dong, Mengnan Dong, Yuhao Dong, Yuxin Dong, Angang Du, Chenzhuang Du, Dikang Du, Jusen Du, Yulun Du, Yu Fan, Jing Feng, Qiulin Feng, Yichen Feng, Kelin Fu, Qiang Fu, Fuxuan Gao, Hongcheng Gao, Jingyue Gao, Tong Gao, Weijia Gao, Shangyi Geng, Jie Gong, Linhu Gong, Shengao Gong, Xiaochen Gong, Qizheng Gu, Yicheng Gu, Shuhao Guan, Haiqing Guo, Shiqi Guo, Xiang Guo, Zhengyan Guo, Beixi Hao, Wenxin Hao, Xiaoru Hao, Dailan He, Haotian He, Lehan He, Qi He, Weiran He, Xinran He, Xinyi He, Yibo He, Yunjia He, Chao Hong, Tiange Hong, Hao Hu, Jiaxi Hu, Ruikun Hu, Weiming Hu, Yangyang Hu, Zhenxing Hu, Liang Hua, Jinbin Huang, Ke Huang, Ruiyuan Huang, Siying Huang, Weixiao Huang, Yan Huang, Zhengjie Huang, Zhiqi Huang, Yulong Hui, Chaobo Jia, Yutong Jiang, Zhejun Jiang, Zuoyou Jiang, Wenyi Jin, Xinyi Jin, Yu Jing, Huanjun Kong, Guokun Lai, Aidi Li, Cheng Li, Chengyuan Li, Cong Li, Fang Li, Guanyu Li, Haoyang Li, Jia Li, Junxiong Li, Lei Li, Letian Li, Lincan Li, Weihong Li, Wentao Li, Xintong Li, Yang Li, Yishen Li, Yiwei Li, Yuxiao Li, Zhaowei Li, Zhaoxi Li, Zheming Li, Zhengxiao Li, Zhiyuan Li, Jiawei Lin, Xiaohan Lin, Yibo Lin, Zichao Lin, Ziyan Lin, Bill Liu, Boxiao Liu, Chuan Liu, Liang Liu, Shaowei Liu, Shudong Liu, Shuran Liu, Tianwei Liu, Weizhou Liu, Yangyang Liu, Yanming Liu, Yibo Liu, Yipeng Liu, Zhengying Liu, Zhiheng Liu, Enzhe Lu, Haoyu Lu, Linqiang Lu, Tingzhan Lu, Zhiyuan Lu, Aotian Luo, G. Luo, Junyu Luo, Yifan Luo, B. Lyu, Wenzhou Lyu, Shaoguang Mao, Yuan Mei, Xin Men, Minqing Ni, Yixuan Niu, Siyuan Pan, Shujun Peng, Zhangyang Qi, Ruoyu Qin, ZeChao Qin, Zeyu Qin, Haiquan Qiu, Jianxin Qiu, Jiezhong Qiu, Bowen Qu, Yuhao Qu, Zeyu Shang, Youbo Shao, Han Shen, Jincheng Shi, Juanfeng Shi, Lidong Shi, Shengyuan Shi, Wingchun Siu, Pengwei Song, Xiaoxi Song, Jianlin Su, Yunfeng Su, Zhaochen Su, Lin Sui, Jingsong Sun, Junyao Sun, Shaoning Sun, Shuzhe Sun, Tongyu Sun, Yujun Sun, Yunpeng Tai, Chuning Tang, Heyi Tang, Sirui Tang, Zecheng Tang, Chaoran Tian, Rongpeng Tian, Yu Tian, Wei Tu, Chensi Wang, Chuang Wang, Chunjie Wang, Dinglu Wang, Feng Wang, Hailong Wang, Haiming Wang, Hao Wang, Huaqing Wang, Hui Wang, Jiayi Wang, Jinglong Wang, Jinhong Wang, Jiuzheng Wang, Linian Wang, Shaobo Wang, Shenzhi Wang, Shuyi Wang, Si Wang, Siyuan Wang, Tianfu Wang, Wenjue Wang, Xingran Wang, Xinmei Wang, Xinyuan Wang, Xusheng Wang, Yalin Wang, Yangkun Wang, Yao Wang, Yaoyu Wang, Yejie Wang, Yiqin Wang, Yucheng Wang, Yuzhi Wang, Zhaoji Wang, Zhaowei Wang, Zhengtao Wang, Zhenhao Wang, Zhongsheng Wang, Zifan Wang, Chu Wei, Ming Wei, Shouxin Wei, Zichen Wen, Fan Wu, Haoning Wu, Rucong Wu, Wenhao Wu, Xiaoxue Wu, Yingcong Wu, Yongqi Wu, Yuxin Wu, Zijian Wu, Xinglang Xian, Chenxuan Xiang, Yuye Xiang, Bocheng Xiao, Chenjun Xiao, Xin Xiao, Jin Xie, Xiaotong Xie, Yifeng Xie, Zhe Xie, Bowei Xing, Yiming Xiong, Baosheng Xu, Boyu Xu, Jiale Xu, Jianfan Xu, Jing Xu, Jinjing Xu, L.H. Xu, Qingtao Xu, Shuyao Xu, Suting Xu, Tiantian Xu, Tianxiang Xu, Weixin Xu, Xinran Xu, Yangchuan Xu, Ye Xu, Yueni Xu, Ziyao Xu, Haonan Xue, Junjie Yan, Yaoyao Yan, Fan Yang, Guangyao Yang, Hao Yang, Junwei Yang, Ruoyu Yang, Wenjie Yang, Xiaofei Yang, Xinyu Yang, Yi Yang, Yiling Yang, Ying Yang, Yuchen Yang, Zhen Yang, Zhilin Yang, Zian Yang, Zuhao Yang, Haotian Yao, Dan Ye, Haoran Ye, Wenjie Ye, Zhanbo Ye, Bohong Yin, Haoxiang Yin, Xietong Yin, Chengzhen Yu, Haozhen Yu, Longhui Yu, Shengnan Yu, Shuying Yu, Tianxiang Yu, Enming Yuan, Mengjie Yuan, Tongtian Yue, Wei Yue, Yang Yue, Dunyuan Zha, Haobing Zhan, B.H. Zhang, Dehao Zhang, Fei Zhang, Hao Zhang, Haoyuan Zhang, Huanyu Zhang, Jiapei Zhang, Jiaxuan Zhang, Jin Zhang, Kaiyi Zhang, Miaozhen Zhang, Puqi Zhang, Qinglei Zhang, Rong Zhang, Rui Zhang, Shaoshuai Zhang, Shiyi Zhang, Xiaobin Zhang, Xiaoyun Zhang, Y. Zhang, Yangkun Zhang, Ye Zhang, Yichi Zhang, Yikun Zhang, Yizhi Zhang, Yongting Zhang, Yu Zhang, Yutao Zhang, Yutong Zhang, Zheng Zhang, Zijing Zhang, Bin Zhao, Chenguang Zhao, Feifan Zhao, Jinglun Zhao, Jinxiang Zhao, Shuai Zhao, Wenshuo Zhao, Xiangyu Zhao, Xuanle Zhao, Yikai Zhao, Zijia Zhao, Haozhi Zheng, Huabin Zheng, Ruihan Zheng, Shaojie Zheng, Tengyang Zheng, Haofeng Zhong, Lei Zhong, Longguang Zhong, M. Zhou, Qiankang Zhou, Runjie Zhou, Ruozhang Zhou, Xinyu Zhou, Yiqiao Zhou, Zaida Zhou, Jinguo Zhu, Liya Zhu, Xinhao Zhu, Yangjunfeng Zhu, Yuxuan Zhu, Zhen Zhu, Chen Zhuang, Weiyu Zhuang, Xinxing Zu

93 score
AI Analysis

Presents Kimi K3, a 2.8-trillion-parameter MoE model by Moonshot AI featuring a 1-million-token context length and advanced agentic capabilities. It delivers frontier-level performance across reasoning, coding, and vision tasks with high scaling efficiency.

Kimi K3, a 2.8-trillion-parameter multimodal Mixture-of-Experts (MoE) model developed by Moonshot AI, establishes an "open frontier" for large-scale AI by unifying extreme pre-training scale with advanced agentic and long-horizon capabilities up to a 1-million-token context length. The model achieves an approximate 2.5x improvement in scaling efficiency over its predecessor and demonstrates frontier-level performance across coding, agentic, knowledge, reasoning, and vision tasks, often outperfor
Large Language ModelsMixture of Experts
Research AlphaXiv Trending Jul 27

Reality Monitoring in Large Language Models: Self-Knowledge That Transforms with Conversation Memory

By Saurabh Ranjan, Konstantina Sokratous, Brian Odegaard

89 score
AI Analysis

Investigates reality monitoring in LLMs, showing that source attribution of self-generated versus user-provided content depends heavily on conversational memory structure. Feedback often reveals decoupling between accuracy and confidence.

A conversational AI that cannot tell its own output from what a user said will treat its own mistakes as user-provided facts. In humans, this capacity is called reality monitoring, and its failures are linked to hallucinations, delusions, and confabulation, yet whether LLMs possess it remains untested. Here we show, across two experiments and six LLMs, that source attribution depends on how conversational memory is structured: ceiling accuracy for self-generated content under minimal memory dema
AI SafetyConversational AI
Research Hugging Face Papers Jul 27

Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills

By Siyuan Huang, Pengyu Cheng, Haotian Liu, Tao Chen, Yihao Liu, Jingwei Ni, Shijie Zhou, Ziyi Yang, Gangwei Jiang, Mengyu Zhou, Yu Cheng, Xiaoxi Jiang, Guanjun Jiang

88 score
AI Analysis

Presents Skill Self-Play (Skill-SP), a co-evolutionary framework that combines verifiable scenario-specific execution with dynamic task routing. This approach reconciles the tension between environment-bound precision and open-ended task diversity in LLM self-evolution.

LLM training is shifting from manual design and annotation to interaction-driven self-evolution. However, existing self-evolutionary methods face a fundamental dilemma between task diversity and verification reliability: environment-bound methods obtain precise feedback but confine learning to narrow domains, while open-ended self-generation broadens the task space but lacks reliable verification, allowing misleading rewards to pollute the training loop. We identify agent skills as a powerful mi
Reinforcement LearningAgentic Workflows
Research AlphaXiv Trending Jul 27

Sol-Attn: Accelerating Video Generation Inference via On-the-Fly Attention Sparsification

By Haopeng Li, Yitong Li, Junsong Chen, Tian Ye, Haozhe Liu, Jincheng Yu, Duomin Wang, Ruihua Zhang, Zeke Xie, Enze Xie, Song Han

88 score
AI Analysis

Introduces Sol-Attn, a training-free method from NVIDIA that accelerates Diffusion Transformer video generation via on-the-fly attention sparsification and proxy-score reuse. It achieves up to 5.41x kernel speedup while preserving video quality.

NVIDIA researchers developed Sol-Attn, a training-free method that accelerates Diffusion Transformer video generation inference by integrating on-the-fly attention sparsification and proxy-score reuse for approximation correction. This approach achieved up to 5.41x kernel speedup and 2.12x end-to-end speedup in text-to-video tasks, while preserving generation quality.
Inference OptimizationVideo Generation
Research AlphaXiv Trending Jul 27

ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understanding

By Hangjie Yuan, Yichen Qian, Zhiwei Tang, Xianzhe Xu, Lirong Wu, Sicheng Yang, Jinwang Wang, Pengju Wang, Zhitao Zeng, Yizeng Han, Yan Xing, Shengxuan Luo, Tao Feng, Qing Xie, Weigen Yao, Yi Yang, Zuozhu Liu, Jiasheng Tang, Shaocheng Wang, Jitao Wang, Jiahong Dong, Weihua Chen, Feng Xu, Fan Wang

88 score
AI Analysis

Presents ClinFusion, a vision-centric multimodal LLM system by Alibaba's DAMO Academy that combines 2D/3D vision encoders and agentic tool use for holistic medical understanding. It sets new benchmarks in medical VQA and report generation.

ClinFusion is a vision-centric multimodal LLM system developed by DAMO Academy and Alibaba Group that integrates a compositional architecture with specialized 2D/3D vision encoders and an agentic tool-use framework to enhance holistic medical understanding. It sets new benchmarks in medical VQA and report generation, demonstrating superior instruction-following and achieving clinical validation from expert radiologists.
AI for HealthMultimodal Models
Research AlphaXiv Trending Jul 27

What do Reward Models Memorize?

By Ivo Verhoeven, Pushkar Mishra, Ekaterina Shutova

88 score
AI Analysis

Studies what discriminatively trained reward models memorize, showing they misallocate memorization to easy pairs, learn dataset shortcuts, and overgeneralize length heuristics. It highlights limitations in current human preference training.

This paper studies what discriminatively trained reward models (RMs) memorize by measuring counterfactual memorization on two human preference datasets. We show that RMs 1) misallocate memorization to easy, high margin preference pairs, 2) memorize dataset-specific shortcuts (e.g., model identity, user sampling strategy), and 3) overgeneralize simple heuristic correlates of human preference (e.g., length, compliance) when confronted with unseen preference pairs. Overall, our findings indicate th
AlignmentReward Models
88 score
AI Analysis

Proposes the untrusted advice protocol for AI control, where a trusted executor model follows short, monitored hints from an untrusted advisor. This narrows the influence channel while recovering substantial capability on complex tasks like SWE-bench.

TL;DR: We introduce the untrusted advice protocol, in which a trusted executor LLM takes every action and an untrusted advisor LLM can only send it short hints. Even with as few as 4 characters per step, this advice recovers a substantial fraction of the capability gap between the two models. Because the untrusted LLM’s influence flows through such a narrow, monitorable channel, we argue that this achieves near-maximal safety in our BashArena setting. We also discuss the general concept of infor
AI SafetyAI Control
Research Hugging Face Papers Jul 27

Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making

By Amirhosein Ghasemabadi, Ruichen Chen, Bahador Rashidi, Di Niu

87 score
AI Analysis

Introduces Multi-Head Latent Control, a lightweight layer that reads hidden-state trajectories to help LLM agents make real-time operational decisions like tool invocation or model deferral. It avoids costly prompt-level routing and external orchestration.

Large language models are increasingly deployed as agents, but reliable agentic behavior requires more than next-token prediction. At inference time, it is preferred that an agent can decide whether to proceed with its current reasoning, defer to a stronger model, request additional information, invoke external tools, or abstain under the given setup. Existing approaches address these decisions through prompt-level routing, external orchestration, or task-specific fine-tuning, which primarily re
Agentic WorkflowsLatent Space Control
Research AlphaXiv Trending Jul 27

τ: Learning Touch-Augmented Vision-Language-Action Models from Future Visual Supervision

By Ning Cheng, Jinan Xu, Wanlin Li, Yangzhi Chen, Jing Gao, Yiqun Wang, Kelan Peng, Wenjuan Han

87 score
AI Analysis

Presents tau (tau), a framework augmenting Vision-Language-Action models with high-dimensional tactile perception learned through future visual supervision. It significantly improves contact-rich robotic manipulation success rates.

This research introduces τ (tau), a framework augmenting Vision-Language-Action (VLA) models with high-dimensional tactile perception to improve robotic manipulation in contact-rich scenarios. τ learns action-conditioned, spatiotemporal tactile representations through future visual supervision and demonstrates significantly higher task success rates in real-robot experiments.
RoboticsMultimodal Models
Research AlphaXiv Trending Jul 27

Sparse Autoencoders Encode Both Concepts and Functions: The Downstream Geometry of Feature Effects

By Phu Gia Hoang, Anwoy Chatterjee, Tanmoy Chakraborty, Iryna Gurevych, Subhabrata Dutta

87 score
AI Analysis

Introduces Feature-Effect Geometry Analysis (FEGA) to study how Sparse Autoencoder features influence LLM outputs. It reveals that features split into diffuse 'pointer-like' operations and multi-directional 'value-like' concepts.

Researchers from UKP Lab and IIT Delhi introduced Feature-Effect Geometry Analysis (FEGA) to characterize how Sparse Autoencoder (SAE) features influence large language model outputs. Their analysis revealed that "pointer-like" features, associated with in-context operations, exhibit diffuse and context-dependent effects, while "value-like" features, linked to factual concepts, show more structured but often multi-directional logit perturbations, challenging the idea of stable, one-dimensional f
Mechanistic InterpretabilitySparse Autoencoders
Research AlphaXiv Trending Jul 27

MMOE: Modernizing Diffusion Transformers with Efficient Expert Design

By Yanhao Jia, Jiepeng Wang, Haibin Huang, Chi Zhang, Erik Cambria, Xuelong Li

87 score
AI Analysis

Introduces MMOE, modernizing diffusion transformers with efficient Mixture-of-Experts designs. It achieves faster FID convergence and reduced activation memory on single-machine training budgets.

MMOE (Modernizing Diffusion Transformers with Efficient Expert Design) introduces an architecture that integrates LLM-proven Mixture-of-Experts efficiency mechanisms into diffusion transformers. This approach achieves faster FID convergence (e.g., 3.75 for MMOE-XL/2 vs. 5.20 for Dense SiT) and reduced activation memory (20-32% per block) under an accessible single-machine training budget, while improving generation quality across various model scales.
Diffusion ModelsMixture of Experts
Research LessWrong Jul 27

Multi-Turn Drift Increases Scheming

By Carlos Guerrero Alvarez

87 score
AI Analysis

Investigates how multi-turn alignment drift gradually pushes models toward misalignment, demonstrating an increased rate of scheming behavior over extended conversational turns.

TLDR -We talk about scheming, and why research on this phenomenon is crucial for AI safety.We find a particular environment/scenario where scheming happens at a higher rate than normal.We provide hypotheses for why this may be happening, andprovide concluding thoughts on this line of research.Introduction "You terrible man, foxy, ingenious, never tired of twists and tricks."(Athena speaking to Odysseus in Book 13, praising his ability to scheme)Scheming in large language models has been a topic
AI SafetyAlignment