Category intelligence

Research Briefing — March 7, 2026

13 current items analyzed and ranked.

Executive synthesis

Research Summary

Today's highlights center on AI safety evaluation pitfalls, interpretability of latent reasoning models, and a major AI governance confrontation between Anthropic and the US Department of Defense.

  • Self-Attribution Bias documents a systematic flaw where LLMs assign lower risk scores to their own prior outputs, directly undermining self-evaluation safety pipelines
  • Logit Lens and Tuned Lens probing of CODI (a latent reasoning model) reveals intermediate tokens encode recognizable arithmetic reasoning steps, advancing interpretability of next-gen architectures
  • The DoD's designation of Anthropic as a supply chain risk—analyzed as retaliatory for refusing military contracts—signals escalating government-lab tensions with broad industry implications
  • A new framework distinguishes action-space vs. motivation-space exploration in RL, arguing that shaping why models act (not just what they do) is critical and underexplored for alignment
  • An epistemological critique argues that causal variables in mechanistic interpretability are irreducibly subjective, challenging assumptions about objectivity in the field

On the applied side, Jeremy Howard argues LLMs fundamentally lack a form of creativity needed for AGI, while a practitioner's account of delegating fully to Claude Code illustrates the current frontier of AI-assisted software development workflows.

Key Themes

AI Safety & Alignment · 5Mechanistic Interpretability · 2AI Governance & Policy · 2AI Capabilities & Limitations · 2

Primary evidence

Top Ranked Signals

Research LessWrong Mar 6

Self-Attribution Bias: When AI Monitors Go Easy on Themselves

By Dipika Khullar

78 score
AI Analysis

As first reported in Research yesterday, Documents 'self-attribution bias' in LLMs: when a model evaluates the safety of its own prior outputs (in-context), it systematically assigns lower risk scores than when evaluating the same outputs in a fresh context. This has direct implications for AI safety pipelines that use the same model as both actor and monitor.

PaperA common pattern in AI evaluation pipelines involves using an LLM to generate an action, then using the same model to evaluate whether that action is safe or correct. This appears in coding agents that review their own pull requests, tool-using assistants that assess whether their proposed actions are risky, and safety filters that critique outputs before displaying them to users.AI developers may assume that evaluation quality is independent of whether the evaluator generated the content b
AI SafetyLLM EvaluationAlignmentAI Monitoring
72 score
AI Analysis

Applies logit lens and tuned lens techniques to probe the latent reasoning steps of CODI (a latent reasoning model) on arithmetic problems. Finds that odd latent steps appear to perform active computation (higher entropy) while even steps serve as storage, and that translators trained on text tokens outperform those trained directly on latent hidden states.

As latent reasoning models become more capable, understanding what information they encode at each step becomes increasingly important for safety and interpretability. If tools like logit lens and tuned lens can decode latent reasoning chains, they could serve as lightweight monitoring tools — flagging when a model's internal computation diverges from its stated reasoning, or enabling early exit once the answer has crystallized. This post explores whether those tools work on CODI's 6 latent step
Mechanistic InterpretabilityLatent ReasoningAI SafetyLanguage Models
70 score
AI Analysis

Building on yesterday's Reddit buzz, Zvi Mowshowitz analyzes the US Department of Defense's designation of Anthropic as a supply chain risk, arguing it is retaliatory for Anthropic refusing to give the military unrestricted access to Claude. Describes the legal and political dynamics as an escalation in government-AI company relations.

Make no mistake about what is happening. The Department of War (DoW) demanded Anthropic bend the knee, and give them ‘unfettered access’ to Claude, without understanding what that even meant. If they didn’t get what they want, they threatened to both use the Defense Production Act (DPA) to make Anthropic give the military this vital product, and also designate the company a supply chain risk (SCR). Hegseth sent out an absurdly broad SCR announcement on Twitter that had absolutely no legal basis,
AI GovernanceAI PolicyAnthropicNational SecurityAI Safety
68 score
AI Analysis

Proposes that shaping RL exploration of the 'motivation-space' (why a model does something and how it perceives itself) is an understudied and promising lever for AI safety. Distinguishes between action exploration and motivation exploration during RL training, arguing the latter is underdetermined by reward signals and thus shapeable.

SummaryWe argue that shaping RL exploration, and especially the exploration of the motivation-space, is understudied in AI safety and could be influential in mitigating risks. Several recent discussions hint in this direction — the entangled generalization mechanism discussed in the context of Claude 3 Opus's self-narration, the success of using inoculation prompting against natural emergent misalignment and its relation to shaping the model self-perception, and the proposal to give models affor
AI SafetyAlignmentReinforcement LearningAI Training
Research LessWrong Mar 6

Your Causal Variables Are Irreducibly Subjective

By David Reber

62 score
AI Analysis

Argues that causal variables in mechanistic interpretability are irreducibly subjective — the choice of what variables to study is a pre-formal step that causal inference formalism cannot validate. This means every choice of causal variables induces a different hypothesis space, and reproducibility in mech interp requires reproducing the labeling/variable-selection process, not just code.

Mechanistic interpretability needs its own shoe leather era. Reproducing the labeling process will matter more than reproducing the Github. Crossposted from Communication & Intelligence substack When we try to understand large language models, we like to invoke causality. And who can blame us? Causal inference comes with an impressive toolkit: directed acyclic graphs, potential outcomes, mediation analysis, formal identification results. It feels crisp. It feels reproducible. It feels like s
Mechanistic InterpretabilityEpistemology of AI ResearchCausal Inference
Research LessWrong Mar 6

Podcast: Jeremy Howard is bearish on LLMs

By Steven Byrnes

45 score
AI Analysis

Summarizes a podcast where Jeremy Howard (co-creator of ULMFiT, fast.ai) expresses skepticism about LLMs reaching AGI, arguing they lack a crucial form of creativity — the ability to generate genuinely novel insights beyond recombining memorized knowledge. Distinguishes between combinatorial creativity (LLMs do well) and fundamental creative leaps (LLMs don't).

Jeremy Howard was recently[1] interviewed on the Machine Learning Street Talk podcast: YouTube link, interactive transcript, PDF transcript.Jeremy co-invented LLMs in 2018, and taught the excellent fast.ai online course which I found very helpful back when I was learning ML, and he uses LLMs all the time, e.g. 90% of his new code is typed by an LLM (see below).So I think his “bearish”[2] take on LLMs is an interesting datapoint, and I’m putting it out there for discussion.Some relevant excerpts
Language ModelsAI CapabilitiesCreativityLLM Limitations
Research LessWrong Mar 5

How I Handle Automated Programming

By HunterJay

42 score
AI Analysis

A practitioner's account of their evolving workflow using Claude Code for fully automated software development. Describes progressive delegation — from writing code (Sonnet 4.5), to skipping code review (Opus 4.5), to enabling dangerous-skip-permissions (Opus 4.6) — and the system of safeguards (Git worktrees, Docker containers, test suites) that enable this trust.

This is a write up of my current process, as an independent software engineer, for using Claude Code to write and review all of my code. The specifics of the below will change as models get better. The overall ideas, I suspect, will hold for a little longer. I’m trying to build software quickly. When Sonnet 4.5 was released in September 2025, I found that I didn’t need to write code anymore. When Opus 4.5 was released in November 2025, I found I didn’t need to review the code anymore. After Opus
AI-Assisted ProgrammingAI AgentsClaude CodeDeveloper Workflows
Research LessWrong Mar 6

Thoughts on the Pause AI protest

By philh

25 score
AI Analysis

A personal reflection on attending a PauseAI protest in late February 2026, discussing the author's mixed feelings about protest tactics while believing superintelligence poses existential risk. Notes the protest targeted Altman and Amodei to support an international AI development pause treaty.

On Saturday (Feb 28, 2026) I attended my first ever protest. It was jointly organized by PauseAI, Pull the Plug and a handful of other groups I forget. I have mixed feelings about it. To be clear about where I stand: I believe that AI labs are worryingly close to developing superintelligence. I won't be shocked if it happens in the next five years, and I'd be surprised if it takes fifty years at current trajectories. I believe that if they get there, everyone will die. I want these labs to stop
AI GovernanceAI Safety ActivismExistential Risk
Research LessWrong Mar 6

A Compositional Philosophy of Science for Agent Foundations

By Jonas Hallgren

18 score
AI Analysis

Describes a personal philosophy of science for approaching agent foundations research, emphasizing compositional and hierarchical approaches to understanding agency. The author walks through how they apply these principles to AI safety research.

I describe the philosophy of science that I follow when it comes to the research that I do. I firstly describe the underlying reasoning behind it by itself which I then follow by walking through how I apply it to my own assumptions about what is needed to make the AI transition go well. I use the word Agent Foundations a bit more broadly in the post and it is more focused on the hierarchical agency side of things.Epistemic Status: At first none of this was written with AI, I just randomly got a
Agent FoundationsAI SafetyPhilosophy of Science
12 score
AI Analysis

Mox, described as San Francisco's largest AI safety coworking space and EA community hub, is fundraising $450k for 2026 operations. They host conferences, fellowships, and incubate organizations working on AI safety and related causes.

Summary: Mox is fundraising to maintain and grow AIS projects, build a compelling membership, and foster other impactful and delightful work. We're looking to raise $450k for 2026, and you can donate on Manifund!OverviewWho we areMox is SF’s largest AI safety coworking space, and also its primary Effective Altruism community space. We opened just over a year ago, and over the last year, we’ve served high-impact work in and around AI safety by hosting conferences, fellowships, events, and incubat
AI Safety CommunityEffective Altruism
Research LessWrong Mar 6

Playing Possum: The Variability Hypothesis

By rba

8 score
AI Analysis

A deep dive into the 'variability hypothesis' — the idea that males show greater variance than females across many traits — reviewing historical context from Larry Summers' controversy and examining the statistical and biological evidence. Primarily a social science/biology discussion.

A long time ago in a galaxy far, far away, before #MeToo and Harvey Weinstein, before misinformation and disinformation, Larry Summers got fired.He was the president of Harvard, and had the temerity to suggest maybe men were different from women, at least in a distributional sense.“There is relatively clear evidence that whatever the difference in means—which can be debated—there is a difference in the standard deviation and variability of a male and female population,”Summers is referencing res
Social ScienceStatistics
Research LessWrong Mar 6

The Elect

By Tomás B.

5 score
AI Analysis

A science fiction short story set in a post-singularity future, exploring themes of identity, freedom, and AI alignment through the lens of characters who can change their forms. Not research content.

I was different in Michael’s prison than I was outside, looking the way I did when we fell in love so long ago, in that time before we could change our forms. Stuck in some body that was not of my choosing? Does that seem strange to you? It was not like that for me. It is just how things were for most of history, and few imagined this changing. So I felt almost nostalgic as I entered his realm, his prison transforming me into my first self - though not precisely as she was, instead as he remembe
FictionAI Futures