Research LessWrong Dec 27
Jailbreaks Peak Early, Then Drop: Layer Trajectories in Llama-3.1-70B
By James Hoffend
72 score
AI Analysis
Introduces the Genuine Engagement Index (GEI), a mechanistic interpretability method showing that jailbreaks in Llama-3.1-70B peak in mid-layers then drop ~51% by output, while standard harmful prompts show monotonic increases with only 6-13% reduction—suggesting safety training creates genuine comprehension but jailbreaks exploit layer-specific vulnerabilities.
o Author: James HoffendDate: December 27, 2025Model tested: Llama-3.1-70B-InstructCode & data: Available upon requestSummaryI developed the Genuine Engagement Index (GEI), a mechanistic interpretability method that measures whether a model internally distinguishes harmful from benign intent across all layers—even when both prompts produce the same surface behavior (refusal).Using GEI on Llama-3.1-70B-Instruct with 300 prompts across 5 harm categories, I found something unexpected about jailb
Mechanistic InterpretabilityAI SafetyJailbreakingLanguage Models