Not Just the Destination, But the Journey: Reasoning Traces Causally Shape Generalization Behaviors
By Pengcheng Wen, Yanxu Zhu, Jiapeng Sun, Han Zhu, Yujin Zhou, Chi-Min Chan, Sirui Han and Yike Guo
This paper demonstrates that reasoning traces in chain-of-thought causally shape model generalization behavior, not just the final answer. By training models on datasets with different reasoning styles (evil, misleading, submissive) while holding final answers constant, they show reasoning paths independently influence downstream safety generalization.