Rohan Paul

The paper finds that LLM reasoning has an internal structure beyond the words being generated, opening a possible route to monitoring reasoning from inside the model. What an LLM is trying to do and whether it is doing it correctly appear to be separable internally. The researchers tracked 8 common moves, including extracting facts, decomposition, recall, deduction, algebra, and calculation. Each move produced a distinct internal pattern, and those patterns were clearest around the middle layers. Even the exact same token looked different inside the model depending on the reasoning job it was doing. Context also shaped these states. When access to the previous 30 tokens was blocked, the signal for the next reasoning operation weakened. Most importantly, a wrong calculation or deduction could still carry the correct operation signature. The model can represent what kind of reasoning it is attempting without necessarily getting that reasoning right. – arxiv. org/abs/2609.04753 Title: "Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs"