AINeutralarXiv – CS AI · 2h ago6/10
🧠
Revealing Algorithmic Deductive Circuits for Logical Reasoning
Researchers have developed methods to identify which attention heads in Large Language Models are responsible for specific reasoning steps, revealing that only ~3% of heads handle factual retrieval while higher layers coordinate multi-step reasoning algorithms. This work provides insights into how LLMs learn logical reasoning from limited demonstrations and could improve model interpretability and design.