SLASH the Sink: Sharpening Structural Attention Inside LLMs
Researchers present SLASH, a training-free method that improves how Large Language Models understand graph structures by fixing an internal attention bottleneck. The approach leverages LLMs' spontaneous ability to reconstruct graph topologies internally, addressing a fundamental limitation where language-focused attention patterns suppress graph reasoning capabilities.