AIBullisharXiv – CS AI · 6h ago7/10
🧠
Communicability-Inspired Positional Encoding (CIPE)
Researchers propose Communicability-Inspired Positional Encoding (CIPE), a novel method for improving how Transformers process graph-structured data by using communicability measures to create attention-compatible geometries. CIPE achieves 35.5% average improvement across seven benchmarks and consistently enhances both structure-agnostic and structure-biased graph Transformers, establishing a principled framework for positional encodings in non-Euclidean domains.