AIBullisharXiv – CS AI · 9h ago7/10
🧠
Platonic Transformers: A Solid Choice For Equivariance
Researchers introduce Platonic Transformers, a novel architecture that adds geometric symmetry constraints to standard Transformers without sacrificing computational efficiency. By leveraging symmetry groups from Platonic solids as reference frames for attention mechanisms, the model achieves equivariance to translations and discrete symmetries while maintaining Transformer performance across vision, 3D point clouds, and molecular prediction tasks.