#geometric-structure News & Analysis

2 articles tagged with #geometric-structure. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 27/10

🧠

Emergent Ordinal Geometry in Transformers Trained on Local Comparisons

Researchers demonstrate that Transformers trained exclusively on adjacent comparisons spontaneously develop one-dimensional geometric structures that encode hidden rank orderings, exhibiting the symbolic distance effect observed in animal cognition. This discovery mechanistically bridges cognitive science with neural network representations, showing that decision confidence scales with ordinal distance even at ceiling accuracy.

AINeutralarXiv – CS AI · Mar 24/106

🧠

Geometric structure of shallow neural networks and constructive ${\mathcal L}^2$ cost minimization

Researchers developed a new approach to minimize cost functions in shallow ReLU neural networks through explicit construction rather than gradient descent. The study provides mathematical upper bounds for cost minimization and characterizes the geometric structure of network minimizers in classification tasks.