3 articles tagged with #neural-collapse. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose a new IMPRINT framework for transfer learning that improves foundation model adaptation to new tasks without parameter optimization. The framework identifies three key components and introduces a clustering-based variant that outperforms existing methods by 4%.
Researchers have extended Neural Collapse theory to regression problems, discovering that Deep Neural Regression Collapse (NRC) occurs across multiple layers in neural networks, not just the final layer. The study reveals that collapsed layers learn structured representations where features align with target dimensions and covariance, providing insights into the simple structures that deep networks learn for regression tasks.
Researchers propose directional CDNV (decision-axis variance) as a key geometric quantity explaining why self-supervised learning representations transfer well with few labels. The study shows that small variability along class-separating directions enables strong few-shot transfer and low interference across multiple tasks.
