y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#fisher-information News & Analysis

2 articles tagged with #fisher-information. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · Jun 106/10
🧠

Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning

Researchers introduce FisherAdapTune, a machine learning framework that dynamically selects which parameters to fine-tune in pretrained models by monitoring Fisher information geometry rather than relying on fixed architectural rules. The method demonstrates improved performance and zero-shot transfer capabilities on segmentation tasks while reducing computational overhead.

AIBullisharXiv – CS AI · Apr 106/10
🧠

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis

Researchers introduce LoRA-DA, a new initialization method for Low-Rank Adaptation that leverages target-domain data and theoretical optimization principles to improve fine-tuning performance. The method outperforms existing initialization approaches across multiple benchmarks while maintaining computational efficiency.