y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#pretraining-bias News & Analysis

2 articles tagged with #pretraining-bias. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · May 276/10
🧠

Aperiodic and Low-Frequency Spectral Bias in Reconstruction based EEG Foundation Models

Researchers identify a fundamental weakness in EEG foundation models: reconstruction-based pretraining causes these models to heavily bias toward aperiodic signal components while neglecting high-frequency oscillatory patterns critical for brain-computer interfaces. This spectral mismatch explains why large pretrained models underperform smaller supervised alternatives in low-resource settings.

AIBearisharXiv – CS AI · Mar 36/106
🧠

Knowledge without Wisdom: Measuring Misalignment between LLMs and Intended Impact

Research reveals that leading foundation models (LLMs) perform poorly on real-world educational tasks despite excelling on AI benchmarks. The study found that 50% of misalignment errors are shared across models due to common pretraining approaches, with model ensembles actually worsening performance on learning outcomes.