AIBearisharXiv – CS AI · 3d ago7/10
🧠Researchers propose a bilayer SIR epidemic model to analyze how synthetic data contamination spreads across AI systems when models train on each other's outputs. Through theoretical analysis, simulations, and GPT-2 experiments, they demonstrate that cross-contamination can sustain itself (R₀ > 1) and identify detection-based filtering as the most effective intervention strategy.
AIBearisharXiv – CS AI · May 297/10
🧠A new study reveals that human curation efforts to align AI models can backfire in multi-model ecosystems where models train on outputs from other models. While curation improves alignment in isolated systems, cross-model interactions can dampen or reverse these benefits, potentially degrading long-term alignment across interconnected AI systems.
AINeutralarXiv – CS AI · May 97/10
🧠Researchers demonstrate that standard fine-tuning of transformer models on causal reasoning tasks causes catastrophic collapse where models learn trivial solutions while appearing accurate. They propose a semantic loss function with graph-based constraints that prevents collapse and achieves stable, context-dependent causal reasoning with 42.7% improvement over baseline models.
AINeutralarXiv – CS AI · Apr 137/10
🧠Researchers develop a mathematical framework showing how AI-generated text recursively shapes training corpora through drift and selection mechanisms. The study demonstrates that unfiltered reuse of generated content degrades linguistic diversity, while selective publication based on quality metrics can preserve structural complexity in training data.
AIBearisharXiv – CS AI · Mar 167/10
🧠Research reveals that recent ChatGPT models show declining ability to generate diverse text outputs, a phenomenon called 'model self-convergence.' This degradation is attributed to training on increasing amounts of synthetic data as AI-generated content proliferates across the internet.
🧠 ChatGPT
AINeutralarXiv – CS AI · Mar 167/10
🧠Research published on arXiv demonstrates that training diverse AI model ecosystems can prevent knowledge collapse, where AI systems degrade when trained on their own outputs. The study shows that optimal diversity levels increase with training iterations, and larger, more homogeneous systems are more susceptible to collapse.
AIBullisharXiv – CS AI · Mar 37/102
🧠Researchers propose Partial Model Collapse (PMC), a novel machine unlearning method for large language models that removes private information without directly training on sensitive data. The approach leverages model collapse - where models degrade when trained on their own outputs - as a feature to deliberately forget targeted information while preserving general utility.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers demonstrate that model collapse during recursive synthetic data retraining can be prevented by curating outputs across multiple reward functions rather than a single objective. The study provides theoretical proof that diverse preference aggregation leads to stable distributions satisfying Nash bargaining solutions, offering a framework for maintaining output diversity in AI training loops.
AINeutralarXiv – CS AI · Mar 54/10
🧠Researchers propose an Adaptive and Selective Reset (ASR) scheme to address model collapse in long-term test-time adaptation, where AI models gradually degrade and predict only a few classes. The solution dynamically determines when and where to reset models while preserving beneficial knowledge through importance-aware regularization.
