#self-conditioning News & Analysis

2 articles tagged with #self-conditioning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Mar 167/10

🧠

The Illusion of Diminishing Returns: Measuring Long Horizon Execution in LLMs

Research shows that large language models' performance on short tasks may underestimate their capabilities, as small improvements in single-step accuracy lead to exponential gains in handling longer tasks. The study reveals that larger models excel at execution over many steps, though they suffer from 'self-conditioning' where previous errors increase the likelihood of future mistakes, which can be mitigated through 'thinking' mechanisms.

AIBullisharXiv – CS AI · May 16/10

🧠

Simple Self-Conditioning Adaptation for Masked Diffusion Models

Researchers propose Self-Conditioned Masked Diffusion Models (SCMDM), a post-training adaptation that improves discrete sequence generation by conditioning each denoising step on previous predictions rather than discarding them. The method achieves nearly 50% perplexity reduction on language models and demonstrates improvements across image synthesis, molecular generation, and genomic modeling without requiring architectural changes or extra computational costs.

🏢 Perplexity