AIBullisharXiv – CS AI · May 287/10
🧠Researchers introduce FLUID, a framework that adapts autoregressive language models to diffusion-based text generation by enforcing strictly causal attention patterns, eliminating the need for expensive retraining from scratch. The approach incorporates Elastic Horizons, a dynamic denoising mechanism that improves efficiency and achieves state-of-the-art performance while reducing training costs significantly.
AIBullisharXiv – CS AI · Apr 147/10
🧠Researchers introduce Introspective Diffusion Language Models (I-DLM), a new approach that combines the parallel generation speed of diffusion models with the quality of autoregressive models by ensuring models verify their own outputs. I-DLM achieves performance matching conventional large language models while delivering 3x higher throughput, potentially reshaping how AI systems are deployed at scale.
AINeutralarXiv – CS AI · Mar 267/10
🧠Researchers propose a new method called coupled autoregressive generation to evaluate large language models more efficiently by controlling for randomness in their responses. The study shows this approach can reduce evaluation samples by up to 75% while revealing that current model rankings may be confounded by inherent randomness in generation processes.
🧠 Llama
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers introduce STAR, a new autoregressive pretraining method for Vision Mamba that uses separators to quadruple input sequence length while maintaining image dimensions. The STAR-B model achieved 83.5% accuracy on ImageNet-1k, demonstrating improved performance through better utilization of long-range dependencies in computer vision tasks.
AIBullisharXiv – CS AI · Mar 56/10
🧠CubeComposer is a new AI model that generates high-quality 4K 360-degree panoramic videos from regular perspective videos using a novel spatio-temporal autoregressive diffusion approach. The technology addresses computational limitations of existing methods by decomposing videos into cubemap representations, enabling native 4K resolution output for VR applications.
AIBullisharXiv – CS AI · Mar 47/104
🧠Researchers propose CoDAR, a new continuous diffusion language model framework that addresses key bottlenecks in token rounding through a two-stage approach combining continuous diffusion with an autoregressive decoder. The model demonstrates substantial improvements in generation quality over existing latent diffusion methods and becomes competitive with discrete diffusion language models.
AIBullisharXiv – CS AI · Mar 47/103
🧠Researchers have developed LEDOM, an open-source reverse autoregressive language model that trains right-to-left instead of the traditional left-to-right approach. The model demonstrates unique capabilities like abductive inference and question synthesis, and when combined with forward models through 'Reverse Reward' scoring, achieves significant performance gains of up to 15% on mathematical reasoning tasks.
AINeutralarXiv – CS AI · Mar 37/104
🧠Researchers identified a structural misalignment in Transformer models where residual connections tie to current tokens while supervision targets next tokens. They propose lightweight residual attenuation techniques that improve autoregressive Transformer performance by addressing this input-output alignment shift.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers present a study optimizing reinforcement learning for autoregressive text-to-image generation by analyzing how different divergence measures affect policy alignment. Using JS divergence within the GRPO framework, they demonstrate improved performance across evaluation metrics while preserving generation diversity on LlamaGen and Janus-7B models.
AINeutralarXiv – CS AI · Jun 116/10
🧠Researchers introduce AnchorEdit, an autoregressive diffusion model designed for multi-turn image editing that maintains subject identity and consistency across 10+ sequential editing rounds. The framework uses a causal memory mechanism and three-stage training approach to address identity drift and error accumulation problems in iterative image manipulation tasks.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers challenge the conventional autoregressive versus diffusion model dichotomy, arguing that distinguishing between inference procedures (sequence expansion versus state refinement) matters more than model families. The paper advocates designing inference algorithms before training objectives, highlighting that training methods cannot compensate for flawed inference architectures, with implications for improving generative AI efficiency.
AIBullishApple Machine Learning · Mar 256/10
🧠Researchers propose Latent Lookahead Training, a new method for training transformer language models that allows exploration of multiple token continuations rather than committing to single tokens at each step. The paper was accepted at ICLR 2026's Workshop on Latent & Implicit Thinking, addressing limitations in current autoregressive language model training approaches.
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers introduce SyncSpeech, a new text-to-speech model that combines autoregressive and non-autoregressive approaches using a Temporal Mask Transformer architecture. The model achieves 5.8x lower first-packet latency and 8.8x improved real-time performance while maintaining comparable speech quality to existing models.
AIBullisharXiv – CS AI · Mar 116/10
🧠Researchers introduce Latent-DARM, a framework that bridges discrete diffusion language models and autoregressive models to improve multi-agent AI reasoning capabilities. The system achieved significant improvements on reasoning benchmarks, increasing accuracy from 27% to 36% on DART-5 while using less than 2.2% of the token budget of state-of-the-art models.
AIBullisharXiv – CS AI · Mar 96/10
🧠Researchers developed DEX-AR, a new explainability method for autoregressive Vision-Language Models that generates 2D heatmaps to understand how these AI systems make decisions. The method addresses challenges in interpreting modern VLMs by analyzing token-by-token generation and visual-textual interactions, showing improved performance across multiple benchmarks.
🏢 Perplexity
AIBullisharXiv – CS AI · Feb 276/108
🧠Researchers developed AVDE, a lightweight framework for decoding visual information from EEG brain signals using autoregressive generation. The system outperforms existing methods while using only 10% of the parameters, potentially advancing practical brain-computer interface applications.
