7 articles tagged with #adaptive-computation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose MixReasoning, a framework that dynamically adjusts reasoning depth across problem-solving steps, applying intensive reasoning only to difficult pivotal steps while using efficient inference for straightforward computations. The approach reduces reasoning length and improves computational efficiency while maintaining accuracy on standardized math and reasoning benchmarks.
Researchers present AVIC, an adaptive framework that optimizes when and how much multimodal language models should use world models for visual imagination during spatial reasoning tasks. The system learns to selectively invoke visual imagination only when necessary, reducing computational costs while matching or exceeding performance of fixed imagination strategies and proprietary baselines like GPT-4o.
Researchers propose Catch Your Breath (CYB), a novel training method that enables AI models to dynamically control the number of computational steps used for processing inputs through <pause> tokens. The approach outperforms standard cross-entropy training by allowing models to signal when they need additional processing time, improving performance metrics like perplexity without increasing computational overhead.
Researchers introduce DA-SIP, a dynamic inference framework for robotic control that adaptively adjusts computational resources based on task difficulty. The approach reduces inference time by 2.6-4.4x while maintaining performance, addressing the computational inefficiency of fixed-budget diffusion and flow-based policies in robotics.
Researchers introduce CosmicFish-HRM, a compact language model that uses a Hierarchical Reasoning Module to dynamically adjust computational effort during inference based on input complexity. The approach challenges the assumption that larger models are necessary for advanced reasoning, suggesting adaptive computation depth could offer efficiency gains as model scale increases.
Researchers introduce AdaAnchor, a new AI reasoning framework that performs silent computation in latent space rather than generating verbose step-by-step reasoning. The system adaptively determines when to stop refining its internal reasoning process, achieving up to 5% better accuracy while reducing token generation by 92-93% and cutting refinement steps by 48-60%.
Researchers introduce DynaMoE, a new Mixture-of-Experts framework that dynamically activates experts based on input complexity and uses adaptive capacity allocation across network layers. The system achieves superior parameter efficiency compared to static baselines and demonstrates that optimal expert scheduling strategies vary by task type and model scale.
