3 articles tagged with #inference-compute. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
DeepSeek released V4, a new series of efficient mixture-of-experts language models supporting one-million-token context windows. The models achieve significant computational improvements over predecessors while maintaining state-of-the-art performance, with V4-Pro requiring only 27% of the inference compute of DeepSeek-V3.2.
Epoch AI forecasts that inference compute—the computational resources needed to run trained AI models—will surpass training compute by 2030, fundamentally shifting where resources and capital flow in AI infrastructure. This transition has major implications for data center investment, energy consumption patterns, and the competitive landscape of AI service providers.
The article discusses research on trading computational resources during inference time to improve adversarial robustness in AI systems. This approach explores how allocating more compute power at inference can enhance model security against adversarial attacks.
