3 articles tagged with #long-context-processing. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce SpikingBrain, a family of brain-inspired large language models optimized for efficient long-context processing on non-NVIDIA hardware. The models achieve comparable performance to Transformers while requiring significantly fewer tokens for training, delivering up to 100x speedup for long sequences and 69% sparsity for low-power operation.
Researchers introduce PaperScope, a comprehensive benchmark for evaluating multi-modal AI systems on complex scientific research tasks across multiple documents. The benchmark reveals that even advanced systems like OpenAI Deep Research and Tongyi Deep Research struggle with long-context retrieval and cross-document reasoning, exposing significant gaps in current AI capabilities for scientific workflows.
Researchers propose a new theoretical framework for understanding visual text compression (VTC) using measure transport theory, which reveals that token savings don't reliably predict performance gains. They develop label-free methods to identify when visual encoding helps or hurts performance, achieving 70% accuracy in matching oracle decisions and improving average task scores by 3.3% while reducing tokens by 10.3%.
