2 articles tagged with #context-scaling. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose Dynamic Linear Attention (DLA), a novel framework that improves how large language models process long sequences by adaptively managing memory states. DLA addresses the limitations of existing linear attention mechanisms by dynamically merging less important information while preserving critical semantic transitions, achieving superior performance across 16 datasets.
Researchers introduce Metacognitive Memory Policy Optimization (MMPO), a novel training method that improves how AI language model agents manage memory across long-horizon tasks. The approach uses Belief Entropy—a self-supervised metric measuring uncertainty about task state—to provide fine-grained supervision during memory summarization, enabling agents to maintain 97.1% performance even with 1.75M-token contexts.
