#llm-context-management News & Analysis

2 articles tagged with #llm-context-management. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 56/10

🧠

TokenMizer: Graph-Structured Session Memory for Long-Horizon LLM Context Management

TokenMizer is an open-source proxy system that addresses a critical constraint in LLM deployments: managing long-horizon tasks within finite context windows. By modeling session history as a typed knowledge graph rather than flat text, TokenMizer achieves 50% smaller resume blocks while preserving architectural decisions and task rationale that traditional baselines lose.

AINeutralarXiv – CS AI · Apr 156/10

🧠

Cooperative Memory Paging with Keyword Bookmarks for Long-Horizon LLM Conversations

Researchers propose cooperative paging, a method for managing long LLM conversations by replacing evicted context with compact keyword bookmarks and providing a recall tool for on-demand retrieval. The technique outperforms existing solutions on the LoCoMo benchmark across multiple models, though bookmark discrimination remains a critical limitation.

🧠 GPT-4🧠 Claude