AINeutralarXiv – CS AI · 3h ago6/10
🧠
MemRouter: Memory-as-Embedding Routing for Long-Term Conversational Agents
MemRouter is a new memory management system for conversational AI agents that uses lightweight embedding-based routing instead of expensive LLM generation to decide which conversation turns to store. The approach achieves 52.0 F1 score versus 45.6 for LLM-based alternatives while reducing latency from 970ms to 58ms, suggesting memory admission can be effectively learned through supervised classification rather than generative models.