AIBullisharXiv – CS AI · Jun 107/10
🧠
From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG
Researchers introduce EPIC, a novel approach to on-device Retrieval-Augmented Generation (RAG) that prioritizes user preferences as compact personal context while operating under strict memory constraints. The method achieves dramatic efficiency gains—reducing memory usage by 2,404x and latency by 32x—while improving preference-following accuracy by 18.79 percentage points across multiple benchmarks.