AINeutralarXiv – CS AI · 10h ago6/10
🧠
On the Sparsity-Storage-Accuracy Tradeoff in Parsimoniously Activated Dictionary Learning
Researchers present a theoretical framework for parsimoniously activated dictionary learning (PADL) that constrains the number of active dictionary atoms rather than using traditional element-wise sparsity. The work establishes a probabilistic interpretation of PADL, derives analytical tradeoffs between sparsity, storage, and accuracy, and demonstrates practical improvements in vision and vision-language model inference.