AIBullisharXiv – CS AI · Mar 176/10
🧠
Learning Retrieval Models with Sparse Autoencoders
Researchers introduce SPLARE, a new method that uses sparse autoencoders (SAEs) to improve learned sparse retrieval in language models. The technique outperforms existing vocabulary-based approaches in multilingual and out-of-domain settings, with SPLARE-7B achieving top results on multilingual retrieval benchmarks.