AIBullisharXiv – CS AI · 3h ago6/10
🧠
FPMoE: A Sparse Mixture-of-Experts Approach to Functional Code Generation
Researchers introduce FPMoE, a sparse Mixture-of-Experts model optimized for functional programming languages like Haskell, OCaml, and Scala, addressing a significant gap in LLM-based code generation. With only 3B active parameters, the model matches the performance of much larger models while using a novel architecture combining language-specific experts with a shared expert for cross-language functional patterns.