AINeutralarXiv – CS AI · 6h ago7/10
🧠
Unifying Data, Memory, and Compute Efficiency in LLM training: A Survey
A comprehensive survey examines how data efficiency, memory constraints, and compute budgets interact as coupled bottlenecks in LLM training. The research reveals that optimal training strategies are resource-dependent rather than universal, with GPU memory often being the primary limiting factor rather than raw computational power.