AINeutralarXiv – CS AI · 8h ago6/10
🧠
Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
Researchers demonstrate that batch size is a critical hyperparameter systematically overlooked in LoRA fine-tuning evaluations, causing conflicting performance claims across variants. A cost-efficient tuning strategy reveals batch size's substantial impact on optimal model performance, reconciling previous contradictory results and establishing clearer evaluation standards.