AINeutralarXiv – CS AI · 7h ago5/10
🧠
Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
Researchers compare canonical polyadic (CP) tensor adapters with LoRA for low-rank parameter-efficient fine-tuning, finding that finer parameter increments enable better budget sensitivity diagnosis but don't guarantee superior accuracy-budget trade-offs across all tasks.