AIBullisharXiv – CS AI · Mar 36/104
🧠
TiTok: Transfer Token-level Knowledge via Contrastive Excess to Transplant LoRA
TiTok is a new framework for transferring LoRA (Low-Rank Adaptation) parameters between different Large Language Model backbones without requiring additional training data or discriminator models. The method uses token-level contrastive learning to achieve 4-10% performance gains over existing approaches in parameter-efficient fine-tuning scenarios.