AIBullisharXiv – CS AI · 7h ago7/10
🧠
NuWa: Deriving Lightweight Class-Specific Vision Transformers for Edge Devices
Researchers introduce NuWa, a novel model compression technique that derives lightweight, class-specific Vision Transformers optimized for edge devices. By identifying and removing class-detrimental weights through self-knowledge purification, NuWa achieves up to 29% accuracy improvements on specialized tasks while reducing pruning costs by 99.83% compared to existing methods.