Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models
Researchers propose Alignment-Guided Score Matching (AGSM), a reward-free post-training method that improves text-to-image alignment in diffusion models by integrating contrastive guidance into the score-matching objective. The approach addresses failure cases like over-counting and repetition in existing methods, achieving 35% improvement in counting accuracy while remaining compatible with major diffusion model architectures.