AIBullisharXiv – CS AI · 7h ago6/10
🧠
Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings
Researchers propose an attention expansion mechanism that enhances keyphrase extraction from long documents by augmenting pre-trained language models with information from out-of-context chunks using word embeddings. This approach achieves state-of-the-art performance across multiple benchmark datasets while maintaining computational efficiency compared to full-context LLMs.