AINeutralarXiv – CS AI · 18h ago6/10
🧠
What's the Point? Spatial Grammar & Index Resolution for Sign Language Processing
Researchers present a framework for improving sign language recognition models by addressing spatial indexing—pointing gestures that assign discourse entities to spatial locations. Despite comprising 10-15% of signing content, current models trained on gloss-sequences poorly capture this non-lexical feature, and the new approach decomposes spatial reference resolution into detection and entity linking tasks to create index-aware models.