AIBullisharXiv – CS AI · 5h ago6/10
🧠
Pro$^2$Assist: Continuous Step-Aware Proactive Assistance with Multimodal Egocentric Perception for Long-Horizon Procedural Tasks
Pro²Assist is a step-aware AI assistant that uses augmented reality glasses and multimodal perception to provide real-time, proactive guidance for multi-step procedural tasks. The system tracks user progress continuously and demonstrates 21% higher accuracy in action understanding and 2.29x better timing accuracy compared to existing baselines, with 90% user approval in testing.