Beyond Static Instruction: A Multi-agent AI Framework for Adaptive Augmented Reality Robot Training

Researchers developed a multi-agent AI framework for adaptive Augmented Reality robot training that uses Large Language Models to dynamically adjust learning environments based on individual cognitive profiles. The system processes multimodal inputs including voice, physiology, and robot data to personalize industrial robot training experiences in real-time.

• →Current AR interfaces for robot training are static and fail to adapt to diverse learner cognitive profiles.
• →Study with 36 participants revealed significant disparities in task duration and learning characteristics during robotic pick-and-place training.
• →Proposed multi-agent framework uses autonomous LLM agents to dynamically adapt AR learning environments in real-time.
• →System processes multimodal inputs including voice, physiological data, and robot performance metrics for personalization.
• →Framework bridges the gap between static visualization and intelligent pedagogical adaptation in industrial training.