Endowing Embodied Agents with Spatial Reasoning Capabilities for Vision-and-Language Navigation

Researchers introduce BrainNav, a bio-inspired navigation framework that mimics biological spatial cognition to enhance Vision-and-Language Navigation in mobile robots. The system addresses spatial hallucination issues when transferring from simulation to real-world environments, demonstrating superior performance in zero-shot real-world testing.