AIBullisharXiv – CS AI · 4d ago7/10
🧠Researchers present ExecTimeNet, a learned world model that bridges the gap between discrete multi-agent path finding (MAPF) planning and real-world robot execution by predicting how planned paths perform on physical systems with realistic dynamics and delays. The framework includes REMAP, which integrates execution-time estimation into planning, and ESADG, a post-planning optimizer that achieves up to 40% improvement in execution efficiency while maintaining path feasibility.
AIBullisharXiv – CS AI · Jun 197/10
🧠Researchers introduce VOiLA, a framework that uses learned diffusion models to enable efficient online planning for robots operating under uncertainty in partially observable environments. By distilling diffusion samplers into compact neural networks and integrating with a GPU-parallelized planner, VOiLA reduces computational costs by up to 1000x while outperforming reinforcement learning baselines with 90% less training data.
AIBullisharXiv – CS AI · Jun 117/10
🧠LUCID is a machine learning framework that learns robot manipulation skills from unstructured internet videos and human demonstrations, then transfers this knowledge to different robot embodiments through a shared intent model. The approach eliminates the need for expensive, embodiment-specific robot training data and demonstrates zero-shot transfer capabilities across multiple real-world tasks.
AIBullisharXiv – CS AI · Jun 97/10
🧠HARBOR is an automated framework that uses specialized AI agents to streamline reinforcement learning workflows for robot training, eliminating manual environment setup, reward shaping, and hyperparameter tuning. Demonstrated across 16 robotic tasks, the system reduces engineering effort while maintaining competitive performance and enabling real-world robot deployment.
AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers propose formalizing the evaluation of foundation model agents through a classical sim-to-real framework based on Markov Decision Processes, addressing the gap between simulated training and real-world deployment. The work advocates adopting established robotics solutions like domain randomization and establishing standardized benchmarks to build more reliable AI agents for production applications.
AIBullisharXiv – CS AI · Jun 57/10
🧠Researchers introduce Torque Adaptation Module (TAM), a learned module that adapts robot torque commands to compensate for dynamics differences across robot instances, payload variations, and sim-to-real gaps. TAM enables reusable policy adaptation without requiring robot-specific retraining or real-world data collection, demonstrating robust performance on dynamic manipulation tasks with a real Franka Panda robot.
AIBullisharXiv – CS AI · Jun 47/10
🧠Researchers introduce CoRe-MoE, a reinforcement learning framework enabling humanoid robots to seamlessly transition between walking and running while adapting to complex terrains. The two-stage approach decouples gait generation from terrain adaptation using a contrastive learning mechanism, with successful zero-shot deployment on a Unitree G1 robot across varied outdoor environments.
AIBullisharXiv – CS AI · May 97/10
🧠Researchers introduce EA-WM, an event-aware generative world model that bridges kinematic control and visual perception for robotic systems. By projecting robot actions directly into camera views as structured kinematic-to-visual action fields rather than abstract tokens, the model achieves state-of-the-art performance on the WorldArena benchmark, significantly advancing robot learning and simulation capabilities.
AIBullisharXiv – CS AI · Apr 207/10
🧠Researchers present a generative framework that converts real-world panoramic images into high-fidelity simulation scenes for robot training, using semantic and geometric editing to create diverse training variants. The approach demonstrates strong sim-to-real correlation and enables robots to generalize better to unseen environments and objects through scaled synthetic data generation.
AIBullisharXiv – CS AI · Apr 137/10
🧠Researchers introduce Humanoid-LLA, a Large Language Action Model enabling humanoid robots to execute complex physical tasks from natural language commands. The system combines a unified motion vocabulary, physics-aware controller, and reinforcement learning to achieve both language understanding and real-world robot control, demonstrating improved performance on Unitree G1 and Booster T1 humanoids.
AIBullisharXiv – CS AI · Apr 77/10
🧠Researchers developed Sim2Real-AD, a framework that successfully transfers VLM-guided reinforcement learning policies trained in CARLA simulation to real autonomous vehicles without requiring real-world training data. The system achieved 75-90% success rates in real-world driving scenarios when deployed on a full-scale Ford E-Transit.
AIBullisharXiv – CS AI · Mar 97/10
🧠Researchers introduced TADPO, a novel reinforcement learning approach that extends PPO for autonomous off-road driving. The system achieved successful zero-shot sim-to-real transfer on a full-scale off-road vehicle, marking the first RL-based policy deployment on such a platform.
AIBullisharXiv – CS AI · Mar 57/10
🧠Researchers have developed Sim2Sea, a comprehensive framework that successfully bridges the simulation-to-reality gap for autonomous maritime vessel navigation in congested waters. The system uses GPU-accelerated parallel simulation, dual-stream spatiotemporal policy, and targeted domain randomization to achieve zero-shot transfer from simulation to real-world deployment on a 17-ton unmanned vessel.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers demonstrate that multi-agent competitive training enables AI agents to develop agile flight capabilities and strategic behaviors that outperform traditional single-agent training methods. The approach shows superior sim-to-real transfer and generalization when applied to drone racing scenarios with complex environments and obstacles.
AIBullishOpenAI News · Oct 197/104
🧠New robotics techniques enable robot controllers trained entirely in simulation to successfully operate on physical robots and adapt to unexpected environmental changes. This breakthrough represents a shift from open-loop to closed-loop robotic systems that can react dynamically to real-world conditions.
AINeutralarXiv – CS AI · 2d ago6/10
🧠ReaDy-Go introduces a real-to-sim simulation pipeline using 3D Gaussian Splatting to generate photorealistic dynamic environments with moving obstacles for training robust visual navigation policies. The system synthesizes realistic human avatars and motions within reconstructed scenes, enabling policies to better transfer from simulation to real-world deployment across various environments.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers developed Physical Atari, an affordable robotic system that applies reinforcement learning algorithms to physical Atari game controllers in real-world conditions. Built for under $1,000 using consumer-grade components and 3D-printed parts, the system has demonstrated weeks of continuous operation while revealing significant performance degradation from even minor distribution shifts between training and deployment environments.
AINeutralarXiv – CS AI · Jun 116/10
🧠Researchers developed a framework for teaching dexterous robotic hands to grasp objects using only touch sensation, without visual input or real-world demonstrations. The approach combines tactile sensor calibration, geometry-aware learning, and diffusion-based policy aggregation to achieve 27% grasp success on both seen and unseen objects.
AINeutralarXiv – CS AI · Jun 106/10
🧠Researchers present a systematic framework for evaluating sim-to-real correlation in vision-language-action (VLA) robot policies, identifying why simulation benchmarks often fail to predict real-world performance. The study examines simulation platforms, policy rankings, and perturbation factors to guide both simulator designers and practitioners on effectively using simulation for policy development.
AINeutralarXiv – CS AI · Jun 106/10
🧠A comprehensive survey examines how physics simulators address the sim-to-real gap in embodied AI, focusing on navigation and manipulation tasks. The research provides benchmarks, metrics, and platform comparisons to help developers select appropriate simulation tools while accounting for hardware constraints.
AINeutralarXiv – CS AI · Jun 96/10
🧠ReCoVLA introduces a framework that enhances vision-language-action (VLA) policies by using external vision-language models to identify failures and guide residual policy training for recovery. The approach freezes pretrained VLA policies and compiles structured rewards for correction, achieving 66.7% success in simulation and 61.7% in zero-shot real-world deployment compared to 36.7% for baseline methods.
AINeutralarXiv – CS AI · Jun 46/10
🧠Instant-Fold is an in-context imitation learning framework that enables robots to manipulate deformable objects like cloth by learning from single human demonstrations. The system uses deformation-aware visual representations and flow-matching transformers to generalize across diverse folding modes and transfers directly to real-world tasks without additional training.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduced RoboBenchMart, an open-source simulated benchmark for evaluating robotic systems in retail dark-store environments. The study reveals that current state-of-the-art vision-language-action (VLA) models struggle with complex grocery manipulation tasks, indicating limitations in their generalization across diverse domains beyond tabletop scenarios.
AINeutralarXiv – CS AI · Jun 16/10
🧠This arXiv paper reviews industrial visual sim-to-real transfer in computer vision, proposing a taxonomy organized by CAD (Computer-Aided Design) data availability. The research distinguishes between CAD-available settings using explicit geometry for rendering and verification, CAD-unavailable settings relying on appearance and feature priors, and hybrid approaches, using benchmark datasets to demonstrate that raw synthetic data volume matters less than source-distribution design, detector capacity, and real-world calibration.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose a policy-neutral execution layer that bridges the gap between reinforcement learning scheduling policies and real-world industrial deployment by standardizing decision snapshots, defining explicit action admissibility, and attributing execution failures to specific causes rather than treating them as undifferentiated errors.