AIBullisharXiv – CS AI · 2d ago7/10
🧠LUCID is a machine learning framework that learns robot manipulation skills from unstructured internet videos and human demonstrations, then transfers this knowledge to different robot embodiments through a shared intent model. The approach eliminates the need for expensive, embodiment-specific robot training data and demonstrates zero-shot transfer capabilities across multiple real-world tasks.
AIBullisharXiv – CS AI · 4d ago7/10
🧠HARBOR is an automated framework that uses specialized AI agents to streamline reinforcement learning workflows for robot training, eliminating manual environment setup, reward shaping, and hyperparameter tuning. Demonstrated across 16 robotic tasks, the system reduces engineering effort while maintaining competitive performance and enabling real-world robot deployment.
AIBullisharXiv – CS AI · 5d ago7/10
🧠Researchers propose formalizing the evaluation of foundation model agents through a classical sim-to-real framework based on Markov Decision Processes, addressing the gap between simulated training and real-world deployment. The work advocates adopting established robotics solutions like domain randomization and establishing standardized benchmarks to build more reliable AI agents for production applications.
AIBullisharXiv – CS AI · Jun 57/10
🧠Researchers introduce Torque Adaptation Module (TAM), a learned module that adapts robot torque commands to compensate for dynamics differences across robot instances, payload variations, and sim-to-real gaps. TAM enables reusable policy adaptation without requiring robot-specific retraining or real-world data collection, demonstrating robust performance on dynamic manipulation tasks with a real Franka Panda robot.
AIBullisharXiv – CS AI · Jun 47/10
🧠Researchers introduce CoRe-MoE, a reinforcement learning framework enabling humanoid robots to seamlessly transition between walking and running while adapting to complex terrains. The two-stage approach decouples gait generation from terrain adaptation using a contrastive learning mechanism, with successful zero-shot deployment on a Unitree G1 robot across varied outdoor environments.
AIBullisharXiv – CS AI · May 97/10
🧠Researchers introduce EA-WM, an event-aware generative world model that bridges kinematic control and visual perception for robotic systems. By projecting robot actions directly into camera views as structured kinematic-to-visual action fields rather than abstract tokens, the model achieves state-of-the-art performance on the WorldArena benchmark, significantly advancing robot learning and simulation capabilities.
AIBullisharXiv – CS AI · Apr 207/10
🧠Researchers present a generative framework that converts real-world panoramic images into high-fidelity simulation scenes for robot training, using semantic and geometric editing to create diverse training variants. The approach demonstrates strong sim-to-real correlation and enables robots to generalize better to unseen environments and objects through scaled synthetic data generation.
AIBullisharXiv – CS AI · Apr 137/10
🧠Researchers introduce Humanoid-LLA, a Large Language Action Model enabling humanoid robots to execute complex physical tasks from natural language commands. The system combines a unified motion vocabulary, physics-aware controller, and reinforcement learning to achieve both language understanding and real-world robot control, demonstrating improved performance on Unitree G1 and Booster T1 humanoids.
AIBullisharXiv – CS AI · Apr 77/10
🧠Researchers developed Sim2Real-AD, a framework that successfully transfers VLM-guided reinforcement learning policies trained in CARLA simulation to real autonomous vehicles without requiring real-world training data. The system achieved 75-90% success rates in real-world driving scenarios when deployed on a full-scale Ford E-Transit.
AIBullisharXiv – CS AI · Mar 97/10
🧠Researchers introduced TADPO, a novel reinforcement learning approach that extends PPO for autonomous off-road driving. The system achieved successful zero-shot sim-to-real transfer on a full-scale off-road vehicle, marking the first RL-based policy deployment on such a platform.
AIBullisharXiv – CS AI · Mar 57/10
🧠Researchers have developed Sim2Sea, a comprehensive framework that successfully bridges the simulation-to-reality gap for autonomous maritime vessel navigation in congested waters. The system uses GPU-accelerated parallel simulation, dual-stream spatiotemporal policy, and targeted domain randomization to achieve zero-shot transfer from simulation to real-world deployment on a 17-ton unmanned vessel.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers demonstrate that multi-agent competitive training enables AI agents to develop agile flight capabilities and strategic behaviors that outperform traditional single-agent training methods. The approach shows superior sim-to-real transfer and generalization when applied to drone racing scenarios with complex environments and obstacles.
AIBullishOpenAI News · Oct 197/104
🧠New robotics techniques enable robot controllers trained entirely in simulation to successfully operate on physical robots and adapt to unexpected environmental changes. This breakthrough represents a shift from open-loop to closed-loop robotic systems that can react dynamically to real-world conditions.
AINeutralarXiv – CS AI · 2d ago6/10
🧠Researchers developed a framework for teaching dexterous robotic hands to grasp objects using only touch sensation, without visual input or real-world demonstrations. The approach combines tactile sensor calibration, geometry-aware learning, and diffusion-based policy aggregation to achieve 27% grasp success on both seen and unseen objects.
AINeutralarXiv – CS AI · 3d ago6/10
🧠Researchers present a systematic framework for evaluating sim-to-real correlation in vision-language-action (VLA) robot policies, identifying why simulation benchmarks often fail to predict real-world performance. The study examines simulation platforms, policy rankings, and perturbation factors to guide both simulator designers and practitioners on effectively using simulation for policy development.
AINeutralarXiv – CS AI · 3d ago6/10
🧠A comprehensive survey examines how physics simulators address the sim-to-real gap in embodied AI, focusing on navigation and manipulation tasks. The research provides benchmarks, metrics, and platform comparisons to help developers select appropriate simulation tools while accounting for hardware constraints.
AINeutralarXiv – CS AI · 4d ago6/10
🧠ReCoVLA introduces a framework that enhances vision-language-action (VLA) policies by using external vision-language models to identify failures and guide residual policy training for recovery. The approach freezes pretrained VLA policies and compiles structured rewards for correction, achieving 66.7% success in simulation and 61.7% in zero-shot real-world deployment compared to 36.7% for baseline methods.
AINeutralarXiv – CS AI · Jun 46/10
🧠Instant-Fold is an in-context imitation learning framework that enables robots to manipulate deformable objects like cloth by learning from single human demonstrations. The system uses deformation-aware visual representations and flow-matching transformers to generalize across diverse folding modes and transfers directly to real-world tasks without additional training.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduced RoboBenchMart, an open-source simulated benchmark for evaluating robotic systems in retail dark-store environments. The study reveals that current state-of-the-art vision-language-action (VLA) models struggle with complex grocery manipulation tasks, indicating limitations in their generalization across diverse domains beyond tabletop scenarios.
AINeutralarXiv – CS AI · Jun 16/10
🧠This arXiv paper reviews industrial visual sim-to-real transfer in computer vision, proposing a taxonomy organized by CAD (Computer-Aided Design) data availability. The research distinguishes between CAD-available settings using explicit geometry for rendering and verification, CAD-unavailable settings relying on appearance and feature priors, and hybrid approaches, using benchmark datasets to demonstrate that raw synthetic data volume matters less than source-distribution design, detector capacity, and real-world calibration.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose a policy-neutral execution layer that bridges the gap between reinforcement learning scheduling policies and real-world industrial deployment by standardizing decision snapshots, defining explicit action admissibility, and attributing execution failures to specific causes rather than treating them as undifferentiated errors.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose a learning-based visual peg-in-hole system that trains on multiple shapes in simulation and adapts to unseen shapes in real-world environments with minimal sim-to-real transfer costs. The approach decouples perception from control through modular networks, achieving 100% success rates on EV charging systems with only hundreds of auto-labeled training samples.
AIBullisharXiv – CS AI · May 286/10
🧠Researchers propose a reinforcement learning framework that enables safer and more efficient transfer of AI agents from simulation to real-world deployment by using probabilistic latent embeddings and dynamic policy adaptation. The approach addresses the critical sim-to-real gap problem in cyber-physical systems like autonomous vehicles by inferring environment context and adjusting risk levels during deployment.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers introduce Center-of-Pressure (CoP), a physics-grounded tactile representation that enables robots to perform complex contact-rich manipulation tasks through sim-to-real transfer learning. The method preserves dense touch sensor information while remaining robust across simulation-to-reality gaps, demonstrating zero-shot transfer on dexterous hand tasks like peg insertion and ball balancing.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers propose a hierarchical reinforcement learning framework that combines multi-agent interaction reasoning with continuous motion control to improve behavioral realism in traffic simulations. The approach outperforms self-play methods by better capturing socially aware driving behaviors while maintaining safety and efficiency in closed-loop SUMO simulations.
