y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#sim-to-real News & Analysis

16 articles tagged with #sim-to-real. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

16 articles
AIBullisharXiv – CS AI · May 97/10
🧠

EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields

Researchers introduce EA-WM, an event-aware generative world model that bridges kinematic control and visual perception for robotic systems. By projecting robot actions directly into camera views as structured kinematic-to-visual action fields rather than abstract tokens, the model achieves state-of-the-art performance on the WorldArena benchmark, significantly advancing robot learning and simulation capabilities.

AIBullisharXiv – CS AI · Apr 207/10
🧠

From Seeing to Simulating: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation

Researchers present a generative framework that converts real-world panoramic images into high-fidelity simulation scenes for robot training, using semantic and geometric editing to create diverse training variants. The approach demonstrates strong sim-to-real correlation and enables robots to generalize better to unseen environments and objects through scaled synthetic data generation.

AIBullisharXiv – CS AI · Apr 137/10
🧠

Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabulary

Researchers introduce Humanoid-LLA, a Large Language Action Model enabling humanoid robots to execute complex physical tasks from natural language commands. The system combines a unified motion vocabulary, physics-aware controller, and reinforcement learning to achieve both language understanding and real-world robot control, demonstrating improved performance on Unitree G1 and Booster T1 humanoids.

AIBullisharXiv – CS AI · Apr 77/10
🧠

Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving

Researchers developed Sim2Real-AD, a framework that successfully transfers VLM-guided reinforcement learning policies trained in CARLA simulation to real autonomous vehicles without requiring real-world training data. The system achieved 75-90% success rates in real-world driving scenarios when deployed on a full-scale Ford E-Transit.

AIBullisharXiv – CS AI · Mar 97/10
🧠

TADPO: Reinforcement Learning Goes Off-road

Researchers introduced TADPO, a novel reinforcement learning approach that extends PPO for autonomous off-road driving. The system achieved successful zero-shot sim-to-real transfer on a full-scale off-road vehicle, marking the first RL-based policy deployment on such a platform.

AIBullisharXiv – CS AI · Mar 57/10
🧠

Sim2Sea: Sim-to-Real Policy Transfer for Maritime Vessel Navigation in Congested Waters

Researchers have developed Sim2Sea, a comprehensive framework that successfully bridges the simulation-to-reality gap for autonomous maritime vessel navigation in congested waters. The system uses GPU-accelerated parallel simulation, dual-stream spatiotemporal policy, and targeted domain randomization to achieve zero-shot transfer from simulation to real-world deployment on a 17-ton unmanned vessel.

AIBullisharXiv – CS AI · Mar 56/10
🧠

Agile Flight Emerges from Multi-Agent Competitive Racing

Researchers demonstrate that multi-agent competitive training enables AI agents to develop agile flight capabilities and strategic behaviors that outperform traditional single-agent training methods. The approach shows superior sim-to-real transfer and generalization when applied to drone racing scenarios with complex environments and obstacles.

AIBullishOpenAI News · Oct 197/104
🧠

Generalizing from simulation

New robotics techniques enable robot controllers trained entirely in simulation to successfully operate on physical robots and adapt to unexpected environmental changes. This breakthrough represents a shift from open-loop to closed-loop robotic systems that can react dynamically to real-world conditions.

AINeutralarXiv – CS AI · 3d ago6/10
🧠

Learning A Simulation-based Visual Policy for Real-world Peg In Unseen Holes

Researchers propose a learning-based visual peg-in-hole system that trains on multiple shapes in simulation and adapts to unseen shapes in real-world environments with minimal sim-to-real transfer costs. The approach decouples perception from control through modular networks, achieving 100% success rates on EV charging systems with only hundreds of auto-labeled training samples.

AIBullisharXiv – CS AI · 4d ago6/10
🧠

Transferable Reinforcement Learning via Probabilistic Latent Embeddings and Dynamic Policy Adaptation for Sim-to-Real Deployment

Researchers propose a reinforcement learning framework that enables safer and more efficient transfer of AI agents from simulation to real-world deployment by using probabilistic latent embeddings and dynamic policy adaptation. The approach addresses the critical sim-to-real gap problem in cyber-physical systems like autonomous vehicles by inferring environment context and adjusting risk levels during deployment.

AINeutralarXiv – CS AI · 4d ago6/10
🧠

Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation

Researchers introduce Center-of-Pressure (CoP), a physics-grounded tactile representation that enables robots to perform complex contact-rich manipulation tasks through sim-to-real transfer learning. The method preserves dense touch sensor information while remaining robust across simulation-to-reality gaps, demonstrating zero-shot transfer on dexterous hand tasks like peg insertion and ball balancing.

AINeutralarXiv – CS AI · May 126/10
🧠

Beyond Self-Play: Hierarchical Reasoning for Continuous Motion in Closed-Loop Traffic Simulation

Researchers propose a hierarchical reinforcement learning framework that combines multi-agent interaction reasoning with continuous motion control to improve behavioral realism in traffic simulations. The approach outperforms self-play methods by better capturing socially aware driving behaviors while maintaining safety and efficiency in closed-loop SUMO simulations.

AINeutralarXiv – CS AI · May 126/10
🧠

Towards Robust Sequential Decomposition for Complex Image Editing

Researchers present a new approach to complex image editing that combines sequential decomposition with synthetic data training to overcome limitations of single-turn and traditional sequential editing methods. The technique demonstrates improved robustness on complex editing tasks and shows promise for sim-to-real generalization when combined with real-world training data.

AIBullisharXiv – CS AI · Mar 36/107
🧠

HydroShear: Hydroelastic Shear Simulation for Tactile Sim-to-Real Reinforcement Learning

HydroShear is a new tactile simulation system for robotics that enables zero-shot sim-to-real transfer of reinforcement learning policies by accurately modeling force, shear, and stick-slip transitions. The system achieved 93% success rate across four dexterous manipulation tasks, significantly outperforming existing vision-based tactile simulation methods.

AINeutralOpenAI News · Oct 184/103
🧠

Sim-to-real transfer of robotic control with dynamics randomization

The article title suggests research on transferring robotic control from simulation environments to real-world applications using dynamics randomization techniques. However, the article body appears to be empty or unavailable, preventing detailed analysis of the research findings or implications.