y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#end-to-end-learning News & Analysis

15 articles tagged with #end-to-end-learning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

15 articles
AIBullisharXiv – CS AI · Jun 257/10
🧠

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

Researchers introduce Wan-Streamer, a unified foundation model that handles real-time audio-visual interaction through a single Transformer architecture, eliminating the need for separate modules and achieving approximately 200ms model-side latency. The system enables sub-second duplex communication by integrating perception, reasoning, generation, and response timing within one end-to-end model.

AINeutralarXiv – CS AI · Jun 257/10
🧠

Position: Reasoning After Perception Means Reasoning Without Vision

Researchers challenge the assumption that language reasoning can compensate for vision-language model weaknesses, arguing that deferring visual reasoning to text collapses spatial information and degrades perception to passive encoding. The study introduces the Turing Eye Test to demonstrate tasks requiring visual reasoning in pixel space cannot be solved through text-only reasoning alone, suggesting AI architectures must shift toward reasoning within perception rather than about it.

AIBullisharXiv – CS AI · Jun 197/10
🧠

Lagrange: An Open-Vocabulary, Energy-Based Sparse Framework for Generalized End-to-End Driving

Researchers introduce Lagrange, an open-vocabulary autonomous driving framework that combines Vision-Language Models with sparse, energy-based planning to address limitations in existing end-to-end driving systems. The approach balances computational efficiency with generalization capacity for handling out-of-distribution scenarios while maintaining kinematic feasibility.

AIBullisharXiv – CS AI · Jun 27/10
🧠

DeepIPCv2: LiDAR-powered Robust Environmental Perception and Navigational Control for Autonomous Vehicle

DeepIPCv2 is an end-to-end autonomous driving framework that uses LiDAR point cloud data instead of cameras to perceive environments and control vehicle navigation. The system demonstrates superior robustness to lighting variations and reduced driving interventions compared to existing methods like TransFuser, advancing the practical deployment of autonomous vehicles.

AIBullisharXiv – CS AI · May 127/10
🧠

VLADriver-RAG: Retrieval-Augmented Vision-Language-Action Models for Autonomous Driving

Researchers introduce VLADriver-RAG, a new framework that combines Vision-Language-Action models with retrieval-augmented generation for autonomous driving. By grounding decisions in explicit historical knowledge rather than relying solely on learned parameters, the system achieves state-of-the-art performance on the Bench2Drive benchmark with a Driving Score of 89.12, demonstrating improved generalization in complex driving scenarios.

AIBullisharXiv – CS AI · Mar 177/10
🧠

What Matters for Scalable and Robust Learning in End-to-End Driving Planners?

Researchers introduce BevAD, a new lightweight end-to-end autonomous driving architecture that achieves 72.7% success rate on the Bench2Drive benchmark. The study systematically analyzes architectural patterns in closed-loop driving performance, revealing limitations of open-loop dataset approaches and demonstrating strong data-scaling behavior through pure imitation learning.

AINeutralarXiv – CS AI · Jun 256/10
🧠

End-to-End Voice Intent Recognition for Spontaneous Human-Drone Interaction with Naive Users

Researchers have developed an end-to-end voice recognition system for drone control that processes spontaneous, natural speech from untrained users with 82% accuracy and minimal latency. The system uses self-supervised learning combined with cross-modal knowledge distillation, eliminating the need for manual transcription and significantly outperforming traditional cascade approaches in both speed and accuracy.

AINeutralarXiv – CS AI · Jun 236/10
🧠

A Projection-Based Surrogate Gradient Interpretation for Neural Codec Wrappers

Researchers propose a new interpretation of surrogate gradients for training neural codec wrappers, showing that the SCALED method can be understood as a first-order approximation of video codecs. The technique enables end-to-end learning of pre- and post-processing networks alongside conventional codecs, achieving significant compression improvements of up to 23.59% BD-Rate reduction on x264.

AINeutralarXiv – CS AI · Jun 236/10
🧠

NeuPAN: Direct Point Robot Navigation with End-to-End Model-based Learning

NeuPAN is a new end-to-end robot navigation system that directly processes point cloud data for real-time collision avoidance without requiring pre-built maps. The technology demonstrates superior performance across multiple robot types and real-world environments by combining perception and control in a unified neural network framework.

AIBullisharXiv – CS AI · Jun 46/10
🧠

StandardE2E: A Unified Framework for End-to-End Autonomous Driving Datasets

StandardE2E introduces a unified framework that standardizes interfaces across six major autonomous driving datasets, eliminating the need for researchers to rebuild preprocessing pipelines for each dataset. By providing a single PyTorch DataLoader and canonical data schema, the framework accelerates end-to-end autonomous driving research and cross-dataset experimentation.

AIBullisharXiv – CS AI · May 126/10
🧠

Latency Analysis and Optimization of Alpamayo 1 via Efficient Trajectory Generation

Researchers have optimized Alpamayo 1, a reasoning-based autonomous driving system, by redesigning it from multi-reasoning to single-reasoning architecture while accelerating diffusion-based action generation. The optimization achieves a 69.23% latency reduction while maintaining trajectory diversity and prediction quality, demonstrating that system-level efficiency improvements are critical for practical autonomous driving deployment.

AINeutralarXiv – CS AI · May 126/10
🧠

REAP: Reinforcement-Learning End-to-End Autonomous Parking with Gaussian Splatting Simulator for Real2Sim2Real Transfer

Researchers introduce REAP, a reinforcement learning-based autonomous parking system that uses Gaussian Splatting to simulate real-world environments for training, then transfers the model to physical vehicles. The method addresses limitations of traditional multi-stage parking approaches by jointly optimizing perception and planning, achieving successful parking in extreme scenarios like mechanical slots.

AIBullisharXiv – CS AI · May 126/10
🧠

VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving

VECTOR-Drive introduces a tightly coupled vision-language-action framework for autonomous driving that balances semantic reasoning with motion planning through expert routing. Built on Qwen2.5-VL-3B, the system achieves 88.91 Driving Score on Bench2Drive by routing vision-language tokens to semantic experts while handling trajectory computation separately, demonstrating advances in multimodal AI for real-world driving tasks.

AIBullisharXiv – CS AI · Apr 156/10
🧠

Unveiling the Surprising Efficacy of Navigation Understanding in End-to-End Autonomous Driving

Researchers propose Sequential Navigation Guidance (SNG), a framework addressing a critical flaw in end-to-end autonomous driving systems that over-rely on local scene understanding while underutilizing global navigation information. The SNG framework combines navigation paths and turn-by-turn instructions with a new VQA dataset and efficient model to improve autonomous vehicle planning and navigation-following in complex scenarios.

AIBullisharXiv – CS AI · Mar 176/10
🧠

AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control

Researchers propose AerialVLA, a minimalist end-to-end Vision-Language-Action framework for UAV navigation that directly maps visual observations and linguistic instructions to continuous control signals. The system eliminates reliance on external object detectors and dense oracle guidance, achieving nearly three times the success rate of existing baselines in unseen environments.