36 articles tagged with #data-efficiency. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
HumanEgo is a new AI framework that enables robots to learn manipulation tasks directly from human egocentric videos without requiring robot-specific training data. The system achieves 92.5% success on real-world tasks using just 30 minutes of human video per task and transfers zero-shot across different robot hardware, cameras, and environments.
GUI-Libra presents a specialized training methodology for native GUI agents that addresses critical gaps between open-source and closed-source systems through action-aware supervised fine-tuning and improved reinforcement learning with partial verifiability. The work introduces an 81K curated GUI reasoning dataset and demonstrates consistent improvements across web and mobile benchmarks without requiring expensive online data collection.
Researchers introduce Athena-PRM, a multimodal process reward model that evaluates reasoning steps in complex problem-solving with remarkable data efficiency, requiring only 5,000 samples. The model leverages prediction consistency between weak and strong AI completers to generate high-quality training labels, achieving state-of-the-art results across multiple benchmarks including WeMath, MathVista, and VisualProcessBench.
PilotTTS demonstrates that competitive text-to-speech systems no longer require massive proprietary datasets or complex architectures. Using only 200K hours of openly-processed data and a lightweight autoregressive model, the system achieves industry-leading performance on benchmark tests while supporting voice cloning, emotion synthesis, and multilingual capabilities.
RewardHarness introduces a self-evolving agentic framework that dramatically improves reward modeling for image-editing evaluation using only 0.05% of typical training data. By iteratively refining tools and skills from minimal examples rather than large-scale annotations, the system achieves 47.4% accuracy on benchmarks, outperforming GPT-5 and enabling more efficient AI alignment.
Researchers conducted a comprehensive empirical study on scaling laws for large language models during reinforcement learning post-training, using Qwen2.5 models ranging from 0.5B to 72B parameters. The study reveals that larger models demonstrate superior learning efficiency, performance can be predicted via power-law models, and data reuse proves highly effective in constrained environments, providing practical guidelines for optimizing LLM reasoning capabilities.
Researchers demonstrate that robots equipped with minimal embodied sensorimotor capabilities learn numerical concepts significantly faster than vision-only systems, achieving 96.8% counting accuracy with 10% of training data. The embodied neural network spontaneously develops biologically plausible number representations matching human cognitive development, suggesting embodiment acts as a structural learning prior rather than merely an information source.
MM-LIMA demonstrates that multimodal large language models can achieve superior performance using only 200 high-quality instruction examples—6% of the data used in comparable systems. Researchers developed quality metrics and an automated data selector to filter vision-language datasets, showing that strategic data curation outweighs raw dataset size in model alignment.
Researchers introduced Webscale-RL, a data pipeline that converts large-scale pre-training documents into 1.2 million diverse question-answer pairs for reinforcement learning training. The approach enables RL models to achieve pre-training-level performance with up to 100x fewer tokens, addressing a critical bottleneck in scaling RL data and potentially advancing more efficient language model development.
Researchers demonstrate a data-efficient fine-tuning method for text-to-video diffusion models that enables new generative controls using sparse, low-quality synthetic data rather than expensive, photorealistic datasets. Counterintuitively, models trained on simple synthetic data outperform those trained on high-fidelity real data, supported by both empirical results and theoretical justification.
Researchers developed GoldiCLIP, a data-efficient vision-language model that achieves state-of-the-art performance using only 30 million images - 300x less data than leading methods. The framework combines three key innovations including text-conditioned self-distillation, VQA-integrated encoding, and uncertainty-based loss weighting to significantly improve image-text retrieval tasks.
This research review examines methodologies for addressing AI systems' challenges with limited training data through uncertainty quantification and synthetic data augmentation. The paper presents formal approaches including Bayesian learning frameworks, information-theoretic bounds, and conformal prediction methods to improve AI performance in data-scarce environments like robotics and healthcare.
Researchers introduce ACTIVEULTRAFEEDBACK, an active learning pipeline that reduces the cost of training Large Language Models by using uncertainty estimates to identify the most informative responses for annotation. The system achieves comparable performance using only one-sixth of the annotated data compared to static baselines, potentially making LLM training more accessible for low-resource domains.
GIPO (Gaussian Importance Sampling Policy Optimization) is a new reinforcement learning method that improves data efficiency for training multimodal AI agents. The approach uses Gaussian trust weights instead of hard clipping to better handle scarce or outdated training data, showing superior performance and stability across various experimental conditions.
Researchers introduce Tether, a breakthrough method enabling robots to perform autonomous functional play using minimal human demonstrations (≤10). The system generates over 1000 expert-level trajectories through continuous cycles of task execution and improvement, representing a significant advance in autonomous robotics learning.
Research demonstrates a breakthrough method for achieving 10,000x reduction in training data requirements while maintaining high-fidelity labels in machine learning systems. This advancement focuses on human-computer interaction and visualization techniques to optimize data efficiency in AI training processes.
Researchers have developed novel data organization methods (STR and SAW) for improving LLM training efficiency by strategically ordering training data using pre-computed sample-level scores. The study formalized four key guidelines—Boundary Sharpening, Cyclic Scheduling, Curriculum Continuity, and Local Diversity—and validated their effectiveness across multiple model scales, offering practical improvements to training stability with minimal computational overhead.
Researchers demonstrate that a 0.6B-parameter ASR model trained on 100k hours of speech can achieve competitive performance with larger models through teacher-guided on-policy distillation, reducing the audio data requirements by 99.5% compared to industry standards while closing the capability gap with 1.7B parameter models.
Researchers introduce LUCoS, an unsupervised method for selecting training instances in tabular machine learning that uses latent embeddings rather than raw features. The approach significantly outperforms random selection across 67 datasets, addressing a critical cold-start problem in tabular foundation models like TabPFN.
Researchers introduce M³ (Multi-scale Morton Measure), a framework that improves neural surrogate models for physical simulations by addressing training bias from discretized data sampling. The method achieves up to 4.7× error reduction in volumetric cases and maintains superior performance even with 90% data reduction, demonstrating that data distribution strategy significantly impacts operator learning efficiency.
Researchers introduce Ace-Skill, a co-evolutionary framework that improves multimodal AI agents by optimizing both data sampling and knowledge organization. The system achieves 35% performance gains on tool-use benchmarks and enables smaller models to inherit capabilities from larger ones without additional training.
Researchers demonstrate that transformer-based world models exhibit distinct scaling behaviors across Atari environments, with joint multi-task training stabilizing performance gains. The study reveals that individual environments respond differently to model scaling, but unified training across 26 Atari games ensures consistent improvements regardless of inherent task complexity.
Researchers introduce PromptDx, a novel AI framework that combines differentiable prompt tuning with multimodal learning to diagnose Alzheimer's Disease using MRI and biomarker data. The method achieves competitive performance using only 1% of context samples compared to 30% in standard approaches, demonstrating significant data efficiency gains for medical imaging applications.
Researchers introduce SuperMeshNet, a semi-supervised neural network framework that dramatically reduces the amount of expensive high-resolution training data needed for mesh-based simulations. By combining small paired datasets with abundant unpaired data through complementary learning, the system achieves superior accuracy while requiring 90% less supervised training data than fully supervised approaches.
Researchers developed PSP-HDC, a graph-structured hyperdimensional computing framework for predicting material properties in 3D microstructure fabrication with sparse, heterogeneous data. The approach achieves 91% accuracy while providing inherent explainability—a critical advantage over conventional machine learning models that struggle with limited datasets and poor generalization.
