53 articles tagged with #data-efficiency. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce FOCA, a new framework for improving Vision-Language-Action (VLA) models in robotic control with limited training data. The method achieves significant performance gains in few-shot learning scenarios, reaching 95.7% success on benchmark tasks with just 20 demonstrations and up to 26% improvements on real robots.
Researchers demonstrate that sparse neural networks can improve scaling efficiency in data-limited training scenarios, where models must train multiple epochs on repeated data. The study introduces a scaling law predicting performance across varying sparsity levels (up to 93.75%), finding that moderate sparsity around 50% optimizes loss while higher sparsity improves compute efficiency, challenging assumptions that sparsity is purely an efficiency tool.
HumanEgo is a new AI framework that enables robots to learn manipulation tasks directly from human egocentric videos without requiring robot-specific training data. The system achieves 92.5% success on real-world tasks using just 30 minutes of human video per task and transfers zero-shot across different robot hardware, cameras, and environments.
Researchers introduce Athena-PRM, a multimodal process reward model that evaluates reasoning steps in complex problem-solving with remarkable data efficiency, requiring only 5,000 samples. The model leverages prediction consistency between weak and strong AI completers to generate high-quality training labels, achieving state-of-the-art results across multiple benchmarks including WeMath, MathVista, and VisualProcessBench.
PilotTTS demonstrates that competitive text-to-speech systems no longer require massive proprietary datasets or complex architectures. Using only 200K hours of openly-processed data and a lightweight autoregressive model, the system achieves industry-leading performance on benchmark tests while supporting voice cloning, emotion synthesis, and multilingual capabilities.
GUI-Libra presents a specialized training methodology for native GUI agents that addresses critical gaps between open-source and closed-source systems through action-aware supervised fine-tuning and improved reinforcement learning with partial verifiability. The work introduces an 81K curated GUI reasoning dataset and demonstrates consistent improvements across web and mobile benchmarks without requiring expensive online data collection.
RewardHarness introduces a self-evolving agentic framework that dramatically improves reward modeling for image-editing evaluation using only 0.05% of typical training data. By iteratively refining tools and skills from minimal examples rather than large-scale annotations, the system achieves 47.4% accuracy on benchmarks, outperforming GPT-5 and enabling more efficient AI alignment.
Researchers conducted a comprehensive empirical study on scaling laws for large language models during reinforcement learning post-training, using Qwen2.5 models ranging from 0.5B to 72B parameters. The study reveals that larger models demonstrate superior learning efficiency, performance can be predicted via power-law models, and data reuse proves highly effective in constrained environments, providing practical guidelines for optimizing LLM reasoning capabilities.
Researchers demonstrate that robots equipped with minimal embodied sensorimotor capabilities learn numerical concepts significantly faster than vision-only systems, achieving 96.8% counting accuracy with 10% of training data. The embodied neural network spontaneously develops biologically plausible number representations matching human cognitive development, suggesting embodiment acts as a structural learning prior rather than merely an information source.
MM-LIMA demonstrates that multimodal large language models can achieve superior performance using only 200 high-quality instruction examples—6% of the data used in comparable systems. Researchers developed quality metrics and an automated data selector to filter vision-language datasets, showing that strategic data curation outweighs raw dataset size in model alignment.
Researchers introduced Webscale-RL, a data pipeline that converts large-scale pre-training documents into 1.2 million diverse question-answer pairs for reinforcement learning training. The approach enables RL models to achieve pre-training-level performance with up to 100x fewer tokens, addressing a critical bottleneck in scaling RL data and potentially advancing more efficient language model development.
Researchers demonstrate a data-efficient fine-tuning method for text-to-video diffusion models that enables new generative controls using sparse, low-quality synthetic data rather than expensive, photorealistic datasets. Counterintuitively, models trained on simple synthetic data outperform those trained on high-fidelity real data, supported by both empirical results and theoretical justification.
Researchers developed GoldiCLIP, a data-efficient vision-language model that achieves state-of-the-art performance using only 30 million images - 300x less data than leading methods. The framework combines three key innovations including text-conditioned self-distillation, VQA-integrated encoding, and uncertainty-based loss weighting to significantly improve image-text retrieval tasks.
This research review examines methodologies for addressing AI systems' challenges with limited training data through uncertainty quantification and synthetic data augmentation. The paper presents formal approaches including Bayesian learning frameworks, information-theoretic bounds, and conformal prediction methods to improve AI performance in data-scarce environments like robotics and healthcare.
Researchers introduce ACTIVEULTRAFEEDBACK, an active learning pipeline that reduces the cost of training Large Language Models by using uncertainty estimates to identify the most informative responses for annotation. The system achieves comparable performance using only one-sixth of the annotated data compared to static baselines, potentially making LLM training more accessible for low-resource domains.
GIPO (Gaussian Importance Sampling Policy Optimization) is a new reinforcement learning method that improves data efficiency for training multimodal AI agents. The approach uses Gaussian trust weights instead of hard clipping to better handle scarce or outdated training data, showing superior performance and stability across various experimental conditions.
Researchers introduce Tether, a breakthrough method enabling robots to perform autonomous functional play using minimal human demonstrations (≤10). The system generates over 1000 expert-level trajectories through continuous cycles of task execution and improvement, representing a significant advance in autonomous robotics learning.
Research demonstrates a breakthrough method for achieving 10,000x reduction in training data requirements while maintaining high-fidelity labels in machine learning systems. This advancement focuses on human-computer interaction and visualization techniques to optimize data efficiency in AI training processes.
Researchers document L20-Edu-135M, a 134.5M-parameter language model trained on a single NVIDIA L20 GPU using only 13 billion tokens—2.17% of the data used by comparable public models. While the model underperforms larger counterparts like SmolLM2, it achieves 87.1% of SmolLM-135M's performance with drastically reduced computational resources, offering insights into data-efficient small language model training.
Researchers introduce Noise-Guided Transport (NGT), a lightweight machine learning method that enables effective imitation learning with minimal expert demonstrations—as few as 20 data samples. The approach frames imitation as an optimal transport problem solved through adversarial training, requiring no pretraining or specialized hardware while achieving strong performance on complex control tasks.
Researchers introduce DOM2, a diffusion-based offline multi-agent reinforcement learning algorithm that significantly improves policy expressiveness and generalization. The method achieves 20x better data efficiency and superior performance across standard benchmarks while maintaining robustness to environment shifts.
Researchers introduce DOG-DPO, a training-free data selection framework that optimizes safety alignment for large language models by treating preference pairs as geometric signals. The method achieves comparable safety performance using only 11% of preference data, significantly reducing computational costs and redundancy in alignment datasets.
Researchers propose Deep Active Re-Labeling (DARL), a framework addressing human annotation errors in deep active learning by allocating budget to re-annotate potentially mislabeled data. The method uses noise detection strategies to identify suspect instances, improving data quality and model performance under annotation noise.
Researchers introduce DEFINED, a computational framework for assessing creativity in debate using a hierarchical eight-dimensional metric system. The approach combines pre-trained language models with human expert annotations to overcome data scarcity challenges, achieving more accurate scoring than standard LLM evaluators.
Researchers propose SpectCount, a synthetic data fine-tuning method that improves large audio language models (LALMs) by generating on-the-fly audio signals to address spectrotemporal perceptual weaknesses. The approach bypasses the bottleneck of scarce annotated audio data and demonstrates performance gains across diverse auditory benchmarks without requiring real-world audio or pretrained generative models.
