AIBullisharXiv – CS AI · Jun 197/10
🧠Researchers have developed a self-play reinforcement learning method that trains autonomous driving policies using only 30 minutes of human demonstrations alongside simulated self-play, achieving 2500x efficiency gains over traditional imitation learning approaches. The technique enables policies to align with human driving conventions while training in 15 hours on consumer-grade hardware, addressing a critical limitation in autonomous systems where pure simulation-trained agents develop incompatible behavioral patterns.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce IEA, a conversational AI agent that enables amateur users to edit images through natural language by learning to operate parameterized editing tools in an interpretable action space. The system uses a three-stage training pipeline combining supervised fine-tuning, reinforcement learning with rewards for editing quality, and synthetic data fine-tuning, producing transparent edit traces that outperform both generative and tool-calling baselines in user studies.
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers present LiDAR, a test-time scaling method for diffusion models that improves sample quality alignment with human intent using efficient reward guidance. The approach achieves comparable performance to existing gradient guidance methods while delivering 9.5x faster sampling speeds by computing expected future rewards from marginal samples without neural backpropagation.
AIBearisharXiv – CS AI · Apr 107/10
🧠A new study challenges the validity of using LLM judges as proxies for human evaluation of AI-generated disinformation, finding that eight frontier LLM judges systematically diverge from human reader responses in their scoring, ranking, and reliance on textual signals. The research demonstrates that while LLMs agree strongly with each other, this internal coherence masks fundamental misalignment with actual human perception, raising critical questions about the reliability of automated content moderation at scale.
AIBullisharXiv – CS AI · Feb 277/106
🧠Researchers introduce Dual-Iterative Preference Optimization (Dual-IPO), a new method that iteratively improves both reward models and video generation models to create higher-quality AI-generated videos better aligned with human preferences. The approach enables smaller 2B parameter models to outperform larger 5B models without requiring manual preference annotations.
AINeutralarXiv – CS AI · Jun 56/10
🧠PerceptUI is a new AI framework that uses persona-conditioned large language models to evaluate user interfaces by simulating how specific users would respond to UX questions. The system achieves human-level accuracy through contrastive learning and prompt evolution, potentially accelerating product development by reducing reliance on costly human testing and A/B tests.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers propose Calibrated Interactive RL, a framework addressing distribution shift problems in multi-turn dialogue systems by combining interactive reinforcement learning with simulator alignment. The approach theoretically and empirically demonstrates that aligning simulators with human interaction patterns significantly improves LLM-based dialogue agent performance compared to static context and unaligned interactive methods.
AINeutralarXiv – CS AI · May 126/10
🧠A dissertation presents research on scaling reinforcement learning across distributed systems while ensuring trustworthy behavior in AI applications. The work addresses communication efficiency in federated settings and alignment with human preferences in large language models, proposing that next-generation intelligent systems require both optimization efficiency and safety mechanisms.
AINeutralarXiv – CS AI · Mar 96/10
🧠Researchers introduce AgoraBench, a new framework for improving Large Language Models' bargaining and negotiation capabilities through utility-based feedback mechanisms. The study reveals that current LLMs struggle with strategic depth in negotiations and proposes human-aligned metrics and training methods to enhance their performance.
AINeutralarXiv – CS AI · Mar 36/109
🧠Researchers propose a tensor factorization method that combines cheap automated evaluation data with limited human labels to enable fine-grained evaluation of AI generative models. The approach addresses the data bottleneck in model evaluation by using autorater scores to pretrain representations that are then aligned to human preferences with minimal calibration data.
AIBullisharXiv – CS AI · Mar 36/104
🧠Researchers developed EditReward, a human-aligned reward model for instruction-guided image editing trained on over 200K preference pairs. The model demonstrates superior performance on established benchmarks and can effectively filter high-quality training data, addressing a key bottleneck in open-source image editing models.
