AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers propose S-SPPO, an improved framework for aligning large language models with human preferences that addresses instability issues in Self-Play Preference Optimization. The method uses semantic calibration techniques to prevent policy degradation when the model generates semantically similar responses, achieving competitive performance on AlpacaEval 2.0 without additional human annotations.
🧠 Llama
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce TriAlign, a machine learning framework that addresses fairness issues in personalized large language models by ensuring universal truths remain consistent across different social groups. The method balances accuracy, fairness, and personalization through multi-agent reinforcement learning, reducing disparities in objective task performance while maintaining user preference adaptation.
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers introduce DPPrefSyn, an algorithm for generating differentially private synthetic preference data to train large language models while protecting user privacy. The method combines the Bradley-Terry preference model with DP-PCA to create synthetic training data from private datasets, achieving competitive alignment performance with formal privacy guarantees.
AIBullisharXiv – CS AI · Jun 16/10
🧠Researchers propose FedVPA-GP, a federated learning framework that enables privacy-preserving alignment of large language models while preserving diverse user preferences instead of averaging them into a single monolithic reward model. The approach uses a Gumbel-Softmax prior and orthogonal loss to prevent posterior collapse and successfully disentangles conflicting user intents in decentralized settings.
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers present a novel inverse reinforcement learning framework that handles multiple imperfect demonstrators with varying suboptimality levels, using a feasible-reward-set approach with linear constraints. The method includes theoretical guarantees for reward recovery and practical algorithms tested on grid-worlds and LLM fine-tuning, addressing a significant gap in real-world IRL applications.
AIBullisharXiv – CS AI · May 296/10
🧠Researchers successfully induced human-like values in Large Language Models using psychological theory and tested them against 5+ million questions, finding strong alignment between value-prompted LLMs and human behavior patterns. This work demonstrates that LLMs can simulate coherent value structures comparable to humans, opening possibilities for more realistic behavioral modeling.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose In-Context Reward Adaptation, a transformer-based framework that dynamically models diverse human preferences without costly retraining. By incorporating human response time as an auxiliary signal, the approach enables language models to adapt to unseen preference domains on-the-fly, addressing a critical limitation of static reward models used in RLHF systems.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers introduce FairMindSim, a simulation benchmark and BREM framework to evaluate how well large language models align with human ethical values through social economic games. Testing 1,017 humans against ten LLMs reveals that frontier models exhibit more human-like restraint and balanced decision-making compared to mid-tier models, which show rigid, overly punitive behavior.
🧠 GPT-5🧠 Gemini
AIBearisharXiv – CS AI · May 286/10
🧠Researchers introduce CARE, a framework that evaluates how well large language models can simulate authentic community discourse by analyzing reaction tones to real-world events. The study reveals a persistent "realism gap" where explicit community prompts fail to meaningfully improve LLM simulation fidelity, highlighting that current alignment strategies are insufficient for capturing genuine sociolinguistic dynamics.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers present DecompR, a method to improve how large language models handle tasks with conflicting stakeholder preferences by separating utility estimation from aggregation. Traditional holistic LLM judges create unstable implicit weights that cause significant score variability, especially as stakeholder numbers increase; the proposed approach fixes weights based on query structure before scoring to eliminate candidate-dependent weight drift.
AINeutralarXiv – CS AI · May 276/10
🧠A new arXiv survey reframes large language model alignment tuning through a data-centric lens, decomposing alignment data construction into three stages: response synthesis, preference evaluation, and preference instantiation. By organizing existing alignment methods into a unified taxonomy, the research identifies design trade-offs and failure modes while establishing principles for improving alignment data pipeline design.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers propose novel algorithms (LDB-DF and NDB-DF) for contextual dueling bandits that handle delayed feedback—a critical real-world constraint in recommender systems and LLM alignment. The breakthrough involves an Inverse Probability Weighting mechanism that eliminates bias from delayed observations, achieving theoretical regret bounds of O(d√T) for linear settings.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers introduce PICACO, a novel in-context alignment method that optimizes meta-instructions to help large language models better understand and balance multiple, often conflicting human values without fine-tuning. The approach uses total correlation optimization to improve alignment across up to 8 distinct values while reducing noise, addressing a key limitation where LLMs struggle to reconcile competing preferences in single prompts.
AINeutralarXiv – CS AI · May 126/10
🧠Open Ontologies is an open-source Rust-based system that combines LLM-driven ontology engineering with formal OWL reasoning and stable matching alignment. The research demonstrates that stable 1-to-1 matching is the critical factor for ontology alignment quality, achieving F1 scores competitive with state-of-the-art systems, while structured tool access via Model Context Protocol significantly outperforms raw file reading for LLM interaction.
AIBullisharXiv – CS AI · May 126/10
🧠Researchers propose Pair-GRPO, a unified theoretical framework for LLM alignment that addresses instability and interpretability issues in reinforcement learning from human preferences. The method introduces Soft-Pair-GRPO and Hard-Pair-GRPO variants with proven gradient equivalence, monotonic policy improvement, and superior performance on standard benchmarks.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers introduce EvoPref, a multi-objective evolutionary algorithm that optimizes LLM alignment across multiple objectives using population-based methods rather than traditional gradient descent. The approach demonstrates 18% improvement in preference coverage and 47% reduction in preference collapse while maintaining competitive alignment quality compared to gradient-based methods like ORPO.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers propose a method to improve RLHF (Reinforcement Learning from Human Feedback) by treating the rationality parameter as context-dependent rather than fixed, using an LLM-as-judge to detect cognitive biases in human annotations and downweight unreliable comparisons. This approach enables training more robust AI models even when human feedback contains systematic biases.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers present a unified theoretical framework for f-divergence regularized Reinforcement Learning from Human Feedback (RLHF), moving beyond the standard reverse KL approach. The work introduces two novel algorithms with provable efficiency guarantees, achieving O(log T) regret bounds and establishing the first theoretical performance guarantees for online RLHF under general f-divergence regularization.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers introduce MaPPO, a new preference optimization method for large language models that integrates prior reward knowledge into the training objective. Building on Direct Preference Optimization (DPO), MaPPO demonstrates consistent improvements across multiple benchmarks while maintaining computational efficiency and compatibility with existing DPO variants.
AINeutralarXiv – CS AI · May 76/10
🧠Researchers introduce StoryRMB, the first benchmark for evaluating reward models on story generation preferences, and develop StoryReward, a specialized reward model achieving 66.3% accuracy where existing models struggle. The work addresses the challenge of modeling subjective human preferences in narrative generation, enabling better alignment between LLM-generated stories and human expectations.
AINeutralarXiv – CS AI · May 46/10
🧠Researchers introduce TUR-DPO, an improved method for aligning large language models with human preferences that incorporates reasoning topology and uncertainty awareness. Unlike standard Direct Preference Optimization, this approach evaluates not just answer correctness but the quality of the reasoning process, showing improvements across mathematical reasoning, factual QA, and dialogue tasks while maintaining training simplicity.
AIBullisharXiv – CS AI · Apr 146/10
🧠Researchers introduce CoSToM, a framework that uses causal tracing and activation steering to improve Theory of Mind alignment in large language models. The work addresses a critical gap between LLMs' internal knowledge and external behavior, demonstrating that targeted interventions in specific neural layers can enhance social reasoning capabilities and dialogue quality.
AIBullisharXiv – CS AI · Apr 136/10
🧠Researchers introduce Sequence-Level PPO (SPPO), a new algorithm that improves how large language models are trained for reasoning tasks by addressing stability and computational efficiency issues in standard reinforcement learning approaches. SPPO matches the performance of resource-heavy methods while significantly reducing memory and computational costs, potentially accelerating LLM alignment for complex problem-solving.
AINeutralarXiv – CS AI · Apr 136/10
🧠Researchers benchmarked five frontier LLMs against human players in Cards Against Humanity games, finding that while models exceed random baseline performance, their humor preferences align poorly with humans but strongly with each other. The findings suggest LLM humor judgment may reflect systematic biases and structural artifacts rather than genuine preference understanding.
AIBullisharXiv – CS AI · Apr 76/10
🧠Researchers propose APPA, a new framework for aligning large language models with diverse human preferences in federated learning environments. The method dynamically reweights group-level rewards to improve fairness, achieving up to 28% better alignment for underperforming groups while maintaining overall model performance.
🏢 Meta🧠 Llama
