AIBearisharXiv – CS AI · Jun 237/10
🧠Researchers demonstrate that large language models exhibit brittle instruction-following when faced with competing behavioral patterns, with compliance rates ranging from 1% to 99% across 13 models. The study reveals that output diversity and format—rather than reasoning ability—are the primary determinants of robustness against induction pressure, highlighting fundamental vulnerabilities in current LLM training.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers present a systematic framework for evaluating large language models using expert-curated rubrics instead of traditional programmatic benchmarks. The ComplexConstraints dataset demonstrates that rubric-based evaluation and training improves instruction-following performance by 12-15% across model sizes and transfers gains to out-of-distribution benchmarks.
AINeutralarXiv – CS AI · May 297/10
🧠Researchers introduce DistractionIF, a benchmark revealing that larger language models are paradoxically less robust to instruction-like noise in reference text, with performance degrading up to 30 points as scale increases. The study demonstrates that reinforcement learning via Group Relative Policy Optimization can restore robustness by 15.5% while maintaining instruction-following capability.
🏢 Perplexity
AIBullisharXiv – CS AI · May 297/10
🧠Researchers propose Cross-Model Entropy (CME), a label-free reward signal for reinforcement learning that uses a separate verifier model's likelihood assessment instead of human labels or self-referential signals. The method successfully extends RL post-training to open-ended instruction following across multiple model families, achieving win rates of 52.5-71.4% in head-to-head comparisons.
🧠 Llama
AINeutralarXiv – CS AI · May 17/10
🧠Researchers systematically investigated whether Large Language Models can decouple fundamental reasoning patterns from specific problem instances by introducing reasoning conflicts between parametric knowledge and contextual instructions. The study reveals that LLMs prioritize task-appropriate reasoning over compliance with conflicting instructions, though mechanistic interventions at the activation level can steer models toward better instruction following by up to 29%.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers propose a label-free self-supervised reinforcement learning framework that enables language models to follow complex multi-constraint instructions without external supervision. The approach derives reward signals directly from instructions and uses constraint decomposition strategies to address sparse reward challenges, demonstrating strong performance across both in-domain and out-of-domain instruction-following tasks.
AINeutralarXiv – CS AI · Mar 277/10
🧠Research reveals that large language models process instructions differently across languages due to social register variations, with imperative commands carrying different obligatory force in different speech communities. The study found that declarative rewording of instructions reduces cross-linguistic variance by 81% and suggests models treat instructions as social acts rather than technical specifications.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers introduce DIALEVAL, a new automated framework that uses dual LLM agents to evaluate how well AI models follow instructions. The system achieves 90.38% accuracy by breaking down instructions into verifiable components and applying type-specific evaluation criteria, showing 26.45% error reduction over existing methods.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers introduce PRIME, a framework for evaluating how large language models handle conflicting instructions, revealing that conflict type significantly impacts model behavior regardless of scale. The study of five instruction-tuned LLMs exposes critical gaps in current benchmarking methods that assess instructions in isolation, demonstrating that real-world instruction-following capabilities cannot be accurately measured without testing competing directives.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers submitted a vision-language-action driving agent called OmniDrive to the doScenes Instructed Driving Challenge, which predicts autonomous vehicle trajectories based on visual context, motion history, and natural language instructions. The team introduced a divided-view perception module that improves multi-camera visual grounding by reducing cross-view interference, enabling better alignment between language instructions and driving-relevant visual evidence.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers propose HRLLI, a hierarchical reinforcement learning framework that dynamically selects relevant natural-language instruction segments to guide agent decision-making at different stages of task execution. The approach outperforms existing instruction-conditioned RL baselines by treating language as adaptive, stage-specific guidance rather than static input, improving sample efficiency in complex environments.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers propose a hybrid diffusion transformer architecture for audio editing that uses a two-stage approach with rectified flow matching to balance performance and computational efficiency. The method addresses limitations of existing approaches by combining joint attention for semantic alignment at low resolution with alternating attention mechanisms at high resolution, enabling more accurate instruction-guided audio editing with reduced computational complexity.
AIBullisharXiv – CS AI · Jun 86/10
🧠Researchers introduce Falconer, a framework that pairs large language models with lightweight proxy models to enable efficient knowledge mining from unstructured text. The system reduces inference costs by up to 90% while maintaining accuracy comparable to state-of-the-art LLMs, accelerating large-scale information extraction by over 20x.
AINeutralarXiv – CS AI · Jun 86/10
🧠Researchers introduce MoDA (Modulation Adapter), a lightweight module that improves fine-grained visual grounding in multimodal language models through instruction-guided channel-wise modulation. Testing across 12 benchmarks and three MLLM architectures demonstrates consistent performance improvements with minimal computational overhead, suggesting a practical advancement in how AI systems understand detailed visual instructions.
AINeutralarXiv – CS AI · Jun 86/10
🧠Researchers introduce SWE-IF, a new evaluation framework that measures both functional correctness and instruction-following capabilities in Large Language Models for code generation. The study reveals that instruction following—how well models comply with non-functional requirements like code style and intent preservation—is the primary differentiator among LLMs and correlates most strongly with human preference.
AINeutralarXiv – CS AI · Jun 56/10
🧠Researchers propose MDP-GRPO, an improved reinforcement learning method that stabilizes group relative policy optimization for instruction-following tasks by addressing three fundamental instabilities in reward normalization. The technique achieves up to 5% improvement in constraint satisfaction on language models while maintaining general performance capabilities.
🧠 Llama
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce CV-Arena, a benchmark containing 12,000 high-resolution image instruction pairs to evaluate how well AI systems solve professional-grade computer vision tasks. The study proposes Active Elo, a human-AI collaborative evaluation protocol, and reveals that current models struggle with instruction adherence, physical reasoning, and detail preservation in real-world editing workflows.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce ProductWebGen, a benchmark dataset and evaluation framework for assessing multimodal AI models' ability to generate e-commerce product webpages from images and textual instructions. The study compares two approaches—using separate image editing and language models versus unified multimodal models—and releases a 1,000-sample fine-tuning dataset to advance webpage generation capabilities.
AIBullisharXiv – CS AI · May 296/10
🧠Researchers introduce LsrIF, a training framework that improves how large language models follow complex instructions by recognizing logical structures like sequential dependencies and conditional branching. The method uses structure-aware reward aggregation instead of simple averaging, demonstrating improved instruction-following performance both within and across domains.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers present a new approach to complex image editing that combines sequential decomposition with synthetic data training to overcome limitations of single-turn and traditional sequential editing methods. The technique demonstrates improved robustness on complex editing tasks and shows promise for sim-to-real generalization when combined with real-world training data.
AIBullisharXiv – CS AI · May 76/10
🧠Researchers introduce JASTIN, an instruction-driven framework that combines frozen audio encoders with fine-tuned LLMs to evaluate generative audio models with zero-shot capabilities. The approach achieves state-of-the-art correlation with human ratings across speech, sound, and music evaluation tasks without task-specific retraining.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers present a layer-wise analysis of Supervised Fine-Tuning (SFT) in large language models, revealing that middle layers remain stable during training while final layers exhibit high sensitivity. They introduce Mid-Block Efficient Tuning, a targeted approach that selectively updates intermediate layers and achieves up to 10.2% performance gains over standard LoRA on benchmarks with significantly reduced parameter overhead.
AIBullisharXiv – CS AI · Apr 66/10
🧠Researchers propose Rubrics to Tokens (RTT), a novel reinforcement learning framework that improves Large Language Model alignment by bridging response-level and token-level rewards. The method addresses reward sparsity and ambiguity issues in instruction-following tasks through fine-grained credit assignment and demonstrates superior performance across different models.
AINeutralarXiv – CS AI · Mar 276/10
🧠Researchers introduce RubricEval, the first rubric-level meta-evaluation benchmark for assessing how well AI judges evaluate instruction-following in large language models. Even advanced models like GPT-4o achieve only 55.97% accuracy on the challenging subset, highlighting significant gaps in AI evaluation reliability.
🧠 GPT-4
AIBullisharXiv – CS AI · Mar 276/10
🧠Researchers developed InstABoost, a new method to improve instruction following in large language models by boosting attention to instruction tokens without retraining. The technique addresses reliability issues where LLMs violate constraints under long contexts or conflicting user inputs, achieving better performance than existing methods across 15 tasks.
