y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#prompt-engineering News & Analysis

185 articles tagged with #prompt-engineering. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

185 articles
AINeutralarXiv – CS AI · Jun 96/10
🧠

Capacity, Not Format: Rethinking Structured Reasoning Failures

Researchers found that structured output formats like JSON degrade AI model performance not because of formatting itself, but because of insufficient model capacity. Models with adequate computational headroom handle JSON constraints without accuracy loss, while smaller models operating near their limits suffer 28-36 percentage point drops, a penalty that can be partially recovered by reasoning first and formatting afterward.

🧠 GPT-4🧠 Opus
AIBullisharXiv – CS AI · Jun 96/10
🧠

Evaluating Advanced Prompting on Gemini Flash for Multi-Hop Biomedical QA

Researchers evaluated Google's Gemini Flash models on the MedHopQA biomedical reasoning challenge, demonstrating that advanced prompt engineering significantly improves LLM performance in complex multi-hop question answering. A sophisticated prompt combining role-playing and chain-of-thought examples achieved a 0.720 score versus 0.565 baseline, with Gemini 2.0 Flash matching newer 2.5 Flash performance.

🧠 Gemini
AINeutralarXiv – CS AI · Jun 96/10
🧠

Symbolic Reasoning Frameworks Modulate LLM Risk Aversion in Multi-Agent Strategic Settings

Researchers demonstrate that symbolic reasoning frameworks (I-Ching, Tarot) injected as prompts into language models deployed as strategic agents significantly reshape multi-agent game outcomes by modulating risk-aversion behaviors, producing framework-specific winner distributions in a 7-player diplomacy simulation without the agents following the frameworks' literal content.

AINeutralarXiv – CS AI · Jun 95/10
🧠

Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation

Researchers present a training-free Video RAG (Retrieval-Augmented Generation) system that decouples semantic retrieval from logical reasoning to improve cross-lingual video comprehension and reduce hallucinations. The two-stage pipeline uses dense retrieval with clean visual data followed by LLM-powered cognitive reranking, achieving strong precision in information retrieval and persona-conditioned generation.

AINeutralarXiv – CS AI · Jun 96/10
🧠

Seeing is Believing: Aligning Prompt Rewriting with Visual Anchors for Text-to-Image Generation

Researchers introduce FaithRewriter, a novel framework that enhances text-to-image generation by grounding prompt rewrites in actual visual outputs rather than linguistic improvements alone. The system uses multimodal AI to generate intermediate images from user prompts, then leverages this visual context to create more faithful augmentations that better align user intent with generated results.

AINeutralarXiv – CS AI · Jun 95/10
🧠

When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA

Researchers introduce Closed-Loop Trace Distillation, a method to improve AI systems' ability to understand robotic manipulation failures and infer necessary action sequences. The approach uses distilled natural-language heuristics derived from training traces, enabling frozen vision-language models to achieve 38-47% accuracy improvements over baseline methods in predicting minimal-success action chains on both simulated and real robots.

AIBullisharXiv – CS AI · Jun 86/10
🧠

MHA-RAG: Improving Efficiency, Accuracy, and Consistency by Encoding Exemplars as Soft Prompts

Researchers introduce MHA-RAG, a framework that encodes domain-specific exemplars as soft prompts instead of text, achieving 20-point performance improvements over standard RAG while reducing inference costs by 10X. The approach demonstrates order-invariant performance across multiple question-answering benchmarks, addressing key challenges in adapting foundation models to new domains with limited data.

AINeutralarXiv – CS AI · Jun 56/10
🧠

Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI

Researchers propose CoRe-3, a three-part competency model for teaching students to reason effectively with generative AI by separating task framing, output evaluation, and iterative steering into distinct, measurable skills. The framework addresses a critical gap in AI education: current assessments collapse productive AI use into a single 'prompting' score, obscuring where students succeed or fail in working with AI systems.

AINeutralarXiv – CS AI · Jun 56/10
🧠

Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversations

Researchers study how Large Language Models deployed as Artificial Moral Advisors should communicate with users discussing ethical dilemmas, proposing three uncertainty-focused conversation strategies and finding that different approaches sustain distinct quality levels of engagement rather than producing uniform belief revision.

AINeutralarXiv – CS AI · Jun 56/10
🧠

Measuring the sensitivity of LLM-based structured extraction to prompt, model, and schema choices in clinical discharge summaries

Researchers evaluated how large language models performing structured data extraction from clinical notes respond to variations in prompts, model sizes, and data schemas. The study found that schema design—particularly the distinction between absent versus undocumented information—drives disagreement more than prompt phrasing, while model choice significantly impacts multi-class categorization tasks.

AINeutralarXiv – CS AI · Jun 56/10
🧠

When Gradients Collide: Failure Modes of Multi-Objective Prompt Optimization for LLM Judges

Researchers identify critical failure modes in multi-objective prompt optimization for LLM judges, finding that jointly optimizing across multiple evaluation criteria reduces gradient task-focus by 59% and combining single-objective prompts degrades performance by 27%. The study reveals fundamental limitations in extending textual gradient methods to multi-criteria scenarios, constraining practical applications of automated LLM judge customization.

AINeutralarXiv – CS AI · Jun 46/10
🧠

DAR: Deontic Reasoning with Agentic Harnesses

Researchers introduce Deontic Agentic Reasoning (DAR), a new framework that enables large language models to better tackle complex rule-based reasoning tasks by dynamically querying statutes and policies. Testing on DeonticBench shows agentic approaches improve performance on hard cases, though weaker models struggle with numerical reasoning and consume significantly more tokens.

AINeutralarXiv – CS AI · Jun 46/10
🧠

Geometry-Aware Hallucination Detection in Large Language Models

Researchers introduce GA-ICL, a geometry-aware framework that improves hallucination detection in large language models by selecting better in-context learning demonstrations. Rather than relying on surface-level text similarity, the method uses latent representations and prototype geometry to choose demonstrations, achieving stronger performance across factual verification and hallucination detection benchmarks while maintaining robustness across model scales.

AINeutralarXiv – CS AI · Jun 26/10
🧠

DetailMaster: Can Your Text-to-Image Model Handle Long Prompts?

DetailMaster introduces a comprehensive benchmark for evaluating text-to-image models on long, complex prompts averaging 285 tokens, revealing significant performance limitations in current T2I systems. The research identifies critical weaknesses in prompt encoding and attribute preservation, while demonstrating that high-quality generation requires both expanded prompt capacity and specialized long-prompt training.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Understanding the Effects of Distractors on Reasoning Vision-Language Models

Researchers investigate how irrelevant visual information affects reasoning in vision-language models, finding that visual distractors reduce accuracy without lengthening reasoning traces—contrasting with textual distractors in language models. The study introduces a new dataset and proposes a prompting strategy to mitigate distractor-driven errors in multimodal AI systems.

AINeutralarXiv – CS AI · Jun 26/10
🧠

PBT-Bench: Benchmarking AI Agents on Property-Based Testing

Researchers introduce PBT-Bench, a benchmark testing AI agents' ability to derive semantic invariants from documentation and construct property-based testing strategies across 100 problems in Python libraries. Results show current LLMs achieve 42-83% bug recall with structured prompting, revealing significant performance gaps where different models fail on different problems.

AINeutralarXiv – CS AI · Jun 26/10
🧠

LLM Consortium for Software Design Refinement: A Controlled Experiment on Multi-Agent Collaboration Topologies

Researchers conducted a controlled experiment evaluating 12 multi-agent LLM collaboration topologies for software design, running 520 tests across 8 tasks. Structural adversarial prompting ranked first, cross-model review second, while parallel merge approaches performed poorly due to token limitations and design fragmentation issues.

$GPT🧠 Claude🧠 Sonnet🧠 Opus
AINeutralarXiv – CS AI · Jun 26/10
🧠

EMoE: Training-Free Expert Disagreement for Uncertainty-Aware Text-to-Image Diffusion

Researchers introduce EMoE, a training-free method that leverages expert disagreement within mixture-of-experts diffusion models to estimate uncertainty in text-to-image generation. The approach measures variance among expert pathways after a single denoising step, enabling early detection of poorly aligned prompts without additional training or auxiliary networks.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents

Researchers at arXiv present findings that challenge assumptions about LLM agent capabilities, revealing that a model's base performance doesn't predict its ability to self-evolve through harness updates. The study identifies two distinct capabilities—harness-updating and harness-benefit—with counterintuitive results suggesting mid-tier models benefit most from self-evolution while strong models benefit less.

🧠 Claude
AINeutralarXiv – CS AI · Jun 16/10
🧠

LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories

Researchers demonstrate that Large Language Models improve their reasoning performance when search histories are explicitly structured with parent pointers (LinTree), rather than implicitly represented. The finding suggests that LLMs benefit from tree-aware representations during problem-solving, outperforming both implicit trace-based reasoning and traditional heuristic-guided search across multiple domains.

AINeutralarXiv – CS AI · Jun 16/10
🧠

TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation

Researchers introduce TunerDiT, a training-free method for improving text-to-video generation with multiple sequential events by identifying critical steering points in diffusion transformer denoising and applying progressive prompt fusion techniques. The approach achieves state-of-the-art performance across benchmark metrics while enabling fine-tuned control over video consistency versus event separation.

AINeutralarXiv – CS AI · May 296/10
🧠

When Does Persona Prompting Actually Help? A Retrieval and Metric Analysis of Expert Role Injection in LLMs

Researchers conducted a controlled study of persona prompting in large language models across 1,140 questions and 38 expert roles, finding that while aggregate metrics show minimal improvement, persona prompting consistently trades clarity for expertise depth. The technique's effectiveness varies significantly by domain and question type, with benefits appearing mainly in advisory contexts like medicine and psychology, while baseline prompting outperforms in domains requiring concise explanations.

← PrevPage 4 of 8Next →