#evaluator-bias News & Analysis

2 articles tagged with #evaluator-bias. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBearisharXiv – CS AI · Jun 237/10

🧠

Memory Contagion: Cross-Temporal Propagation of Evaluator Bias via Agent Memory

Researchers identify 'Memory Contagion,' a phenomenon where biased evaluator feedback propagates through LLM agent memory systems into future iterations, even with perfect consolidation. The study demonstrates that bias contamination occurs at rates as low as 20% and has differential effects depending on bias type, exposing a critical vulnerability in current agent memory architectures.

AIBearisharXiv – CS AI · Jun 197/10

🧠

Contagion Networks: Evaluator Bias Propagation in Multi-Agent LLM Systems

Researchers demonstrate that evaluation biases in large language models systematically spread through multi-agent systems, with a new framework showing biases propagate at rates of 15.7-35.2% between same-model agents. Deploying evaluation committees of three agents reduces contagion by 72.4%, offering a practical mitigation strategy for AI systems relying on LLM evaluators.