#position-bias News & Analysis

2 articles tagged with #position-bias. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBearisharXiv – CS AI · May 117/10

🧠

More Thinking, More Bias: Length-Driven Position Bias in Reasoning Models

Researchers discovered that reasoning-capable AI models like DeepSeek-R1 exhibit increasing position bias as their reasoning chains grow longer, contradicting assumptions that extended thinking reduces heuristic biases. The effect persists across multiple model sizes and datasets, suggesting that longer reasoning trajectories actually accumulate bias rather than eliminate it, with critical implications for multiple-choice question evaluation.

🧠 Llama

AINeutralarXiv – CS AI · Jun 236/10

🧠

On the Position Bias of On-Policy Distillation

Researchers discover that On-Policy Distillation (OPD) in reinforcement learning suffers from position bias, where later tokens in sequences receive degraded supervision as student rollouts deviate from teacher distributions. They propose Importance-Weighted OPD (IW-OPD), which adaptively reweights tokens based on accumulated distribution discrepancy, achieving up to 6.9-point improvements on benchmark tasks.