y0news
← Feed
←Back to feed
🧠 AIβšͺ NeutralImportance 6/10

Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News

arXiv – CS AI|Alexander Loth, Martin Kappes, Marc-Oliver Pahl|
πŸ€–AI Summary

A research study using JudgeGPT platform found that humans cannot reliably distinguish between AI-generated and human-written news articles across 2,318 judgments from 1,054 participants. The study tested six different LLMs and concluded that user-side detection is not viable, suggesting the need for cryptographic content provenance systems.

Key Takeaways
  • β†’Humans cannot reliably distinguish between AI-generated and human-written news content across all tested language models.
  • β†’Even smaller open-weight models with 7B parameters can fool human detection consistently.
  • β†’Domain expertise correlates with better judgment accuracy while political orientation does not affect detection ability.
  • β†’Participants fall into distinct response patterns as either 'Skeptics' or 'Believers' when evaluating content authenticity.
  • β†’Detection accuracy degrades after about 30 sequential evaluations due to cognitive fatigue effects.
Read Original β†’via arXiv – CS AI
Act on this with AI
Stay ahead of the market.
Connect your wallet to an AI agent. It reads balances, proposes swaps and bridges across 15 chains β€” you keep full control of your keys.
Connect Wallet to AI β†’How it works
Related Articles