AIBearisharXiv – CS AI · 6d ago7/10
🧠Researchers evaluated LLM-generated peer reviews for scientific papers using ACL Rolling Review data, finding limited alignment between LLM and human reviews while discovering that authors can strategically game LLM feedback to improve paper scores by up to 35%. The study highlights emerging risks in automated academic review systems as both reviewers and authors increasingly leverage language models.
AINeutralarXiv – CS AI · 6d ago7/10
🧠Researchers introduce PRAIB, a benchmark framework that evaluates how Large Language Models perform peer review compared to human reviewers. Analysis of 11,000 LLM-generated reviews across major AI conferences reveals significant behavioral divergences: LLM ratings show less variability, positive bias, overconfidence, and frequently miss atomic weaknesses that human reviewers catch.
AIBullisharXiv – CS AI · May 277/10
🧠Researchers introduce E3, an automated review assistant that identifies technical concerns in research papers with 90.2% recall—outperforming human reviewers and leading AI models. The system detects unsupported claims, missing ablations, weak baselines, and validity threats, with evaluation conducted on 100 ICLR 2026 papers using a contamination-resistant backtesting protocol.
🏢 OpenAI🏢 Anthropic🧠 GPT-5
AIBearisharXiv – CS AI · May 127/10
🧠A new threat called Agentic Denominator Gaming could exploit AI conferences' stable acceptance rates by flooding submissions with low-quality papers generated by automated agents, inflating the denominator to boost legitimate papers' acceptance odds without intending publication of the spam itself. This systemic vulnerability exposes academic peer review to coordinated attacks that would degrade review quality and increase reviewer burnout while requiring institutional policy reforms beyond technical solutions.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers demonstrate an autonomous LLM agent capable of executing a complete research loop—reading, reproducing, critiquing, and extending computational physics papers. Testing across 111 papers reveals the agent identifies substantive flaws in 42% of cases, with 97.7% of issues requiring actual computation to detect, and produces a publishable peer-review comment on a Nature Communications paper without human direction.
AIBullisharXiv – CS AI · Mar 46/102
🧠Researchers have developed APRES, an AI-powered system that uses Large Language Models to automatically revise scientific papers based on evaluation rubrics that predict citation counts. The system improves citation prediction accuracy by 19.6% and produces paper revisions that human experts prefer 79% of the time over original versions.
AIBearisharXiv – CS AI · Mar 46/102
🧠Researchers developed a method to detect AI-generated content at scale and found that 6.5-16.9% of peer reviews at major AI conferences after ChatGPT's release were substantially modified by LLMs. The study reveals concerning patterns where AI-generated reviews correlate with lower reviewer confidence, last-minute submissions, and reduced engagement in rebuttals.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers introduce TADDLE, an AI system that detects quality deficiencies in LLM-generated peer reviews by decomposing analysis into specialized tools and multi-label classification. The work addresses a growing problem in academic publishing where AI-written reviews are fluent but potentially flawed, backed by the first expert-annotated benchmark of 1,800 reviews across six defect categories.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers introduce CoCoReviewBench, a new benchmark dataset of 3,900 papers from ICLR and NeurIPS designed to reliably evaluate AI review systems. The benchmark addresses critical gaps in current evaluation methods by prioritizing correctness over mere overlap with human reviews, revealing that existing AI reviewers struggle with hallucinations and reasoning accuracy.
AINeutralarXiv – CS AI · May 96/10
🧠Researchers propose IntraGuard, a defense framework that embeds hidden safeguards into PDF manuscripts to detect when AI chatbots are used to generate peer reviews instead of human experts. The system achieves 84% success rate in disrupting AI-generated reviews while maintaining transparency for legitimate human reviewers, addressing growing concerns about academic integrity as LLMs proliferate.
AINeutralarXiv – CS AI · May 16/10
🧠A comprehensive survey examines how large language models can assist or automate peer review processes across academia, synthesizing techniques for review generation, post-review tasks, and evaluation methods. The research catalogs datasets and modeling approaches while addressing ethical concerns and practical implementation challenges for integrating AI into scholarly publishing workflows.
AIBullisharXiv – CS AI · Apr 156/10
🧠Researchers introduce GoodPoint, an AI system trained to generate constructive scientific feedback by learning from author responses to peer review. The method improves feedback quality by 83.7% over baseline models and outperforms larger LLMs like Gemini-3-flash, demonstrating that specialized training on valid, actionable feedback signals yields better results than general-purpose models.
🧠 Gemini
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers introduced NovBench, the first large-scale benchmark for evaluating how well large language models can assess research novelty in academic papers. The benchmark comprises 1,684 paper-review pairs from a leading NLP conference and reveals that current LLMs struggle with scientific novelty comprehension despite promise in peer review support.
AINeutralarXiv – CS AI · Apr 76/10
🧠Researchers introduce FactReview, an AI system that improves academic peer review by combining claim extraction, literature positioning, and code execution to verify research claims. The system addresses weaknesses in current LLM-based reviewing by grounding assessments in external evidence rather than relying solely on manuscript narratives.
$MKR
AINeutralarXiv – CS AI · Feb 275/106
🧠Researchers developed Fair-PaperRec, an AI system that uses fairness regularization to reduce bias in academic peer review processes. The system achieved up to 42% increased participation from underrepresented groups while maintaining scholarly quality with minimal utility loss.
$NEAR
AINeutralarXiv – CS AI · Mar 114/10
🧠Researchers propose RbtAct, a novel approach that uses peer review rebuttals as supervision to train AI models for generating more actionable scientific review feedback. The system leverages a new dataset RMR-75K and fine-tuned Llama-3.1-8B model to produce focused, implementable guidance rather than superficial comments.
🧠 Llama
AINeutralGoogle Research Blog · Dec 154/107
🧠Gemini AI is providing automated feedback services for theoretical computer scientists at the STOC 2026 conference. This represents an application of AI technology in academic research and peer review processes within the theoretical computer science community.
