AINeutralarXiv – CS AI · Jun 27/10
🧠
Consistency evaluation of benchmarks used for causal discovery
Researchers have systematically evaluated the quality of benchmark causal graphs used to assess causal discovery methods, finding significant inconsistencies between popular benchmarks and current domain research. Using an automated pipeline that processes tens of thousands of scientific papers, the study reveals that benchmark reliability varies substantially, with critical implications for validating LLM-based causal discovery approaches.