#scientific-knowledge News & Analysis

2 articles tagged with #scientific-knowledge. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 27/10

🧠

Consistency evaluation of benchmarks used for causal discovery

Researchers have systematically evaluated the quality of benchmark causal graphs used to assess causal discovery methods, finding significant inconsistencies between popular benchmarks and current domain research. Using an automated pipeline that processes tens of thousands of scientific papers, the study reveals that benchmark reliability varies substantially, with critical implications for validating LLM-based causal discovery approaches.

AIBearisharXiv – CS AI · May 17/10

🧠

In-Context Examples Suppress Scientific Knowledge Recall in LLMs

Research shows that in-context examples in large language models suppress recall of scientific knowledge, causing models to shift from knowledge-driven reasoning to empirical pattern fitting even when examples are generated from the same formulas they should reinforce. This finding across 60 tasks and four models suggests practitioners deploying LLMs for scientific work should be cautious about using examples, as they may undermine rather than support domain expertise.