AIBearisharXiv – CS AI · 8h ago7/10
🧠
In-Context Examples Suppress Scientific Knowledge Recall in LLMs
Research shows that in-context examples in large language models suppress recall of scientific knowledge, causing models to shift from knowledge-driven reasoning to empirical pattern fitting even when examples are generated from the same formulas they should reinforce. This finding across 60 tasks and four models suggests practitioners deploying LLMs for scientific work should be cautious about using examples, as they may undermine rather than support domain expertise.