AINeutralarXiv – CS AI · 15h ago7/10
🧠
Beyond Questions: Evaluating What Large Language Models (Actually) Know
Researchers introduce BeQu, a new benchmark that evaluates LLM knowledge through open-ended prompts rather than predefined questions, addressing availability bias in existing benchmarks. The paradigm shift from narrow question-answering to characterizing naturally expressed knowledge provides deeper insights into parametric knowledge across 10,000 entities and multiple language models.