#model-probing News & Analysis

2 articles tagged with #model-probing. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Apr 75/10

🧠

When Models Know More Than They Say: Probing Analogical Reasoning in LLMs

Researchers found that large language models (LLMs) have an asymmetry between their internal knowledge and prompted responses when detecting analogies. While probing reveals models understand rhetorical analogies better than their prompted responses suggest, both methods perform poorly on narrative analogies requiring deeper abstraction.

AINeutralarXiv – CS AI · Mar 95/10

🧠

Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement

Research reveals that vision-language models internally encode geometric information that cannot be effectively expressed through their text pathways. A lightweight linear probe can extract hand joint angles with 6.1 degrees accuracy from frozen features, while text output only achieves 20.0 degrees accuracy, indicating a significant bottleneck in geometric understanding translation.