y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#formal-semantics News & Analysis

2 articles tagged with #formal-semantics. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBearisharXiv – CS AI · Jun 17/10
🧠

LLMs Lean on Priors, Not Programming Language Semantics

Researchers have demonstrated that large language models rely heavily on statistical patterns from training data rather than systematically understanding formal programming semantics. The PLSemanticsBench benchmark reveals that LLM accuracy drops 40-60 percentage points when semantic rules are altered or novel symbols are introduced, suggesting current models struggle with explicit rule-following in structured domains.

AINeutralarXiv – CS AI · Jun 96/10
🧠

Understanding Benchmark Language Under Weakened Formal Semantics

Researchers propose a method to improve NLP benchmark understanding by extracting executable representations (computables) that provide operational evidence of semantic adequacy beyond traditional text-based reasoning. The approach demonstrates consistent improvements over baseline methods across mathematical reasoning, legal, and biomedical benchmarks while offering inspectable semantic evidence.