#theoretical-bounds News & Analysis

2 articles tagged with #theoretical-bounds. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · 14h ago7/10

🧠

Reasoning about Reasoning: BAPO Bounds on Chain-of-Thought Token Complexity in LLMs

Researchers extend the bounded attention prefix oracle (BAPO) model to establish theoretical lower bounds on chain-of-thought reasoning tokens required by LLMs, proving that canonical tasks require Ω(n) tokens as input size n grows. Experiments with frontier models confirm linear scaling behavior, revealing fundamental computational bottlenecks in inference-time scaling.

AINeutralarXiv – CS AI · 14h ago7/10

🧠

NOVA: Fundamental Limits of Knowledge Discovery Through AI

Researchers introduce the NOVA framework, which models AI knowledge discovery as an adaptive sampling process and identifies fundamental scaling limitations. The analysis reveals a contamination trap where false positives accumulate faster than genuine discoveries as knowledge becomes scarce, with cumulative generation costs following a Zipf-distributed scaling law demonstrating asymptotic diminishing returns.