#queueing-theory News & Analysis

2 articles tagged with #queueing-theory. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · May 77/10

🧠

A Queueing-Theoretic Framework for Stability Analysis of LLM Inference with KV Cache Memory Constraints

Researchers introduce a queueing-theoretic framework that models LLM inference stability by accounting for both computational and GPU memory constraints from KV caching. The framework derives conditions for service stability and enables operators to calculate optimal cluster sizes for efficient GPU provisioning, with experimental validation showing predictions within 10% accuracy.

AINeutralarXiv – CS AI · Apr 146/10

🧠

A Queueing-Theoretic Framework for Dynamic Attack Surfaces: Data-Integrated Risk Analysis and Adaptive Defense

Researchers develop a queueing-theoretic framework that models cyber-attack surfaces as dynamic systems where vulnerabilities arrive and depart over time. Using reinforcement learning and Markov decision processes, they demonstrate an adaptive defense strategy that reduces active vulnerabilities by over 90% in software supply chains without increasing maintenance budgets.