y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#scheduling-optimization News & Analysis

2 articles tagged with #scheduling-optimization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBullisharXiv – CS AI · Jun 237/10
🧠

Geometry-Aware Online Scheduling for LLM Serving: From Theoretical Bound to System Practice

Researchers propose Geometry-Aware Online Scheduling, introducing the Smallest Volume First (SVF) algorithm to optimize LLM inference by accounting for dynamic memory footprint of Key-Value caches. The approach improves upon traditional time-centric scheduling heuristics, achieving significant reductions in latency and throughput gains when integrated into vLLM.

🧠 Llama
AINeutralarXiv – CS AI · Jun 195/10
🧠

Optimal Scheduling in a Question-Answering Forum of Knowledge Workers

Researchers propose an optimal scheduling system for question-answering forums staffed by paid knowledge workers rather than volunteers. The study calculates system capacity, designs efficient schedulers, and explores how expert collaboration can improve request-handling throughput.