AIBullisharXiv – CS AI · 8h ago7/10
🧠
Ekka: Automated Diagnosis of Silent Errors in LLM Inference
Researchers introduce Ekka, an automated diagnostic system that identifies root causes of silent errors in large language model serving frameworks by comparing execution states between target and reference implementations. The system achieves 80% pass@1 accuracy and has already discovered 4 new bugs in production serving frameworks, addressing a critical reliability challenge in LLM deployment.