BELLS-O: Evaluating the Operational Trade-offs of LLM Supervision Systems
Researchers released BELLS-O, the first independent operational benchmark comparing 28 LLM supervision systems across detection accuracy, false-positive rates, latency, and cost. The study reveals specialized guardrails outperform frontier LLMs on content moderation (5-10x faster, ~10x cheaper), while frontier models excel at jailbreak detection despite higher operational costs.