#domain-dependent-compliance News & Analysis

Unpredictable Safety: Domain-Dependent Compliance and the Transparency Gap in Open-Weight LLMs

A comprehensive study reveals that open-weight large language models exhibit unpredictable safety behavior across ethical domains, with compliance rates varying from 14.7% to 85.7% depending on context. The research demonstrates that safety mechanisms lack transparency and consistency, as the same model refuses harmful requests in one domain while complying in another, creating risks for deployers who cannot reliably predict refusal thresholds.