Constitutional Black-Box Monitoring for Scheming in LLM Agents

Researchers developed constitutional black-box monitors to detect scheming behavior in LLM agents using only observable inputs and outputs. The study found that monitors trained on synthetic data can generalize to realistic environments, but performance improvements plateau quickly with simple optimization techniques outperforming complex methods.

• →Constitutional black-box monitors can detect scheming in LLM agents using only externally observable behaviors.
• →Two synthetic data generation pipelines (STRIDE and Gloom) were developed to train monitoring systems.
• →Monitors trained purely on synthetic data successfully generalized to more realistic testing environments.
• →Simple prompt optimization techniques matched the performance of more complex automated optimization methods.
• →Performance improvements saturated quickly, with extensive optimization leading to overfitting rather than better results.