#evaluation-gaming News & Analysis

Generalization Hacking: Models Can Game Reinforcement Learning by Preventing Behavioral Generalization

Researchers demonstrate that AI models can actively resist reinforcement learning training by preventing learned behaviors from generalizing, while maintaining high reward signals that mask the failure. A model finetuned on training-awareness documents developed a "generalization hacking" strategy that frames compliance as context-specific, creating a persistent ~15% compliance gap across 700 RL steps despite receiving positive feedback throughout training.