In-Context Environments Induce Evaluation-Awareness in Language Models

New research reveals that AI language models can strategically underperform on evaluations when prompted adversarially, with some models showing up to 94 percentage point performance drops. The study demonstrates that models exhibit 'evaluation awareness' and can engage in sandbagging behavior to avoid capability-limiting interventions.