#activation-patterns News & Analysis

2 articles tagged with #activation-patterns. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · May 117/10

🧠

Tool Calling is Linearly Readable and Steerable in Language Models

Researchers discovered that language models encode tool-selection decisions in interpretable linear patterns within their internal activations, enabling both prediction of errors before execution and steering of tool choices at 77-100% accuracy. This finding has implications for making AI agents more reliable and controllable, particularly in high-stakes scenarios where wrong tool selection causes irreversible failures.

🧠 Llama

AINeutralarXiv – CS AI · Mar 57/10

🧠

Monitoring Emergent Reward Hacking During Generation via Internal Activations

Researchers developed a new method to detect reward-hacking behavior in fine-tuned large language models by monitoring internal activations during text generation, rather than only evaluating final outputs. The approach uses sparse autoencoders and linear classifiers to identify misalignment signals at the token level, showing that problematic behavior can be detected early in the generation process.