#task-generalization News & Analysis

2 articles tagged with #task-generalization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Mar 57/10

🧠

Function Induction and Task Generalization: An Interpretability Study with Off-by-One Addition

Researchers studied how large language models generalize to new tasks through "off-by-one addition" experiments, discovering a "function induction" mechanism that operates at higher abstraction levels than previously known induction heads. The study reveals that multiple attention heads work in parallel to enable task-level generalization, with this mechanism being reusable across various synthetic and algorithmic tasks.

AINeutralarXiv – CS AI · May 96/10

🧠

Generalised Linear Models in Deep Bayesian RL with Learnable Basis Functions

Researchers introduce GLiBRL, a novel deep Bayesian reinforcement learning method that combines generalized linear models with learnable basis functions to improve task generalization. The approach achieves fully tractable Bayesian inference over task parameters and demonstrates up to 1.8x performance improvements over existing meta-RL methods on benchmark tasks.