#conditional-computation News & Analysis

2 articles tagged with #conditional-computation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Apr 207/10

🧠

FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models

Researchers introduce FineSteer, a novel framework for controlling Large Language Model behavior at inference time through two-stage steering: conditional guidance and expert-based vector synthesis. The method achieves superior safety and truthfulness performance while preserving model utility more effectively than existing approaches, without requiring parameter updates.

AIBullisharXiv – CS AI · Apr 137/10

🧠

Dynamic sparsity in tree-structured feed-forward layers at scale

Researchers demonstrate that tree-structured sparse feed-forward layers can replace dense MLPs in large transformer models while maintaining performance, activating less than 5% of parameters per token. The work reveals an emergent auto-pruning mechanism where hard routing progressively converts dynamic sparsity into static structure, offering a scalable approach to reducing computational costs in language models beyond 1 billion parameters.