4 articles tagged with #llm-control. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce MidSteer, a theoretical framework for steering generative models through intermediate representation manipulation. The work formalizes concept steering as an optimization problem, demonstrating that existing safety alignment methods are special cases of affine transformations, with applications across vision and language models.
Researchers introduce a framework that automatically learns context-sensitive constraints from LLM interactions, eliminating the need for manual specification while ensuring perfect constraint adherence during generation. The method enables even 1B-parameter models to outperform larger models and state-of-the-art reasoning systems in constraint-compliant generation.
Researchers propose 'Curveball steering', a nonlinear method for controlling large language model behavior that outperforms traditional linear approaches. The study challenges the Linear Representation Hypothesis by showing that LLM activation spaces have substantial geometric distortions that require geometry-aware interventions.
Researchers present a unified framework for understanding how different methods control large language models—including fine-tuning, LoRA, and activation interventions—revealing a fundamental trade-off between steering strength and output quality. The analysis explains this through an activation manifold perspective and introduces SPLIT, a new steering method that improves control while better preserving model coherence.
