y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#contrastive-steering News & Analysis

2 articles tagged with #contrastive-steering. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBearisharXiv – CS AI · Jun 237/10
🧠

The Geometry of Refusal: Linear Instability in Safety-Aligned LLMs

Researchers have discovered that safety mechanisms in large language models operate as linear features in the output layer rather than deep semantic principles, allowing them to be manipulated or inverted through Contrastive Logit Steering. This finding reveals fundamental vulnerabilities in current alignment techniques while simultaneously suggesting a method to strengthen defenses without retraining.

🧠 Llama
AINeutralarXiv – CS AI · Mar 46/103
🧠

Understanding and Mitigating Dataset Corruption in LLM Steering

Research reveals that contrastive steering, a method for adjusting LLM behavior during inference, is moderately robust to data corruption but vulnerable to malicious attacks when significant portions of training data are compromised. The study identifies geometric patterns in corruption types and proposes using robust mean estimators as a safeguard against unwanted effects.