3 articles tagged with #inference-control. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers developed Logit Diff Amplification (LDA) as an inference-time safety mechanism for protein language models to prevent toxic protein generation. The method reduces predicted toxicity rates while maintaining biological plausibility and structural viability, addressing dual-use safety concerns in AI-driven protein design.
Researchers propose VEROIC, a framework for optimizing inference costs in black-box LLM services by dynamically deciding when to allocate additional computation. The system uses partially observable reliability signals to balance response quality against computational expenses, achieving better cost-efficiency trade-offs than existing approaches.
Researchers developed a method to control AI safety refusal behavior using categorical refusal tokens in Llama 3 8B, enabling fine-grained control over when models refuse harmful versus benign requests. The technique uses steering vectors that can be applied during inference without additional training, improving both safety and reducing over-refusal of harmless prompts.
