#inference-time2 articles

2 articles

AIBullisharXiv – CS AI · 6h ago2

🧠

Inference-Time Safety For Code LLMs Via Retrieval-Augmented Revision

Researchers developed a new inference-time safety mechanism for code-generating AI models that uses retrieval-augmented generation to identify and fix security vulnerabilities in real-time. The approach leverages Stack Overflow discussions to guide AI code revision without requiring model retraining, improving security while maintaining interpretability.

AIBullisharXiv – CS AI · 6h ago0

🧠

Enhancing Persona Following at Decoding Time via Dynamic Importance Estimation for Role-Playing Agents

Researchers propose a new Persona Dynamic Decoding (PDD) framework that enables AI role-playing agents to dynamically adapt their personas based on context during inference time. The method uses psychological theories to estimate persona importance and adjust behavior without requiring expensive fine-tuning or static prompts.