#transformer-security News & Analysis

3 articles tagged with #transformer-security. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBearisharXiv – CS AI · Jun 257/10

🧠

Privacy Vulnerabilities of Attention Layers in Tabular Foundation Models and Protection of High-Risk Queries

Researchers demonstrate that transformer-based tabular foundation models leak sensitive information through their attention mechanisms, enabling effective membership inference attacks despite being pre-trained on synthetic data. The study proposes both an attack method (AMIA) and a defense strategy inspired by k-anonymity that reduces privacy leakage by 50% while maintaining model performance.

AIBearisharXiv – CS AI · May 77/10

🧠

On the (In-)Security of the Shuffling Defense in the Transformer Secure Inference

Researchers demonstrate that the shuffling defense mechanism used to protect Transformer model weights during secure inference can be broken through an alignment attack, allowing adversaries to recover weights with minimal cost. The attack exploits multiple shuffled activations by finding a common permutation, undermining a key security assumption in privacy-preserving machine learning.

AINeutralarXiv – CS AI · May 276/10

🧠

Hidden-State Privacy Has an Empty Middle

Researchers demonstrate that Gaussian mechanisms for hidden-state privacy face a fundamental trade-off, with no configurations achieving both moderate utility and moderate privacy against adaptive attackers. A diagonal inverse-Fisher mechanism emerges as minimax-optimal but sits at the privacy-utility boundary rather than within an achievable middle ground, suggesting future work must redesign architectures rather than optimize within existing Gaussian frameworks.