AINeutralarXiv – CS AI · 10h ago6/10
🧠
SOHET: Sequence Of Heterogeneous Events Transformer with Self-Supervised Pre-Training
Researchers introduce SOHET, a transformer-based architecture for processing heterogeneous event streams with self-supervised pre-training capabilities. The model demonstrates significant performance improvements on fraud detection and sequential prediction tasks, outperforming existing methods by 5.8% on a large-scale benchmark while achieving faster convergence.