#embedding-space News & Analysis

6 articles tagged with #embedding-space. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

6 articles

AIBullisharXiv – CS AI · Jun 107/10

🧠

Rotate2Think: Geometric Priming via Orthogonal Rotation to Improve Language Model Reasoning

Researchers introduce Rotate2Think, a training-free method that improves language model reasoning by applying geometric transformations to embedding space. The technique identifies that input and reasoning embeddings occupy distinct directional regions and uses orthogonal rotation to geometrically prime the model before generating reasoning traces, showing consistent accuracy improvements across 30 of 32 tested model-benchmark configurations.

AIBullisharXiv – CS AI · Jun 27/10

🧠

DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs

Researchers have developed DSL-LLaDA, an 8-billion parameter masked diffusion language model that addresses the quality-versus-length tradeoff in fast text generation by adopting continuous embedding-space denoising instead of discrete token unmasking. Adapted from LLaDA-8B with minimal additional training, the model achieves superior summarization performance on low-step inference budgets while demonstrating robustness to corrupted input tokens.

AIBearisharXiv – CS AI · May 297/10

🧠

Hijacking Agent Memory: Stealthy Trojan Attacks Through Conversational Interaction

Researchers present MemPoison, a novel attack that exploits vulnerabilities in large language model agents by injecting malicious information into their long-term memory through dialogue interactions. The attack achieves up to 95% success rates by using semantic bridges, entity masquerading, and embedding optimization to bypass modern selective memory mechanisms, revealing critical security gaps in autonomous AI systems.

AINeutralarXiv – CS AI · Apr 146/10

🧠

Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance

Researchers introduce a Cross-Lingual Mapping Task during LLM pre-training to improve multilingual performance across languages with varying data availability. The method achieves significant improvements in machine translation, cross-lingual question answering, and multilingual understanding without requiring extensive parallel data.

AIBullisharXiv – CS AI · Mar 176/10

🧠

ES-Merging: Biological MLLM Merging via Embedding Space Signals

Researchers propose ES-Merging, a new framework for combining specialized biological multimodal large language models (MLLMs) by using embedding space signals rather than traditional parameter-based methods. The approach estimates merging coefficients at both layer-wise and element-wise granularities, outperforming existing merging techniques and even task-specific fine-tuned models on cross-modal scientific problems.

AIBullisharXiv – CS AI · Mar 37/108

🧠

Unified Vision-Language Modeling via Concept Space Alignment

Researchers introduce V-SONAR, a vision-language embedding system that extends text-only SONAR to support 1500+ languages with vision capabilities. The system demonstrates state-of-the-art performance on video captioning and multilingual vision tasks through V-LCM, which combines vision and language processing in a unified framework.