AIBullisharXiv – CS AI · Jun 257/10
🧠Researchers introduce MiniOpt, a reinforcement learning framework that enables compact language models (3B parameters) to solve diverse optimization problems efficiently without requiring large supervised datasets or expensive expert annotations. The approach uses a hierarchical reward function and structured decomposition strategy, achieving competitive performance compared to larger models while significantly reducing training overhead.
AIBullisharXiv – CS AI · Jun 237/10
🧠OmniV2X is a generative foundation model that enables vehicle-to-everything (V2X) cooperative driving by processing multi-modal, multi-agent data without requiring dense 3D perception or shared representations. The model achieves state-of-the-art performance on the DAIR-V2X-Seq dataset while using 90% less fine-tuning data and consuming less than 1% of typical communication bandwidth.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce RAPID, a depth-aware token reduction framework for Vision Transformers that uses different pruning and merging strategies across network layers to reduce computational costs while maintaining accuracy. The method achieves superior performance compared to existing approaches like ToMe, with up to 4.29% higher accuracy in aggressive compression scenarios.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce I-Segmenter, the first fully integer-only Vision Transformer framework for semantic segmentation that eliminates floating-point operations to enable efficient deployment on resource-constrained devices. The model achieves only 5.1% accuracy loss compared to standard floating-point versions while reducing model size by 3.8x and improving inference speed by 1.2x, with a novel activation function addressing quantization challenges.
AIBullisharXiv – CS AI · Jun 57/10
🧠Researchers introduce LLMCodec, a novel compression method that adapts video codecs like VVC/H.266 to efficiently compress large language models. The approach achieves significant improvements over existing quantization methods, reducing perplexity by 1.5x on LLaMA-3-8B at 2-bit precision while improving downstream task accuracy by 21%.
🏢 Perplexity
AIBullisharXiv – CS AI · Jun 57/10
🧠Researchers introduce Drive-KD, a knowledge distillation framework that compresses large vision-language models for autonomous driving by decomposing the task into perception, reasoning, and planning components. The method achieves superior performance with 42x less GPU memory and 11.4x higher throughput compared to larger baseline models, advancing the practical deployment of AI in safety-critical driving systems.
🧠 GPT-5
AIBullisharXiv – CS AI · Jun 27/10
🧠FreqLite is a new lightweight linear model for long-term time-series forecasting that uses frequency decomposition and adaptive normalization to achieve better accuracy than larger transformer models while requiring 4x fewer parameters and significantly less computational resources. The method introduces Adaptive Reversible Instance Normalization (A-RevIN) to handle non-stationary data more effectively than existing approaches.
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers propose ASKD-Whisper, a new knowledge distillation technique that compresses OpenAI's Whisper speech recognition model while improving performance. The method achieves 5x faster inference and 1.07% lower error rates than the original teacher model by dynamically reducing reliance on the teacher's predictions during training.
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers present AVIC, an adaptive framework that optimizes when and how much multimodal language models should use world models for visual imagination during spatial reasoning tasks. The system learns to selectively invoke visual imagination only when necessary, reducing computational costs while matching or exceeding performance of fixed imagination strategies and proprietary baselines like GPT-4o.
🧠 GPT-4
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers introduce DyLLM, a training-free inference framework that accelerates diffusion language model decoding by up to 9.6x by selectively computing only salient tokens rather than processing entire sequences at each step. The approach identifies important tokens through attention context similarity and reuses cached activations for stable tokens, maintaining baseline accuracy across benchmarks.
AIBullisharXiv – CS AI · May 297/10
🧠Pocket-Dentist presents an efficiency-aware benchmark for dental image analysis using compact multimodal vision-language models, demonstrating that smaller 2B-parameter models outperform larger counterparts while consuming significantly fewer computational resources. Successfully deployed on iPhone hardware, the approach enables privacy-preserving dental prescreening outside specialist centers with practical latency and memory constraints.
AIBullisharXiv – CS AI · May 277/10
🧠MiniMax introduces the M2 series, a Mixture-of-Experts language model with 229.9B total parameters but only 9.8B activated per token, achieving frontier-tier performance on agentic tasks through agent-driven data pipelines and a custom reinforcement learning system called Forge. The M2.7 checkpoint demonstrates early self-evolution capabilities, autonomously debugging and modifying its own training scaffold.
AIBullisharXiv – CS AI · May 277/10
🧠Researchers introduce JetViT, a hybrid Vision Transformer architecture that maintains accuracy of state-of-the-art models while delivering up to 1.79x faster throughput and 44.81% lower latency on high-resolution images. The innovation uses post-training attention search to convert full-attention models into efficient hybrid variants by strategically replacing redundant attention blocks.
🏢 Nvidia
AIBullisharXiv – CS AI · May 127/10
🧠Researchers introduce AHD Agent, a reinforcement learning framework that enables language models to autonomously design heuristics for solving complex combinatorial optimization problems. A 4-billion-parameter model achieves performance comparable to much larger systems while requiring significantly fewer computational evaluations, advancing the frontier of AI-driven algorithm design.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers introduce BaLoRA, a Bayesian extension of Low-Rank Adaptation that improves fine-tuning of large AI models by adding uncertainty quantification while narrowing the accuracy gap with full fine-tuning. The method uses input-adaptive parameterization with minimal computational overhead and demonstrates stronger performance across language, vision, and materials science tasks.
AIBullisharXiv – CS AI · May 127/10
🧠Zyphra has released ZAYA1-VL-8B, a compact mixture-of-experts vision-language model that delivers competitive performance with larger systems while using significantly fewer active parameters. The model introduces vision-specific LoRA adapters and bidirectional attention mechanisms to enhance visual understanding, representing meaningful progress in efficient AI model design.
🏢 Hugging Face
AIBullisharXiv – CS AI · May 97/10
🧠Zyphra has unveiled ZAYA1-8B, a compact reasoning-focused AI model with only 700M active parameters that matches larger competitors like DeepSeek-R1 on mathematics and coding tasks. The model introduces Markovian RSA, a novel test-time compute method that achieves 91.9% on AIME'25 benchmarks while maintaining computational efficiency, suggesting small models can compete with much larger reasoning systems through architectural innovation.
🧠 GPT-5🧠 Gemini
AINeutralarXiv – CS AI · Jun 236/10
🧠MoECodec introduces a unified image compression framework using Mixture-of-Experts (MoE) routing to dynamically adapt compression based on image content and downstream vision tasks. The approach reduces computational overhead compared to task-specific models while maintaining performance across multiple machine perception applications.
AIBullisharXiv – CS AI · Jun 236/10
🧠Researchers demonstrate that untrained Reservoir Computing models, specifically deep bidirectional Echo State Networks, achieve competitive performance on audio surveillance tasks while requiring significantly less computational resources than traditional trained neural networks. The approach shows particular promise for edge device deployment in emergency sound detection scenarios.
🏢 Nvidia
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers introduce ESM (Essential Subspace Merging), a framework that combines multiple task-specific AI models into a single multi-task model by analyzing parameter updates through PCA and projecting them onto essential subspaces. The method reduces task interference while preserving specialized functionality, achieving state-of-the-art performance in model merging without additional training.
AINeutralarXiv – CS AI · Jun 56/10
🧠EGTR-Review presents a novel framework for automating scientific peer review using a multi-agent teacher model that distills its reasoning into a lightweight student model, achieving superior performance with significantly lower computational costs while maintaining evidence traceability and factual grounding.
AINeutralarXiv – CS AI · Jun 46/10
🧠Researchers propose an enhanced medical image segmentation framework by integrating a lightweight Box Predictor module into MedSAM, which estimates bounding boxes from single user clicks to improve segmentation accuracy across CT, MRI, and ultrasound imaging. The method adds minimal computational overhead (1.6M parameters) while achieving strong Dice scores across four diverse medical imaging datasets.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers propose a lightweight temporal convolutional network enhanced with physics-guided attention mechanisms for WiFi-based human activity recognition. The approach uses Doppler-energy and variance-driven attention to capture motion dynamics more efficiently than deep learning baselines, achieving better performance with fewer parameters.
AIBullisharXiv – CS AI · Jun 26/10
🧠M-DESIGN, a new retrieval-augmented framework, addresses the inefficiency gap between expensive neural architecture search and suboptimal model retrieval by dynamically leveraging historical evidence from prior tasks to discover near-optimal network modifications. Tested on 67,760 graph neural networks across 22 datasets, the method achieves state-of-the-art performance in 79% of cases under computational constraints.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers propose Compressed Video Aggregator (CVA), a lightweight module that improves micro-video recommendation systems by decoupling video processing from preference learning. The method reduces training time and GPU memory by orders of magnitude while maintaining or improving performance through intelligent frame selection based on video titles.
