y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#performance-optimization News & Analysis

75 articles tagged with #performance-optimization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

75 articles
AIBullisharXiv – CS AI · Mar 176/10
🧠

Beyond Local Code Optimization: Multi-Agent Reasoning for Software System Optimization

Researchers introduced a multi-agent AI framework for whole-system software optimization that goes beyond local code improvements to analyze entire microservice architectures. The system uses coordinated agents for summarization, analysis, optimization, and verification, achieving 36.58% throughput improvement and 27.81% response time reduction in proof-of-concept testing.

AIBullisharXiv – CS AI · Mar 166/10
🧠

When to Ensemble: Identifying Token-Level Points for Stable and Fast LLM Ensembling

Researchers have developed SAFE, a new framework for ensembling Large Language Models that selectively combines models at specific token positions rather than every token. The method improves both accuracy and efficiency in long-form text generation by considering tokenization mismatches and consensus in probability distributions.

AIBullisharXiv – CS AI · Mar 126/10
🧠

Trajectory-Informed Memory Generation for Self-Improving Agent Systems

Researchers introduce a new framework for AI agent systems that automatically extracts learnings from execution trajectories to improve future performance. The system uses four components including trajectory analysis and contextual memory retrieval, achieving up to 14.3 percentage point improvements in task completion on benchmarks.

AIBullisharXiv – CS AI · Mar 66/10
🧠

Adaptive Memory Admission Control for LLM Agents

Researchers propose Adaptive Memory Admission Control (A-MAC), a new framework for managing long-term memory in LLM-based agents. The system improves memory precision-recall by 31% while reducing latency through structured decision-making based on five interpretable factors rather than opaque LLM-driven policies.

AIBullisharXiv – CS AI · Mar 37/108
🧠

AI Runtime Infrastructure

Researchers introduce AI Runtime Infrastructure, a new execution layer that sits between AI models and applications to optimize agent performance in real-time. This infrastructure actively monitors and intervenes in agent behavior during execution to improve task success, efficiency, and safety across long-running workflows.

AIBullisharXiv – CS AI · Mar 37/107
🧠

QuickGrasp: Responsive Video-Language Querying Service via Accelerated Tokenization and Edge-Augmented Inference

Researchers propose QuickGrasp, a video-language querying system that combines local processing with edge computing to achieve both fast response times and high accuracy. The system achieves up to 12.8x reduction in response delay while maintaining the accuracy of large video-language models through accelerated tokenization and adaptive edge augmentation.

AIBullisharXiv – CS AI · Mar 37/107
🧠

Whisper-MLA: Reducing GPU Memory Consumption of ASR Models based on MHA2MLA Conversion

Researchers introduce Whisper-MLA, a modified version of OpenAI's Whisper speech recognition model that uses Multi-Head Latent Attention to reduce GPU memory consumption by up to 87.5% while maintaining accuracy. The innovation addresses a key scalability issue with transformer-based ASR models when processing long-form audio.

AIBullisharXiv – CS AI · Mar 36/103
🧠

Probabilistic Kernel Function for Fast Angle Testing

Researchers have developed new probabilistic kernel functions for angle testing in high-dimensional spaces that achieve 2.5x-3x faster query speeds than existing graph-based algorithms. The approach uses deterministic projection vectors with reference angles instead of random Gaussian distributions, improving performance in similarity search applications.

AIBullisharXiv – CS AI · Mar 36/102
🧠

Inner Loop Inference for Pretrained Transformers: Unlocking Latent Capabilities Without Training

Researchers propose a new inference technique called "inner loop inference" that improves pretrained transformer models' performance by repeatedly applying selected layers during inference without additional training. The method yields consistent but modest accuracy improvements across benchmarks by allowing more refinement of internal representations.

AIBullisharXiv – CS AI · Mar 27/1022
🧠

Beyond Na\"ive Prompting: Strategies for Improved Context-aided Forecasting with LLMs

Researchers introduce a framework of four strategies to improve large language models' performance in context-aided forecasting, addressing diagnostic tools, accuracy, and efficiency. The study reveals an 'Execution Gap' where models understand context but fail to apply reasoning, while showing 25-50% performance improvements and cost-effective adaptive routing approaches.

AIBullisharXiv – CS AI · Feb 276/106
🧠

SideQuest: Model-Driven KV Cache Management for Long-Horizon Agentic Reasoning

Researchers introduce SideQuest, a novel KV cache management system that uses Large Reasoning Models to compress memory usage during long-horizon AI tasks. The system reduces peak token usage by up to 65% while maintaining accuracy by having the model itself determine which tokens are useful to keep in memory.

AIBullisharXiv – CS AI · Feb 276/107
🧠

GetBatch: Distributed Multi-Object Retrieval for ML Data Loading

Researchers introduce GetBatch, a new object store API that optimizes machine learning data loading by replacing thousands of individual GET requests with a single batch operation. The system achieves up to 15x throughput improvement for small objects and reduces batch retrieval latency by 2x in production ML training workloads.

AIBullisharXiv – CS AI · Feb 276/108
🧠

Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching

Researchers developed a new framework called 'Stitching Noisy Diffusion Thoughts' that improves AI reasoning by combining the best parts of multiple solution attempts rather than just selecting complete answers. The method achieves up to 23.8% accuracy improvement on math and coding tasks while reducing computation time by 1.8x compared to existing approaches.

AIBullishHugging Face Blog · Oct 96/108
🧠

Scaling AI-based Data Processing with Hugging Face + Dask

The article discusses scaling AI-based data processing using Hugging Face in combination with Dask for distributed computing. This approach enables efficient handling of large-scale machine learning workloads by leveraging parallel processing capabilities.

AI × CryptoBullishHugging Face Blog · Sep 16/105
🤖

Fetch Cuts ML Processing Latency by 50% Using Amazon SageMaker & Hugging Face

Fetch.ai has successfully reduced machine learning processing latency by 50% through implementation of Amazon SageMaker and Hugging Face technologies. This technical improvement enhances the performance of Fetch's AI infrastructure and could strengthen its competitive position in the AI-crypto space.

AIBullishFortune Crypto · Jun 115/10
🧠

Olympic champion Shaun White says AI is ‘leveling the playing field’ for professional athletes

Olympic champion Shaun White highlighted AI's democratizing potential for professional athletes at Fortune's Brainstorm Tech conference, emphasizing that artificial intelligence technology is becoming increasingly accessible to athletes across all levels. White's comments underscore growing adoption of AI tools in sports for performance optimization and training.

Olympic champion Shaun White says AI is ‘leveling the playing field’ for professional athletes
AINeutralHugging Face Blog · May 295/10
🧠

Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler

This article provides a beginner's guide to PyTorch's torch.profiler tool, explaining how developers can identify performance bottlenecks in their machine learning models. The profiler is essential for optimizing neural network training and inference, helping practitioners understand where computational resources are being consumed.

AIBullishTechCrunch – AI · Mar 175/10
🧠

Niv-AI exits stealth to wring more power performance out of GPUs

Niv-AI has emerged from stealth mode with $12 million in seed funding to develop technology that measures and manages GPU power surges. The company aims to optimize GPU power performance, addressing a critical infrastructure challenge in AI computing.

AIBullisharXiv – CS AI · Mar 25/108
🧠

CoME: Empowering Channel-of-Mobile-Experts with Informative Hybrid-Capabilities Reasoning

Researchers introduce Channel-of-Mobile-Experts (CoME), a new AI agent architecture that uses four specialized experts to handle different reasoning stages for mobile device automation. The system employs progressive training strategies and information gain-driven optimization to improve mobile agent performance on complex tasks.

AIBullishHugging Face Blog · Oct 35/105
🧠

🧨 Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e

Google demonstrates accelerated inference performance for Stable Diffusion XL using JAX framework on their Cloud TPU v5e hardware. This technical advancement showcases improved efficiency for AI image generation workloads on Google's cloud infrastructure.

GeneralNeutralCrypto Briefing · Jun 103/10
📰

Norwegian squad brings 300 kg of fish, 116 kg of cheese to World Cup

Norway's World Cup squad brought 300 kg of fish and 116 kg of cheese to support player performance and psychological comfort. The strategy highlights how cultural familiarity with home foods can influence athlete wellbeing and mental resilience in high-pressure competitive environments.

Norwegian squad brings 300 kg of fish, 116 kg of cheese to World Cup
AINeutralarXiv – CS AI · Mar 33/104
🧠

Test Case Prioritization: A Snowballing Literature Review and TCPFramework with Approach Combinators

Researchers conducted a comprehensive literature review of test case prioritization (TCP) techniques and developed a new framework with ensemble methods called approach combinators. The study analyzed 324 TCP-related studies and proposed new evaluation metrics, with their methods achieving up to 2.7% reduction in regression testing time while performing comparably to state-of-the-art algorithms.

← PrevPage 3 of 3