y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#edge-computing News & Analysis

200 articles tagged with #edge-computing. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

200 articles
AIBullisharXiv – CS AI · Apr 156/10
🧠

RPRA: Predicting an LLM-Judge for Efficient but Performant Inference

Researchers propose RPRA (Reason-Predict-Reason-Answer/Act), a framework enabling smaller language models to predict how a larger LLM judge would evaluate their outputs before responding. By routing simple queries to smaller models and complex ones to larger models, the approach reduces computational costs while maintaining output quality, with fine-tuned smaller models achieving up to 55% accuracy improvements.

AIBullisharXiv – CS AI · Apr 156/10
🧠

Fast AI Model Partition for Split Learning over Edge Networks

Researchers propose an optimal model partitioning algorithm for split learning that reduces training delays by up to 38.95% by representing AI models as directed acyclic graphs and solving the problem via maximum-flow methods. The approach includes a low-complexity block-wise algorithm that achieves 13x faster computation on edge computing hardware, advancing the feasibility of distributed AI inference on mobile and edge devices.

🏢 Nvidia
AIBullisharXiv – CS AI · Apr 146/10
🧠

AEG: A Baremetal Framework for AI Acceleration via Direct Hardware Access in Heterogeneous Accelerators

Researchers introduce AEG, a bare-metal runtime framework that enables high-performance machine learning inference on heterogeneous AI accelerators without OS overhead. The system achieves 9.2× higher compute efficiency and uses 11× fewer hardware tiles than Linux-based alternatives, demonstrating significant potential for edge AI deployment optimization.

AINeutralarXiv – CS AI · Apr 146/10
🧠

ConfigSpec: Profiling-Based Configuration Selection for Distributed Edge--Cloud Speculative LLM Serving

ConfigSpec introduces a profiling-based framework for optimizing distributed LLM inference across edge-cloud systems using speculative decoding. The research reveals that no single configuration can simultaneously optimize throughput, cost efficiency, and energy efficiency—requiring dynamic, device-aware configuration selection rather than fixed deployments.

AIBullisharXiv – CS AI · Apr 146/10
🧠

WebLLM: A High-Performance In-Browser LLM Inference Engine

WebLLM is an open-source JavaScript framework enabling high-performance large language model inference directly in web browsers without cloud servers. Using WebGPU and WebAssembly technologies, it achieves up to 80% of native GPU performance while preserving user privacy through on-device processing.

🏢 OpenAI
AINeutralarXiv – CS AI · Apr 146/10
🧠

The Weight of a Bit: EMFI Sensitivity Analysis of Embedded Deep Learning Models

Researchers demonstrate that embedded neural network models using integer representations (8-bit and 4-bit) are significantly more resilient to electromagnetic fault injection attacks than floating-point formats (32-bit and 16-bit). The study reveals that floating-point models experience near-complete accuracy degradation from a single fault, while 8-bit integer representations maintain robust performance, with implications for securing AI systems deployed on edge devices.

AIBullishTechCrunch – AI · Apr 136/10
🧠

Vercel CEO Guillermo Rauch signals IPO readiness as AI agents fuel revenue surge

Vercel CEO Guillermo Rauch indicated the company is preparing for an initial public offering, signaling confidence in the platform's growth trajectory driven by increased adoption of AI agents. The statement comes as Vercel's revenue accelerates, positioning the deployment platform as a beneficiary of the expanding AI infrastructure market.

AI × CryptoNeutralCoinTelegraph – AI · Apr 136/10
🤖

Bitcoin mining and AI may be on opposite decentralization paths: Reseacher

A researcher argues that Bitcoin mining and AI development are following divergent decentralization trajectories. While Bitcoin mining has become increasingly centralized among large-scale operations, edge AI computing could enable broader distribution of AI capabilities beyond corporate data centers.

Bitcoin mining and AI may be on opposite decentralization paths: Reseacher
$BTC
AIBullishDecrypt – AI · Apr 126/10
🧠

Want Claude Opus AI on Your Potato PC? This Is Your Next-Best Bet

A developer has created Qwopus, a distilled version of Claude Opus 4.6's reasoning capabilities embedded into a local Qwen model that runs on consumer hardware. The tool democratizes access to advanced AI reasoning by enabling users with modest computing resources to run sophisticated models locally, challenging the centralized AI infrastructure paradigm.

Want Claude Opus AI on Your Potato PC? This Is Your Next-Best Bet
🧠 Claude🧠 Opus
AINeutralarXiv – CS AI · Apr 106/10
🧠

AgentGate: A Lightweight Structured Routing Engine for the Internet of Agents

AgentGate introduces a lightweight routing engine that optimizes how AI agents communicate and dispatch tasks across distributed systems by treating routing as a constrained decision problem rather than open-ended text generation. The system uses a two-stage approach—action decision and structural grounding—and demonstrates that compact 3B-7B parameter models can achieve competitive performance while operating under resource constraints, latency, and privacy limitations.

AIBullisharXiv – CS AI · Apr 76/10
🧠

MUXQ: Mixed-to-Uniform Precision MatriX Quantization via Low-Rank Outlier Decomposition

Researchers propose MUXQ, a new quantization technique for large language models that addresses activation outliers through low-rank decomposition. The method enables efficient INT8 quantization while maintaining accuracy close to FP16, making it suitable for edge device deployment with NPU-based hardware.

🏢 Perplexity
AIBullisharXiv – CS AI · Mar 266/10
🧠

APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs

Researchers propose APreQEL, an adaptive mixed precision quantization method for deploying large language models on edge devices. The approach optimizes memory, latency, and accuracy by applying different quantization levels to different layers based on their importance and hardware characteristics.

AIBullisharXiv – CS AI · Mar 266/10
🧠

PLACID: Privacy-preserving Large language models for Acronym Clinical Inference and Disambiguation

Researchers developed PLACID, a privacy-preserving system using small on-device AI models (2B-10B parameters) for clinical acronym disambiguation in healthcare settings. The cascaded approach combines general-purpose models for detection with domain-specific biomedical models, achieving 81% expansion accuracy while keeping sensitive health data local.

AINeutralarXiv – CS AI · Mar 176/10
🧠

Quantization Meets dLLMs: A Systematic Study of Post-training Quantization for Diffusion LLMs

Researchers conducted the first systematic study on post-training quantization for diffusion large language models (dLLMs), identifying activation outliers as a key challenge for compression. The study evaluated state-of-the-art quantization methods across multiple dimensions to provide insights for efficient dLLM deployment on edge devices.

AIBullishAI News · Mar 166/10
🧠

NTT DATA and NVIDIA bring enterprise AI factories to production scale

NTT DATA announced a partnership with NVIDIA to deliver enterprise AI platforms that provide organizations with production-ready, scalable AI infrastructure. The offering combines NVIDIA's GPU computing, networking, and AI Enterprise software including NeMo and NIM Microservices into a full-stack platform deployable in cloud and edge environments.

🏢 Nvidia
AINeutralarXiv – CS AI · Mar 116/10
🧠

Benchmarking Federated Learning in Edge Computing Environments: A Systematic Review and Performance Evaluation

A systematic review evaluates federated learning algorithms for edge computing environments, benchmarking five leading methods across accuracy, efficiency, and robustness metrics. The study finds SCAFFOLD achieves highest accuracy (0.90) while FedAvg excels in communication and energy efficiency, though challenges remain with data heterogeneity and energy limitations.

AIBullisharXiv – CS AI · Mar 96/10
🧠

TempoSyncDiff: Distilled Temporally-Consistent Diffusion for Low-Latency Audio-Driven Talking Head Generation

Researchers introduce TempoSyncDiff, a new AI framework that uses distilled diffusion models to generate realistic talking head videos from audio with significantly reduced computational latency. The system addresses key challenges in AI-driven video synthesis including temporal instability, identity drift, and audio-visual alignment while enabling deployment on edge computing devices.

AIBullisharXiv – CS AI · Mar 96/10
🧠

Federated Learning: A Survey on Privacy-Preserving Collaborative Intelligence

This research survey examines Federated Learning (FL), a distributed machine learning approach that enables collaborative AI model training without centralizing sensitive data. The paper covers FL's technical challenges, privacy mechanisms, and applications across healthcare, finance, and IoT systems.

AIBullisharXiv – CS AI · Mar 37/107
🧠

QuickGrasp: Responsive Video-Language Querying Service via Accelerated Tokenization and Edge-Augmented Inference

Researchers propose QuickGrasp, a video-language querying system that combines local processing with edge computing to achieve both fast response times and high accuracy. The system achieves up to 12.8x reduction in response delay while maintaining the accuracy of large video-language models through accelerated tokenization and adaptive edge augmentation.

AINeutralarXiv – CS AI · Mar 36/104
🧠

How Small Can 6G Reason? Scaling Tiny Language Models for AI-Native Networks

Researchers evaluated compact AI language models for 6G networks, finding that mid-scale models (1.5-3B parameters) offer the best balance of performance and computational efficiency for edge deployment. The study shows diminishing returns beyond 3B parameters, with accuracy improving from 22% at 135M to 70% at 7B parameters.

AIBullisharXiv – CS AI · Mar 36/104
🧠

A Contemporary Overview: Trends and Applications of Large Language Models on Mobile Devices

Large language models (LLMs) are increasingly being deployed on mobile devices, enabling applications like voice assistants, real-time translation, and intelligent recommendations. Advancements in hardware and 5G infrastructure allow for efficient local inference while improving data privacy and reducing cloud dependency.

AIBullisharXiv – CS AI · Mar 36/104
🧠

FAuNO: Semi-Asynchronous Federated Reinforcement Learning Framework for Task Offloading in Edge Systems

Researchers have developed FAuNO, a new federated reinforcement learning framework that uses asynchronous processing to optimize task distribution in edge computing networks. The system employs an actor-critic architecture where local nodes learn specific dynamics while a central critic coordinates overall system performance, demonstrating superior results in reducing latency and task loss compared to existing methods.

AIBullisharXiv – CS AI · Mar 26/1014
🧠

BiKA: Kolmogorov-Arnold-Network-inspired Ultra Lightweight Neural Network Hardware Accelerator

Researchers propose BiKA, a new ultra-lightweight neural network accelerator inspired by Kolmogorov-Arnold Networks that uses binary thresholds instead of complex computations. The FPGA prototype demonstrates 27-51% reduction in hardware resource usage compared to existing binarized and quantized neural network accelerators while maintaining competitive accuracy.

← PrevPage 7 of 8Next →