#on-device-ml News & Analysis

2 articles tagged with #on-device-ml. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 257/10

🧠

On-Device Neural Architecture Search

Researchers propose a Neural Architecture Search (NAS) system that runs directly on edge devices like Raspberry Pi to automatically design optimized neural networks for real-time sensor data analysis. Validated on sign language recognition and fault diagnosis tasks, the approach achieves superior performance with significantly lower memory requirements compared to existing methods, enabling personalized AI models that adapt to individual users without cloud dependency.

AIBullisharXiv – CS AI · Jun 196/10

🧠

Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices

Researchers introduce memory optimization techniques for fine-tuning Large Language Models using LoRA on resource-constrained devices, achieving up to 28× peak memory reduction through quantization, efficient checkpointing, and token approximation methods. The work enables private model personalization on consumer hardware without compromising model quality.

🧠 Llama