AIBullishIEEE Spectrum – AI · Mar 167/10
🧠
With Nvidia Groq 3, the Era of AI Inference Is (Probably) Here
Nvidia announced the Groq 3 LPU at GTC 2024, its first chip specifically designed for AI inference rather than training, incorporating technology licensed from startup Groq for $20 billion. The chip uses SRAM memory integrated within the processor to achieve 7x faster memory bandwidth than traditional GPUs, optimizing for the low latency required for real-time AI inference applications.
🏢 Nvidia