NVIDIA Enters Full Production of Groq 3 LPX AI Inference Accelerator Chips, Supercharging Vera Rubin With The Fastest Token Generation Speeds Ever Recorded

NVIDIA's Groq 3 LPX is now in full production, offering big token generation speedups for Vera Rubin platforms in the Agentic AI space.

NVIDIA Dials Up Vera Rubin NVL72 Token Generation Capabilities, Recording 3,400 TPS With Groq 3 LPX AI Inference Accelerators

As part of its Hot Chips 2026 announcements, NVIDIA today announced that its Groq 3 LPX AI inference accelerator chip is in full production. This announcement follows the mass production announcements of Vera CPUs and Vera Rubin servers, marking the robust execution of NVIDIA's AI roadmap.

The Groq 3 LPX racks serve as an extension to the NVIDIA Vera Rubin platform, delivering boosted AI inference capabilities that enable ultra-fast token generation for response-sensitive agentic workloads, as these systems can generate a massive amount of tokens across hundreds or even thousands of inference steps, making fast token generation a critical step for AI factories.

While NVIDIA's Vera Rubin NVL72 is the bleeding-edge solution for Agentic AI, its capabilities can be further bolstered by the Groq 3 LPX solution.

In one demonstration, NVIDIA showcases its Vera Rubin NVL72 platform with Groq 3 LPX pushing out a record 3,400 tokens per second in Artificial Analysis running the Gemma 4 31B open model. With a context window of 100,000 tokens, this was the fastest performance ever recorded on the model.

NVIDIA Rubin GPUs handle large-scale context processing while LPX accelerates latency-sensitive decode workloads. The result is faster, more predictable token generation that helps AI factories deliver responsive reasoning, smoother agent interactions, and greater infrastructure efficiency.

With Groq 3 LPX, NVIDIA also enables agentic AI tasks such as coding to be done within minutes versus hours, offering a 4x boost in response times versus the nearest alternative platform.

“Inference is the growth engine of AI. NVIDIA Grace Blackwell and NVL72 revolutionized large language model inference with an unprecedented leap in performance and efficiency,” said Jensen Huang, founder and CEO of NVIDIA.

“Vera Rubin extends that vision with workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation. This transforms how intelligence is produced, delivering another giant leap in AI throughput, efficiency and responsiveness, just as demand for AI computation is accelerating worldwide.”

The NVIDIA Groq 3 LPX solution is also being eyed by AI cloud providers as a solution to the growing needs, giving enterprises and developers access to advanced infrastructure for training, reasoning, and inference at scale. As such, Nebius plans to utilize Groq 3 LPX in its Nebius Token Factory.

“Generation is the phase of inference that determines how responsive an AI system actually is, and that’s exactly what NVIDIA Groq 3 LPX is built to accelerate,” said Danila Shtan, chief technology officer of Nebius. “As the first AI cloud bringing it to production via Nebius Token Factory, we’re making sure every step of an agent’s loop feels instant — through the same API developers are already using, with no migration to a new stack.”

Groq 3 LPX and Vera Rubin, as a combo, are designed for the Agentic AI era, bringing a purpose-built inference architecture designed to maximize responsiveness, throughput, and efficiency, helping power the next generation of AI factories.