Intel’s Challenges Nvidia With Gaudi 3 AI Accelerator

In a move that directly challenges Nvidia in the lucrative AI training and inference markets, Intel announced its long-anticipated new Intel Gaudi 3 AI accelerator at its Intel Vision event.

The new accelerator offers significant improvements over the previous generation Gaudi 3 processor, promising to bring new competitiveness to training and inference for LLMs and multimodal models.Gaudi 3 dramatically increases AI compute capabilities, delivering substantial improvements over Gaudi 2 and competitors, particularly in processing BF16 data types, which are crucial for AI workloads.Manufactured using a 5nm process technology, Gaudi 3 incorporates significant architectural advancements, including more TPCs and MMEs. This provides the computing power necessary for the parallel processing of AI operations, significantly reducing training and inference times for complex AI models.