"Intel's Gaudi2 Chip Challenges NVIDIA GPUs in MLPerf Benchmarks"

Intel's Gaudi2 chip has emerged as the only alternative to NVIDIA GPUs for training large language models (LLMs) according to MLPerf benchmarks. Intel claims that Gaudi2 offers similar price/performance to NVIDIA's A100 in FP16 workloads and aims to surpass NVIDIA's H100 by September in FP8 workloads. The benchmarks show impressive time-to-train results for GPT-3 and other models, indicating the growing software maturity of Gaudi2. Additionally, Intel's Xeon Platinum CPUs also demonstrated strong performance in LLM training, achieving training times of less than 50 minutes for BERT and ResNet-50 models.