Scaling up BERT-like model Inference on modern CPU
AI-generated summary Intel states that Ice Lake Xeon processors achieve up to 75% faster inference on natural language processing tasks compared to the previous generation of Cascade Lake Xeon processors. Intel says that these performance gains on AI workloads are achieved through a combination of software optimizations and hardware improvements on the Sunny Cove architecture.