| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | fp32 | 175.29 img/s | 0.22 | 128 |
| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | bf16 | 396.24 img/s | 0.52 | 256 |
| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | bf32 | 197.14 img/s | 0.25 | 128 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | fp32 | 145.93 img/s | 0.19 | 512 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | bf16 | 354.45 img/s | 0.46 | 512 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | bf32 | 166.37 img/s | 0.21 | 512 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte, QUAD Mode | Recommender | fp32 | 290,772.24 rec/s | 359.83 | 32,768 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte, QUAD Mode | Recommender | bf16 | 862,286.46 rec/s | 1,055.35 | 32,768 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte, QUAD Mode | Recommender | bf32 | 417,584.33 rec/s | 504.29 | 32,768 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | fp32 | 61.25 img/s | 0.09 | 448 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | bf16 | 219.77 img/s | 0.31 | 448 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | bf32 | 83.44 img/s | 0.11 | 448 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | fp32 | 4.35 fps | 0.01 | 64 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | bf16 | 35.13 fps | 0.04 | 64 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | bf32 | 13.65 fps | 0.02 | 32 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | fp32 | 4.8 img/s | 0.01 | 128 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | bf16 | 16.43 img/s | 0.02 | 128 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | bf32 | 5.37 img/s | 0.01 | 96 |
| Intel PyTorch 2.1 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | fp32 | 4.41 sent/s | 0.01 | 64 |
| Intel PyTorch 2.1 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf16 | 12.53 sent/s | 0.02 | 28 |
| Intel PyTorch 2.1 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf32 | 5.52 sent/s | 0.01 | 56 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | fp32 | 5.38 sent/s | 0.01 | 64 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf16 | 11.74 sent/s | 0.02 | 64 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf32 | 6.07 sent/s | 0.01 | 64 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | fp32 | 15,671.55 sent/s | 16.95 | 42,000 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | bf16 | 40,653.1 sent/s | 43.77 | 42,000 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | bf32 | 15,316.08 sent/s | 15.44 | 42,000 |