| Transformers 4.31, Intel Extension for Pytorch 2.0.1, PEFT 0.4.0 | GPT-J 6B (Glue MNLI dataset) | Fine-turning, Text generation task | bf16 | 230.40 | 81.6 | 8 | 1 |
| Transformers 4.34.1, Intel PyTorch 2.1.0, PEFT 0.5.0, Intel(r) oneCCL v2.1.0 | BioGPT (1.5 billion parameters) (PubMedQA dataset) | Fine-turning, Response generation | bf16 | 48.70 | 79.4 | 8 | 8 |
| Intel(r) Tensorflow 2.14, horovod 0.28, Open MPI 4.1.2, Python 3.10.0 | ResNet50 v1.50 (Colorectal histology dataset) | Fine-turning, Colorectal cancer detection | fp32 | 8.83 | 94.3 | 32 | 64 |
| Intel(r) Tensorflow 2.14, horovod 0.28, Open MPI 4.1.2, Python 3.10.0 | ResNet50 v1.50 (Colorectal histology dataset) | Fine-turning, Colorectal cancer detection | bf16 | 4.65 | 94.3 | 32 | 64 |
| Intel(r) Tensorflow 2.14, horovod 0.28, Open MPI 4.1.2, Python 3.10.0 | ResNet50 v1.50 (Colorectal histology dataset) | Fine-turning, Colorectal cancer detection | fp32 | 6.04 | 93.8 | 32 | 128 |
| Intel(r) Tensorflow 2.14, horovod 0.28, Open MPI 4.1.2, Python 3.10.0 | ResNet50 v1.50 (Colorectal histology dataset) | Fine-turning, Colorectal cancer detection | bf16 | 4.02 | 94.6 | 32 | 128 |
| Transformers 4.35.0, Intel PyTorch 2.0.100, Intel® oneCCL 2.0.100 | BERTLarge Uncased (IMDb dataset) | Fine-turning, Sentiment Analysis | fp32 | 61.72 | 93.59 | 64 | 4 |
| Transformers 4.35.0, Intel PyTorch 2.0.100, Intel® oneCCL 2.0.100 | BERTLarge Uncased (IMDb dataset) | Fine-turning, Sentiment Analysis | bf16 | 18.86 | 93.88 | 64 | 4 |
| Transformers 4.35.0, Intel PyTorch 2.0.100, Intel® oneCCL 2.0.100 | BERTLarge Uncased (GLUE SST2 dataset) | Fine-turning, Sentiment Analysis | fp32 | 14.06 | 92.2 | 256 | 4 |
| Transformers 4.35.0, Intel PyTorch 2.0.100, Intel® oneCCL 2.0.100 | BERTLarge Uncased (GLUE SST2 dataset) | Fine-turning, Sentiment Analysis | bf16 | 3.68 | 92.09 | 256 | 4 |