Intel® Gaudi® Al Accelerators
Intel® Gaudi® Al accelerators and Intel® Gaudi® software are designed to bring a new level of productivity advantages and choice to data center generative Al.
Intel® Gaudi® Al Accelerators
Performance and Efficiency at Every Scale
With the surging demand for the advantages deep learning and generative Al can bring, there's never been a greater need for improved computing performance, efficiency, usability, and choice.
Intel® Gaudi® Al accelerators and software are designed to bring a new level of computing advantages and choice to data center training and inference-whether in the cloud or on-premises.
We aim to make the benefits of Al deep learning more accessible to more enterprises and organizations, removing barriers to bring deep learning advantages to many.
High-Efficiency, Deep Learning-Optimized Processors and Software.
To bring Al to many, the Intel Gaudi platform was conceived and architected to address the training and inference demands of large-scale era Al, providing enterprises and organizations with high-performance, high-efficiency deep learning computing.
Efficient Performance
- Architected expressly for DL compute
- Heterogeneous computing architecture
- AI-optimized matrix multiplication engine
- Custom Tensor Processor cores
- Large on-board memories
- Networking integrated on chip
Massive Flexibility and Scale
- On-chip integration of industry-standard RoCE
- Massive capacity with integration of 10 or 24 100 GbE ports
- All-to-all configuration within the server
- Flexible scale-out to support numerous configurations
- Industry-standard networking lowers cost
- Avoids vendor lock-in
Ease of Model Migration & Build
- Software optimized for Deep Learning training & inference
- Integrates popular frameworks: TensorFlow and PyTorch
- Provides custom graph compiler
- Supports custom kernel development
- Enables ecosystem of software partners
- Habana GitHub & Community Forum1
Two Ways to Experience Intel Gaudi AI Accelerators
Cloud
Intel Gaudi accelerators on the Amazon EC2 cloud and the Intel Tiber developer cloud.
On-Premises
OEM and ODM solutions for the data center.
Cloud Options
Intel Tiber Developer Cloud
With over 4,000 accelerators on the Intel Tiber Developer Cloud, customers and developers can experience first-hand how their favorite generative Al models run. What it's like to build new or migrate existing models on Intel Gaudi 2 accelerator.
Register here for your trial on the Intel Tiber Developer Cloud.
Amazon EC2 DL1 Instances Based on First-Generation Intel Gaudi Accelerators
Delivering up to 40% better price performance than comparable GPU-based training instances, Amazon EC2 DLI instances make training and deploying models in the cloud more accessible to customers— enabling them to leverage the insights, efficiencies, and enhanced end-user experiences that Al computer vision and natural language applications can provide. To learn how to set up and run EC2 DL1 training instances based on Intel Gaudi Al Accelerators, visit the developer site.
On-Premises Options
For First and Second-Generation Intel Gaudi Accelerators
Supermicro offers 8-accelerator OCP-OAM-based systems.
Products and Software
Get the Latest on AI Trends and Technologies
Subscribe to stay connected with Intel
Product and Performance Information
Habana Labs is an Intel company and publisher of the Habana Developer Site and Habana GitHub content.