Intel® Gaudi® Software
Optimized to meet deep learning developers where you are.
Intel® Gaudi® Software
Intel Gaudi software, like our accelerator hardware, was purpose-designed to deliver Gen AI performance, efficiency, and, most importantly, increased developer ease of use and productivity. With support for go-to frameworks like PyTorch and DeepSpeed, and popular LLM and multimodal models supported on Hugging Face, the goal of Intel Gaudi software is to enable you to easily enable new models or migrate existing code with 3 to 5 lines of code. In essence, Intel Gaudi software and its many tools and documents are designed to meet deep learning developers where you are — enabling you to develop what and how you want.
Simplified Development the Way You Want to Develop
Intel® Gaudi® software: optimized for deep learning training and inference.
Intel Gaudi Software Suite
Integrating frameworks, tools, drivers and libraries.
We Offer Extensive Support for Data Scientists, Developers, and IT and Systems Administrators With:
Intel Gaudi® AI® accelerators developer platform: featuring developer news, model references, libraries, containers, and tools for training and deploying GenAI and LLM.
Habana GitHub: providing reference models, set-up and install instructions, snapshot scripts for analysis and debug, custom kernel examples, roadmap, and “issues” sub-site tracking to dos, bugs, feature requests and more.1
Intel Gaudi AI Accelerator
Software ecosystem for deep learning brings together leading software providers, tools and code to accelerate development of state-of-the-art deep learning models based on PyTorch, TensorFlow, PyTorch Lightning and DeepSpeed frameworks. Our collaboration with software partners such as Hugging Face enables Intel to rapidly expand its support for the latest popular models, easing your development process to enable the explosive array of deep learning applications emerging daily. Intel’s software team leverages open code, models and capabilities from trusted partners who share our focus on developing models for computer vision, natural language processing, generative AI and multi-modal applications.
Hugging Face
500k+ AI Models, 320k+ GitHub Stars. Explore Habana Optimum Library for Intel Gaudi accelerators.
DeepSpeed
Easy-to-use deep learning optimization software that enables scale and speed with particular focus on large scale models.
PyTorch Lightning
Acceleration of PyTorch deep learning workloads.
Cnvrg.io
Cnvrg.io provides MLOPs support for customers implementing Intel Gaudi processor solutions.
Solutions Focused on Business and End-User Outcomes
Intel Gaudi accelerator model development is focused on industries and applications where AI is proven to provide the greatest near-term business revenue and deliver rich consumer experiences. For more information on how our team is enabling high-value applications using computer vision, NLP, generative AI, large-language and multi-modal models, see our industry solutions.
Stay informed:
Get the Latest on AI Trends and Technologies.
Subscribe to stay connected with Intel
Product and Performance Information
Habana Labs is an Intel company and publisher of the Habana Developer Site and Habana GitHub content.