According to a myriad of trusted tech-focused websites, Intel® Arc™ GPUs offer great price-to-performance value for game development, media creation, and, yes, generative AI.

This session focuses on how to implement high-performing generative AI (GenAI) applications on these budget-friendly GPUs using Stable Diffusion*, LlaMA 3 quantization, and Intel-optimized extensions for PyTorch* and Transformers. Watch a demo on building a chatbot using the retrieval augmented generation (RAG) technique.

This session shows how to:

• Deploy Stable Diffusion and large language models (LLM) on Intel Arc GPUs.
• Set up your own GenAI application with a few lines of code.
• Quantize LlaMA 3 with int4 through Intel AI-optimized software.
• Build a chatbot with a RAG engine.

Skill level: Novice

• Intel® Extension for PyTorch*
• Intel® Extension for Transformers*