A preview is not available for this record, please engage by choosing from the available options ‘download’ or ‘view’ to engage with the material
Description
Twixor is a company that transforms automated customer service experiences through highly advanced chat and automation
capabilities for industries such as banking, insurance, healthcare, logistics, commerce, and more. LLMs are essential for enabling the rich, natural interactions necessary to accomplish that objective. However, as LLM inferencing became more complex, Twixor faced challenges in delivering responsive, conversational interactions cost-effectively at scale due to the high costs of a GPU-based infrastructure.
Fortunately, Twixor discovered they could solve that challenge with a cost-effective, high-performance CPU-based
infrastructure based on 4th Gen Intel® Xeon® Scalable processors—using Intel® Advanced Matrix Extensions (Intel® AMX), a built-in AI acceleration engine—and performance-optimized Intel software extensions for PyTorch and
Transformers.