Smart, Powerful, and Responsive Chatbots Based on a CPU Infrastructure - Twixor Solution Brief

Description

Twixor is a company that transforms automated customer service experiences through highly advanced chat and automation capabilities for industries such as banking, insurance, healthcare, logistics, commerce, and more. LLMs are essential for enabling the rich, natural interactions necessary to accomplish that objective. However, as LLM inferencing became more complex, Twixor faced challenges in delivering responsive, conversational interactions cost-effectively at scale due to the high costs of a GPU-based infrastructure. Fortunately, Twixor discovered they could solve that challenge with a cost-effective, high-performance CPU-based infrastructure based on 4th Gen Intel® Xeon® Scalable processors—using Intel® Advanced Matrix Extensions (Intel® AMX), a built-in AI acceleration engine—and performance-optimized Intel software extensions for PyTorch and Transformers.