Support Knowledge Base

Received NPU Error When Using Llm-Agent-Rag-Llamaindex Notebook

Content Type: Error Messages | Article ID: 000100672 | Last Reviewed: 05/21/2025

Description Resolution

Description

Used conda create -n ov-nb-demos python=3.11 to create an environment to run the llm-agent-rag-llamaindex notebook.
Received error when Create OpenVINO Embedding section is executed:

[ERROR] [vpux-compiler] Got non broadcastable dimensions pair : '0' and -9223372036854775808'

LLVM ERROR: Failed to infer result type(s).

The llm-agent-rag-llamaindex notebook is not designed to support NPU.

Use the llm-rag-llamaindex notebook for deploying embedding model on NPU.

This article applies to 3 products.

Intel® Xeon Phi™ Processor Software OpenVINO™ toolkit Performance Libraries

Contact support