Is Parallelism Possible in OpenVINO™?
Content Type: Product Information & Documentation | Article ID: 000101300 | Last Reviewed: 03/25/2026
Parallelism is possible in OpenVINO™. To distribute inference across multiple GPUs, a heterogeneous plugin in OpenVINO can be used, allowing you to simultaneously leverage multiple inference devices (CPU, GPU, NPU) within a single model.
Refer to pipeline-parallelism for multiple devices' execution in OpenVINO.