Article ID: 000092917 Content Type: Troubleshooting Last Reviewed: 03/01/2023

Is It Possible to Enable Batch Size Larger than One When Inferencing with Integrated Graphics Processing Unit (iGPU)?

BUILT IN - ARTICLE INTRO SECOND COMPONENT
Summary

Method to enable batch size larger than one when inferencing with iGPU.

Description

Unable to enable batch size larger than one when inferencing with iGPU.

Resolution

Use openvino.runtime.set_batch(model: ov::Model, batch_size: int = -1).

Related Products

This article applies to 1 products