Is It Possible to Enable Batch Size Larger than One When Inferencing with Integrated Graphics Processing Unit (iGPU)?
Content Type: Troubleshooting | Article ID: 000092917 | Last Reviewed: 03/01/2023
Unable to enable batch size larger than one when inferencing with iGPU.
Use openvino.runtime.set_batch(model: ov::Model, batch_size: int = -1).