Support Knowledge Base

How the Inference Performance Is Calculated for OpenVINO™ DL Workbench

Content Type: Product Information & Documentation | Article ID: 000091115 | Last Reviewed: 02/04/2023

Description Resolution Additional information

Description

Questions regarding the formulas used for calculating throughput or FPS in OpenVINO™ DL Workbench.

Throughput (frames per second, FPS) is a measurement used when it comes to batch inputs.
Divide the number of inputs that were processed by the processing time:
Throughput (FPS) = Inferred number of images / Processing time in seconds
Latency value measures inference time (ms) required to process a single input.

Refer to the What Is Inference Performance documentation for more details.

This article applies to 1 products.

OpenVINO™ toolkit

Contact support