Article ID: 000093301 Content Type: Compatibility Last Reviewed: 11/20/2023

What Is the Reason When Inferring FP32 Model Format Is Faster than FP16 Model Format on CPU?

BUILT IN - ARTICLE INTRO SECOND COMPONENT
Summary

Compatibility of supported device plugin and supported model format.

Description
  1. Inferred FP32 model format and FP16 model format on CPU.
  2. Inference speed of FP32 model format was faster than FP16 model format.
  3. Unable to determine the reason when inferring FP32 model format is faster than FP16 model format on CPU.
Resolution

Inference result varies according to supported device plugin with supported model format.

Related Products

This article applies to 1 products