CPU Dispatcher Control
Intel Streaming SIMD Extensions 4.1 (Intel SSE4.1)
Intel Advanced Vector Extensions (Intel AVX)
Intel Advanced Vector Extensions 2 (Intel AVX2)
Intel AVX2 with Intel Deep Learning Boost (Intel DL Boost)
Intel AVX-512 with AVX512BW, AVX512VL, and AVX512DQ extensions
Intel AVX-512 with Intel DL Boost
Intel AVX-512 with Intel DL Boost and bfloat16 support
Intel AVX-512 with Intel DL Boost and bfloat16 support and Intel Advanced Matrix Extensions (Intel AMX) with 8-bit integer and bfloat16 support
No restrictions (default)
- SSE41 < AVX < AVX2,
- AVX2 < AVX512_CORE < AVX512_CORE_VNNI < AVX512_CORE_BF16 < AVX512_CORE_AMX,
- AVX2 < AVX2_VNNI.
- dnnl::set_max_cpu_isa function allows changing the ISA at run-time. The limitation is that it is possible to set the value only once. This ensures that the JIT-ed code observe consistent CPU features both during generation and execution. In addition, it is advised to call this function before any other oneDNN API. This is because the first internal ISA query will disable the ability to change the ISA. Once disabled, changing the ISA will return an error.