Intel® oneAPI Deep Neural Network Developer Guide and Reference
A newer version of this document is available. Customers should click here to go to the newest version.
Visible to Intel only — GUID: GUID-633F88AD-31E7-4D23-81BF-03F7E054C099
Visible to Intel only — GUID: GUID-633F88AD-31E7-4D23-81BF-03F7E054C099
Compiled Partition Cache
Overview
A set of functions that provide compiled partition cache control. More…
// global functions int dnnl::graph::get_compiled_partition_cache_capacity(); void dnnl::graph::set_compiled_partition_cache_capacity(int capacity); dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity); dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity);
Detailed Documentation
A set of functions that provide compiled partition cache control.
Global Functions
int dnnl::graph::get_compiled_partition_cache_capacity()
Returns the number of compiled partition that can be held in the compiled partition cache at the same time.
void dnnl::graph::set_compiled_partition_cache_capacity(int capacity)
Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.
The default capacity of compiled partition cache is 1024.
Parameters:
capacity |
Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.
dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity)
Returns the number of compiled partitions that can be held in the compiled partition cache at the same time.
Parameters:
capacity |
Compiled partition cache capacity to query. Concurrently accessing capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.
dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity)
Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.
The default capacity of compiled partition cache is 1024.
Parameters:
capacity |
Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.