Provides information on how to resolve “Not enough memory…” error on Intel® NCS2.
Receiving the following error when trying to run inference on a custom model with the Intel® NCS2:
E: [nCAPI] [388407] [object_detectio] ncGraphAllocate:2127 Not enough memory to allocate intermediate tensors on remote device
- If possible, run one of OpenVINO's pretrained models to ensure that there are no memory issues.
- Try to set NUM_STREAMS option to 1 as this reduces the required memory size.
The model may be too large for the Intel® NCS2. While the internal memory of the Intel® NCS2 is about 500 MB, 100 MB of memory is set aside for intermediate processing, which is memory that is allocated for processing the current layer. For example, a model that is 181 MB exceeds the memory capacity for intermediate processing.