Single Program Multiple Data
Distributed computation using SPMD model
Supported Collective Operations
- bcastBroadcasts data from specified process.
- allreduceReduces data among all processes.
- allgathervGathers data from all processes and shares the result among all processes.
- sendrecv_replaceSends and receives data using a single buffer.
- oneCCL: Allgetherv does not support arbitrary displacements. The result is expected to be closely packed without gaps.
- oneMPI: Collective operations in oneMPI do not support asynchronous executions. They block the process till completion.