Measuring Communication and Computation Overlap
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Measuring Pure Communication Time
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallgather
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallgather_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallgatherv
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallgatherv_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallreduce
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iallreduce_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ialltoall
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ialltoall_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ialltoallv
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ialltoallv_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ibarrier
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ibarrier_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ibcast
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ibcast_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Igather
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Igather_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Igatherv
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Igatherv_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ireduce
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ireduce_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ireduce_scatter
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Ireduce_scatter_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iscatter
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iscatter_pure
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iscatterv
                                                    
                                                    
                                                
                                                    
                                                    
                                                        Iscatterv_pure
                                                    
                                                    
                                                
                                            
                                        Collective Benchmarks
The following benchmarks belong to the collective class:
- Bcast/multi-Bcast 
- Allgather/multi-Allgather 
- Allgatherv/multi-Allgatherv 
- Alltoall/multi-Alltoall 
- Alltoallv/multi-Alltoallv 
- Scatter/multi-Scatter 
- Scatterv/multi-Scatterv 
- Gather/multi-Gather 
- Gatherv/multi-Gatherv 
- Reduce/multi-Reduce 
- Reduce_scatter/multi-Reduce_scatter 
- Allreduce/multi-Allreduce 
- Barrier/multi-Barrier 
See sections below for definitions of these benchmarks.