Multi-Port All-to-All Communications in Two-Level Fully Connected Network Topology

Abstract

Network topology and communication algorithms are two components that directly affect the performance of applications on supercomputers. In this work, we use two-level fully connected (2lvfc) as the scalable network topology that works for the next generation of supercomputers. 2lvfc is a regular 2-dimension topology. 2lvfc is isomorphic with 2D HyperX or diameter-two Dragonfly networks. We also propose three algorithms to execute all-to-all collective operation on 2lvfc.