Scalable communication architecture for network-attached accelerators

• Verfasst von: Neuwirth, Sarah [VerfasserIn]
• Verfasst von: Frey, Dirk [VerfasserIn]
• Verfasst von: Brüning, Ulrich [VerfasserIn]
• Titel: Scalable communication architecture for network-attached accelerators
• Verf.angabe: Sarah Neuwirth, Dirk Frey, Mondrian Nuessle and Ulrich Bruening
• Umfang: 12 S.
• Fussnoten: Gesehen am 23.05.2018
• Titel Quelle: Enthalten in: IEEE International Symposium on High Performance Computer Architecture (21. : 2015 : Burlingame, California, USA): 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA 2015)
• Jahr Quelle: 2015
• Band/Heft Quelle: (2015), S. 627-638
• ISBN Quelle: 978-1-4799-8931-7
• DOI: doi:10.1109/HPCA.2015.7056068
• Datenträger: Online-Ressource
• Sprache: eng
• K10plus-PPN: 1575443201

Abstract

On the road to Exascale computing, novel communication architectures are required to overcome the limitations of host-centric accelerators. Typically, accelerator devices require a local host CPU to configure and operate them. This limits the number of accelerators per host system. Network-attached accelerators are a new architectural approach for scaling the number of accelerators and host CPUs independently. In this paper, the communication architecture for network-attached accelerators is described which enables remote initialization and control of the accelerator devices. Furthermore, an operative prototype implementation is presented. The prototype accelerator node consists of an Intel Xeon Phi coprocessor and an EXTOLL NIC. The EXTOLL interconnect provides new features to enable accelerator-to-accelerator direct communication without a local host. Workloads can be dynamically assigned to CPUs and accelerators at run-time in an N to M ratio. The latency, bandwidth, and performance of the low-level implementation and MPI communication layer are presented. The LAMMPS molecular dynamics simulator is used to evaluate the communication architecture. The internode communication time is improved by up to 47%.