Allreduce - the basis of multi-device communication for neural network training posted in HPC Thu 15 August 2019