MPI-based Federated Learning for cross-GPU/CPU servers. In this example, we will present how to apply the standalone simulation of FedML in the MINIST image ...

If you need to compile a software package written to use MPI, you must first load the appropriate version of MPI. There are some simple example MPI programs in the /gpfs1/sw/examples/mpi directory ...