From Mpich
Revision as of 19:40, 25 March 2020 by Robl (talk | contribs) (Build notes)

Jump to: navigation, search

This page describes how to build MPICH on the 'Summit' machine at Oak Ridge. Summit is a POWER9-based machine with Infiniband interconnect. The 'UCX' device works best here. Performance is on par with the IBM SpectrumScale MPI (based on OpenMPI).

Summit build instructions

Released versions of mpich (as of 3.2) do not know how to deal with the unusually large business cards generated on this platform. You'll need a release containing commit 2bb15c6e875386f.

configure options

configure --with-device=ch4:ucx CFLAGS=-std=gnu11

Build notes

Watch out for system ucx vs mpich built-in ucx. I got some undefined symbols in ucx routines because MPICH was configured to use its own mpich but was picking up system UCX (thanks to spack setting LD_LIBRARY_PATH)

Execution notes

MPICH won't know how to deal with 'jsrun', so you'll have to construct your host file by hand