mellanox infiniband + openmpi

Posted by chris Mon, 26 Jan 2009 21:28:07 GMT

If you are having trouble getting OpenMPI on Linux to work via a Mellanox Infiniband fabric, than this thread may be of interest to you.

Long story short, you may need to set this parameter in your execd environment in order to avoid memory issues:

execd_params H_MEMORYLOCKED=infinity

OpenMPI Support

Posted by chris Wed, 27 Sep 2006 02:30:04 GMT

Two interesting things reported by Olli-Pekka Leht in this interesting thread on OpenMPI support for grid engine:

  • A tight parallel environment integration module exists in the OpenMPI development tree and there is a chance it may be released at the November 11-17 SC06 meeting.
  • Not wanting to wait, Olli-Pekka took the module from a nightly snapshot and compiled it into an OpenMPI-1.1.1 installation

People interested in doing what Olli-Pekka has done can visit http://staff.csc.fi/~oplehto/openmpi-gridengine/. Basic implementation notes are offered in this mailing list post.

Sun and the OpenMPI project - good news for sge/mpi integration

Posted by chris Mon, 08 May 2006 17:33:39 GMT

Thanks to Ron for pointing these links out again.

Back in March, Sun announced its membership in the OpenMPI community. A side effect of this effort is that OpenMPI and Grid Engine interoperability will get serious high level attention. Ron also provides a link to a Sun HPC presentation PDF where there is explicit mention of creating an "SGE Plugin for ORTE" -- the Open Run Time Environment within the OpenMPI distribution.

If this makes rolling out a tightly integrated Grid Engine / MPI Parallel Environment (PE) a bit easier then everybody wins.