<div dir="ltr"><div class="gmail_default" style="color:#000000">Hello all,</div><div class="gmail_default" style="color:#000000"><br></div><div class="gmail_default" style="color:#000000">I am trying to install ET with OpenMPI 2.1.0 but it seems to be causing issues. </div><div class="gmail_default" style="color:#000000"><br></div><div class="gmail_default" style="color:#000000">I have done it successfully once with OpenMPI-x86_64 in our cluster, but it turns out this MPI is only available in the login node and not available on computing nodes, hence, I am not able to use it once a job is submitted in the queue.</div><div class="gmail_default" style="color:#000000"><br></div><div class="gmail_default" style="color:#000000">I could find OpenMPI 2.1.0 being available on computing nodes, so I was trying to compile with this version. I created a module file to load this module before installation. I could see the following in the terminal, which I guess, ET could recognise OpenMPI 2.1.0:</div><div class="gmail_default" style="color:#000000"><br></div><div class="gmail_default" style=""><font color="#741b47" style="">Running configuration script for thorn MPI:<br>MPI selected, but MPI_DIR is not set. Computing settings...<br>Found MPI compiler wrapper at /opt/mpi/openmpi/2.1.0/bin/mpic++!<br>Successfully configured MPI.<br>Finished running configuration script for thorn MPI.</font><br></div><div class="gmail_default" style=""><i style=""><font color="#a64d79"><br></font></i></div><div class="gmail_default" style="">Later, the progress stops with the following error:</div><div class="gmail_default" style=""><br></div><div class="gmail_default" style=""><font color="#741b47" style="">/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `MPI::Op::Init(void (*)(void const*, void*, int, MPI::Datatype const&amp;), bool)&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/op_inln.h:121: undefined reference to `ompi_mpi_cxx_op_intercept&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `Intracomm&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm_inln.h:23: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `Intracomm&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `Cartcomm&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `Graphcomm&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o): In function `Intracomm&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o):/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: more undefined references to `MPI::Comm::Comm()&#39; follow<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o):(.rodata._ZTVN3MPI8DatatypeE[_ZTVN3MPI8DatatypeE]+0x78): undefined reference to `MPI::Datatype::Free()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CT_MultiLevel.a(CT_MultiLevel.cc.o):(.rodata._ZTVN3MPI3WinE[_ZTVN3MPI3WinE]+0x48): undefined reference to `MPI::Win::Free()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CarpetLib.a(backtrace.cc.o): In function `MPI::Intracomm::Intracomm()&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm.h:25: undefined reference to `MPI::Comm::Comm()&#39;<br>/home2/mallick/ET3/Cactus/configs/sim/lib/libthorn_CarpetLib.a(backtrace.cc.o): In function `MPI::Intracomm::Intracomm(ompi_communicator_t*)&#39;:<br>/usr/include/openmpi-x86_64/openmpi/ompi/mpi/cxx/intracomm_inln.h:23: undefined reference to `MPI::Comm::Comm()&#39;<br>collect2: error: ld returned 1 exit status<br>make[1]: *** [/home2/mallick/ET3/Cactus/exe/cactus_sim] Error 1<br>make: *** [sim] Error 2</font><br></div><div class="gmail_default" style=""><br></div><div class="gmail_default" style="">I could not figure out the issue here. It seems<font color="#741b47"> <i><font size="1">/</font>usr/include/openmpi-x86_64/openmpi/ompi/mpi </i>i</font>s being taken by ET from somewhere and it is not taking OpenMPI 2.1.0.</div><div class="gmail_default" style=""><br></div><div class="gmail_default" style="">Some suggestions would be very helpful. Thank you.</div><div class="gmail_default" style=""><br></div><div class="gmail_default" style="">Regards</div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font color="#666666">Shamim Haque</font></div><div dir="ltr"><font color="#666666">Senior Research Fellow (SRF)<br></font><div><font color="#666666">Department of Physics</font></div><div><font color="#666666">IISER Bhopal</font></div></div></div></div></div></div></div></div></div></div></div>