<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><br><div><div>On 15 May 2017, at 16:49, Chris Stevens <<a href="mailto:c.stevens@ru.ac.za">c.stevens@ru.ac.za</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">
<meta http-equiv="content-type" content="text/html; charset=utf-8">
<div text="#000000" bgcolor="#FFFFFF"><p>Hi there,</p><p>I am new to Cactus, and have been having trouble getting the
qc0-mclachlan.par test file to run. I have compiled the latest
version of Cactus successfully on the CHPC cluster in South
Africa.</p><p>I have attached .out and .err files for the run, along with my
machine file, optionlist file, run and submit scripts. The submit
command was <br>
</p><p>./simfactory/bin/sim submit mctest
--configuration=mclachlantest_mpidebug
--parfile=par/qc0-mclachlan.par --procs=240 --num-threads=12
--walltime=10:0:0 --queue=normal --machine=lengau-intel</p><p>Using --mca orte_base_help_aggregate 0 in the mpirun command in
the runscript, the error is:</p><p>[cnode0823:136405] *** An error occurred in
MPI_Comm_create_keyval<br>
[cnode0823:136405] *** reported by process [476512257,3]<br>
[cnode0823:136405] *** on communicator MPI_COMM_WORLD<br>
[cnode0823:136405] *** MPI_ERR_ARG: invalid argument of some other
kind<br>
[cnode0823:136405] *** MPI_ERRORS_ARE_FATAL (processes in this
communicator will now abort,<br>
[cnode0823:136405] *** and potentially your MPI job)</p><p>I unfortunately have no idea where to go from here, and some help
would be greatly appreciated! I hope I have attached enough
information.<br></p></div></blockquote><div>Hi Chris,</div><div><br></div><div>Welcome to Cactus! (meant in a friendly sense, not sarcastic!)</div><div><br></div><div>I cannot see anything wrong, and I've never seen this error before. It's a mystery. Have you tried running on fewer MPI processes? I wonder if something is going wrong because the problem size is too small for the number of processes. This *shouldn't* cause a problem, but it's something to try. Is there another MPI implementation, or another version of OpenMPI, available on the machine? Maybe it's a bug in OpenMPI 1.8.8. </div><div><br></div><div>When faced with such strange behaviour, it's always worth wiping the configuration and rebuilding it, just in case it was not built cleanly. e.g. when developing the optionlist, maybe you partially built the configuration, then corrected something, and the resulting configuration has a mixture of the two versions. You can do this with rm -rf configs/mclachlantest_mpidebug, though I suspect that the debug version was built cleanly, so this is unlikely to be the problem.</div><div><br></div></div><div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div>-- </div><div>Ian Hinder</div><div><a href="http://members.aei.mpg.de/ianhin">http://members.aei.mpg.de/ianhin</a></div></div></div></div></div>
</div>
<br></body></html>