<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hello Shamim,</p>
<p>The error says that you're calling MPI with the wrong parameters,
specificall -npernode. Since you're using slurm, MPI should be
smart enough that you don't need to pass -n, -npernode, How did
you get a Runscript and Submitscript for this machine. Did you
create yourself?</p>
<p>--Steve<br>
</p>
<div class="moz-cite-prefix">On 5/1/2024 6:54 AM, Shamim Haque
1910511 wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAHrQTHXObukjrTGefs0A_vDkxjtme345JpCa6FnRh3X3XfdT4Q@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div class="gmail_default" style="color:#000000">Hi all,</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">I am
attempting ETK installation in KALINGA Cluster at NISER,
India. This cluster has 40 procs per node and SLURM workload
manager.</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">I compiled ETK
with gcc-7.5 and openmpi-4.0.5 (attached the machinefile,
optionlist, submitscript and runscript). The installation is
mostly alright, as I can run parfiles for test TOV and BNS
mergers.</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">I tried to run
a simulation with procs=160 (nodes 4) and num-threads=1 but
landed with this error (error file also attached):</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style=""><i style=""><font
color="#a64d79">+ mpiexec -n 640 -npernode 40.0
/home/kamal/simulations/dx25_r500_rg7_t30_p640-1_2/SIMFACTORY/exe/cactus_sim
-L 3
/home/kamal/simulations/dx25_r500_rg7_t30_p640-1_2/output-0000/eos20_dx25_r500_rg7.par<br>
----------------------------------------------------------------------------<br>
Open MPI has detected that a parameter given to a command
line<br>
option does not match the expected format:<br>
<br>
Option: npernode<br>
Param: 40.0<br>
<br>
This is frequently caused by omitting to provide the
parameter<br>
to an option that requires one. Please check the command
line and try again.<br>
----------------------------------------------------------------------------</font><br>
</i></div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">Strangely, this
error is not at all regular. Mostly, the error won't appear,
and the simulation works just fine (with no changes being made
in the scripts or simfactory command). In fact, this exact
simulation has worked fine before. Since I am unable to find
the source of this issue, I am also unable to recreate the
error on my own. But it does kick in occasionally.</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">My command for
mpi execution in runscript looks like this:</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default"><i><font color="#3d85c6">time mpiexec
-n @NUM_PROCS@ -npernode @(@PPN_USED@ / @NUM_THREADS@)@
@EXECUTABLE@ -L 3 @PARFILE@</font></i><br>
</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">If I replace <i
style="color:rgb(34,34,34)"><font color="#3d85c6"> @(@PPN_USED@
/ @NUM_THREADS@)@ </font></i>with a desired value, then
the script always works. My simfactory command looks like
this:</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style=""><i style=""><font style=""
color="#3d85c6">./simfactory/bin/sim create-submit
dx25_r500_rg7_t30_p640-1_2
--parfile=par-smooth/scale_test/eos20_dx25_r500_rg7.par
--queue=large1 --procs=640 --num-threads=1
--walltime=00:45:00<br>
</font></i></div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">I am unable to
understand how to solve this issue. Any help with this issue
is appreciated. Please let me know if you need more
information. Thank you.</div>
<div class="gmail_default" style="color:#000000"><br>
</div>
<div class="gmail_default" style="color:#000000">Regards</div>
<div>
<div dir="ltr" class="gmail_signature"
data-smartmail="gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr"><font color="#666666">Shamim
Haque</font></div>
<div dir="ltr"><font color="#666666">Senior
Research Fellow (SRF)<br>
</font>
<div><font color="#666666">Department of
Physics</font></div>
<div><font color="#666666">IISER Bhopal</font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div hspace="streak-pt-mark" style="max-height:1px"><img alt=""
style="width:0px;max-height:0px;overflow:hidden"
src="https://mailfoogae.appspot.com/t?sender=ac2hhbWltc0BpaXNlcmIuYWMuaW4%3D&type=zerocontent&guid=e2f8d473-349d-4337-ba32-7ab03cfbfabd"
moz-do-not-send="true"><font size="1" color="#ffffff">ᐧ</font></div>
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@einsteintoolkit.org">Users@einsteintoolkit.org</a>
<a class="moz-txt-link-freetext" href="http://lists.einsteintoolkit.org/mailman/listinfo/users">http://lists.einsteintoolkit.org/mailman/listinfo/users</a>
</pre>
</blockquote>
</body>
</html>